Stocks on Radar -short term view-

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

TRUMP: "I've decided to eat babies."

PEOPLE: "He can't eat babies, that's super illegal."

TRUMP, on TV, eating babies, not even cooking them first: "People are saying that I really am the best baby-eater, folks."

NYT: "Trump Vs. Babies: The Rhetoric On Both Sides Must Stop"

Jeff Flake tweets: "It is a sad day in America when this callous man can eat babies live on TV"

Jeff Flake, 10 seconds later, votes to help him install a series of 4,000 new judges that are very, very pro-babyphagia.

Judge Kavanaugh, found drunk in a Capitol Hill closet: "I LIKE BEER. OKAY? I LIKE BEER AND I LIKE BABIES AND THAT'S NOT SO WRONG. THAT'S RIGHT. I LIKE BABIES DIPPED IN BEER. I JUST DIP EM. IN THE BEER. THE BABIES. THE BABIES I EAT. OKAY? THAT'S AMERICA."

Mike Pence, wringing his hands about the baby-eating: "We must take care of our children. Our youngest must be protected on this troubling day."

Mike Pence then invites a Baby Chef to say a prayer.

Twitter Users: "It's a distraction technique! Trump eating babies is trying to DISTRACT YOU from ALL THE OTHER HORRORS, which are themselves distractions from the BABY-EATING. It's DISTRACTIONS ALL THE WAY DOWN."

Trump: *eats tons of babies at a rally*

*literal tons of babies*

According to @RadioZET_NEWS PKN Orlen (major Polish oil refiner and petrol retailer) is considering entering F1 as a fuel sponsor (supplier) and personal sponsor of Robert Kubica. #F1

Yesterday Kubica was at Orlen's headquarters and met with Polish Prime Minister. #F1

I got a Toshiba T1200, which has a bad screen, and a dead CMOS battery, and I thought the hard drive was broken too...

but I rebooted it and heard a KTHUNK and a really loud spin-up noise and holy shit, the hard drive works!

and it still has files on it. the newest date is January 1994.

It's a 21mb hard drive, with ~37k of bad sectors.

This fucker is never going to spin up again, so I better go find some serial cables and copy shit off now.

The backlight is fucked so I'm shining a flashlight on it.
without it, it looks like this.

On December 25 Mr Pool retweeted August 16 message about the Phoenix and that the worst was still on the horizon to come. 1/*

Maybe now we can assume that November 3 message meant "FUD" nor "FUN". Putting the word in capital letters seems to indicate the aspect the word fud has in our space, FUD. 2/*

Brad started it on December 22 (1/3 posts (Don't say? Sure) = 13 = Plan B). 3/*

And immediately the SEC followed dropping the bomb (1.3 billions (Don't say? Sure) = 13 = Plan B). 4/*

FUD materializes, Bitstamp is one of the first that haltes XRP trading and so on. 5/*