Why was @LudwigAhgren's Twitch stream yesterday a masterpiece in creating live content?

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Right, screw it. Here's a thread on *that* FBLive by Alex Cairnie about #Govanhill. Lets do a watch-through shall we? (Mind, I'm a resident of Govanhill, and a sociologist. I'm also 5'3, and a visibly queer woman so if half his claims are true I should be living in terror)

00:30: Welcomes viewers and uses points out that his videos are only getting attention b/c they're 'horrific'. Directs folk to his Youtube page. So already clout hunting.

1:08: "I've been warned to stay out of Govanhill. I'm a marked man" (proceeds to use a beanie as a disguise)

1:30 "Laughing and joking aside, here's somebodys front garden." Proceeds to show litter and claim its thrown from windows and this is 'common'. I know a handful of streets with litter issues like this, but its neither common nor unique to #govanhill and other deprived areas.

2:10 "Don't be under any illusion I'm only showing you the bad bits" - only shows you the bad bits.

3:45: He's had offers of help, but hes said no because hes not responsible for 'anybody elses safety' Good lord.

5:01: "Its not that bad. But its not all good either" -Correct

6:00: TW: child abuse - He starts claiming to have been contacted by a health professional and told about child abuse 'in the area'. Huge ethical issues here as the 'professional' who has 'been in the game a long time' is reporting to Facebook Dude and not authorities.

1. This is "Hollie The Card".

She's a Doctor, Physician, PhD, MA, Clinical Psychologist, Hospital Consultant, PTSD consultant, Long Covid Consultant.

(Thread)

2. Although sometimes she’s also an AUTHOR and English Academic.

3. A Hospital Consultant and ex Gymnast.

(Pinterest public profile)

4. A Physician, Doctor, or hospital consultant.

A “Hospital Consultant”, would probably mean a senior doctor, in the UK at least.

5. Hollie changes her Twitter picture and bio so often, it’s hard to keep up with her qualifications.

Ok I was wrong about theHouse. 2 years of legislative gridlock = not fun. Few bills passing.

Control of the House is useless when it comes to keeping Trump from declassifying all the SpyGate docs. Or stopping an Inspector General from releasing a report.

Trump still gets control of judicial appointments so we can expect another 100 judges over the next two years. This time there’ll be no McCain or Flake playing the Maverick role with their swing vote.

That new margin in the Senate is huge if another Supreme Court seat comes open.

So from the responses I’m getting, people seem to think if Trump declassifies the Spygate stuff now, nothing happens.

Are you under the impression federal prosecutors have to wait until CONGRESS finishes an investigation and makes criminal referrals before the DOJ can act?

There’s a federal grand jury on McCabe right now. Did Congress ever finish it’s investigation and make a referral to the DOJ against him?

No.

BUT INSPECTOR GENERAL HOROWITZ DID. On finishing his McCabe leak report.

Funny how nobody remembers that.