My Rush story is the opposite of most people’s. He wasn’t the first host I heard. I didn’t grow up listening to him (my entire family runs left of left). I only heard him when I got to college (after several failed attempts since he was out a lot). 1/x

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Rhino Barges

One of the dullest, coolest, more bizarre and fascinating pieces of kit used in Normandy.

Which NO ONE REALLY CARES ABOUT.

BUT I DO AND YOU SHOULD TOO.
/1

#WW2 #SWW #History

Planning for Overlord and Neptune had a serious snag, how to get troops from LSTs onto the beach as simply ramming them onto the beaches and dropping the ramp was known to damage the exceptionally vulnerable LSTs and felt to be unsustainable in the mid to long term. /2

LSTs were essential in sustaining Overlord's progress and were a subject of major headaches in the planning phase, and a real subject of friction when it came to launching additional amphibious operations such as Dragoon.

A single LSTs loss represented a capability nick. /3

So, logic dictated, we don't really want these remarkable but rare and highly valuable vessels constantly doing beach landings, we want something to act as a medium between ship to shore, and in came the (mostly) American designed Rhino. /4

I fucking love Rhinos.

Seriously.

Graceful lines of pure industrial pedigree.

Modular.

LOOK AT IT. /5

The Ife Primary Education Research Project (1970-1983).

aka

The Ife 6-Year Primary Project.

In 1970, as the Director of the Institute of Education of the then University of Ife (now Obafemi Awolowo University, Ile-Ife), later Dean Faculty of Education, Prof. Babs Fafunwa & his team embarked on one of the most groundbreaking research projects in education for Yorubaland.

The aim of the project was to test the hypothesis that the best instructional medium for good concept formation at a very tender age is the mother tongue.

This was bolstered by the observation that “of all the continents and peoples of the world, it is only in Africa…

…that formal education is offered in a language that is foreign to the child.”

So, Yoruba was to be used & tested as an exclusive medium of passing information or instructions to a set of pupils.

The project was based on the premise that:

(a). the child will benefit culturally, socially, linguistically & cognitively.

(b). the child’s command of English will be improved if he is taught English as an entirely separate subject by a specialist teacher through the 6 years.