To those saying that those who have got their public health advice wrong earlier in the pandemic should put up their hands and apologise... a little cautionary lesson from another sector

A short 🧵

1/

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

The Story of how Mary Slessor Stopped the killing of Twins but sadly died of Fever.

All you need to know

Retweet to educate someone

Killing new-born twins was common practice in the 19th century among the Ibibio people of Nigeria, but one Scotswoman went to great lengths to put an end to this.

Aberdeen-born Mary Slessor was one of the few missionaries in Africa who learnt the local language, adapted to the native customs and environment and gained the trust of the locals in order to make a truly positive impact.

Her father, a shoe-maker from Buchan, became incapacitated by alcoholism and Mary more or less became the breadwinner for the family.

From the age of 11, she worked as a ‘half-timer’ mill girl in the Baxter Brothers and Co Ltd, spending half the day at a school provided by the mill owners and the other half working for the company

This day was inevitable. Indian Muslims always lived in La La Land. They bad mouthed real well wishers & slept with the enemy who never considered them as part of them. In Gulf, Indian Muslims were busy with Javed Akhtar & Sonu Nigam. Never interacted with South Asian diaspora

Now when Indian Muslims are thrown to wolves it’s Pakistani & Bangladeshi Muslims with whom they kept distance are the only ones feeling their pain. None of the people who they invited for Eid Milan. Qawali & Mushaira are there for them. Such people invoke wrath upon themselves

Indian Muslims never spoke for Kashmiri Muslims. Distancing from separatist was understandable but we never even bothered to highlight their human rights violation & rapes carried out by forces. We could have sent them humanitarian help we didn’t. Our silence made us complicit.

When Sania Mirza married Shoaib Malik it was something legal. A Muslim married another Muslim. Entire Hindutva media went after her. They launched a witch-hunt for months. No Indian Muslim stood by her. All were silent. Now days come when Muslims are arrested for marrying a Hindu

Indian Muslims particularly the elite downplayed communalism in India by saying it will pass or Hindu majority is good. Fringe are bad. They misguiding others. Muslims were always others. Indians were happy to see Muslims sing & dance & eat their food but never considered as own