#Syngene Probable Triple Top Buy in 1%

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

The man who invented autocorrect should burn in hello.

It was meant to put a smile on your face. Please stop sending me instructions on how to turn my autocorrect off. 😳🤔

Texted my friends to ask if I could take their kids with me to Satan... still have not heard back from them. I meant Santa...

Thanks for all the love, I appreciate a follow. 💗

Best resort on the Ganga at Rishikesh

WEAPONS OF MAHADEV

Sarvaripati Shiva is one of the most fearsome manifestations of Mahadev. Assigned with destroying all of the universes at the end of time, Shiva is one of the most fearsome warriors. He is the Mrityunjaya.
Here are some weapons associated with him:

TRISHULA: the 3 pointed blades denote creation, maintenance, and destruction or the 3 Kalas – Past, Present and Future. They also represent 3 Gunas – Sattva, Rajas and Tamas).
Shiva’s trishul can only be stopped by Shiva himself.
@onlyonenetra @DetheEsha

Trishul is also said to represent Ida, Pingala, and Sushumna. These are the three basic nadis – the left, the right and the central – in the pranamaya kosha, or the energy body of the human system.
@iamkamyabuch @unever_followme

PARASHU: axe with 4 cutting edges which Shiva gave to Parashurama. In his anger, Parashurama used the parashu to get rid of the all the Earth’s tyrannical kshatriya caste twenty-one times over.
@harshasherni

CHANDRAHASA SWORD: The divine sword Chandrahasa literally means ‘the laughter of the moon’. Ravana gave this sword to Indrajit on different occasions especially to fight against Devas.
GIRISH: A special sword of Shiva with unique characteristics.

@FionaPearman @ScottMorrisonMP Morrison is our statue of unempathic neoliberalism - erected by evangelical and corporate Australia to celebrate their victory over compassion, equality and secular humanism. 

Hopefully it gets pulled down like the statues of dubious heroes of oppression from an earlier age.

@ScottMorrisonMP The two-party-preferred system in 
Australia politics isn’t working for people, and it sure isn’t working for the planet.

@ScottMorrisonMP My collapse of faith in our democracies isn’t an accident. It’s one of the central victories of the neoliberal project, delivered through two generations of privatisation, outsourcing and deregulation, underfunding of government services (locked in by tax cuts),...

@ScottMorrisonMP restricting freedom of information, targeting whistleblowers and raiding the media who report on them, delegitimising and gagging public interest advocacy, and criminalising protest.

@ScottMorrisonMP Politics in Australia today relies hugely on the fact that most people don’t know most of what’s going on so as to get away with stuff that couldn’t be done under real scrutiny we have seen a clear example of this with the National Coronvirus Cabinet.