5 IMPORTANT LIFE LESSONS FROM PLATO:

In Academia, people aren’t always supported when they need it. I want to share what @WesternU did when my husband died right after the pandemic shutdown. It should be shared with other uni’s as a model for empathy and proactive care when someone is in crisis.
1/
#AcademicChatter

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

#twitterArts
Arts are best form to Express thoughts & devotion. In All civilization Arts played very important role to express sprituality. Tibbeten Tangkhas are prime example .

List of My Paintings & Sketches

प्रलय पयोधि-जले धृतवान् असि वेदम्
विहित वहित्र-चरित्रम् अखेदम्
केशव धृत-मीन-शरीर, जय जगदीश हरे!!

छलयसि विक्रमणे बलिम् अद्भुत-वामन
पद-नख-नीर-जनित-जन-पावन
केशव धृत-वामन रूप जय जगदीश हरे

नंदसि यज्ञ- विधेर् अहः श्रुति जातम्
सदय-हृदय-दर्शित-पशु-घातम्
केशव धृत-बुद्ध-शरीर जय जगदीश हरे

क्षत्रिय-रुधिर-मये जगद् -अपगत-पापम्
स्नपयसि पयसि शमित-भव-तापम्
केशव धृत-भृगुपति रूप जय जगदीश हरे