Tata Power - no one was reading my tweet back then but I was still sharing my charts after I joined Twitter.

Otw to 235 & 285 https://t.co/JgvNjKT3al

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Krishna and the False Vasudeva
#story

Paundraka Vasudeva was a King mentioned in Bhagavatha Purana. He was friend of Jarasandha, the king of Magadha. He believed that he is Vasudeva Krishna.
Once Paundraka Vasudeva received a letter from Shishupala, stating that he wanted

protection from Krishna, because it was Rukmini's wedding and Shishupala thought Krishna would take away Rukmini.

Paundraka Vasudeva agreed and went to Vidarbha, the Kingdom of Shishupala, but failed to provide protection as Krishna took Rukmini away. Paundraka Vasudeva was

feeling sad. His Minister's cheered him.
They said that Paundraka Vasudeva was the real Vasudeva and Krishna is a cheater. Everyone started to believe this and soon Paundraka Vasudeva soon started to taunt Krishna by saying that Krishna was a cheater.
Paundraka Vasudeva then

challenged Krishna to a war and Krishna said that he would give Paundraka his Chakra and Gadha. Paundraka suspected some foul play and went to King of Kashi for his protection. In battlefield, Krishna came in front of Paundraka, and said that he would throw his Chakra and Gadha

to him. But, Krishna's throw was perfect that the Gadha hurled him to the Ground and the Chakra killed him.
Krishna soon killed king of Kashi with an arrow and his head went flying to Kashi.
Thus Victorious Krishna was recieved by people of Dwaraka.
Hare Krishna 🙏🕉🙏

#Thread Two divine forms of Khatu Shyam ji...

On the day of Amavasya, devotees get the darshan of Shyam Baba in Shyam varan (black color). In ordinary days, the form of Baba is saffron. The reason for this is a custom. The real head of Shyam Baba which had appeared from Shyam Kund is of Shyam varan.

Every day Shyam Baba's grand Shringar is done by Pujaris. The main part of Shyam Baba's shringar is Tilak. This Shringar is done by the members of Nij Mandir sevaks. The sevaks of the Nij Mandir do sandalwood tilak to Baba everyday in the auspicious time.

This Divine Tilak is applied from the forehead to the nose. When Baba is given a bath by sevaks, this tilak comes off. Then in the auspicious time, the sevaks again apply tilak to Baba.

There is no auspicious time on the Amavasya. Because of this, tilak is not done on that day. That's why devotees have darshan of Shyam Baba on the Amavasya only in the actual real form (Shyam Swaroop). Baba's tilak is done on Amavasya only on the day of Deepawali.