7 meta tags to improve the optimization of your site.

A Thread 👇

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Many readers have asked me "why do so many pulp covers feature women in ripped red blouses standing in swamps while a man fights off an unusual animal attack?"

The answer is artist Will Hulsey...

Will Hulsey was the undisputed king of the animal attack pulp cover. You name it, he'd paint it attacking you in a pool of stagnant water.

Very little is known about Will Hulsey, but he worked on a number of men's pulp magazines in the 1950s and early 1960s including Man's Life, True Men, Guilty, Trapped and Peril.

Their audience was ex-GIs: during WWII the US Council of Books in Wartime had given away over 122 million books to American servicemen to read; this led to a post-war surge in paperback and magazine sales amongst these newly enthusiastic readers.

As a result the 1950s saw a raft of men's pulp magazines being published to tap into this market - almost 200 different titles!

NARHARI AND BHAGWAN PANDURANG/VITTHAL

Once a goldsmith by the name of Narhari lived in Pandharpur. He excelled in his craft. He had vowed not to look at Pandurang or visit his mandir ever, as he was a Shiva Bhakt.
One day, a wealthy merchant visited him.

He wanted a gold girdle studded with precious gems, to be made for Prabhu Vitthal. Narhari refused to make it as it was for Vitthal.
After many requests, he agreed to make the girdle but asked the merchant to bring the measurement from the mandir as he himself would not go there

The measurement was given n he made the girdle. When the girdle was put on Vitthal, it was loose. Narhari had to shorten it. Now the girdle became tight. So Narhari was forced to take measurement on his own. He had to go to the mandir but went blindfolded to avoid seeing Vitthal

In the Mandir, when blindfolded Narhari touched Vitthal, he felt as if he was touching Shiva with matted hair, the moon, snake in His neck and Trishul in His hand. Ecstatic with joy, he removed the blindfold to see Shiva but he found the murti of Vitthal with Rukmini there.

He realised the truth that there was no difference between Vitthal and Shiva. Narhari at once fell at the feet of Panduranga. He then took the measurement of the waist of Vitthal and this time the ornament fit the Murti perfectly.

Narayan Hari🙏🏻

Puthucode Annapoorneshwari Temple,
Palakkad, Kerala 🚩
#keralatemples
अन्नपूर्णे सदापूर्णे शङ्करप्राणवल्लभे 
ज्ञानवैराग्यसिद्ध्यर्थं भिक्षां देहि च पार्वति 

Temple is also called Puthukode Bhaghavathy Kshetram
Parasurama did Prathishta of Devi here. Temple is one amoung 👇

108 Durga temples
Navarathri festival is celebrated in a grant manner here. Annadanam is done daily on these days. The Idichu pizhinja payasam/ Chathachatayam is the main nivedyam in Annapoorneswari temple during Navarathri.
In the mornings, Devi Mahatmyam and Sundarakandam are

recited here daily.
Sri Godavarma Raja gifted lots of rice fields for the maintenance of the temple.
Annapoorneshwari holds Shanku and Chakra in her hands. Puthucode Annapoorneswari Temple is managed by the Naduvil Madom Devaswom.
🙏🕉🙏