@buzz_chronicles save

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

PAKISTAN-INDIA WATER ISSUES – HOW INDIA STOPPED WATER IN PAKISTAN's CANALS IN 1948

Thread

After partition in 1947, the water system was also bifurcated between Pakistan n India.

India cheated Pakistan when on April 1, 1948, India suddenly n without warning stopped...
1/n

...the supply of waters flowing into Pakistan's Central Bari Doab and Dipalpur Canals.

The boundary award on the partition of the sub-continent had left the headworks of these canals in Indian territory, and in accepting it India had implied her willingness to leave...

2/n

...the historic distribution of common waters undisturbed.

India's action was therefore in flagrant disregard not only of international law n morality, but of her solemn commitments with Pakistan and a gross violation of this country's historical rights over common waters.

3/n

Faced with a threat of utter desolation of millions of acres of fertile land, Pakistan had perforce to sign a document with India in which she agreed to "India's progressively diminishing water supplies to these canals and to the West Punjab government's tapping...

4/n

...alternative resources".

A specific reservation was made in the document with regard to India's claim that she had full property rights over waters flowing into her territory, and could therefore use them as she liked.

The issue was, however, to be examined...

5/n

WHEN GH0RI TOOK TO HIS HEELS WHILST FIGHTING A HINDU QUEEN

THE BATTLE OF KASAHRADA (Kayadara)
1178 AD

Strategy! Bravado! Glory!

(Thread)

The narrative set by left historians about one of their favorite poster boys "Gh0ri" is that he went unchallenged upon entering the Indian subcontinent with one king falling after another.(1)

They conveniently deleted this event. Why? An agenda aimed at making us feel weak and inferior against the invaders in an attempt to glorify them. Simple strategy: To destroy a civilization tamper their history.(2)

Gh0ri defeated Prithviraj Chauhan at the 2nd Battle of Tarain in 1192 and laid the foundation of Delhi Sultanate. What is not well known is the fact that 14 years before he won this battle, he was defeated by the queen of Gujarat "Naiki Devi"!(3)

In 1173 Md Gh0ri had conquered the Ghaznavids in Afghanistan. A ruthless, persistent and deceptive Gh0ri was successful in conducting massive raids deep inside Indian territory.(4)