Tata Elxsi - Target of 6163 as per PnF chart achieved. https://t.co/wykvClQnMf

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Did you know?
Ahilyabai Holkar was one of India's
greatest women rulers of all time.

Ahilyabai was Born on May 31,1725 in the village of Chondi,Jamkhed distt,Maharashtra to a man named Mankoji Shinde,who was the Patil(Chief) of a village and a member of proud Dhangar Community.

Despite the fact that girls' education was a farther dream in those days, Ahilyabai was homeschooled by her father.
Ahilya didn't belong to any royal family but in a twist of fate she is still remembered as one of the most revered Queen in the history.

While they were living their humdrum lives, one day Malhar Rao Holkar, commander of the Peshwa Bajirao & Lord of the Malwa stopped in Chondi on his way to Pune, where he couldn't help but notice a young 8yrs old Ahilyabai in the temple service feeding the poor & hungry.

He was so impressed by the sheer innocence&beauty with simplicity character of Ahilyabai dat he asked her hand in marriage for his son Khanderao Holkar.Just like that she got married to Khanderao in 1733 at a tender age of 8&became a bride of esteemed Maratha community of Holkars

But destiny had something else in store for her as her husband died in the Battle of Kumbher in 1754 leaving her widow at 29.Distressed Ahilyabai was to commit Sati when her father-in-law Malhar Rao refused to let it happen.

Spent a quaint half hour in a cafe listening to a guy yell at his dad after his dad said that the women Trump molested wanted it: "Dad, that's like saying the Jews who died in the Holocaust were asking for it!" ENJOY YOUR TERRIBLE FAMILIES THIS WEEK!

"Mom, has a man ever touched you without your consent?"
"Of course."
"Did you report it?"
"No."
"Dad, your WIFE has been through this!"

Dad was unmoved and told the guy to stop arguing with him.

At this point we learned the boy child has allergies.

I forgot to remark upon the presence of the very cute grandson, who was very small and gave not one shit about the yelling. I believe a sister or aunt was present and feeling very stressed. I wanted to hand her a Xanax or seven.

It was really hard to not jump in and say, "Sounds like you guys are going to have a fun meal tomorrow!" so they could unite in hatred against me, the outsider, and stop squabbling. Instead I exchanged glances with a nearby fellow lady patron, who also emotionally ate a cookie.

Anyway, I want to thank the random family for yelling about rape and the Holocaust in an Israeli cafe in the US of A today because it reminded me that while this country isn't the greatest, it is inevitably my stupid favorite and I am never, ever bored.

Here is a special thread introducing our series on “The Making of the Islamic World.” It offers 10 episodes about the transformation of Islamicate societies between the 7th and 17th centuries. You can find the series page here: https://t.co/7mL9eWmMmz

This is Chris Gratien posting. I created this series during Fall 2020 for my students as asynchronous material supported by readings and discussion. This is going to be a long thread, but it will be a great shortcut for those looking to make similar use of these materials.

There are two items worth pointing out: 1. This is an overview of the political, social, and cultural history of Islamicate societies. It does not deal with the origins of Islam or many theological questions. It does discuss Islam’s spread and the transformation of Islamic law.

2. This is the first part of a two-part sequence that takes the history of the Islamic world into the present. It emphasizes developments and themes that have particular relevance for later periods.

This is really a multivocal narrative of Islamic history. We feature over 20 scholars from almost as many institutions. Many of those who worked on it, myself included, study the early modern and modern era but have teaching obligations that take us further back in history.