Kuch ho ya na ho but yeh to confirm hai pura #twitter jagat #Polycab pe bullish hai.

Shared chart for reference

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Starting my 2nd thread on Sringeri Parampara. This will cover the Jagadgurus after Sri Vidyaranya to Sri Shivabhinava Nrisimha Bharati.

It is really very tough to match the brilliance and achievements of Vidyaranya. After whom came 15 - Chandrashekara Bharati [1386-1389].

The next Acharya was Nrisimha Bharati [1389-1408]. Harihara raya found a town for this Acharya - Narasimhapuram. Acharya helped the king by guiding him in political affairs. He also initiated the kind with mahamantras for spiritual development.

Subsequent Acharyas were
15-Puroshottama Bharati [1408 - 1448]
16-Shankara Bharati[1448 - 1455]
17-Chandrasekhara Bharati II [1455 - 1464]
18- Nrisimha Bharati II [1464 - 1479]
19-Puroshottama Bharati II [1479 - 1517]

20-Ramachandra Bharati [1517 - 1560]. Sadashiva Raya was emporer of Vijayanagara during this time.
21-Nrisimha Bharati III [1560 - 1573]
22-Nrisimha Bharati IV [1573 - 1576]
23-Nrisimha Bharati V [1576 - 1600]

24-Abhinava Nrisimha Bharati [1600-1623]. When he visited Malahanikareswara temple for first time he noticed there was no Vinayaka there so he took piece of turmeric and drew outline of Ganesha on a pillar and offered puja.

A thread on HN about bad code in legacy projects both makes me think how little we've learned as a discipline over the years and, honestly, how little credit we give ourselves for some pretty major

Fun going down this list and thinking: "Hmm, plausible at a well-run modern software shop", "Hmm, possible, but requires implausible tradeoffs", "Literally disallowed by languages", and "If you were to attempt doing that our test suite wouldn't let you merge."

I think we as an industry celebrate (not quite the right word) failure too much and don't celebrate success nearly enough. There is no DailyWTF for competent execution, word of which generally stays pretty local to the source while incompetence passes into legend.

Alrighty let me try to thread the needle on being the change I want to see in the world while not giving away anything that will get me in trouble:

Ruby has wonderful developer ergonomics. Typed languages are easier for machines to guarantee the correctness of. We built a type checker for Ruby (and I believe it is slated for OSS release sometime).

c.f.

THREAD: The following tweets are for the purposes of stories that will appear in Sunday Times Daily. The videos and images depicted may be upsetting but are deemed to be in the public interest. This is the story of the Ayanda "Borhey" Mtila as far as we were able to verify it.

On 13 October Mtila as defacto overlord of the Boko Harram gang, allegedly carried out his penultimate cash-in-transit robbery. Sources say he sustained a head wound in a shootout with security guards. Some friends believe he was killed by a fellow

He died two days later, on 15 October, after allegedly being in a coma for more than a day. His funeral was a spectacle, held on Nyanga Sports fields on 24 October and attended by hundreds of people. Sources say it was made possible by Paarl businessman Lukhanyo "Spur" Mangena.

Maker movement is doing to startups what startups did to corporations.

Here is why 👇

Startups fixed the problem of innovation, that corporations lack.

In big, slow corporations, innovation is a RISK and distraction from the core $$$ profitable business.

Agile startups could launch, iterate fast and eventually stumble upon new growing market opportunities.

However,

When a startup reaches product-market-fit, it has to 🚀 "grow at all costs" and reach market dominance before some giant corporation can replicate their new product and distribute it to their existing giant customer base.

Startup's "growth at all costs" often means growth at the expense of charging customers $$$ money.

Hence, to be sustainable, startups have to constantly chase investor money.

Startup teams spend more time finding and pleasing investors, than finding and pleasing customers.

95% of startups die because they run out of (investor) money + no business model + crazy investor expectations.

Same way corporations die, when unable to adjust to new technology and market shifts.