#CDSL - range-breakout range - TradingView -

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Rio de Janeiro, 1920. 🇧🇷

São Paulo, 1910. 🇧🇷

“Arpoador”, Rio de Janeiro, 1900. 🇧🇷

“Avenida Paulista”, São Paulo, 1902. 🇧🇷

Recife, 1885. 🇧🇷

So there's a class of puzzles called "river crossing puzzles" which involve having to cross a river on a boat/bridge containing some set of individuals/items with restrictions on which ones can be on the boat/left on each shore, right?

and the most common subclass of these problems is the one where you have 3 items/animals to cross with.
This is alternatively called the "fox, goose, and bag of beans" or "wolf, goat, and cabbage" puzzle.

the idea is that your boat can only carry one item at a time, but if you leave the wolf/fox unattended with the goat/goose, the wolf/fox will eat the goat/goose.
and similarly, the goose/goat will eat the beans/cabbage if left alone

so you have to set up a set of actions that never leaves either side of the river in one of the lose-states.

the solution to this variant being:
1. take the goat/goose over
2. return empty
3. take the wolf/fox over
4. return with the goat/goose
5. take the cabbage/beans over
6. return empty
7. take the goat/goose over

Want to do an MBA for free ?

A thread 👇

1) Leadership: Foundations of Teamwork and Leadership

School: wharton

2) Marketing: Marketing Management

School: wharton

3) Microeconomics: Microeconomics for Managers

School:

4) Financial Theory

School:

Andhakasuravadha Samharamurti -#story #Thread
Sculpture of Bhagwan Shiva as the destroyer of the Asura Andhaka - Cave 29,Ellora caves

Asura Andhaka hangs on to a trishula held by 6-armed Shiva.

Once Parvathi & Shiva were relaxing in the pleasant gardens of Mount Mandhara.

Bhagwan Shiva sat down there to enjoy the happiness.Parvati closed the eyes of Shiva playfully & darkness covered the whole universe.Parvati was perplexed & her palms were wet with perspiration.A few drops of her sweat mixed with sweat from Shiva’s body& fell to the ground.

From this sweat,a fierce creature was born,it started to roar.Child was born blind as Shiva's eyes were closed so was named as Andaka.Andha means darkness&also ignorance.Around the same time Asura Hiranyaksha was performing rigorous tapas Shiva for a boon of powerful son.

Bhagwan Shiva was pleased by tapas of Hiranyaksha & blessed him with darshan.Hiranyaksha asked for a powerful son,Shiva told him that he cannot have his own son,but can adopt a blind child who would become very powerful later.Shiva gave child Andaka to Hiranyaksha.

Hiranyaksha returned to his kingdom with Andaka.Later after the vadh of Hiranyaksha, Andaka is said to have lived with his cousins.He was ridiculed,so dejected Andaka went to forest.He did severe tapas for over many years towards Brahma Dev. Brahma dev appeared before him.