Full technical analysis courses in one thread 🧵

For free which is Worth ₹80k 👇

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

THE SCIENCE BEHIND YAJNA

Fire is, of course, one of the greatest discovery of mankind. Our control over the fire dramatically changed the entire human habits; earlier it was used to cook food, protection from animals and to stay warm.

Among the many applications of fire, one is Yajna (यज्ञ, yajña); also called as Havana (हवन) or Agnihotra (अग्निहोत्र).
Yajna is elaborately described in Yajurveda. In Yajurveda, Yajna is the greatest among all works (Karman). One can purify his /her soul by performing Yajna.

In Vedic culture, it is thought that the holy fire is the mediator between Gods and us; when the offerings are made to Yajna with chanting mantras, it directly reaches the Gods, who bless the people with rains, food, health, and good luck.

According to Apastamba Sutra, the definition of Yajna is Vedic sacrifice; an act by which we surrender something for gods e.g. grains (Anna), pulse, milk and milk product (ghee, butter, curd) fruits, plant juice (soma), etc.

As we said; Yajna is the contact medium for gods and

to seek their blessings.

There are many types of Yajna performed by Hindus for e.g.,

1. Rajsuya Yajna
2. Ashwamedha Yajna
3. Chaaturmasya Yajna
4. Vaajpey Yajna
5. Purushmedha Yajna
6. Sarvamedha Yajna

1/
Hello, my name is Gal,
I am an Israeli citizen, and I want to convey this urgent message to the world: Contrary to what you are told, Israel has not "returned to normal" in any way >>

2/ Moreover, despite the desire to create a setting as if there was a full and normal routine here - the Israeli Ministry of Health JUST RECOMMENDED TODAY TO EXTENT THE DECLARATION OF A “STATE OF EMERGENCY” in Israel >>

3/ to which is the foundation for coercion, violation of basic rights, severe discrimination under a "green mark (pass)", prolonged closure (Of about 5 months overall) and a lot of undemocratic and not “routine" restrictions. >

4/ If the situation in Israel had "returned to routine thanks to the astounding success of vaccines" then the "state of emergency" would not have continued.

5/ In fact, since the beginning of the "vaccination project" there has been only more intimidation and in many ways - even though the closure has been lifted, much more coercion.

In 1937, a trucker got frustrated waiting for his cargo to be unloaded. He later sold his company for $1.1 billion.

Here’s the story of how Malcom McLean made a billion dollars and which startup could be following in his footsteps. (Inspired by our episode with @laurabehrenswu)

In the early 1950s, the shipping industry was a dying business.

New York’s docks were handling half as much domestic cargo in the early 1950s as they had been in the depressed 1930s.

In thirty years, no one had invested significant money in coastal shipping.

Why?

As McLean found out, loading ships was difficult and slow.

A truck or train would deliver items to the port. Each item was unloaded separately, recorded, and carried to storage.

When a ship was ready, each item was taken from storage, counted again, and hauled on-board.

The cost of this labor was significant. As one expert at the time explained:

“A four-thousand-mile voyage for a shipment might consume 50 percent of its costs in covering just the two ten-mile movements through two ports.”

Yet, despite the industry’s issues, it felt little pressure to change.

Foreigners were barred from operating domestically. Cartels ran international routes. And gov. subsidies eased the pain of labor costs.

Reshaping the industry needed an outsider.

Enter Malcolm McLean.