#HDFCAMC - Will HDFCAMC Breakout this time? - TradingView -

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Shocking fact: Millennial men are less likely to work than any other age and gender demographic in America.

Today, there are 500,000 young men missing from the U.S. workforce.

Research suggests video games & improved leisure tech plays a role in the problem. 👇 Thread:

Following the 2007 to 2009 recession, 25 to 34 year old men exited high school with fewer middle-skill job opportunities than years prior.

During this time, we saw an increased number of men living with parents & choosing unemployment over lower paying jobs.

It's estimated that 24M millennials live w/ their parents.

1 in 4 living in their parents’ home neither go to school nor work.

What's more surprising? 9 in 10 who lived with their parents a year ago are still living there w/ no plans to leave.

Economists are calling millennial men a lost generation.

According to economist David Dorn:

“If you get to the point where you’re turning 30, you’ve never held a real job and you don’t have a college education, then it is very hard to recover at that point.”

Economists suggest this choosiness is a generational trait.

Forbes interview w/ a high school educated man:

"I’m very quick to get frustrated when people refuse to pay me what I’m worth."
“People feel that they have choice nowadays, and they

Ancient Egypt was the most advanced civilization in the ancient world. Why was Egypt so special?

There are so many firsts in Egypt that we all know about, and that makes Egypt unique. For example, the Sumerians did not build the pyramids of Egypt.

Save as history

1/ Productivity tip: when I keep procrastinating on something I often trick myself by saying, "ok just work on it for the next 20 minutes" or some short period of time, "and then you can chill/relax guilt free" and give myself some treat (sugar, netflix, etc)

2/ Usually at the 20 minute mark (sometimes I set a timer) I'm so engrossed in what I'm doing that I don't want want to stop and end up working on it for the next hour or two. But getting started seems to be the hardest part.

3/ Key to this: you have to actually be ok with stopping after 20 minutes and being guilt free if that's how you feel. So it's not a trick, i have the option every time, I just often don't want to use it once i'm in the zone.

IT WAS RISHI KANADA WHO GAVE THE ATOMIC THEORY & TALKED ABOUT THE GRAVITY OF EARTH, 2600 YEARS BEFORE AN APPLE FELL IN FRONT OF NEWTON'S EYES:

Scientists of the modern world credit an English scientist John Dalton (1766 CE -1844 CE) for the Atomic Theory.

And this is because, most of us are not even aware of an ancient Indian Sage named Kanada, who was the first to formulate the theory of atoms, almost 2600 yrs before Dalton and talk about earth's gravity.

Rishi Kanada was born around 600 BCE in Dwarka, Gujarat and he was the son of a philosopher named Ulka. He was fascinated with the minute detailing of the things right from his childhood. Once, when he was very young, he accompanied his father on a journey to Prayaga.

He saw plentiful grains scattered along the path leading to the shore of river Ganga. It's a tradition in Hindu families to scatter the grains for the ants and birds to feed on them. Suddenly, an ant caught his attention, who was feeding on a rice grain.

He was mesmerised by this very fact that how a small grain of rice becomes food for the ant but to satisfy the hunger of a person so many grains are needed together. This incidence made him realize the importance of a single grain of rice.