BC ALL
Saved by @ankitsrihbti

So you think you know distillation; it's easy, right?

We thought so too with @XiaohuaZhai @__kolesnikov__ @_arohan_ and the amazing @royaleerieme and Larisa Markeeva.

Until we didn't. But now we do again. Hop on for a ride (+the best ever ResNet50?)

🧵👇https://t.co/3SlkXVZcG3

 This is not a fancy novel method. It's plain old distillation.

But we investigate it thoroughly, for model compression, via the lens of *function matching*.

We highligh two crucial principles that are often missed: Consistency and Patience. Only both jointly give good results!
0. Intuition: Want the student to replicate _the whole function_ represented by the teacher, everywhere that we expect data in input space.

This is a much stronger view than the commonly used "teacher generates better/more informative labels for the data". See pic above.
1. Consistency: to achieve this, teacher and student need to see the same view (crop) of the image. For example, this means no pre-computed teacher logits! We can generate many more views via mixup.

Other approaches may look good early, but eventually fall behind consistency.
2. Patience: The function matching task is HARD! We need to train *a lot* longer than typical, and actually we were not able to reach saturation yet. Overfitting does not happen, as when function-matching, an "overfit" student is great! (Note: w/ pre-computed teacher, we overfit)
2b. Excessively long training may mean optim struggle. We try advanced optimization via Shampoo, and get 4x faster convergence.

We believe this setting is a great test-bed for optimizer research: No concern of overfitting, and reducing training error means generalizing better!
3. By distilling a couple large BiT R152x2 models into a ResNet-50, we get a ResNet-50 on ImageNet that gets 82.8% at 224px resolution, and 80.5% at 160px! 😎

No "tricks" just plain distillation, patiently matching functions.
4. Importantly, this simple strategy works on many datasets of various sizes, down to only 1020 training images, where anything else we tried overfit horribly.

Be patient, be consistent, that's it. Eventually, you'll reach or outperform your teacher!
2c. We can't stress patience enough. Multiple strategies, for example initializing the student with a pre-trained model shown here, look promising at first, but eventually plateau and are outperformed by patient, consistent function matching.
5. We have a lot more content. MobileNet students, distilling on on "random other" data (shown below), very thorough baselines, a teacher ensemble, and.... BiT download statistics!
PS: we are working on releasing a bunch of the models, including the best ones, ... but we're also on vacation. Watch https://t.co/Age8NXgS1D and stay tuned, we're aiming for next week!

More from All

\u0938\u093e \u0935\u093f\u0926\u094d\u092f\u093e \u092f\u093e \u0935\u093f\u092e\u0941\u0915\u094d\u0924\u092f\u0947
सा विद्या या विमुक्तये...
@raghav_aanya
कुंडली में 12 भाव होते हैं। कैसे ज्योतिष द्वारा रोग के आंकलन करते समय कुंडली के विभिन्न भावों से गणना करते हैं आज इस पर चर्चा करेंगे।
कुण्डली को कालपुरुष की संज्ञा देकर इसमें शरीर के अंगों को स्थापित कर उनसे रोग, रोगेश, रोग को बढ़ाने घटाने वाले ग्रह


रोग की स्थिति में उत्प्रेरक का कार्य करने वाले ग्रह, आयुर्वेदिक/ऐलोपैथी/होमियोपैथी में से कौन कारगर होगा इसका आँकलन, रक्त विकार, रक्त और आपरेशन की स्थिति, कौन सा आंतरिक या बाहरी अंग प्रभावित होगा इत्यादि गणना करने में कुंडली का प्रयोग किया जाता है।


मेडिकल ज्योतिष में आज के समय में Dr. K. S. Charak का नाम निर्विवाद रूप से प्रथम स्थान रखता है। उनकी लिखी कई पुस्तकें आज इस क्षेत्र में नए ज्योतिषों का मार्गदर्शन कर रही हैं।
प्रथम भाव -
इस भाव से हम व्यक्ति की रोगप्रतिरोधक क्षमता, सिर, मष्तिस्क का विचार करते हैं।


द्वितीय भाव-
दाहिना नेत्र, मुख, वाणी, नाक, गर्दन व गले के ऊपरी भाग का विचार होता है।
तृतीय भाव-
अस्थि, गला,कान, हाथ, कंधे व छाती के आंतरिक अंगों का शुरुआती भाग इत्यादि।

चतुर्थ भाव- छाती व इसके आंतरिक अंग, जातक की मानसिक स्थिति/प्रकृति, स्तन आदि की गणना की जाती है


पंचम भाव-
जातक की बुद्धि व उसकी तीव्रता,पीठ, पसलियां,पेट, हृदय की स्थिति आंकलन में प्रयोग होता है।

षष्ठ भाव-
रोग भाव कहा जाता है। कुंडली मे इसके तत्कालिक भाव स्वामी, कालपुरुष कुंडली के स्वामी, दृष्टि संबंध, रोगेश की स्थिति, रोगेश के नक्षत्र औऱ रोगेश व भाव की डिग्री इत्यादि।
ALL
Aditya Todmal
Aditya Todmal
@AdityaTodmal
MASTER THREAD on Short Strangles.

Curated the best tweets from the best traders who are exceptional at managing strangles.

• Positional Strangles
• Intraday Strangles
• Position Sizing
• How to do Adjustments
• Plenty of Examples
• When to avoid
• Exit Criteria

How to sell Strangles in weekly expiry as explained by boss himself. @Mitesh_Engr

• When to sell
• How to do Adjustments
• Exit


Beautiful explanation on positional option selling by @Mitesh_Engr
Sir on how to sell low premium strangles yourself without paying anyone. This is a free mini course in


1st Live example of managing a strangle by Mitesh Sir. @Mitesh_Engr

• Sold Strangles 20% cap used
• Added 20% cap more when in profit
• Booked profitable leg and rolled up
• Kept rolling up profitable leg
• Booked loss in calls
• Sold only


2nd example by @Mitesh_Engr Sir on converting a directional trade into strangles. Option Sellers can use this for consistent profit.

• Identified a reversal and sold puts

• Puts decayed a lot

• When achieved 2% profit through puts then sold
OPTIONSLEARNINGS , ALL , OPTIONS STRATEGY
Advertisement
Jaya_Upadhyaya
Jaya_Upadhyaya
@Jayalko1
WEAPONS OF MAHADEV

Sarvaripati Shiva is one of the most fearsome manifestations of Mahadev. Assigned with destroying all of the universes at the end of time, Shiva is one of the most fearsome warriors. He is the Mrityunjaya.
Here are some weapons associated with him:


TRISHULA: the 3 pointed blades denote creation, maintenance, and destruction or the 3 Kalas – Past, Present and Future. They also represent 3 Gunas – Sattva, Rajas and Tamas).
Shiva’s trishul can only be stopped by Shiva himself.
@onlyonenetra @DetheEsha


Trishul is also said to represent Ida, Pingala, and Sushumna. These are the three basic nadis – the left, the right and the central – in the pranamaya kosha, or the energy body of the human system.
@iamkamyabuch @unever_followme


PARASHU: axe with 4 cutting edges which Shiva gave to Parashurama. In his anger, Parashurama used the parashu to get rid of the all the Earth’s tyrannical kshatriya caste twenty-one times over.
@harshasherni


CHANDRAHASA SWORD: The divine sword Chandrahasa literally means ‘the laughter of the moon’. Ravana gave this sword to Indrajit on different occasions especially to fight against Devas.
GIRISH: A special sword of Shiva with unique characteristics.
ALL
professorstam.eth
professorstam.eth
@ProfessorStam
I worked in bank liquidity and treasury for the better part of the last decade, and there is one very interesting risk factor from the SVB collapse that I do not think we have ever witnessed before in modern finance, a 🧵:

First, some context. Following the 2008 financial crisis where a massive driver of stress was caused by low quality assets littering the balance sheets of massive institutions, the regulators sought to create a framework to ensure all banks were verifiably sound.

This meant forcing Federally registered banks to conform to capital and liquidity ratios. If they did not comply, they would not be allowed to issue dividends or buy back stocks, hurting the value of their enterprise.

There was the introduction of the concept of RWA, or risk weighted assets. A simple way to think of these ratios is, the riskier your asset base on a weighted basis, the more high quality capital (think cash) you would need to hold to stay in compliance.

Not only were banks required to regularly be in compliance with these ratios as a going concern, but needed to prove they could maintain certain limits when met with a time of stress across a number of incrementally adverse scenarios.
ALL
Anshumani Ruddra
Anshumani Ruddra
@baboonzero
Mahabharat - the great war - 18 days of heroism, deceit, blood and intrigue - now as a mega Twitter thread.

I'll add the events from a few days of the war each day.

Caveats: lots of editorialization, creative liberties and interpretations.

There will also be a lot of asides - especially around war strategy and tactics, the characters and their motivations and non-canon storylines.

Over the years, I've read multiple versions, phenomenal translations and modern retellings. So be prepared for a potpourri.

There are different ways of looking at this war. Was it a family feud? Sure - but whose family? Shantanu's or Satyavati's? Was Vyas essentially telling us his family history? And then Kunti added a twist to this tale. Here's a helpful chart:


Satyavati's two sons from Shantanu both died without children. Vyas - her first son - fathered Dhritarashtra and Pandu (and Vidur).

Pandu never fathered any children. Kunti and Madari gave birth to six demi-gods (Karna and the five Pandavs).

So Satyavati Vs Kunti and Madari.

Or was this a fight between two massive neighbouring kingdoms - the Kurus and the Panchals? While many smaller kingdoms joined the battle, most of the Pandav army (more than half of their 7 divisions) came from the Panchals. King Drupad and his son Shikhandi led two divisions.
ALL

You May Also Like

Jaya_Upadhyaya
Jaya_Upadhyaya
@Jayalko1
SRI CHAMPAKADHAMA SWAMY, BANNERGHATTA HILL, BENGALURU (KAR)
#bharatmandir

The shrine is dedicated to Sri Vishnu along with Devi Lakshmi and Bhoodevi.
It is built in an area full of Champaka trees.
As champaka flowers are offered to Sri Vishnu here, it is called Champakadhama.


It is believed that King Janmejaya had sarpa-dosha. To get rid of it, he took bath in the nearby pond. He emerged with a golden body and sarpa-dosha was also removed. The pond is called Swarnamukhi and believed to have curative powers.
Sri Vishnu murti was consecrated by him.


It is also believed that this forest area was the Dandakaranya where Sri Ram stayed in exile.
Some believe that the original shrine was built by Pandavas.
The pushkarni/pond is emptied once a year so that the rock at the bottom (which has image of Anjaneya) may be worshipped.
ALL
Patrick McKenzie
Patrick McKenzie
@patio11
So the cryptocurrency industry has basically two products, one which is relatively benign and doesn't have product market fit, and one which is malignant and does. The industry has a weird superposition of understanding this fact and (strategically?) not understanding it.


The benign product is sovereign programmable money, which is historically a niche interest of folks with a relatively clustered set of beliefs about the state, the literary merit of Snow Crash, and the utility of gold to the modern economy.

This product has narrow appeal and, accordingly, is worth about as much as everything else on a 486 sitting in someone's basement is worth.

The other product is investment scams, which have approximately the best product market fit of anything produced by humans. In no age, in no country, in no city, at no level of sophistication do people consistently say "Actually I would prefer not to get money for nothing."

This product needs the exchanges like they need oxygen, because the value of it is directly tied to having payment rails to move real currency into the ecosystem and some jurisdictional and regulatory legerdemain to stay one step ahead of the banhammer.
CRYPTO
Advertisement
Anu Satheesh
Anu Satheesh
@AnuSatheesh5
Ameda Temple
Ernakulam, Kerala 🚩
#keralatemples

Ameda Ksetram is located in the banks of Vembanad Lake. Temple is very unique and Powerful Sarpa Kavu.
Parashurama did Prathishta here. Vilakku which was lighted by Parasurama is still seen inside the temple.


The oil from this lamp is given to bhakthas for recovering from illness.

Sthala puranam says that, Once, when Parashurama was travelling through Kerala, he reached this place. As it was evening, he stepped into the Lake for Sandhya Vandanam
At that Sapthamathrukkal 👇


(Brahmini, maheshwari, kowmari, vaishnavi, varahi, indirani and chamundi) were travelling there on a tortoise through the water. The tortoise was unable to move, because the Water had made its way for Parashurama. The place where the tortoise became Still came to be known as 👇


Aama Ni Nidayam' ( Aama means tortoise) and later become ‘Ameda’. Parashurama came to know about the journey of Sapthamathrukkal. Thus, he did Prathishta for the Sapthamathrukkal here.
7 forms of Aadi Parashakthi are Sapthamathrukkal. Veerabhadra and Ganesha have Sannidhi here.


The main Garbhagriham in the temple is the Sapthamathrukkal. There are Sannidhi to Nagas, Nagayakshi and Vishnu too. Sarparadhana or snake worship is done here. Naga Panchami is famous here. Those who have Naga Dosham come here and get relieved of their Doshas.
🕉🙏🕉
ALL
Anu Satheesh \U0001f1ee\U0001f1f3
Anu Satheesh 🇮🇳...
@AnuSatheesh5
Chennimalai Murugan Kovil
#Erode
#TamilNaduTemples 🚩

Chennimalai Murugan Temple is located  near Perunthurai in Erode District. Murugan is worshipped here as Dandayudapani. Temple is situated on the banks of Noyyal river also called Kanchima Nadhi. Temple is situated in a hill


Sthala Puranam says that, there lived a Landlord who had many cows in his farm. One among them was a Black Cow, which didn't give milk. Land lord observed that evening time, when all the cows came back after grazing, this cow used to go to a particular spot and gave all  the milk


by itself. He decided to dig the spot where the cow gave its milk

On digging a beautiful Vigraham of Murugan was found, but lower portion was very rough. So he called a great sculptor to soften it. Everyone was shocked to see that on the first chisel the vigraham bleeded.


Land lord realized that Murugan wanted the Vigraham the way it was.

Thus Prathishta was done on Chennimalai hill. It is believed that Sivalaya Chola got relieved from his Brahmahatti Dosha here. Kanda Shasti Kavacham was first offered here.

Muruganukku Haro Hara
🙏🕉🙏
ALL
Carol Forden
Carol Forden
@CarolForden
1. The major problem most startups face is marketing and the ability to carve out a niche, find and retain paying customers.

Even with a stellar developer team and a stellar product, your startup may not grow or survive without a great marketing and sales teams.

2. Start growing your audience before you’ve a product or an idea.

You should start promoting yourself and building your audience before you have a finished product or even before you have a great idea that you want to build.

3. Don’t wait to start building your audience after you’ve launched a product.

Most first-time developers actually ignore marketing.

They’re oblivious to the challenge of attracting people to take a look at something they’ve created.

4. At least until they see their first project crash and burn within hours of the launch.

There are so many times that I have seen developers spend countless hours building something, releasing it with no fanfare...

5. and only then trying to figure out how to promote it by asking marketing questions on Indie Hackers, Quora or Hacker News. Don’t make that mistake.
STARTUPS