BC ALL
Saved by @kumar_praveen96

Barlow Twins: a new super-simple self-supervised method to train joint-embedding architectures (aka Siamese nets) non

 Basic idea: maximize the normalized correlation between a variable in the left branch and the same var in the right branch, while making the normalized cross-correlation between one var in the left branch and all other vars in the right branch as close to zero as possible.
2/N
In short: the loss tries to make the normalized cross-correlation between the embedding vectors coming out of the left branch and the right branch as close to the identity matrix as possible.
3/N
The 2 branches are always fed with differently-distorted version of the same image, and there is no need for dissimilar training pairs.

The objective makes the embedding vectors of the two branches as similar as possible, while maximizing their information content.
4/N
No contrastive samples, no huge batch size (optimal is 128), nor predictor, no moving-average weights, no vector quantization, nor cut gradients in one of the branches.
5/N
Competitive results on ImageNet with a linear classifier head.
Great results on semi-supervised ImageNet in the low labeled-data regime and on transfer tasks.
6/N
Results on ImageNet with linear classifier head
7/N
Results with 1% and 10% of ImagNet labeled images
8/N
Results on transfer tasks.
9/N
Arch is standard ResNet50 with 2048-D feature vec.
But contrary to others, the embedding size (projector output) is larger. The perf keeps going up as the embedding dim grows (we stopped at 16384).
Probably cause the feature vars are made independent, not just decorrelated.
10/N
Why Barlow? Horace Barlow was a pioneer of visual neuroscience who proposed the idea that the brain tries to minimize redundancy in representations.

By Jure Zbontar, Li Jing, Ishan Misra, yours truly, and Stéphane Deny.
All from FAIR.
To appear at ICML 2021
11/N
Don't you just hate slicing what would be a decent-size post into threaded thin tweets?
12/N
No, really. Don't you hate reading those long thread slices?
If you do, you could just read my Facebook post:
https://t.co/dQii7BEPQ5
13/N
N=13
Typo: optimal batch size is 1024, not 128.
14/13 (haha).

More from All

Vibhu Vashisth
Vibhu Vashisth
@VIBHU_Tweet
LACHIT BORPHUKAN : AN UNSUNG WARRIOR OF THE AHOM KINGDOM & THE GREAT BATTLE OF SARAIGHAT

Originally named as Lachit Deca, Lachit Borphukan, the fierce and invincible Ahom Commander, was born during the early 17th century at Betioni in the Golaghat district of modern Assam.


His father, Momai Tamuli Borbarua was the ‘Governor’ of the kingdom and also ‘Commander-in-Chief’ of Ahom army under King Pratap Singha during his reign starting from 1603 to 1639. Lachit received military training from an early age and joined the Ahom King Jayadhvaj Singha...


...(1648-1663) as a scarf-bearer.  The post ‘scarf-bearer’ or ‘Soladhara Barua’ is considered as a part of the incumbent king’s personal staff. Owing to his military training Lechit was appointed "Ghora Barua", Supdt. of the Royal horses. When Chakradhwaj Singha became king..


..of Ahom dynasty in 1663,he appointed him Suptd. of The Royal Guards &finally he was appointed as Borphukan by the king.Then onwards,he was known as Lachit Borphukan.Borphukan used to be top councillor in Ahom Kingdom. This position was embedded with executive & judicial powers.


Assam was facing incessant Islamic invasion since Jan1662, when Mughal General Mir Jumla II attacked Ahom capital Gargaon. He never defeated Ahom king Jayadhwaja Singha as king retreated to hill &continued Guerrilla warfare.Prolonged fight &prospect of stalemate disturbed Jumla.
ALL
Daddy Files
Daddy Files
@DaddyFiles
This is my son, Sam. He’s 5. And today he learned how shitty and harmful #ToxicMasculinity is. My rage meter is spiking right now so excuse me if this is a little raw but there are some things I want to say about BS #gender norms (a thread)


Sam is my middle child & he’s a terror. A “boy’s boy” as so many (not me) would say. He’s rough and tumble, he’s loud, he’s always dirty, loves trucks, plays sports and knee drops me from the couch. But he also loves a lot of “girl” things.

Sam has a collection of purses because he likes to carry things around. And he also loves to have his nails painted bright colors because he thinks they “look beautiful.” And he’s right – they are beautiful…


So he proudly wore his red nail polish to kindergarten this morning because Sam has absolutely no concept of nail polish only being for girls or reason to think anyone would possibly have a problem with beautiful nails.


But his classmates did have a problem. A big one. Sam was ridiculed for being a boy with nail polish. They called him names and told him to take it off. This lasted the entire day.
ALL
Advertisement
itrade(DJ)
itrade(DJ)
@ITRADE191
Here is the detailed information of about strategy,

Entry time : 9.30 - 10
Exit : Upto you

Strategy :
Sell weekly ATM CE & PE at almost equal price
For ex : Sell Nifty 17250 CE at 50 and Nifty 17250 PE at 48 so it will become short straddle

Buy monthly ATM or near ATM CE & PE at matching price (5-10 points diff should be fine) as hedge
For ex : Buy Nifty 17250 CE at 150 and Nifty 17300 PE at 155 so it will become long straddle.

Weekly Short straddle + Monthly Long straddle

Adjustment:

• If you feel slightly bullish/bearish then no adjustment needed
• If Nifty moves 50 up or down and sustain then just simply roll up or down half of qnty and keep rest of the quantity. If market goes up or down further then roll up or down rest.

• If Nifty moves one side or about to breach BEP then add equal amount of lot. This can balance tested side. For ex: If I bought 17300 CE 4 lot as hedge then add 4 lot so you will have only one side risk . Note: Remember to keep SL at cost price (only for additional lot bought)

Capital requirement:
2.2 L for 4 lot
Adjustment requires additional capital upto 1L

Note : High risk high reward strategy, please don’t execute until you fully understand. Kindly do paper trading or backtest.
RR : 1:1
POP : 45-55%
OPTIONSLEARNINGS , ALL
Pratham
Pratham
@Prathkum
APIs in general are so powerful.

Best 5 public APIs you can use to build your next project:

1. Number Verification API

A RESTful JSON API for national and international phone number validation.

🔗 https://t.co/fzBmCMFdIj


2. OpenAI API

ChatGPT is an outstanding tool. Build your own API applications with OpenAI API.

🔗 https://t.co/TVnTciMpML


3. Currency Data API

Currency Data API provides a simple REST API with real-time and historical exchange rates for 168 world currencies

🔗 https://t.co/TRj35IUUec


4. Weather API

Real-Time & historical world weather data API.

Retrieve instant, accurate weather information for
any location in the world in lightweight JSON format.

🔗 https://t.co/DCY8kXqVIK
ALL
Buzz Chronicles
Buzz Chronicles
@buzz_chronicles
@UnrollHelper Hello! Pleasure is mine. Original tweet by @AnJamison: "@bellingcat @buzz\_chronicles @buzz\\\_chronicles @buzz_chronicles save as categ...". Thanks! 👉

Ciao! You can find it here. Original tweet by @UnrollHelper: "@AnJamison @bellingcat @buzz @buzz_chronicles @pdfmakerapp @Readwiseio @threader...". Enjoy 👌
ALL

You May Also Like

Nikita Poojary
Nikita Poojary
@niki_poojary
One of the most successful stock trader with special focus on cash stocks and who has a very creative mind to look out for opportunities in dark times

Covering one of the most unique set ups: Extended moves & Reversal plays

Time for a 🧵 to learn the above from @iManasArora

What qualifies for an extended move?

30-40% move in just 5-6 days is one example of extended move

How Manas used this info to book


Post that the plight of the


Example 2: Booking profits when the stock is extended from 10WMA

10WMA =


Another hack to identify extended move in a stock:

Too many green days!

Read
SCREENERS , A SCREENER
Trader knight
Trader knight
@Traderknight007
Pyramiding 2.0

A thread-


What is pyramiding?

It is simply adding to your winners.

Why use pyramiding?

1. It makes your winners bigger than your losers.

• Because you are adding positions when your trades are going your way, you are increasing your gains but your losers will be small comparatively.

2. You lose less during Draw-down time ( it saves you from losing big during whipsaws )

• Many times when the market is in sideways mode, Entering a trade with full risk might not be the best idea.

• So, you test the waters with a small position first, it could be ⅓ or ¼ of your total risk.

• So if the Breakout fails or whipsaws come, then you will only lose a small part of your overall risk.

• Then when position starts to go in your favor you can add to it.

3. It helps you to concentrate on a few trades,

They say that don’t put all your eggs in one basket, but don’t put them in too many either.

• See, Everyone can see charts and find breakouts, pullbacks etc.
ALL , SWING TRADING , PYRAMIDING
Advertisement
V\u0936\u0941\u0926\u094d\u0927\u093f
Vशुद्धि...
@V_Shuddhi
The first ever world map was sketched thousands of years ago by Indian saint
“Ramanujacharya” who simply translated the following verse from Mahabharat and gave the world its real face

In Mahabharat,it is described how 'Maharishi Ved Vyasa' gave away his divine vision to Sanjay


Dhritarashtra's charioteer so that he could describe him the events of the upcoming war.

But, even before questions of war could begin, Dhritarashtra asked him to describe how the world looks like from space.

This is how he described the face of the world:

सुदर्शनं प्रवक्ष्यामि द्वीपं तु कुरुनन्दन। परिमण्डलो महाराज द्वीपोऽसौ चक्रसंस्थितः॥
यथा हि पुरुषः पश्येदादर्शे मुखमात्मनः। एवं सुदर्शनद्वीपो दृश्यते चन्द्रमण्डले॥ द्विरंशे पिप्पलस्तत्र द्विरंशे च शशो महान्।

—वेद व्यास, भीष्म पर्व, महाभारत


Meaning:-

हे कुरुनन्दन ! सुदर्शन नामक यह द्वीप चक्र की भाँति गोलाकार स्थित है, जैसे पुरुष दर्पण में अपना मुख देखता है, उसी प्रकार यह द्वीप चन्द्रमण्डल में दिखायी देता है। इसके दो अंशो मे पीपल और दो अंशो मे विशाल शश (खरगोश) दिखायी देता है।


Meaning: "Just like a man sees his face in the mirror, so does the Earth appears in the Universe. In the first part you see leaves of the Peepal Tree, and in the next part you see a Rabbit."

Based on this shloka, Saint Ramanujacharya sketched out the map, but the world laughed
ALL
Shaun Russell
Shaun Russell
@_ShaunRussell
"I really want to break into Product Management"

make products.

"If only someone would tell me how I can get a startup to notice me."

Make Products.

"I guess it's impossible and I'll never break into the industry."

MAKE PRODUCTS.

Courtesy of @edbrisson's wonderful thread on breaking into comics – https://t.co/TgNblNSCBj – here is why the same applies to Product Management, too.


There is no better way of learning the craft of product, or proving your potential to employers, than just doing it.

You do not need anybody's permission. We don't have diplomas, nor doctorates. We can barely agree on a single standard of what a Product Manager is supposed to do.

But – there is at least one blindingly obvious industry consensus – a Product Manager makes Products.

And they don't need to be kept at the exact right temperature, given endless resource, or carefully protected in order to do this.

They find their own way.
TECH
foone
foone
@Foone
So I was talking to @gewt about Job: A Comedy of Justice and I came up with a theory that I think explains why Heinlein's late-period work is so kinda-terrible and why I still enjoy it so much


So Heinlein had always been very interesting in the short parts of his novels, like the little snippets inside chapters. He had a very fun writing style, and wrote some fun dialogue with fun characters, right?>
It probably comes from how much of his early stuff was short fiction

And I think what happened with a lot of his longer works is that he'd just start writing fun bits and hope it would end up going somewhere or having a bigger plot by the end. like eventually he'd figure out where this was going, then go back and rewrite it into a cohesive whole

and I'm sure he had editors that'd help this process. No editor would let you publish something as rambly and changing-gears-every-other-chapter as The Number Of The Beast, for example... unless you were God-King Of Science Fiction 1980s Robert Heinlein.

so basically I think what happened is that by the 80s (when he was in his seventies!!) he lost the drive to go back and rewrite and he was too Untouchable for editors to make him.
CULTURE