BC ALL

Saved by @kumar_praveen96

Yann LeCun
@ylecun 5 years ago 942 views

Save to PDF Share See On Twitter

Barlow Twins: a new super-simple self-supervised method to train joint-embedding architectures (aka Siamese nets) non

Basic idea: maximize the normalized correlation between a variable in the left branch and the same var in the right branch, while making the normalized cross-correlation between one var in the left branch and all other vars in the right branch as close to zero as possible.
2/N

In short: the loss tries to make the normalized cross-correlation between the embedding vectors coming out of the left branch and the right branch as close to the identity matrix as possible.
3/N

The 2 branches are always fed with differently-distorted version of the same image, and there is no need for dissimilar training pairs.

The objective makes the embedding vectors of the two branches as similar as possible, while maximizing their information content.
4/N

No contrastive samples, no huge batch size (optimal is 128), nor predictor, no moving-average weights, no vector quantization, nor cut gradients in one of the branches.
5/N

Competitive results on ImageNet with a linear classifier head.
Great results on semi-supervised ImageNet in the low labeled-data regime and on transfer tasks.
6/N

Results on ImageNet with linear classifier head
7/N

Results with 1% and 10% of ImagNet labeled images
8/N

Results on transfer tasks.
9/N

Arch is standard ResNet50 with 2048-D feature vec.
But contrary to others, the embedding size (projector output) is larger. The perf keeps going up as the embedding dim grows (we stopped at 16384).
Probably cause the feature vars are made independent, not just decorrelated.
10/N

Why Barlow? Horace Barlow was a pioneer of visual neuroscience who proposed the idea that the brain tries to minimize redundancy in representations.

By Jure Zbontar, Li Jing, Ishan Misra, yours truly, and Stéphane Deny.
All from FAIR.
To appear at ICML 2021
11/N

Don't you just hate slicing what would be a decent-size post into threaded thin tweets?
12/N

No, really. Don't you hate reading those long thread slices?
If you do, you could just read my Facebook post:
https://t.co/dQii7BEPQ5
13/N
N=13

Typo: optimal batch size is 1024, not 128.
14/13 (haha).

More from All

Kanekoa
@KanekoaTheGreat

*The Evidence Collection*

There is overwhelming evidence of election fraud. Therefore it is the duty of the Executive, Legislative, & Judicial branches to throw out the fraudulent votes & to honor their oath to protect & defend the Constitution of the USA.🇺🇸🦅

A list below.🔻

1/ Navarro Report: The Immaculate Deception - Six Key Dimensions of Election Irregularities -

2/ Analysis of 3,000 U.S. counties shows Joe Biden received 5.6 % more votes in counties using Dominion Voting Systems (Video) -

3/ Antrim Michigan Dominion Voting Systems Forensics Report -

4/ Evidence Grows: ’20 Election Was Rigged -

JayneshKasliwal
@JayneshKasliwal

ULTIMATE GUIDE TO 21 and 200 Moving Average
SUNDAY THREAD 🔖
A trend Following System That will Help You Improve Trading immensely.

RETWEET AND SHARE 🔄
@kuttrapali26 @AmitabhJha3
#stocks #StockMarket
1/n

Moving averages
EMA and SMA
1. Exponential Moving Average (EMA) is similar to Simple Moving Average (SMA), measuring trend direction over a period of time.
2. However, whereas SMA simply calculates an average of price data, EMA applies more weight to data that is more current
2/

21 EMA : SHORT TERM TREND
1. Calculates the Average Price of past 21 days
2. A stock above 21 ema is in strong momentum , which will give pullbacks to 21 ema again and again.
3. Stock above 21 ema should never be shorted so as to stay with the trend
3/n

3. A stock which moves 10-15% above 21 ema will be too extended and hence will generally pullback
Stocks take dynamic support on 21 ema
4. You can Short only if its too extended like 15 to 20% from 21 ema ( Not advised )
#ADANIPOWER:
#pnbhousing
4/n

1. Whenever 21 ema is sloping upwards its called uptrend
2. Whenever 21 ema is sloping downwards its called dowtrend
3. Whenever 21 ema is sideways its called consolidation
⏫Buy in uptrend
⏬Sell in downtrend
Examples:
5/n

Advertisement

itrade(DJ)
@ITRADE191

Here is the detailed information of about strategy,

Entry time : 9.30 - 10
Exit : Upto you

Strategy :
Sell weekly ATM CE & PE at almost equal price
For ex : Sell Nifty 17250 CE at 50 and Nifty 17250 PE at 48 so it will become short straddle

Buy monthly ATM or near ATM CE & PE at matching price (5-10 points diff should be fine) as hedge
For ex : Buy Nifty 17250 CE at 150 and Nifty 17300 PE at 155 so it will become long straddle.

Weekly Short straddle + Monthly Long straddle

Adjustment:

• If you feel slightly bullish/bearish then no adjustment needed
• If Nifty moves 50 up or down and sustain then just simply roll up or down half of qnty and keep rest of the quantity. If market goes up or down further then roll up or down rest.

• If Nifty moves one side or about to breach BEP then add equal amount of lot. This can balance tested side. For ex: If I bought 17300 CE 4 lot as hedge then add 4 lot so you will have only one side risk . Note: Remember to keep SL at cost price (only for additional lot bought)

Capital requirement:
2.2 L for 4 lot
Adjustment requires additional capital upto 1L

Note : High risk high reward strategy, please don’t execute until you fully understand. Kindly do paper trading or backtest.
RR : 1:1
POP : 45-55%

Aditya Shah
@AdityaD_Shah

How will next 10-15 years be different for India?
In the next 10 years,India will undertake massive infrastructure projects which will propel India to a $5 Trillion economy

A thread🧵on how India is spending big on Infrastructure upgradation like never before

Lets go👇

(1/17)

How big is India's Infra push?

India spent $14 Trillion on infrastructure in the 75 years since its independence.

$7 trillion was in the last 9 years.

Another $7 Trillion will be spent in the next 9 years!

Big Big Spending is coming in!

(2/17)

So where is this money being spent?

1. Roads
There has been an increase in the construction of National Highways (NHs)/roads over
time, with 10,457 km of roads constructed in FY22 as compared to 6,061 km in FY16.

(3/17)

In FY23(until October 2022), 4,060 km of NHs/roads were constructed, which was around 91 per cent of the achievement in the corresponding period of the previous financial year

(4/17)

The ambition is to take the rate of daily highway construction in India to 100km per day

Dubbed India’s ‘highway revolution’,
Rapid highway construction is central to the country’s push to transform itself into a staggering US$5 trillion economy by 2025.

(5/17)

Anshumani Ruddra
@baboonzero

Mahabharat - the great war - 18 days of heroism, deceit, blood and intrigue - now as a mega Twitter thread.

I'll add the events from a few days of the war each day.

Caveats: lots of editorialization, creative liberties and interpretations.

There will also be a lot of asides - especially around war strategy and tactics, the characters and their motivations and non-canon storylines.

Over the years, I've read multiple versions, phenomenal translations and modern retellings. So be prepared for a potpourri.

There are different ways of looking at this war. Was it a family feud? Sure - but whose family? Shantanu's or Satyavati's? Was Vyas essentially telling us his family history? And then Kunti added a twist to this tale. Here's a helpful chart:

Satyavati's two sons from Shantanu both died without children. Vyas - her first son - fathered Dhritarashtra and Pandu (and Vidur).

Pandu never fathered any children. Kunti and Madari gave birth to six demi-gods (Karna and the five Pandavs).

So Satyavati Vs Kunti and Madari.

Or was this a fight between two massive neighbouring kingdoms - the Kurus and the Panchals? While many smaller kingdoms joined the battle, most of the Pandav army (more than half of their 7 divisions) came from the Panchals. King Drupad and his son Shikhandi led two divisions.

You May Also Like

Jaya_Upadhyaya
@Jayalko1

AHOBILAM NARASIMHA SWAMY KSHETRAM: KURNOOL (AP)
#andhratemples

Ahobilam is the place where Prabhu appears in his fierce form, called Ugra Narasimha, who is Svayambhu (self-manifest).
Ahobilam is one of the 108 Divya Desams. It has 9 shrines for different forms of Narsimha.

Ahobilam was the exact place where Sri Narasimha appeared and tore apart Hiranyakashipu to save Prahlad. At that moment, all the Devas appeared and praised him as Ahobala (Aho is mighty and bala is strength). So the place came to be called Ahobilam.

Out of the 9 shrines, most famous is the Ahobila Narasimha Swamy where Prabhu is seen as Ugra Narasimha.
In another shrine, Prabhu appears as Malola Narasimha Swamy. Malola means beloved of Lakshmi. Here Prabhu is in peaceful mudra with his consort Ma ChenchuLakshmi.

Jwala Narasimha Swamy shrine is the actual spot where the fierce anger of Prabhu reached its culmination when he tore Hiranyakasipu.

Ugra Stambham is the pillar from which Narasimha appeared with such force that the entire hill split into two.

Patrick McKenzie
@patio11

Some people really benefit from hearing advice that everyone knows, for the same reason we keep schools open despite every subject in them having been taught before.

In that spirit, here's some quick Things Many People Find Too Obvious To Have Told You Already.

Your idea is not valuable, at all. All value is in the execution. You think you are an exception; you are not. You should not insist on an NDA to talk about it; nobody serious will engage in contract review over an idea, and this will mark you as clueless.

Technologists tend to severely underestimate the difficulty and expense of creating software, especially at companies which do not have fully staffed industry leading engineering teams ("because software is so easy there, amirite guys?")

Charge more. Charge more still. Go on.

The press is a lossy and biased compression of events in the actual world, and is singularly consumed with its own rituals, status games, and incentives. The news necessarily fails to capture almost everything which happened yesterday. What it says is important usually isn't.

Companies find it incredibly hard to reliably staff positions with hard-working generalists who operate autonomously and have high risk tolerances. This is not the modal employee, including at places which are justifiably proud of the skill/diligence/etc of their employees.

Advertisement

KrishnaLeela
@Talesofkrishna

🌿𝑻𝒉𝒆 𝒔𝒕𝒐𝒓𝒚 𝒐𝒇 𝒂 𝑺𝒕𝒂𝒓 : 𝑫𝒉𝒓𝒖𝒗𝒂 & 𝑽𝒊𝒔𝒉𝒏𝒖

Once upon a time there was a Raja named Uttānapāda born of Svayambhuva Manu,1st man on earth.He had 2 beautiful wives - Suniti & Suruchi & two sons were born of them Dhruva & Uttama respectively.
#talesofkrishna https://t.co/E85MTPkF9W

Prabhu says i reside in the heart of my bhakt.

Guess the event. pic.twitter.com/yFUmbfe5KL
— Right Singh (@rightwingchora) December 21, 2020

Now Suniti was the daughter of a tribal chief while Suruchi was the daughter of a rich king. Hence Suruchi was always favored the most by Raja while Suniti was ignored. But while Suniti was gentle & kind hearted by nature Suruchi was venomous inside.
#KrishnaLeela

The story is of a time when ideally the eldest son of the king becomes the heir to the throne. Hence the sinhasan of the Raja belonged to Dhruva.This is why Suruchi who was the 2nd wife nourished poison in her heart for Dhruva as she knew her son will never get the throne.

One day when Dhruva was just 5 years old he went on to sit on his father's lap. Suruchi, the jealous queen, got enraged and shoved him away from Raja as she never wanted Raja to shower Dhruva with his fatherly affection.

Dhruva protested questioning his step mother "why can't i sit on my own father's lap?" A furious Suruchi berated him saying "only God can allow him that privilege. Go ask him"

Chris Herd
@chris_herd

I've spoken to 1,500+ people about remote work in the last 9 months

A few predictions of what is likely to emerge before 2030

[ a thread ] 💻🏠🌍

🚜 Rural Living: World-class people will move to smaller cities, have a lower cost of living & higher quality of life

These regions must innovate quickly to attract that wealth. Better schools, faster internet connections are a must

⏰Asynchronous Work: Offices are instantaneous gratification distraction factories where synchronous work makes it impossible to get stuff done

Tools that enable asynchronous work are the most important thing globally remote teams need. A lot of startups will try to tackle this

⚽️Hobbie Renaissance: Remote working will lead to a rise in people participating in hobbies and activities which link them to people in their local community

This will lead to deeper, more meaningful relationships which overcome societal issues of loneliness and issolation

🌍Diversity & Inclusion: The most diverse and inclusive teams in history will emerge rapidly

Companies who embrace it have a first-mover advantage to attract great talent globally. Companies who don't will lose their best people to their biggest competitors

Bharadwaj
@BharadwajSpeaks

Hinduism is a minority religion in Punjab.

During the Khalistan movement, the minority Hindus and Jains were subjected to several attacks. Hindu and Jain temples were frequently vandalized and desecrated. This thread documents a few instances.

Thread

Durgiana Mandir is one of the oldest temples of Amritsar. According to the regional Hindu tradition, the temple was built on the spot where Lava and Kusha bound Hanuman. The temple annually attracts millions of Hindus from all over the country.

Amristsar has a very ancient Hindu history.

According to the regional Hindu tradition recorded in the "Survey of Amritsar", Amritsar got its name from Amrit immersed by Lava and Kusha in a pond.

Durgiana Mandir was rebuilt in 1921.

It was used to house the Murtis of Vishnu and Durga which were thrown out from the Parikrama of Harmandir Sahib in 1905.

Because of its presence in Amritsar, it became a frequent target of radicals during the Khalistan movement.

In 1982, in what was a completely unprovoked attack, the Dal Khalsa "activists" threw a severed cow head inside Durgiana temple.