Survivorship Bias 101

History is written by the victors. But if we exclusively focus on these successes, we allow survivorship bias to distort our understanding of the world.

But what is "survivorship bias" and how does it work?

Here's Survivorship Bias 101!

👇👇👇

1/ First, a few definitions.

Survivorship bias is the logical error of concentrating on survivors (successes) and ignoring casualties (failures).

When we do so, we miss the true "base rates" of survival (the actual probability of success) and arrive at flawed conclusions.
2/ When we completely ignore failures, we lose our ability to correctly identify the differences between successes and failures.

Put simply, exclusively focusing on successes may actually inhibit our ability to identify (and replicate) the actions that led to such success.
3/ Cicero wrote on the topic over 2,000 years ago.

An atheist named Diagoras is shown portraits of people who prayed and were saved from death at sea as proof of God's existence.

Diagoras replies, "I see those who were saved, but where are those painted who were shipwrecked?"
4/ Cicero cuts right to the point - we cannot conclude that prayer led to being saved from the sea if we ignore those who prayed and then drowned.

Survivorship bias can lead to a deeply-flawed understanding of cause-and-effect relationships.

Let's look at some examples.
5/ One of the famous examples of survivorship bias comes from World War II.

The U.S. wanted to add reinforcement armor to specific areas of its planes.

Analysts plotted the bullet holes and damage on returning bombers, deciding the tail, body, and wings needed reinforcement.
6/ But a young statistician named Abraham Wald noted that this would be a tragic mistake.

By only plotting data on the planes that returned, they were systematically missing data on a critical, informative subset - the planes that were damaged and unable to return.
7/ The "seen" planes had sustained damage that was survivable.

The "unseen" planes had sustained damage that was not.

Wald concluded that armor should be added to the unharmed regions of the survivors.

Where the survivors were unharmed is where the planes were most vulnerable.
8/ Based on his observation, the military reinforced the engine and other vulnerable parts, significantly improving the safety of the crews during combat.

Wald had identified the survivorship bias and avoided its wrath.

Where else do we see survivorship bias arise?
9/ In business?

We all love business success stories. We love to read about companies and people who have achieved incredible success and fame.

We scan their backgrounds in desperate search of the actions or features that led to that success.

But these conclusions are flawed.
10/ For every entrepreneur who took out a second mortgage in a last-ditch attempt and succeeded, there may be 10 who did the same and went bankrupt.

For every company that pursued a moonshot idea and is now worth billions, there may be 10 who did the same and collapsed.
11/ In markets?

Analysts may try to calculate the performance of funds or groups of stocks using only the survivors at the end of the period.

By ignoring closed funds or stocks removed from an index, we bias the data and overstate returns.

Flawed data ➡️ Flawed decisions
12/ The point? By ignoring the companies or people who failed, we miss out on valuable data points from those cases.

To actively fight this, we must study the features of both successes and failures.

The "seen" and the "unseen" are equally important in guiding our decisions.
13/ As @nntaleb wrote in his classic, Fooled by Randomness, "Heroes are heroes because they are heroic in behavior, not because they won or lost."

So the next time you read a story of the hero who won, be sure to reflect on all of the heroes who lost, whose stories are not told.
14/ So that was Survivorship Bias 101. As someone who shares many success stories on Twitter, I thought it was an important topic to address.

Special thanks to @austin_rief of @MorningBrew, whose interesting tweet on new founders sparked this thread. https://t.co/ldSVsPP4uX
15/ For more on the topic of survivorship bias, I highly recommend the below resources.

Fooled by Randomness by @nntaleb: https://t.co/fB9ncIMlvE

Great blog from @ShaneAParrish and @FarnamStreet: https://t.co/o1T85OJMl7
16/ And for more educational threads on business, money, finance, and economics, check out my meta-thread below. Turn on post notifications so you never miss one! https://t.co/53UhhfzIcp

More from Sahil Bloom

More from For later read

I should mention, this is why I keep talking about this. Because I know so many people who legally CAN'T.

How do I know they have NDAs, if they can't talk legally about them? Because they trusted me with their secrets... after I said something. That's how they knew I was safe.


Some of the people who have reached out to me privately have been sitting with the pain of what happened to them and the regret that they signed for YEARS. But at the time, it didn't seem like they had any other option BUT to sign.

I do not blame *anyone* for signing an NDA, especially when it's attached to a financial lifeline. When you feel like your family's wellbeing is at stake, you'll do anything -- even sign away your own voice -- to provide for them. That's not a "choice"; that's survival.

And yes, many of the people whose stories I now know were pressured into signing an NDA by my husband's ex-employer. Some of whom I *never* would have guessed. People I thought "left well." Turns out, they've just been *very* good at abiding by the terms of their NDA.

(And others who have reached out had similar experiences with other Christian orgs. Turns out abuse, and the use of NDAs to cover up that abuse, is rampant in a LOT of places.)
Every single public defender. Every single day.


Bail arguments, motions, oral arguments, hearings. Judges don’t know, follow, or care about the law. Prosecutors are willing to take advantage of it. And mandatory minimums, withheld evidence, & pretrial detention coerces people to plead before trial. When theres a jury. A shot.

But defenders still fight. And still win. Most times wins aren’t “Justice.” It’s power of repetition of argument in front of same judges. Introducing those in power to the people they oppress. Not just a RAP sheet or words on a page. Defenders make it harder to be brutal & cruel.

I worked as a public defender at an office as well resourced as any in the country. Social workers, team of investigators, a reentry team, support staff, specialist attorneys in immigration, housing, education, family. Relatively low caseloads (80-100). And yet still injustice.

Most think that balancing the scales of justice means more funding for defenders. Thats part of it. Enough a attorneys to actually be at bail hearings. Wrap around services to be able to help people trapped in the system end up better off in their communities. Lower caseloads.

You May Also Like

The chorus of this song uses the shlokas taken from Sundarkand of Ramayana.

It is a series of Sanskrit shlokas recited by Jambavant to Hanuman to remind Him of his true potential.

1. धीवर प्रसार शौर्य भरा: The brave persevering one, your bravery is taking you forward.


2. उतसारा स्थिरा घम्भीरा: The one who is leaping higher and higher, who is firm and stable and seriously determined.

3. ुग्रामा असामा शौर्या भावा: He is strong, and without an equal in the ability/mentality to fight

4. रौद्रमा नवा भीतिर्मा: His anger will cause new fears in his foes.

5.विजिटरीपुरु धीरधारा, कलोथरा शिखरा कठोरा: This is a complex expression seen only in Indic language poetry. The poet is stating that Shivudu is experiencing the intensity of climbing a tough peak, and likening

it to the feeling in a hard battle, when you see your enemy defeated, and blood flowing like a rivulet. This is classical Veera rasa.

6.कुलकु थारथिलीथा गम्भीरा, जाया विराट वीरा: His rough body itself is like a sharp weapon (because he is determined to win). Hail this complete

hero of the world.

7.विलयगागनथाला भिकारा, गरज्जद्धरा गारा: The hero is destructive in the air/sky as well (because he can leap at an enemy from a great height). He can defeat the enemy (simply) with his fearsome roar of war.