Survivorship Bias 101

History is written by the victors. But if we exclusively focus on these successes, we allow survivorship bias to distort our understanding of the world.

But what is "survivorship bias" and how does it work?

Here's Survivorship Bias 101!

👇👇👇

1/ First, a few definitions.

Survivorship bias is the logical error of concentrating on survivors (successes) and ignoring casualties (failures).

When we do so, we miss the true "base rates" of survival (the actual probability of success) and arrive at flawed conclusions.
2/ When we completely ignore failures, we lose our ability to correctly identify the differences between successes and failures.

Put simply, exclusively focusing on successes may actually inhibit our ability to identify (and replicate) the actions that led to such success.
3/ Cicero wrote on the topic over 2,000 years ago.

An atheist named Diagoras is shown portraits of people who prayed and were saved from death at sea as proof of God's existence.

Diagoras replies, "I see those who were saved, but where are those painted who were shipwrecked?"
4/ Cicero cuts right to the point - we cannot conclude that prayer led to being saved from the sea if we ignore those who prayed and then drowned.

Survivorship bias can lead to a deeply-flawed understanding of cause-and-effect relationships.

Let's look at some examples.
5/ One of the famous examples of survivorship bias comes from World War II.

The U.S. wanted to add reinforcement armor to specific areas of its planes.

Analysts plotted the bullet holes and damage on returning bombers, deciding the tail, body, and wings needed reinforcement.
6/ But a young statistician named Abraham Wald noted that this would be a tragic mistake.

By only plotting data on the planes that returned, they were systematically missing data on a critical, informative subset - the planes that were damaged and unable to return.
7/ The "seen" planes had sustained damage that was survivable.

The "unseen" planes had sustained damage that was not.

Wald concluded that armor should be added to the unharmed regions of the survivors.

Where the survivors were unharmed is where the planes were most vulnerable.
8/ Based on his observation, the military reinforced the engine and other vulnerable parts, significantly improving the safety of the crews during combat.

Wald had identified the survivorship bias and avoided its wrath.

Where else do we see survivorship bias arise?
9/ In business?

We all love business success stories. We love to read about companies and people who have achieved incredible success and fame.

We scan their backgrounds in desperate search of the actions or features that led to that success.

But these conclusions are flawed.
10/ For every entrepreneur who took out a second mortgage in a last-ditch attempt and succeeded, there may be 10 who did the same and went bankrupt.

For every company that pursued a moonshot idea and is now worth billions, there may be 10 who did the same and collapsed.
11/ In markets?

Analysts may try to calculate the performance of funds or groups of stocks using only the survivors at the end of the period.

By ignoring closed funds or stocks removed from an index, we bias the data and overstate returns.

Flawed data ➡️ Flawed decisions
12/ The point? By ignoring the companies or people who failed, we miss out on valuable data points from those cases.

To actively fight this, we must study the features of both successes and failures.

The "seen" and the "unseen" are equally important in guiding our decisions.
13/ As @nntaleb wrote in his classic, Fooled by Randomness, "Heroes are heroes because they are heroic in behavior, not because they won or lost."

So the next time you read a story of the hero who won, be sure to reflect on all of the heroes who lost, whose stories are not told.
14/ So that was Survivorship Bias 101. As someone who shares many success stories on Twitter, I thought it was an important topic to address.

Special thanks to @austin_rief of @MorningBrew, whose interesting tweet on new founders sparked this thread. https://t.co/ldSVsPP4uX
15/ For more on the topic of survivorship bias, I highly recommend the below resources.

Fooled by Randomness by @nntaleb: https://t.co/fB9ncIMlvE

Great blog from @ShaneAParrish and @FarnamStreet: https://t.co/o1T85OJMl7
16/ And for more educational threads on business, money, finance, and economics, check out my meta-thread below. Turn on post notifications so you never miss one! https://t.co/53UhhfzIcp

More from Sahil Bloom

More from For later read

@snip96581187 @Daoyu15 @lab_leak @walkaboutrick @ydeigin @Ayjchan @franciscodeasis @TheSeeker268 @angie_rasmussen Clearly, because as I have been saying for 8 months now, DTRA and DARPA have been using Ecohealth and UC Davis to collect novel pathogens for gain of function work back in the USA. I have documented this in many threads which I will post here just to annoy everyone.

@Daoyu15 @lab_leak @walkaboutrick @ydeigin @Ayjchan @franciscodeasis @TheSeeker268 @angie_rasmussen


@Daoyu15 @lab_leak @walkaboutrick @ydeigin @Ayjchan @franciscodeasis @TheSeeker268 @angie_rasmussen


@Daoyu15 @lab_leak @walkaboutrick @ydeigin @Ayjchan @franciscodeasis @TheSeeker268 @angie_rasmussen


@Daoyu15 @lab_leak @walkaboutrick @ydeigin @Ayjchan @franciscodeasis @TheSeeker268 @angie_rasmussen
Part of what is going on here is that large sectors of evangelicalism are poorly equipped to help people deal with basic struggles, let alone the ubiquitous pornography addictions that most of their men have been enslaved to for years.


On the one hand, there's a high standard of holiness. On the other hand, there's a model of growth that is basically "Try Harder to Mean it More." Identify the relevant scriptural truth & believe it with all of your sincerity so that you may access the Holy Spirit's help to obey.

Helping sincere believers believe and obey the Bible facts is pretty much all the Holy Spirit does these days, other than convict us of our sins in light of the Bible facts.

If you know you are sincere and hate your sin and believe the right Bible facts as hard as you can but continue to be enslaved to your pornography addiction, what else left for you to do? Just Really, Just Really, Just Really Trust God and Give it to Him?

To suggest that there are other strategies available sounds to those formed in this model of growth like one is also suggesting that the Bible is insufficient, but it also suggests something just as threatening- that there are aspects of reality that are not immediately apparent.
Today's Twitter threads (a Twitter thread).

Inside: Planet Money on HP's myriad ripoffs; Strength in numbers; and more!

Archived at: https://t.co/esjoT3u5Gr

#Pluralistic

1/


On Feb 22, I'm delivering a keynote address for the NISO Plus conference, "The day of the comet: what trustbusting means for digital manipulation."

https://t.co/Z84xicXhGg

2/


Planet Money on HP's myriad ripoffs: Ink-stained wretches of the world, unite!

https://t.co/k5ASdVUrC2

3/


Strength in numbers: The crisis in accounting.

https://t.co/DjfAfHWpNN

4/


#15yrsago Bad Samaritan family won’t return found expensive camera https://t.co/Rn9E5R1gtV

#10yrsago What does Libyan revolution mean for https://t.co/Jz28qHVhrV? https://t.co/dN1e4MxU4r

5/

You May Also Like

And here they are...

THE WINNERS OF THE 24 HOUR STARTUP CHALLENGE

Remember, this money is just fun. If you launched a product (or even attempted a launch) - you did something worth MUCH more than $1,000.

#24hrstartup

The winners 👇

#10

Lattes For Change - Skip a latte and save a life.

https://t.co/M75RAirZzs

@frantzfries built a platform where you can see how skipping your morning latte could do for the world.

A great product for a great cause.

Congrats Chris on winning $250!


#9

Instaland - Create amazing landing pages for your followers.

https://t.co/5KkveJTAsy

A team project! @bpmct and @BaileyPumfleet built a tool for social media influencers to create simple "swipe up" landing pages for followers.

Really impressive for 24 hours. Congrats!


#8

SayHenlo - Chat without distractions

https://t.co/og0B7gmkW6

Built by @DaltonEdwards, it's a platform for combatting conversation overload. This product was also coded exclusively from an iPad 😲

Dalton is a beast. I'm so excited he placed in the top 10.


#7

CoderStory - Learn to code from developers across the globe!

https://t.co/86Ay6nF4AY

Built by @jesswallaceuk, the project is focused on highlighting the experience of developers and people learning to code.

I wish this existed when I learned to code! Congrats on $250!!