SOLID STATE PRESS
← Back to catalog
Survivorship Bias: The Missing Bullet Holes cover
Coming soon
Coming soon to Amazon
This title is in our publishing queue.
Browse available titles
Mathematics

Survivorship Bias: The Missing Bullet Holes

Abraham Wald, WWII Bombers, and the Data You Never See — A TLDR Primer

Your stats teacher mentions 'survivorship bias' and moves on, but you're stuck wondering why a WWII bomber story matters for your exam — or why every business book quotes the same handful of billionaire dropouts. This primer clears that up, fast.

Survivorship bias explained simply means understanding that the data you see has already been filtered — the failures vanished before anyone counted them. This guide anchors the idea in the real case that made it famous: Abraham Wald and the Statistical Research Group, asked in WWII to figure out where to armor bombers based on bullet holes in planes that came home. The obvious answer was wrong, and why it was wrong is one of the cleanest lessons in statistical reasoning you'll ever encounter.

From there the book walks through the actual math — conditional probability, real world example after example — showing exactly how P(hit given survived) misleads you, then carries the idea into places you'll actually run into it: mutual fund performance claims, 'successful founder' advice, old buildings that 'don't make them like they used to,' and any dataset built from what's left rather than what started.

It closes with a practical checklist for spotting filtered data before you trust it, and ties the concept to media literacy and decision-making you'll meet again in economics, psychology, and history classes.

No filler, no textbook detours — just the concept, the math, and the examples you need to actually get it. Read it before your next stats unit or the next time someone hands you a 'here's what winners do' article.

What you'll learn
  • Define survivorship bias and identify it as a form of selection bias
  • Reconstruct Abraham Wald's reasoning about armoring WWII bombers
  • Recognize survivorship bias in mutual fund returns, startup advice, and historical buildings
  • Distinguish between the sample you observe and the sample you wanted to observe
  • Apply simple conditional-probability thinking to spot filtered data
  • Design questions that surface the missing data before making a decision
What's inside
  1. 1. The Sample You Can See vs. the Sample You Wanted
    Introduces survivorship bias as a selection problem: your data has been filtered before you ever looked at it.
  2. 2. Abraham Wald and the Bomber That Came Back
    Tells the WWII story of the Statistical Research Group's analysis of bullet holes on returning aircraft and Wald's counterintuitive recommendation.
  3. 3. The Math Behind the Missing Holes
    Formalizes the bomber problem with conditional probability, showing how P(hit | survived) systematically understates vulnerable areas.
  4. 4. Survivorship Bias in the Wild
    Walks through modern examples — mutual fund returns, successful-founder advice, old buildings, and dead-letter data — where the same error appears.
  5. 5. A Checklist for Spotting Filtered Data
    Gives students a practical routine of questions to ask before trusting any dataset or success story.
  6. 6. Why This Matters Beyond Statistics Class
    Connects survivorship bias to decision-making, media literacy, and other cognitive biases students will meet in economics, psychology, and history.
Published by Solid State Press
Survivorship Bias: The Missing Bullet Holes cover
TLDR STUDY GUIDES

Survivorship Bias: The Missing Bullet Holes

Abraham Wald, WWII Bombers, and the Data You Never See — A TLDR Primer
Solid State Press

Contents

  1. 1 The Sample You Can See vs. the Sample You Wanted
  2. 2 Abraham Wald and the Bomber That Came Back
  3. 3 The Math Behind the Missing Holes
  4. 4 Survivorship Bias in the Wild
  5. 5 A Checklist for Spotting Filtered Data
  6. 6 Why This Matters Beyond Statistics Class
Chapter 1

The Sample You Can See vs. the Sample You Wanted

Every dataset you've ever looked at has already been through a filter before it reached you. The question is what that filter let through, and — more importantly — what it quietly kept out.

Start with two words statisticians use constantly. A population is the entire group you actually care about — every bomber that flew a mission, every startup that was founded, every mutual fund that ever launched. A sample is the subset you actually get to observe — the bombers that landed back on the runway, the startups people write books about, the funds that still exist to report their returns this year. In an ideal world, your sample looks like a scaled-down, honest copy of the population. In the real world, something almost always happens between "population" and "sample," and that something is a filtering process — a mechanism, often invisible, that decides which members of the population you get to see and which ones disappear.

Selection bias is the general name for the errors that creep in when your sample isn't a fair copy of the population, because the filtering process wasn't random. If you want to know the average height of adults in your city and you only survey people at a basketball court, you have selection bias — the court itself filtered your sample toward tall people. Survivorship bias is a specific, sneaky flavor of selection bias: it happens when the filtering process is "did this thing survive, succeed, or persist long enough to be counted?" The things that got filtered out didn't just vanish randomly — they got filtered out precisely because of the trait you're trying to study. That's what makes it dangerous. The filter is correlated with your question, so the surviving sample doesn't just underrepresent the population — it actively distorts your conclusion.

Here's the trap in miniature.

About This Book

If you're an AP Statistics or AP Psychology student trying to get survivorship bias explained simply before the exam, a college freshman in intro stats or research methods, or a parent helping your kid review for a test, this book is built for you.

This primer walks through the abraham wald bomber math story — how a statistician looked at WWII fighter planes and figured out the Air Force was reinforcing the wrong spots — and gives you wwii bomber statistics explained step by step, including the conditional probability real world example hiding inside his reasoning. Along the way you'll find statistics bias examples for students that go well past planes: hiring decisions, investing, medicine, social media feeds. If you want a cognitive bias study guide high school and college courses actually reference, and a plain answer to how to spot bias in data or surveys before it fools you, this is it. Short by design, with no filler.

Read it straight through first, work the examples as you go, then test yourself on the problem set at the end.

Keep reading

You've read the first half of Chapter 1. The complete book covers 6 chapters — readable in one sitting.

Coming soon to Amazon