The Base Rate Fallacy: Why Doctors Misread Positive Tests
Bayes' Theorem, False Positives, and the 1% Trap — A TLDR Primer
You just tested positive for something rare. Your doctor looks worried. But here's the math your doctor may not walk you through: even a test that's 99% accurate can mean you probably don't have the disease — if the disease itself is rare enough. This is the base rate fallacy, and it trips up trained physicians as often as it trips up nervous patients.
This TLDR primer walks through the classic puzzle that stumps most doctors (a mammogram-style problem with a shocking answer), then builds the four numbers you need to reason clearly: sensitivity, specificity, base rate, and the contingency table that ties them together. From there it derives Bayes' theorem — not as a scary formula to memorize, but as simple counting logic you can rebuild from scratch. A section on the 'natural frequencies trick' shows why reframing percentages as counts out of 10,000 makes the answer obvious, even to people who freeze up at the word 'probability.'
Later sections cover why doctors, judges, and TSA screeners make this same mistake, and apply the math to real debates — mammography, PSA screening, COVID rapid tests — so you leave with a checklist for reading any positive result skeptically.
Written for high school and early college students tackling statistics, pre-med coursework, or just a confusing test result, this guide is concise, worked-example-driven, and stripped of textbook padding. No calculus, no fear — just the reasoning laid out clearly enough to actually stick.
Grab it, work the examples, and never misread a positive test again.
- Define base rate, sensitivity, specificity, and predictive value in plain language
- Apply Bayes' theorem to compute the probability of disease given a positive test
- Recognize the base rate fallacy in medical, legal, and everyday reasoning
- Use natural-frequency reasoning to avoid common probability mistakes
- Explain why screening rare diseases produces so many false positives
- 1. The Puzzle: A Positive Test That Probably Means NothingOpens with the classic mammogram/HIV-style problem to hook the reader and show that even trained doctors get it wrong.
- 2. The Vocabulary: Sensitivity, Specificity, and Base RateDefines the four numbers you need to reason about any diagnostic test and builds a 2x2 contingency table.
- 3. Bayes' Theorem Without the FearDerives Bayes' theorem from the 2x2 table, presents the formula, and walks through the algebra step by step.
- 4. The Natural Frequencies TrickShows how reframing probabilities as counts out of 10,000 makes the same problem transparent, and explains why this format works better for human brains.
- 5. Why Doctors (and Everyone Else) Get This WrongCovers documented studies of physician error, the psychology of neglecting base rates, and parallels in courtrooms and airport security.
- 6. When Screening Helps and When It HurtsApplies the math to real screening debates (mammography, PSA, COVID rapid tests) and gives the reader a decision-making checklist.