Outcome Bias

aka Outcome Effect

Judging a decision's quality by how it turned out rather than by whether the reasoning was sound at the time.

Illustration: Outcome Bias
WHAT IT IS

The glitch, explained plainly.

Imagine you and your friend both studied the same amount for a test. Your friend guessed on the last question and got lucky — got it right. You guessed too but got it wrong. Now everyone says your friend is smarter and you made a bad choice, even though you both did the exact same thing. That's outcome bias: judging the choice by what happened after, not by whether it was a smart choice to begin with.

Outcome bias leads people to conflate the quality of a decision with the quality of its result, even when the result was largely determined by chance or factors beyond the decision-maker's control. A surgeon who made a statistically sound call to operate will be praised if the patient lives and condemned if the patient dies, despite the decision process being identical in both cases. This bias persists even when evaluators are explicitly told they have all the same information the decision-maker had and even when they acknowledge that outcomes should not influence their ratings. The effect is particularly insidious because it punishes well-reasoned risk-taking that happens to fail and rewards reckless choices that happen to succeed, thereby distorting the feedback loops people rely on to improve their judgment over time.

SOUND FAMILIAR?

Where it shows up.

  1. 01 Taking a different route to work on a whim and hitting terrible traffic, then calling it a stupid decision — even though there was no way to predict the delay.
  2. 02 A friend investing savings in a single volatile stock that triples in value, and everyone calling them a genius investor rather than recognizing the enormous risk.
IN DIFFERENT DOMAINS

Where it shows up at work.

The same glitch looks different depending on the terrain. Finance, medicine, a relationship, a team — same mechanism, different costume.

Finance & investing

Investors and fund managers are routinely evaluated based on portfolio returns rather than the soundness of their investment theses. A trader who made a highly leveraged, undiversified bet that happened to pay off is celebrated as skilled, while a disciplined risk manager whose diversified portfolio underperformed due to a black swan event is penalized — leading to systematic reward of reckless strategies and punishment of prudent ones.

Medicine & diagnosis

Physicians and surgeons are frequently judged by patient outcomes rather than by whether their clinical reasoning was appropriate given the available evidence. A surgeon who opts for a procedure with an 80% success rate is evaluated differently depending on whether the patient lives or dies, despite the decision being identical. This can lead to defensive medicine, where doctors avoid risky-but-appropriate interventions to protect their reputation.

HOW TO SPOT IT

Ask yourself…

  • Am I evaluating this person's decision based on what I now know happened, or based on what they reasonably knew at the time?
  • If the outcome had been different but the decision process identical, would I still rate this decision the same way?
HOW TO DEFEND AGAINST IT

The playbook.

  • Before evaluating any decision, write down what a reasonable person would have concluded given only the information available at the time of the decision — ignore all outcome data.
  • Use pre-mortems: before a decision is made, imagine both good and bad outcomes and evaluate the decision logic independently of each hypothetical result.
FAMOUS CASES

In history.

  • The post-mortem criticism of NASA's decision-making after the Challenger disaster, where the same risk-tolerance that had been accepted in many prior successful launches was suddenly deemed reckless only after the tragic outcome.
  • Evaluations of military commanders throughout history — generals who took similar calculated risks are remembered as geniuses (when they won) or reckless fools (when they lost), regardless of whether the strategic reasoning was sound.
  • The 2008 financial crisis led to the vilification of some risk managers who had made decisions consistent with prevailing models, while those who happened to short the housing market were celebrated as prescient, even when some acted on hunches rather than rigorous analysis.
WHERE IT COMES FROM
Academic origin

Jonathan Baron and John C. Hershey, 1988. Formalized in their paper 'Outcome Bias in Decision Evaluation' published in the Journal of Personality and Social Psychology (Vol. 54, pp. 569–579).

Evolutionary origin

In ancestral environments, outcomes were often the only reliable feedback signal. If eating a berry made you sick, avoiding that berry was adaptive regardless of the underlying probability. Environments were stable enough that outcome-based learning ('that worked, do it again; that failed, avoid it') was a fast, low-cost heuristic that generally tracked real causal patterns. The brain did not evolve to handle domains where outcomes are dominated by randomness or delayed feedback.

IN AI SYSTEMS

How the machines inherit it.

Machine learning models trained on outcome data rather than decision-process quality can systematically learn to reward lucky strategies. Recommendation systems and reinforcement learning agents may over-fit to positive outcomes caused by random environmental factors rather than genuinely superior actions. In hiring algorithms, training on 'successful employee' outcomes can encode outcome bias by attributing success to the hiring decision rather than to post-hire environmental factors like team composition or market conditions.

Read more on Wikipedia
FREE FIELD ZINE

10 glitches quietly running your life.

A free field-zine PDF — ten cognitive glitches named, illustrated, with a defense move for each. Plus the weekly Glitch Report on Fridays — one bias named, two spotted in the wild, one defense move. Unsubscribe any time.

EXPLORE MORE

Related glitches.

LAUNCH PRICE

You read about it. Now drill it.

This page taught you the name. The deck turns the name into reflex. 1,100+ swipeable scenarios, 1,100+ defenses, 650+ detection prompts — spaced-repetition Swipe Deck, unlimited Spot-the-Bias Quiz, Defense Playbook, Pre-Flight, My Blindspots, Cheat Sheets, Field Guide e-book. $39.53$59.

Unlock the full kit

Everything below — yours forever. Pay once, use across every device.

Launch price — first 100 readers, $20 off. Auto-applied at checkout.
$59 $39.53
one-time payment · lifetime access
  • All interactive digital cards — search, filter, flip, shuffle on any device
  • Five training modes — Spot-the-Bias Quiz, Swipe Deck, Pre-Flight, Diagnose, Blindspots
  • Curated Lenses + Decision Templates + Defense Playbook
  • Printable Deck PDFs + Field Guide e-book + Cheat Sheets + Anki Export
  • Every future improvement, included
Get the full kit  $39.53

30-day refund · no questions asked

Unlock the full kit

Everything below — yours forever. Pay once, use across every device.

Launch price — first 100 readers, $20 off. Auto-applied at checkout.
$59 $39.53
one-time payment · lifetime access
  • All interactive digital cards — search, filter, flip, shuffle on any device
  • Five training modes — Spot-the-Bias Quiz, Swipe Deck, Pre-Flight, Diagnose, Blindspots
  • Curated Lenses + Decision Templates + Defense Playbook
  • Printable Deck PDFs + Field Guide e-book + Cheat Sheets + Anki Export
  • Every future improvement, included
Get the full kit  $39.53

30-day refund · no questions asked