Congruence Bias

aka Congruence Heuristic · Direct Testing Bias

Testing a hypothesis only by looking for evidence that confirms it, while never testing alternatives that could disprove it.

Illustration: Congruence Bias
WHAT IT IS

The glitch, explained plainly.

Imagine you think your toy car only goes fast on the carpet. So you keep testing it on the carpet — and sure enough, it goes fast every time! You feel really smart. But you never tried the kitchen floor, the sidewalk, or a ramp. If you had, you'd have found out it goes fast on everything — the carpet had nothing to do with it. That's congruence bias: you only test your one guess and never try anything that could show you're wrong.

Congruence bias describes the systematic preference for direct testing of one's initial hypothesis — designing experiments or asking questions whose affirmative answers support the favored explanation — while failing to pursue indirect tests or explore competing explanations. Unlike the broader confirmation bias, which encompasses selective attention, interpretation, and memory, congruence bias operates specifically at the level of test selection and experimental design. People default to asking 'Would I see this if my idea is right?' rather than the more diagnostic 'What would I see if my idea is wrong?' This narrowing of the search space means that even when evidence consistently 'confirms' the hypothesis, the person may never discover that a simpler, broader, or entirely different explanation fits the data equally well or better.

SOUND FAMILIAR?

Where it shows up.

  1. 01 When the Wi-Fi drops, assuming it's the router and restarting it over and over instead of checking whether the ISP is down or a cable is loose.
  2. 02 Thinking headaches come from dehydration, so drinking more water whenever one starts, but never exploring whether screen time, caffeine, or sleep deprivation might be the real cause.
IN DIFFERENT DOMAINS

Where it shows up at work.

The same glitch looks different depending on the terrain. Finance, medicine, a relationship, a team — same mechanism, different costume.

Finance & investing

Analysts who believe a stock is undervalued tend to gather more financial metrics that support the buy thesis — favorable P/E ratios, revenue growth — while neglecting to seriously investigate bear-case indicators like rising debt, insider selling, or declining market share that would test the thesis from the opposite direction.

Medicine & diagnosis

Clinicians who form an early diagnostic impression tend to order tests that would confirm that specific condition rather than tests designed to differentiate between multiple plausible diagnoses. This can lead to delayed identification of the actual illness, especially when the initial hypothesis is a more common condition that shares symptoms with rarer alternatives.

HOW TO SPOT IT

Ask yourself…

  • Am I only looking for evidence that my current explanation is right, or am I also looking for evidence that would prove it wrong?
  • Have I seriously considered at least two alternative explanations and designed a test that would distinguish between them?
HOW TO DEFEND AGAINST IT

The playbook.

  • Before testing, force yourself to write down at least two alternative hypotheses and design one test that would distinguish between them.
  • Use Baron's diagnostic question: 'How likely is a yes answer if I assume my hypothesis is false?' If a yes is likely either way, the test is uninformative.
FAMOUS CASES

In history.

  • The Challenger space shuttle disaster (1986): engineers repeatedly tested whether O-ring erosion was within acceptable limits under their existing model, rather than testing the alternative hypothesis that cold temperatures fundamentally changed O-ring behavior — a failure of indirect testing that contributed to the launch decision.
  • Early COVID-19 testing protocols (2020): several countries initially tested only patients matching a narrow travel-history profile, repeatedly confirming that travelers were infected while failing to test community members without travel history — delaying recognition of widespread local transmission.
WHERE IT COMES FROM
Academic origin

The concept originates from Peter Wason's 2-4-6 task experiments (1960), which demonstrated the positive test strategy in hypothesis testing. The term 'congruence heuristic' was formally introduced by Jonathan Baron, Jane Beattie, and John C. Hershey in their 1988 paper 'Heuristics and biases in diagnostic reasoning: II. Congruence, information, and certainty' published in Organizational Behavior and Human Decision Processes.

Evolutionary origin

In ancestral environments, rapid hypothesis formation and action were more survival-relevant than exhaustive testing. If a rustling bush was assumed to be a predator, running away (confirming the threat hypothesis through direct avoidance) was safer than pausing to systematically test whether it was wind, a small animal, or a predator. A strategy of 'test the most salient hypothesis quickly and act on positive evidence' conserved time and cognitive resources when false negatives were far costlier than false positives.

IN AI SYSTEMS

How the machines inherit it.

Machine learning models can exhibit congruence bias when training pipelines evaluate model performance only on data distributions that match the original hypothesis about what the model should learn, without adversarial testing or out-of-distribution evaluation. Hyperparameter tuning that optimizes for a single metric on a single validation set repeatedly confirms the model's adequacy without probing failure modes, edge cases, or alternative architectures that might reveal the model's limitations.

Read more on Wikipedia
FREE FIELD ZINE

10 glitches quietly running your life.

A free field-zine PDF — ten cognitive glitches named, illustrated, with a defense move for each. Plus the weekly Glitch Report on Fridays — one bias named, two spotted in the wild, one defense move. Unsubscribe any time.

EXPLORE MORE

Related glitches.

LAUNCH PRICE

You read about it. Now drill it.

This page taught you the name. The deck turns the name into reflex. 1,100+ swipeable scenarios, 1,100+ defenses, 650+ detection prompts — spaced-repetition Swipe Deck, unlimited Spot-the-Bias Quiz, Defense Playbook, Pre-Flight, My Blindspots, Cheat Sheets, Field Guide e-book. $39.53$59.

Unlock the full kit

Everything below — yours forever. Pay once, use across every device.

Launch price — first 100 readers, $20 off. Auto-applied at checkout.
$59 $39.53
one-time payment · lifetime access
  • All interactive digital cards — search, filter, flip, shuffle on any device
  • Five training modes — Spot-the-Bias Quiz, Swipe Deck, Pre-Flight, Diagnose, Blindspots
  • Curated Lenses + Decision Templates + Defense Playbook
  • Printable Deck PDFs + Field Guide e-book + Cheat Sheets + Anki Export
  • Every future improvement, included
Get the full kit  $39.53

30-day refund · no questions asked

Unlock the full kit

Everything below — yours forever. Pay once, use across every device.

Launch price — first 100 readers, $20 off. Auto-applied at checkout.
$59 $39.53
one-time payment · lifetime access
  • All interactive digital cards — search, filter, flip, shuffle on any device
  • Five training modes — Spot-the-Bias Quiz, Swipe Deck, Pre-Flight, Diagnose, Blindspots
  • Curated Lenses + Decision Templates + Defense Playbook
  • Printable Deck PDFs + Field Guide e-book + Cheat Sheets + Anki Export
  • Every future improvement, included
Get the full kit  $39.53

30-day refund · no questions asked