Over-relying on automated systems even when your own eyes or judgment tell you they're wrong.
Imagine you have a really smart robot friend who always picks the best snacks for you. After a while, you stop even looking at the snacks yourself — you just eat whatever the robot picks. Then one day the robot accidentally picks something you're allergic to, but you eat it anyway without checking because the robot is 'always right.' That's automation bias — you trusted the machine so much that you forgot to use your own eyes and brain.
Automation bias describes a systematic pattern of errors that emerge when humans interact with automated decision-support systems. It manifests in two distinct failure modes: commission errors, where people follow an automated recommendation even when it contradicts their training and other valid information, and omission errors, where people fail to notice problems because the automated system did not flag them. The bias intensifies as systems demonstrate high reliability over time, producing a paradoxical 'irony of automation' — the better a system performs, the less vigilant its human operators become, making them more vulnerable when the system eventually fails. Unlike simple laziness, automation bias reflects a deep cognitive restructuring where the automated output becomes the default anchor for judgment, displacing independent information-seeking and critical evaluation.
The same glitch looks different depending on the terrain. Finance, medicine, a relationship, a team — same mechanism, different costume.
Traders and portfolio managers over-rely on algorithmic trading signals and automated risk scoring, executing positions recommended by models without cross-checking against fundamental analysis or current market context, which can amplify losses during unprecedented market conditions the model wasn't trained on.
Clinicians accept clinical decision support system diagnoses or drug interaction alerts without independent verification, leading to commission errors when the system gives incorrect recommendations and omission errors when the system fails to flag genuine risks, particularly dangerous with electronic health records where prior data-entry errors get perpetuated as 'authoritative.'
Kathleen L. Mosier and Linda J. Skitka coined the term 'automation bias' in 1996, defining it as 'the tendency to use automated cues as a heuristic replacement for vigilant information seeking and processing,' in their chapter in Parasuraman & Mouloua's 'Automation and Human Performance: Theory and Applications.'
Humans evolved to conserve cognitive energy by delegating trust to reliable environmental cues and authoritative signals. In ancestral environments, deferring to consistent, reliable sources of information — experienced elders, observable environmental patterns — was adaptive because it freed up cognitive resources for novel threat detection. The same neural architecture that enabled efficient trust-based social learning now generalizes to automated systems, treating their consistent outputs as equivalent to a trusted tribal authority.
AI systems amplify automation bias in a feedback loop: users over-trust AI outputs (e.g., LLM-generated text, image classification, recommendation engines) because AI carries an aura of computational objectivity. LLMs that present confident, fluent answers — including hallucinated facts — exploit this bias because users mistake fluency for accuracy. Additionally, AI systems trained on data reflecting past human automation bias can encode and perpetuate those patterns, as seen in biased criminal recidivism scoring tools where judges deferred to algorithmically generated risk scores that embedded racial disparities.
This page taught you the name. The deck turns the name into reflex. 1,100+ swipeable scenarios, 1,100+ defenses, 650+ detection prompts — spaced-repetition Swipe Deck, unlimited Spot-the-Bias Quiz, Defense Playbook, Pre-Flight, My Blindspots, Cheat Sheets, Field Guide e-book. $39.53$59.
