RS Glossary
Automation Bias
Automation bias is the tendency to favor an automated cue or recommendation over other evidence, including following incorrect advice or missing a problem because the system gave no alert.
- Review state
- Reviewed in POC
- Freshness
- Current
- Version
- 1
- Automation Bias
Remember it this wayThe machine's cue becomes the shortcut.
In plain language
Automation can become a mental shortcut. A person may follow a wrong recommendation even when conflicting evidence is available, or assume nothing is wrong because the system stayed silent. Keeping a human in the process does not prevent the bias if the person only rubber-stamps the machine.
Why it matters
Decision-support systems are rarely perfect. Automation Bias can introduce new errors precisely because the tool usually helps and earns trust. High workload, difficult verification, weak alternatives, and low confidence in one's own judgment can make the shortcut more tempting.
Example
A clinician overlooks a documented drug contraindication because the prescribing system does not display an alert. The absence of an automated warning replaces an independent review of the record.
Common misconception
Automation Bias is not the same as bias encoded in an algorithm, and appropriate reliance on a reliable system is not bias. It describes the human's decision behavior at the automation boundary. AI Overreliance is broader and can include habits, role transfer, and dependence beyond a single cue or recommendation.
Related terms
Sources
- Goddard, Roudsari, and Wyatt, “Automation Bias: A Systematic Review of Frequency, Effect Mediators, and Mitigators”reviews commission and omission errors caused by overreliance on automated decision support.
- NIST, “Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile”identifies overreliance on generative AI as an example of automation bias and a human-AI configuration risk.
Learn more
- Compare the decision shortcut in [[automation-bias|Automation Bias]] with the broader working pattern in [[ai-overreliance|AI Overreliance]].
- Design [[human-oversight|Human Oversight]] around independent evidence and meaningful authority rather than a nominal approval click.
Public history
30 recorded events · 30 public summaries
A potential shared concept was discussed and selected for initial glossary drafting.
The captured candidate received a complete initial draft and entered section-level human review.
Radar reviewed the initial definition draft for human consideration.
Radar reviewed the initial plain-language-explanation draft for human consideration.
Radar reviewed the initial why-it-matters draft for human consideration.
Radar reviewed the initial example draft for human consideration.
Radar reviewed the initial common-misconception draft for human consideration.
Radar reviewed the initial remember-it-this-way draft for human consideration.
Radar reviewed the initial related-terms draft for human consideration.
Radar reviewed the initial sources draft for human consideration.
Radar reviewed the initial learn-more draft for human consideration.
Definition review recorded as approve.
Plain-Language Explanation review recorded as approve.
Why It Matters review recorded as approve.
Example review recorded as approve.
Common Misconception review recorded as approve.
Remember It This Way review recorded as approve.
Related Terms review recorded as approve.
Sources review recorded as approve.
Learn More review recorded as approve.
All wording and media review gates are approved; the term is now canonical.
Definition review recorded as approve.
Plain-Language Explanation review recorded as approve.
Why It Matters review recorded as approve.
Example review recorded as approve.
Common Misconception review recorded as approve.
Remember It This Way review recorded as approve.
Related Terms review recorded as approve.
Sources review recorded as approve.
Learn More review recorded as approve.
Source: vault/Glossary/terms/automation-bias/term.md · sha256:58b0395ed0268e4cde8c01fc0ff567bd994d03126659535d9b9eb4a524a3ecdd · Release: rs-glossary-glossary-team-poc-0.5.5-2026-09-02