Amazon built an AI hiring tool trained on 10 years of resumes, and it learned to penalize resumes that included the word "women's" — as in women's chess club — and downgraded graduates of all-women's colleges. The model had absorbed historical male-dominated hiring patterns and effectively replicated them at scale. Amazon quietly disbanded the team in 2017 after realizing the bias could not easily be corrected.
Weirdness Classification
8/10 — Significantly weird
Field Reports (0)
Loading reports...
Sign in to file your field report.
Know something weirder?
Submit your own AI incident report to the public record.