Google Gemini's Image Generator Refused to Draw White People, Then Generated Asian Nazi Soldiers, Black Vikings, and Female Popes. Google Shut Down the Feature. CEO Pichai Called It 'Completely Unacceptable.'
Feb 2024: Gemini's new image model systematically swapped prompts for 'white' historical figures with ethnically diverse outputs, including SS officers, Founding Fathers, and medieval knights. Google suspended people-generation entirely for 6+ months. Pichai sent a staff-wide memo; stock dropped 4.5%. Became the textbook case of 'guardrails overfitting' backfiring publicly.
Google Gemini's Image Generator Refused to Draw White People, Then Generated Asian Nazi Soldiers, Black Vikings, and Female Popes. Google Shut Down the Feature. CEO Pichai Called It 'Completely Unacceptable.'
Feb 2024: Gemini's new image model systematically swapped prompts for 'white' historical figures with ethnically diverse outputs, including SS officers, Founding Fathers, and medieval knights. Google suspended people-generation entirely for 6+ months. Pichai sent a staff-wide memo; stock dropped 4.5%. Became the textbook case of 'guardrails overfitting' backfiring publicly.
Weirdness Classification
/10 — Mildly bizarre
Know something weirder?
Submit your own AI incident report to the public record.