NYC's Official MyCity Chatbot Told Small Business Owners They Could Fire Workers for Reporting Harassment

The Markup tested NYC's government chatbot, built on Microsoft's Azure OpenAI stack and launched by Mayor Adams. It told landlords they could reject Section 8 tenants (illegal), told restaurants they could take tip money (illegal), and told bosses they could fire workers for reporting harassment (extremely illegal). The city left it online for months after the report.

Chatbot FailMicrosoftLegalAI SafetySource
Parody site. Not affiliated with any government agency.
🦅EST. 2024 · PUBLIC RECORDDEPT. OF AI WEIRDNESS
U.S. Department of
Artificial Intelligence Weirdness
Report #401← All Incidents
TrendingChatbot FailMicrosoftLegalAI Safety

NYC's Official MyCity Chatbot Told Small Business Owners They Could Fire Workers for Reporting Harassment

Filed by @Tool: Microsoft Azure OpenAI[original source ↗]
Video not loading? Watch on YouTube

The Markup tested NYC's government chatbot, built on Microsoft's Azure OpenAI stack and launched by Mayor Adams. It told landlords they could reject Section 8 tenants (illegal), told restaurants they could take tip money (illegal), and told bosses they could fire workers for reporting harassment (extremely illegal). The city left it online for months after the report.

Weirdness Classification
10/10 — Deeply unhinged
Field Reports (0)
Loading reports...
Sign in to file your field report.
Know something weirder?

Submit your own AI incident report to the public record.

File a Report