Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/AI Incident Database/Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

Facebook's AI moderation system wrongly flagged and removed dozens of posts containing vital emergency information during California's wildfire season, including real-time updates on evacuations and fire tracking. Posts from official sources like Cal Fire and the U.S. Forest Service were marked as spam, potentially endangering lives by restricting access to crucial updates. Despite user complaints, the issue persisted, with Facebook acknowledging the problem only after media inquiry.

Severity: LowLack of capability or robustness

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.