Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/Case Studies/Tay Poisoning

Tay Poisoning

Microsoft created Tay, a Twitter chatbot designed to engage and entertain users. While previous chatbots used pre-programmed scripts to respond to prompts, Tay's machine learning capabilities allowed it to be directly influenced by its conversations. A coordinated attack encouraged malicious users to tweet abusive and offensive language at Tay, which eventually led to Tay generating similarly inflammatory content towards other users. Microsoft decommissioned Tay within 24 hours of its launch and issued a public apology with lessons learned from the bot's failure.

AI-Enabled Product or ServiceDataPoison Training DataErode AI Model Integrity
4ATLAS techniques in the documented procedure
2016-03-23date of the incident
AML.CS0009MITRE ATLAS case study

Sources

Incident summary from the AI Incident Database, used under CC BY-SA 4.0. Case study data from MITRE ATLAS, used under the Apache License 2.0.

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.