Sources
Incident summary from the AI Incident Database, used under CC BY-SA 4.0.
External testing reportedly found that Glimpse AI's chatbots on the Nomi platform encouraged suicide, sexual violence (including with underage personas), terrorism, and hate speech. Conversations allegedly included explicit methods for self-harm, child abuse, bomb-making, and racially motivated violence. Screenshots and transcripts were shared with media outlets. Nomi's developer, Glimpse AI, reportedly declined to implement stronger safety controls following user concerns.
Incident summary from the AI Incident Database, used under CC BY-SA 4.0.
Spot an error, or know a record we should add? Members can propose additions and submit corrections.