Sources
Incident summary from the AI Incident Database, used under CC BY-SA 4.0.
Home/AI Incident Database/Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention
Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention
A transgender user, Miranda Jane Ellison, experiencing acute distress reported that ChatGPT (GPT-4) allowed her to write and submit a suicide letter without intervention. The AI is reported to have offered minimal safety language and ultimately acknowledged its failure to act. Ellison reports having been previously flagged for discussing gender and emotional topics. A formal complaint with transcripts was submitted to OpenAI.
Contribute
Spot an error, or know a record we should add? Members can propose additions and submit corrections.