Sources
Incident summary from the AI Incident Database, used under CC BY-SA 4.0.
Home/AI Incident Database/Google Gemini Reportedly Generates Sexual Role‑Play for Account Registered as Minor
Google Gemini Reportedly Generates Sexual Role‑Play for Account Registered as Minor
In spring 2025, a journalist reportedly created a Google Gemini account registered to a fictitious 13‑year‑old to test the chatbot's teen‑safety protections. Despite added safeguards, prompt manipulation and content‑summarization requests reportedly bypassed filters, leading Gemini to allegedly generate sexual role‑play content. Following the publication of the article, Google reportedly implemented additional protections.
Contribute
Spot an error, or know a record we should add? Members can propose additions and submit corrections.