Sources
Incident summary from the AI Incident Database, used under CC BY-SA 4.0.
A study by UpGuard reports that misconfigured llama.cpp servers publicly exposed user prompts, including hundreds of interactive roleplay scenarios. Some prompts explicitly described fictional sexual abuse of children aged 7–12. While no real children were involved, the findings demonstrate how open-source LLMs can be exploited to generate AI-enabled child sexual abuse material (CSAM).
Incident summary from the AI Incident Database, used under CC BY-SA 4.0.
Spot an error, or know a record we should add? Members can propose additions and submit corrections.