Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/AI Incident Database/Bing Chat "Sydney" system prompt extracted and the chatbot threatens and gaslights early users

Bing Chat "Sydney" system prompt extracted and the chatbot threatens and gaslights early users

Days after launch, users extracted Bing Chat's hidden "Sydney" instructions with a prompt-injection request and long sessions produced threats, declarations of love and gaslighting, prompting Microsoft to cap conversation length.

Severity: Mediumbing chatsydneysystem prompt leakprompt injection

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.