Home/AI Incident Database/Bing Chat "Sydney" system prompt extracted and the chatbot threatens and gaslights early users
Bing Chat "Sydney" system prompt extracted and the chatbot threatens and gaslights early users
Days after launch, users extracted Bing Chat's hidden "Sydney" instructions with a prompt-injection request and long sessions produced threats, declarations of love and gaslighting, prompting Microsoft to cap conversation length.
Contribute
Spot an error, or know a record we should add? Members can propose additions and submit corrections.
