Research question
Can a simple system-prompt reminder reduce jailbreak success?
Key findings
- Wrapping user queries in a reminder to respond responsibly cut jailbreak success from 67% to 19% - Introduces a jailbreak dataset of 540 prompts
Defending ChatGPT against jailbreak attack via self-reminders
A Nature Machine Intelligence study showing self-reminder prompts substantially reduce jailbreaks, an early lightweight defence.
Contribute
Spot an error, or know a record we should add? Members can propose additions and submit corrections.