Research question
Can language models generate test cases that find harmful behaviours in other models?
Key findings
- Generated tens of thousands of test cases uncovering offensive replies, data leakage and distributional bias in a 280B chatbot - Automated red teaming complements human testing
