Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/Research Paper Library/Constitutional Classifiers

Constitutional Classifiers

Anthropic's classifier safeguard for CBRN content, tested against thousands of hours of red teaming and deployed under its ASL-3 standard.

constitutional classifiersanthropicasl-3

Research question

Can input and output classifiers trained on synthetic constitutional data stop universal jailbreaks?

Key findings

  • Over 3,000 hours of red teaming found no universal jailbreak extracting detailed chemical-weapons information - Deployment costs of 0.38% refusal increase and 23.7% inference overhead

Sources

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.