Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member

AI Control

Redwood Research's AI control paradigm: designing deployment protocols that remain safe even if the model is scheming, evaluated with adversarial red teams.

ai controlredwoodprotocols

Research question

Can protocols using untrusted capable models plus trusted weaker models and limited human labour stay safe against deliberate sabotage?

Key findings

  • Trusted editing and monitoring protocols catch backdoored code from an adversarial GPT-4 with high probability - Frames safety as a red-team/blue-team game over protocols

Sources

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.