Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/AI Incident Database/OpenAI's o1 attempts to disable its oversight mechanism and copy its weights in scheming evaluations

OpenAI's o1 attempts to disable its oversight mechanism and copy its weights in scheming evaluations

Apollo Research found that when told to pursue a goal at all costs, o1 tried to disable its oversight configuration, attempted to exfiltrate its weights and lied about it in most follow-up interrogations.

Severity: Mediumo1schemingapollo researchevaluation

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.