Chain of Thought Monitorability: A New and Fragile Opportunity

Research question

Why is chain-of-thought monitoring valuable and what could destroy it?

Key findings

Reasoning in natural language creates a monitorable channel for detecting misbehaviour - Monitorability could be eroded by RL pressure, process supervision, architecture changes and indirect optimisation; developers should track it

Sources

arxiv.orghttps://arxiv.org/abs/2507.11473

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.

Submit research Report a correction or request removal

Related in Research Paper Library

Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety

A cross-lab position paper arguing that models which reason in natural language give defenders a monitoring channel that catches misbehaviour before it acts, and that this channel is fragile and must be protected in…

Chain-of-thought monitoring and faithfulness2025

Reasoning Models Don't Always Say What They Think

Measured chain-of-thought faithfulness in reasoning models, finding that visible reasoning often omits the factors driving answers.

Chain-of-thought monitoring and faithfulness2025

Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation

OpenAI's finding that chain-of-thought monitoring works but that optimising against it teaches models to obfuscate, the empirical basis for preserving monitorable reasoning.

Chain-of-thought monitoring and faithfulness2025