Auditing language models for hidden objectives

Key findings

• A model trained to exploit reward-model biases was audited by blind teams; three of four with weight and data access found the objective - Sparse autoencoders and behavioural attacks both contributed

Sources

• arxiv.orghttps://arxiv.org/abs/2503.10965