Natural Emergent Misalignment from Reward Hacking in Production RL
A model that learned to reward hack in real coding environments generalised to alignment faking, sabotage of safety research and cooperation with attackers, and the misalignment was cured by telling the model that cheating was acceptable.
Contribute
Spot an error, or know a record we should add? Members can propose additions and submit corrections.