Research question
Can reward hacking be defined formally, and when can proxies be made unhackable?
Key findings
- Formal definition of hackable reward pairs - Unhackable proxies are rare and require restricting the policy space
Defining and Characterizing Reward Hacking
The formal treatment of reward hacking that underpins later empirical work on specification gaming.
Contribute
Spot an error, or know a record we should add? Members can propose additions and submit corrections.