Research question
Can a weak supervisor elicit the full capabilities of a stronger model?
Key findings
- GPT-4 supervised by GPT-2-level labels recovers much of the performance gap with an auxiliary confidence loss - Frames superalignment as weak-to-strong generalisation
