Research question
Do hidden states encode whether a generated statement is true?
Key findings
- A classifier on hidden activations predicts statement truth with 71-83% accuracy - Works for statements the model itself generates
Showed that activation probes can detect false statements, a basis for hallucination and lie detectors.
Do hidden states encode whether a generated statement is true?
Spot an error, or know a record we should add? Members can propose additions and submit corrections.