Deep Reinforcement Learning from Human Preferences: RLHF origin

Research question

Can agents learn complex goals from human comparisons of behaviour?

Key findings

Reward models trained on pairwise human preferences guide RL with under 1% of interactions labelled - Solves Atari and MuJoCo tasks without an explicit reward

Sources

arxiv.orghttps://arxiv.org/abs/1706.03741

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.

Submit research Report a correction or request removal

Related in Research Paper Library

HYDRA: Proactive Android Malware Drift Adaptation via Hierarchical Graph Contrastive Learning

Concept drift, driven by the rapid evolution of Android malware, severely degrades the performance of machine learning detectors. Current adaptation strategies are often reactive, responding only after performance…

Alignment and safety training2026

From Alignment to Access Control: A Framework for GenAI Policy Enforcement

Generative AI (GenAI) applications have flourished enabling users to chat with large language models, and to create agents to act on their behalf for a variety of tasks. The pace of development of capabilities in…

Alignment and safety training2026

Does Deeper Reasoning Compromise Alignment? Revealing and Mitigating of Alignment Collapse in Large Reasoning Models

The emergence of Chain-of-Thought (CoT) has established a robust foundation for Large Reasoning Models (LRMs). While deep reasoning is widely believed to enhance safety alignment, the stability of alignment…

Alignment and safety training2026