---
title: "Reinforcement Learning from Human Feedback (RLHF)"
description: "Reinforcement Learning from Human Feedback (RLHF) is a post-training method that uses human preferences to improve a model's behavior. It is commonly applied when desired qualities such as helpfulness, relevance, or safety are difficult to specify with a deterministic reward function."
canonical_url: "https://promptmetheus.com/resources/llm-knowledge-base/reinforcement-learning"
---

> Index of every page on this site: [llms.txt](https://promptmetheus.com/llms.txt)

Reinforcement Learning from Human Feedback (RLHF) is a post-training method that uses human preferences to improve a model's behavior. It is commonly applied when desired qualities such as helpfulness, relevance, or safety are difficult to specify with a deterministic [reward function](https://promptmetheus.com/resources/llm-knowledge-base/reward-function).

A typical RLHF pipeline includes:

1. collecting human comparisons or ratings of model outputs;
2. training a reward model to predict those preferences; and
3. optimizing the language model against that reward while limiting divergence from a reference policy.

RLHF is used in [Generative AI](https://promptmetheus.com/resources/llm-knowledge-base/generative-ai) to make model behavior better match intended user and developer preferences. The result depends on the quality, diversity, and instructions given to human annotators. Preference data can encode inconsistent standards or demographic and cultural biases.

RLHF is distinct from [Reinforcement Learning with Verifiable Rewards (RLVR)](https://promptmetheus.com/resources/llm-knowledge-base/reinforcement-learning-with-verifiable-rewards-rlvr), which computes rewards with an automatic verifier for tasks such as mathematics or code. Policy-optimization algorithms used in language-model training include [Proximal Policy Optimization (PPO)](https://promptmetheus.com/resources/llm-knowledge-base/proximal-policy-optimization-ppo) and [Group Relative Policy Optimization (GRPO)](https://promptmetheus.com/resources/llm-knowledge-base/group-relative-policy-optimization-grpo).

Optimizing a learned reward does not guarantee the intended behavior. A policy can exploit reward-model weaknesses, become excessively cautious, or sacrifice response diversity. Independent [evaluation](https://promptmetheus.com/resources/llm-knowledge-base/evaluation) remains necessary after training.

## Sitemap

See the full [sitemap](https://promptmetheus.com/sitemap.md) for all pages.