What is RLHF?
Reinforcement Learning from Human Feedback (RLHF) is a training method that aligns a model with human preferences by having people rate outputs and using those ratings to fine-tune behaviour. It is how modern assistants learn to be helpful and safe.
RLHF is a key step that turns a raw next-token predictor into a usable assistant — teaching it to follow instructions, refuse unsafe requests and match a preferred style. Most teams consume already-aligned foundation models rather than running RLHF themselves.