RLHF Training Pipeline

Medium

llms Anthropic OpenAI DeepMind

What are the three main stages of the RLHF (Reinforcement Learning from Human Feedback) pipeline?

Multiple Choice

Pre-training, tokenization, and deployment Data collection, model pruning, and quantization Supervised fine-tuning, reward model training on human preferences, and RL-based policy optimization Embedding training, attention training, and feedforward training

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations

RLHF Training Pipeline

Multiple Choice

Related problems

Deep-dive guides