RLHF Training Pipeline

Medium

llms Anthropic OpenAI DeepMind

Multiple Choice

Pre-training, tokenization, and deployment Data collection, model pruning, and quantization Supervised fine-tuning, reward model training on human preferences, and RL-based policy optimization Embedding training, attention training, and feedforward training

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations