Stanford CME295 Transformers & LLMs | Autumn 2026 | Lecture 4 - Reinforcement Learning with LLMs

0:00 · Watch on YouTube

CME 295’s fourth lecture derives how reinforcement learning turns an already pretrained and supervised-fine-tuned LLM into a policy that maximizes rewards, then shows why raw policy gradients fail and how PPO, GRPO, a...

Read the full summary on retube