Stanford CME295 Transformers & LLMs | Autumn 2026 | Lecture 4 - Reinforcement Learning with LLMs
0:00 · Watch on YouTube
CME 295’s fourth lecture derives how reinforcement learning turns an already pretrained and supervised-fine-tuned LLM into a policy that maximizes rewards, then shows why raw policy gradients fail and how PPO, GRPO, a...