The Insane Infrastructure Design of DeepSeek V4

0:00 · Watch on YouTube

DeepSeek V4’s cheap million-token context is a full-stack result: compressed attention only works because the lab also rebuilt kernels, cache, the Muon optimizer layout, distillation, rollout recovery, and agent sandb...

Read the full summary on retube