Why Inference Matters 12x More Than Training | YC Paper Club
Y Combinator · 110:48 · Watch on YouTube
Inference cost swamps training once a checkpoint is in production, and the same open weights can be cheap or unusable depending on decode efficiency, KV-cache reuse, quantization, and which provider actually serves th...