Distinguished Seminar in Optimization & Data: Santosh Vempala (Georgia Tech)
Paul G. Allen School · 53:50 · Watch on YouTube
Language models hallucinate because pre-training to maximize log-likelihood mathematically forces calibration to the training distribution, so on unseen arbitrary facts they must generate at the missing-data rate; pos...