Next-Latent Prediction Transformers Learn World Models feat. Jayden Teoh from MIT
Deep Learning with Yacine · 128:14 · Watch on YouTube
Next latent prediction adds one auxiliary loss so a standard transformer’s final hidden state must predict the next hidden state, pushing it to store a compact belief about the future while leaving inference as ordina...