Looped LLM? Recurrent Depth Transformer Explained
bycloud · 19:09 · Watch on YouTube
Chain-of-thought improves reasoning by spending test-time compute on extra tokens, but each thought has to be decoded into text, written into the context, and embedded again before the model can update its hidden stat...