Attention Is All You Need
Yannic Kilcher · 27:06 · Watch on YouTube
The paper argues you can drop recurrence entirely for seq-to-seq translation and do everything with attention: encode the full source and already-generated target at once, then use queries to directly pull relevant in...