LSTM is dead. Long Live Transformers!
Seattle Applied Deep Learning · 28:48 · Watch on YouTube
Transformers represent a ~12-month-old sea change in NLP that fixes LSTMs' training and transfer-learning failures with parallelizable multi-headed attention plus positional encoding, enabling reusable pre-trained mod...