HackerTube / Video
LSTM is dead. Long Live Transformers!
Seattle Applied Deep Learning
Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into multi-headed self-attention and positional encoding, with sample code.
Recommended as a clear explanation of why RNNs fall short and how transformers solve it.
5 Hacker News mentions · 2020–2023