HackerTube / Video

Attention in transformers, step-by-step | Deep Learning Chapter 6

3Blue1Brown

Attention in transformers, step-by-step | Deep Learning Chapter 6

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

HN treats it as the go-to visual explanation of attention, recommended to people who find text-based transformer explainers hard to follow.

8 Hacker News mentions · 2024–2026

Topics

Watch on YouTube

Explore more videos