HackerTube / Video

CS480/680 Lecture 19: Attention and Transformer Networks

Pascal Poupart

CS480/680 Lecture 19: Attention and Transformer Networks

A university lecture from CS480/680 by Pascal Poupart on attention mechanisms and transformer networks, worked through on a chalkboard.

HN recommends it to newcomers as a clear explanation of attention, including the query/key/value intuition.

4 Hacker News mentions · 2023–2023

Topics

  • LLMs & generative AI
  • Machine learning & deep learning
  • University lectures & courses

Watch on YouTube

Explore more videos