HackerTube / Video

Large Language Models from scratch

Graphics in 5 Minutes

Large Language Models from scratch

A short cartoon explaining how language models like ChatGPT work, from autocomplete and conditional probabilities to neural networks, gradient descent and backpropagation. It shows how networks act as universal function approximators.

HN recommends it as a quick, non-dumbed-down way to get up to speed on how LLMs are built.

5 Hacker News mentions · 2023–2024

Topics

Watch on YouTube

Explore more videos