Deep Dive into LLMs like ChatGPT

Name: Deep Dive into LLMs like ChatGPT
Description: Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

Andrej Karpathy

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

HN's most frequent recommendation for a clear, approachable foundation in how LLMs work without heavy math.

18 Hacker News mentions · 2025–2026

Topics

LLMs & generative AI
Machine learning & deep learning

Watch on YouTube

Explore more videos