Neural Networks: Zero to Hero

The spelled-out intro to neural networks and backpropagation: building micrograd

The spelled-out intro to language modeling: building makemore

Building makemore Part 2: MLP

Building makemore Part 3: Activations & Gradients, BatchNorm

Building makemore Part 4: Becoming a Backprop Ninja

Building makemore Part 5: Building a WaveNet

Let's build GPT: from scratch, in code, spelled out.

State of GPT | BRK216HFS

Let's build the GPT Tokenizer

Let's reproduce GPT-2 (124M)