Series

LLM Architecture: GPT-2

The fundamentals every model since has inherited.

Chapters

8 of 8
  1. 01LLM Tokenization2 min
  2. 02From Raw Text to LLM Training Data6 min
  3. 03Layer Normalization3 min
  4. 04Attention, Step by Step9 min
  5. 05Dropout4 min
  6. 06Shortcut Connections4 min
  7. 07Feed-Forward Network4 min
  8. 08Output Layer3 min

Search

Search pages, articles, and resources