Nimendra's Notes 🪴

Home

❯

00.Fleeting Notes

❯

AI-LLM

❯

Hands-on Large Language Models

❯

Decoder-Only Transformers (GPT)

Decoder-Only Transformers (GPT)


Backlinks

  • 1. An Introduction to LLM
  • Encoder-Only Transformers (BERT)
  • Hands-on Large Language Models
  • 1. Original Transformer: where the decoder gets its input
  • 2. What GPT does instead
  • 3. Worked example
  • 4. What “decoder” means in GPT
  • 5. How GPT understands the prompt
  • 6. Input and output are the same sequence
  • 7. Specs side by side
  • 8. The three families

Graph View

Created with Quartz v5.0.0 © 2026

  • Blog
  • GitHub
  • X(Twitter)