Implementation of a small GPT-style transformer from scratch in PyTorch. Learn how Large Language Models work by building, training, generating text, and visualizing attention.
-
Updated
Feb 8, 2026 - Python
Implementation of a small GPT-style transformer from scratch in PyTorch. Learn how Large Language Models work by building, training, generating text, and visualizing attention.
Add a description, image, and links to the tiny-gpt topic page so that developers can more easily learn about it.
To associate your repository with the tiny-gpt topic, visit your repo's landing page and select "manage topics."