Description
nanochat is a minimalist, full-stack implementation of a ChatGPT-style large language model built to be accessible and hackable. The repository combines all phases—tokenization, pretraining, fine-tuning, evaluation, inference, and a simple web UI—into a clean, dependency-light codebase. Karpathy designed it so that with a single script (e.g. speedrun.sh), one can train a conversational model on an 8× H100 node for about four hours (costing ~$100) and immediately interact with it via the web.
