Description
CS336 is a Stanford course taught by Tatsunori Hashimoto and Percy Liang in which students build their own language model end to end. It covers the entire development process: collecting and cleaning pre-training data, constructing the transformer, training the model, and evaluating it before deployment. The lecture videos are public on YouTube and the course materials are on the course site. One of the most thorough free paths for engineers who want to understand LLMs by building one rather than only calling an API.
