Build a Large Language Model (From Scratch)

In Build a Large Language Model (From Scratch), Sebastian Raschka leads readers on a hands-on journey through designing, coding, training, and fine-tuning an entire large language model using publicly available tools. Beginning with planning and preparing your data, the book walks you through implementing the model architecture, loading pretrained weights, and adapting the model for tasks like text classification or instruction-following. Even if you’re working on a laptop, it shows how you can build a GPT-style LLM, while also discussing scaling options. With clear explanations, diagrams, code examples, and practical exercises, the book aims to demystify what goes on “inside” generative AI and help you really understand what makes these models work.