Build a Large Language Model (From Scratch) (MEAP V01) Chapters 1 and 2

✍ Scribed by Sebastian Raschka

• Publisher: Manning Publications
• Year: 2023
• Tongue: English
• Category: Library

✦ Synopsis

Build a Large Language Model (from Scratch) is a one-of-a-kind guide to building your own working LLM. In it, machine learning expert and author Sebastian Raschka reveals how LLMs work under the hood, tearing the lid off the Generative AI black box. The book is filled with practical insights into constructing LLMs, including building a data loading pipeline, assembling their internal building blocks, and finetuning techniques. As you go, you’ll gradually turn your base model into a text classifier tool, and a chatbot that follows your conversational instructions. Learn how to create, train, and tweak large language models (LLMs) by building one from the ground up! Build a Large Language Model (from Scratch) teaches you how to: Plan and code all the parts of an LLM Prepare a dataset suitable for LLM training Finetune LLMs for text classification and with your own data Use human feedback to ensure your LLM follows instructions Load pretrained weights into an LLM.