[Day 66] Starting Build a LLM from scratch by Sebastian Raschka
Hello :) Today is Day 66! A quick summary of today, covered the below chapters from the title book: Chapter 1: Understanding LLMs Chapter 2: Working with text data I am in a discord server called DS/ML book club, and one of the organisers is Sophia Yang from MistralAI and I saw she posted about the server reading this book called Build a Large Language Model (From Scratch) by Sebastian Raschka (it is still being written but half of the chapters are available for purchase). Given I just completed a very comprehensive NLP course by Stanford Uni, this felt a good next stop - to test my knowledge and understanding of language models and how they work. So, below is an intro to the book, quick summary of chapter 1, and then a bit more in depth for chapter 2. The perhaps a bit more interesting part is Chapter 2 (available upon purchase) The book goes over the life of a LLM The content follows the below diagram but not all content is written. Understanding LLMs Worki...