LLM architecture (part 1): Tokenization, Embeddings, and Attention

In the first article, I shared why I decided to build a GPT-style model from scratch and what I ultimately built. In this article, I want to open that box and look at the first set of building blocks