Building a GPT Model From Scratch: Tokenization, Embeddings, and Attention
In the first article, I shared why I decided to build a GPT-style model from scratch and what I ultimately built. In this article, I want to open that box and look at the first set of building blocks
curious-pm.hashnode.dev15 min read