I built the algorithm behind ChatGPT from scratch — here's what I learned
"What I cannot create, I do not understand." — Richard Feynman
That quote hit different when I was staring at my screen at 2am, watching my tokenizer learn the word "the" by merge #17.
The origin st
queued.hashnode.dev11 min read