#tokeniser

I built the algorithm behind ChatGPT from scratch — here's what I learned

How I built a bilingual BPE tokenizer in pure Python — no ML libraries, trained on 1GB of English + Hindi text. Here's what I learned.