
Building a Transformer from Scratch, Part 2
Final-year CSE (AI/ML) student · building language models from scratch
I’m Yash, a final-year Computer Science student specializing in AI and ML. I like understanding how things work underneath, so I built a GPT-style transformer from scratch, tokenizer included, and trained it at 110M and 336M parameters. I write about what I learn along the way. Interested in NLP, LLMs, interpretability and healthcare AI.
Markdown supported · ⌘↵ to post
No responses yet.