From GPT-2 to Kimi K3: The Journey of 22,580 Models in One
From GPT-2 to Kimi K3: Discover how AI architecture evolved from 124M to 2.8T parameters. Learn about attention mechanisms, KV cache, DeltaNet, MoE, and the innovations that made 22,580 models fit into one. Perfect for developers and AI enthusiasts.
Written by
Learning | Exploring | Currently working in Genpact as Lead Associate- EUC
I'm a 2024 Computer Science Undergrad from SRM University, specialising in AI&Data Science. Currently working at Genpact as a Lead Associate – EUC, and passionately learning AI, NLP, and ML, while building full stack projects to sharpen my skills. I enjoy reading and writing tech blogs and stay driven by a constant curiosity for all things tech.
Responses
Markdown supported · ⌘↵ to post
No responses yet.