@sachinrajput
About
I build and measure LLM inference systems: latency, throughput and cost per token for production LLMs. 15 years of low-latency systems, 13 LLM systems in production. I write about what really happens inside the machine, with code you can run. Main blog: https://blog.sachinrajput.dev
Available for
Conversations on LLM inference, serving cost and latency, and GPU benchmarking. Connect on LinkedIn or email hello@sachinrajput.dev.