MKMayank Kulkarniinmayankmk03.hashnode.dev·Jul 21 · 6 min readWhy is SGLang booming if vLLM already exists?If one tool already made serving open-source models efficient, why would anyone build a second one? That's the question you might be pondering upon. So let's find out. A while back, I wrote about a to00
MKMayank Kulkarniinmayankmk03.hashnode.dev·Jul 9 · 11 min readvLLM Solved the Wrong Bottleneck… and That's Why It WonImagine spending thousands of dollars every month on GPUs, only to discover they're sitting idle for a significant portion of the time. Strange, right? Surely the first thought would be: The transform11K
MKMayank Kulkarniinmayankmk03.hashnode.dev·Jul 9 · 8 min readIf vLLM already solved LLM serving, why did SGLang appear?After the launch of ChatGPT and open-source models in 2022–2023, lots of companies tried hosting models on GPU infrastructure, but they encountered issues like GPU idle time and computational bottlene00
