MKMayank Kulkarniinmayankmk03.hashnode.dev·4d ago · 11 min readvLLM Solved the Wrong Bottleneck… and That's Why It WonImagine spending thousands of dollars every month on GPUs, only to discover they're sitting idle for a significant portion of the time. Strange, right? Surely the first thought would be: The transform11K
MKMayank Kulkarniinmayankmk03.hashnode.dev·4d ago · 8 min readIf vLLM already solved LLM serving, why did SGLang appear?After the launch of ChatGPT and open-source models in 2022–2023, lots of companies tried hosting models on GPU infrastructure, but they encountered issues like GPU idle time and computational bottlene00