LLM Inference GPU Sizing: How to Choose the Right GPU for Your Model and Traffic

When developers scale LLM workloads to production, one question always comes up: which GPUs should I use, how many will I need, and how much is this going to cost me? Not a back-of-the-envelope guess