AAkshay Suryawanshi·Oct 16From Replicas to FP8: My First vLLM Performance InvestigationTesting vLLM replicas, NVIDIA MPS, and FP8 KV cache and attention on one laptop GPU, measuring throughput, latency, goodput, and answer quality.10 min read·akshaysuryawanshi.hashnode.dev
