Understanding P95 and P99 Latency in Production Systems

Most production systems look healthy when we only monitor average latency. But in real-world distributed systems, averages often hide the actual user experience. A backend service may show an average