Scaling & Load Balancing

If you have a single road, the 100 cars might take 5 minutes on average to cross the road. The throughput here is 20 cars/minute and latency is 5 minutes. But if you have 5 roads, they might take only 2 minutes on average. So the throughput increased...