API Gateway and Load Balancing — How Requests Actually Reach Your Services

When I was designing my platform's backend, one question kept coming up — if I have multiple services running, how does a request from the client know where to go? And if one service has multiple inst