Designing a Rate Limiter: Token Bucket vs Sliding Window, and Making It Distributed

Every public API eventually gets a rate limiter, and almost every first version is a counter in a hash map with a threshold check. That version works on one machine, in one process, in a demo. It stop