Performance optimization

Performance optimization is a common topic in system design interviews. We will cover two areas to improve. First, a multi-datacenter setup is crucial for a rate limiter because latency is high for users located far away from the data center. Most cloud service providers build many edge server locations around the world. For example, as of 5/20 2020, Cloudflare has 194 geographically distributed edge servers. Traffic is automatically routed to the closest edge server to reduce latency.

Synchronize data with an eventual consistency model.