What is rate limiting in System Design?

Rate limiting controls how many requests a caller can make within a defined policy or time window. In practice, the value of this concept comes from understanding where it belongs in the architecture, what problem it solves, and what constraints or tradeoffs it introduces.