Abstract: A method including receiving, from a server, a backoff data packet including first information and second information. The first information includes a backoff command to cease transmitting at least some requests to a service executing on the server, and The second information includes metadata. The method also includes adding the backoff data packet to cached data stored in a cache. The method also includes receiving, from a client, a request data packet including a request for the service. The method also includes comparing request information, associated with the request data packet, to the cached data, including at least comparing the request information to the metadata. The method also includes blocking, responsive to a match between the request information and the cached data, the request data packet from being transmitted to the service.

Abstract: Systems and methods for throttling requests to web services are disclosed. A system is configured to receive, at a host, one or more requests during a first time period. Each request is for a web service hosted on a backend. The host is one of a plurality of hosts of an application programming interface (API) gateway to receive a plurality of requests for the web services. The system is further configured to: process at least a portion of the one or more requests for the one or more web services; count, by a local counter in a local cache of the host, the one or more requests received at the host during the first time period; compare a local count of the local counter to a local bucket size associated with the host; and provide an instruction to update a remote count of a remote counter based on the comparison.