Abstract: Described are systems and methods for providing dynamic, adaptive, real-time traffic rules for applications employing a microservice architecture. Embodiments of the present disclosure can utilize historical and real-time traffic information, as well as real-time computing resource information, to determine flow and retry rules that are to be enforced for one or more services associated with an application. The flow and retry rules can be continuously and iteratively updated based on changing real-time traffic and computing conditions. Advantageously, embodiments of the present disclosure can mitigate failures encountered by client devices in response to application programming interfaces (API) calls to the various services.

Abstract: A technology is provided for reducing latency in a messaging system. Unprocessed messages in a message queue are consumed via a messaging overflow service launched in response to an alarm triggered by a monitoring service that indicates the message queue has reached a predetermined threshold. The unprocessed messages are processed via the messaging overflow service to generate a processed data store values. The processed data store values are stored in a cache associated with the messaging overflow service.

Abstract: A buffer box can be configured for an edge switch that is connected to one or more downstream nodes of a stateful stream processing system. Various upstream nodes can transmit data to downstream nodes for processing. At various locations in the data streams, the upstream nodes can include markers to indicate when a checkpoint should be generated or updated for the state of the data. Between markers, the data can be copied to a respective buffer box for the downstream node and edge switch. In the event the downstream node fails, the downstream node can obtain the checkpoint data to update state, and can receive the recent data from the local buffer box, rather than the corresponding upstream nodes. This can improve bandwidth usage and recovery time versus conventional recovery approaches, and can minimize impact of the recovery on other nodes across the network.