Abstract: Exemplary embodiments include tracking processing time metrics of multiple server queries. A processing time per query type is estimated using the tracked processing time metrics. A current queue wait time is estimated based on a number of queries currently in the queue and the estimated processing times of query types for each of the queries currently in the queue. Upon receiving a current server query from a client, the current query type is mapped to an estimated processing time determined using the tracked processing time metrics. An estimated response time is determined using the current queue wait time and the estimated processing time. The server query is rejected from being added to the queue in response to determining the estimated response time does not satisfy a service level objective and an error message is sent to the client indicating the rejection of the server query.

Abstract: One embodiment provides a caching system comprising a hash table, a network interface for receiving a sequence of network-level packets for caching, and a caching application module for storing the sequence of network-level packets in the hash table. The sequence of network-level packets is stored its original form without de-fragmentation.

Abstract: One embodiment provides an eviction system for dynamically-sized caching comprising a non-blocking data structure for maintaining one or more data nodes. Each data node corresponds to a data item in a cache. Each data node comprises information relating to a corresponding data item. The eviction system further comprises an eviction module configured for removing a data node from the data structure, and determining whether the data node is a candidate for eviction based on information included in the data node. If the data node is not a candidate for eviction, the eviction module inserts the data node back into the data structure; otherwise the eviction module evicts the data node and a corresponding data item from the system and the cache, respectively. Data nodes of the data structure circulate through the eviction module until a candidate for eviction is determined.

Abstract: One embodiment provides an eviction system for dynamically-sized caching comprising a non-blocking data structure for maintaining one or more data nodes. Each data node corresponds to a data item in a cache. Each data node comprises information relating to a corresponding data item. The eviction system further comprises an eviction module configured for removing a data node from the data structure, and determining whether the data node is a candidate for eviction based on information included in the data node. If the data node is not a candidate for eviction, the eviction module inserts the data node back into the data structure; otherwise the eviction module evicts the data node and a corresponding data item from the system and the cache, respectively. Data nodes of the data structure circulate through the eviction module until a candidate for eviction is determined.

Abstract: One embodiment provides a caching system comprising a hash table, a network interface for receiving a sequence of network-level packets for caching, and a caching application module for storing the sequence of network-level packets in the hash table. The sequence of network-level packets is stored its original form without de-fragmentation.