Abstract: A system determines, by a network device, a total capacity of a cache to be used by multiple applications, the cache comprising memory distributed across a plurality of compute nodes. The system allocates, of the total capacity, a cache partition for a respective application, by: determining a desired cache capacity over a current first time interval; determining an updated target hit rate based on at least a measured quality-of-service (QoS) value over a prior second time interval; and adjusting the desired cache capacity over the current first time interval based on the updated target hit rate.

Abstract: One aspect of the instant disclosure provides a cache system for a computer cluster comprising a plurality of nodes. The cache system may include a global cache distributed over a subset of nodes of the computer cluster. A respective node in the subset contributes a portion of local storage resource to the global cache and runs a cache-manager process to: receive a request for a piece of data; determine whether the requested data is present in the global cache; responsive to locating the requested data in the portion of local storage resource contributed to the global cache by a contributing node, retrieve the requested data by accessing the local storage resource of the contributing node; and respond to the request using the retrieved data.

Abstract: One aspect provides a system for dynamically adjusting capacity of a distributed global cache. A cache-manager process running on a respective node may monitor the usage of the global cache and determine whether capacity of the global cache needs adjustment based on the monitored usage. In response to determining that the global cache needs additional capacity, the system may identify a first node capable of providing the additional capacity, send an add-capacity request to the first node, and add a portion of storage resource on the first node to the global cache. In response to determining that the global cache needs to reduce capacity, the system may identify a second node that contributes to the global cache, send a reduce-capacity request to the second node, and remove, from the global cache, at least a portion of storage resource contributed by the second node.