Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives a query for data from a client device. The program further generates a key based on the query for the data. The program also selects a cache service instance in a plurality of cache service instances. The program further sends the cache service instance the key and a request for a cached version of the data. The program also receives the cached version of the data from the cache service instance. The program further processes the query based on the cached version of the data. The program also sends a result set for the query to the client device.

Abstract: In one embodiment, a method uses a first probabilistic data structure to determine whether queries have been previously received during a first time period. Data from a first storage device is retrieved to satisfy a query and stored in a second storage device when information in the first probabilistic data structure indicates the query is repeated. Within the first time period, the method trains a second probabilistic data structure while the first probabilistic data structure is being used to determine whether queries have been previously received. Information in the second probabilistic data structure is set for the queries to indicate the second set of queries have been received. Upon an end of the first time period, the method replaces the first probabilistic data structure with the second probabilistic data structure. The second probabilistic data structure is used to determine whether queries have been previously received for a second time period.

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives a query for data from a client device. The program further generates a key based on the query for the data. The program also selects a cache service instance in a plurality of cache service instances. The program further sends the cache service instance the key and a request for a cached version of the data. The program also receives the cached version of the data from the cache service instance. The program further processes the query based on the cached version of the data. The program also sends a result set for the query to the client device.