Abstract: Described are tiered data storage systems and methods for distributing data into high performance and low performance tiers based on an estimation of the frequency of use. Probabilistic data structures such as counting bloom filters may be used to provide a frequency of use estimation. However, the size of the probabilistic data structure may not be appropriate for all workloads. Accordingly, the size of probabilistic data structures can be dynamically adjusted based on workload, thus ensuring that the probabilistic data structure is large enough to be effective in frequency of use estimations, but not so large as to result in excess memory overhead. The efficiency of the probabilistic data structure may be determined by changes in request pattern as indicated by a unique virtual block address (VBA) ratio, as well as changes in block request hit rate.

Abstract: The technology disclosed herein provides a method including receiving a plurality of video frames, monitoring inter-frame compression ratio (IPCR) in the plurality of video frames, and in response to determining that the IPCR of a frame is below a threshold, increasing the resolution level of recording of the plurality of video frames.