Abstract: A hierarchical compression tester and associated method employs a grid-based storage capacity wherein a storage unit is defined by a grouping of data blocks. Each data block is stored in one of a plurality of storage devices. Each stored data block has a data portion and a data integrity field (DIF) including a data reliability qualifier (DRQ) indicating whether the respective data portion is valid. The tester also has a logical device allocation map that includes a storage unit descriptor array that identifies one or more storage units corresponding to a selected logical address. The logical device allocation map has a DIF array that identifies whether any of the data blocks in the one or more storage units corresponding to the selected logical address includes invalid data.

Abstract: Method and apparatus for application profiling in a multi-device data storage array. In accordance with various embodiments, a storage array is formed of independent data storage devices that form a fast pool and a slow pool of said devices, such as solid-state drives (SSDs) and hard disc drives (HDDs). A controller is adapted to migrate a distributed data set stored across a first plurality of the devices in the slow pool to a second plurality of said devices in the fast pool. The controller carries out the migration responsive to a hint that a selected application is about to be executed that utilizes the distributed data set, and responsive to a return on investment (ROI) determination that an estimated cost of said migration will be outweighed by an overall improved data transfer capacity of the storage array over a predetermined minimum payback period of time.

Abstract: Method and apparatus for managing data in a multi-device data storage array. In accordance with various embodiments, a storage array of independent data storage devices are arranged to form a fast pool and a slow pool of said devices. A controller is adapted to migrate a distributed data set stored across a first plurality of said devices in the slow pool to a second plurality of said devices in the fast pool. The migration is carried out responsive to a return on investment (ROI) determination by the controller that an estimated cost of said migration will be outweighed by an overall improved data transfer capacity of the storage array over a predetermined minimum payback period of time. In some embodiments, the fast pool is formed from a plurality of solid-state drives (SSDs) and the slow pool is formed from a plurality of hard disc drives (HDD).

Abstract: Method and apparatus for application profiling in a multi-device data storage array. In accordance with various embodiments, a storage array is formed of independent data storage devices that form a fast pool and a slow pool of said devices, such as solid-state drives (SSDs) and hard disc drives (HDDs). A controller is adapted to migrate a distributed data set stored across a first plurality of the devices in the slow pool to a second plurality of said devices in the fast pool. The controller carries out the migration responsive to a hint that a selected application is about to be executed that utilizes the distributed data set, and responsive to a return on investment (ROI) determination that an estimated cost of said migration will be outweighed by an overall improved data transfer capacity of the storage array over a predetermined minimum payback period of time.

Abstract: A hierarchical compression tester and associated method stored in a computer readable medium employs a grid-based storage capacity wherein a storage unit is defined by a grouping of data blocks. Each data block is stored in one of a plurality of storage devices. Each stored data block has a data portion and a data integrity field (DIF) including a data reliability qualifier (DRQ) indicating whether the respective data portion is valid. The tester also has a logical device allocation map that includes a storage unit descriptor array that identifies one or more storage units corresponding to a selected logical address. The logical device allocation map has a DIF array that identifies whether any of the data blocks in the one or more storage units corresponding to the selected logical address includes invalid data.

Abstract: Method and apparatus for managing data in a multi-device data storage array. In accordance with various embodiments, a storage array of independent data storage devices are arranged to form a fast pool and a slow pool of said devices. A controller is adapted to migrate a distributed data set stored across a first plurality of said devices in the slow pool to a second plurality of said devices in the fast pool. The migration is carried out responsive to a return on investment (ROI) determination by the controller that an estimated cost of said migration will be outweighed by an overall improved data transfer capacity of the storage array over a predetermined minimum payback period of time. In some embodiments, the fast pool is formed from a plurality of solid-state drives (SSDs) and the slow pool is formed from a plurality of hard disc drives (HDD).

Abstract: A speed and memory control system and method for use with a sort accelerator having a rebound sorter and merger is disclosed. The speed and memory control system includes a variable length shift register which utilizes circulating RAM indexing, tag extraction lookahead features to speed up access of records, and merge lookahead and memory management features to provide quick and effective storage of records.