Abstract: A data storage system and associated method are provided wherein a policy engine continuously collects qualitative information about a network load to the data storage system in order to dynamically characterize the load and continuously correlates the load characterization to the content of a command queue of transfer requests for writeback commands and host read commands, selectively limiting the content with respect to writeback commands to only those transfer requests for writeback data that are selected on a physical zone basis of a plurality of predefined physical zones of a storage media.

Abstract: Apparatus and method for aggregating storage elements. In accordance with various embodiments, a virtual storage space is formed across a plurality of storage elements each comprising an array of data storage devices. A virtual controller comprises a first storage element aggregator (SEA) configured to issue a first command to a selected storage element in response to receipt by the first SEA of a first host command. The virtual controller further comprises a second SEA configured to concurrently issue a second command to the selected storage element in response to receipt by the second SEA of a second host command.

Abstract: A data storage system and associated method are provided wherein a policy engine continuously collects qualitative information about a network load to the data storage system in order to dynamically characterize the load and continuously correlates the load characterization to the content of a command queue of transfer requests for writeback commands and host read commands, selectively limiting the content with respect to writeback commands to only those transfer requests for writeback data that are selected on a physical zone basis of a plurality of predefined physical zones of a storage media.

Abstract: A data storage system and associated method are provided wherein a policy engine continuously collects qualitative information about a network load to the data storage system in order to dynamically characterize the load and continuously correlates the load characterization to the content of a command queue of transfer requests for writeback commands and host read commands, selectively limiting the content with respect to writeback commands to only those transfer requests for writeback data that are selected on a physical zone basis of a plurality of predefined physical zones of a storage media.

Abstract: Apparatus and method for arranging a virtual storage space with a cyclical wrapping grid function. The virtual storage space is formed from a physical memory and comprises a plurality of larger grains of selected storage capacity, each divided into a power of two number of smaller grains. Each of the larger grains are distributed across a non-power of two number of storage elements so that each of the storage elements receives the same number of smaller grains.

Abstract: Apparatus and associated methodology involving use of a multiple-core processor. A reserved hard allocation of resources partition (HARP) dedicates physical resources for operably supporting a first processing function. The dedicated resources of the reserved HARP include a reserved physical memory that is sized in relation to data processing requirements of the first processing function. The dedicated resources of the first HARP also include a command buffer residing in the reserved physical memory. The dedicated resources of the first HARP also include a reserved physical core of the multiple core processor. The apparatus also includes a second HARP having resources that are used for operably supporting a different second processing function. The second HARP resources operably put transaction requests from the second processing function to the command buffer in the first HARP.

Abstract: An atomic write descriptor associated with stripe buffer list metadata.

Abstract: As apparatus and associated method for a dual active-active array storage system with a first controller with top level control of a first memory space and a second controller with top level control of a second memory space different than the first memory space. A seek manager residing in only one of the controllers defines individual command profiles derived from a combined list of data transfer requests from both controllers. A policy engine continuously collects qualitative information about a network load to both controllers to dynamically characterize the load, and governs the seek manager to continuously correlate each command profile in relation to the load characterization.

Abstract: A data storage system and associated method comprising system configuration information; a first processor adapted for identifying a portion of the system configuration information in response to a configuration change request to the memory space, and for signaling an update request incident with the configuration change request to a second processor; and a second processor adapted for updating the portion in response to the update request and independently of the first processor.

Abstract: A generic storage container system is provided for a grid-based storage architecture, comprising a generic storage container comprising a plurality of storage domains along one axis against a plurality of rows of stripes along another axis defining a preselected storage capacity, and configuration information allocating the stripes in response to a storage format specified by an allocation request. A method is provided for storing the data, comprising: providing the generic storage container; providing configuration information adapted for selectively allocating the stripes in relation to a data storage format; specifying a desired storage format; and allocating the stripes in response to the desired format.

Abstract: Apparatus and associated method that stores first metadata only at the same addressable storage location of a computer readable medium as that where associated first user data is stored, and afterward satisfies a read request for the first user data by retrieving the first user data from the addressable location of the computer readable medium where the first metadata is stored if the first metadata has a first value, and by reconstructing the first user data from other metadata stored at another addressable location of the computer readable medium than where the first metadata is stored if the first metadata has a second value.

Abstract: Apparatus and method for highly efficient data queries. In accordance with various embodiments, a data structure is provided in a memory space with a first portion characterized as a virtual data space storing non-sequential entries and a second portion characterized as a first data array of sequential entries. At least a first sequential entry of the data array points to a skip list, at least a second sequential entry of the data array points to a second data array, and at least a third sequential entry points to a selected non-sequential entry in the first portion.

Abstract: An apparatus and associated method are provided for performing a storage transaction associated with a network I/O command by employing an ASIC having an interconnect selectively coupling a plurality of dedicated purpose function controllers in the ASIC to a policy processor via a list manager in the ASIC communicating on a peripheral device bus to which the policy processor is connected.

Abstract: A data storage system and associated method implement a HASTE with a policy engine that continuously collects qualitative information about a network load to the data storage system in order to dynamically characterize the load, and continuously correlates a command profile to a data storage device of the data storage system in relation to the characterization.

Abstract: Apparatus and method for command queue management of back watered requests. A selected request is released from a command queue, and further release of requests from the queue is interrupted when a total number of subsequently completed requests reaches a predetermined threshold.

Abstract: Apparatus and method for efficiently arranging and searching data in a memory space, such as a cache memory of a data storage array controller. A data structure comprises a skip list of nodes having an array of forward pointers. Each node has a node level derived from an index at which the node is stored in a table in the memory space. The total available number of nodes is preferably selected to be less than half of the largest power of 2 that can be expressed by a number of bits of the index, and the nodes are preferably stored at only even or only odd indices of the table. In such case, a free list of nodes is preferably generated from an array of pairs of counts and indices to identify the available nodes. Additional table structures can further be provided to enhance data arrangement and searching functions.

Abstract: A data storage system and associated method is provided within an enclosure supporting a self-contained plurality of discrete data storage devices configured for connecting with a network device via a network. The data storage system includes a redundant array of independent drives (RAID) container services module in the enclosure that allocates and manages a storage space of the data storage devices for storing primary and redundant data, and a policy engine in the enclosure that continuously and qualitatively characterizes the network load to the data storage system and manages a power distribution to each of the data storage devices based on a predicted utilization that differentiates between access commands for primary data and access commands for redundant data.

Abstract: A data storage system and associated method are provided wherein a policy engine continuously collects qualitative information about a network load to the data storage system in order to dynamically characterize the load and continuously correlates the load characterization to a command queue depth of data transfer requests.

Abstract: A dual ported active-active array controller apparatus is provided having a first policy processor partnered with a first ISP having a first plurality of dedicated purpose FCs, a second policy processor partnered with a second ISP having a second plurality of dedicated purpose FCs, a communication bus interconnecting the ISPs, and programming instructions stored in memory and executed by the array controller to maintain the first policy processor in top level control of transaction requests from both the first plurality of FCs and the second plurality of FCs that are associated with network input/output (I/O) commands directed to a storage logical unit number (LUN) which the first ISP is a logical unit master of.

Abstract: A storage system is provided with an ASIC having an interconnect selectively coupling a plurality of dedicated purpose function controllers in the ASIC to a policy processor, via a list manager in the ASIC communicating on a peripheral device bus to which the policy processor is connected, and an event ring buffer to which all transaction requests from each of the plurality of function controllers to the policy processor are collectively posted in real time.