Abstract: To provide enhanced operation of data storage devices and systems, various systems, apparatuses, methods, and software are provided herein. In a first example, a data storage device accumulates write data into a cache storage region prior to committing into an archive storage region and maintains a data structure that tracks the write data in the cache storage region. Responsive to receiving first write data into the cache storage region, the data storage device establishes first tracking elements in the data structure for the first write data in the cache storage region. Responsive to receiving second write data directed to storage locations overlapping the first write data, the data storage device accepts the second write data into the cache storage region and establishes second tracking elements in the data structure for the second write data in the cache storage region without modifying the first tracking elements.

Abstract: A data storage array is presented that includes a plurality of storage drives each comprising storage media with a first storage region and a shingled magnetic recording (SMR) storage region. The data storage array includes a control system communicatively coupled to the storage drives and configured to receive a write operation over a host interface for storage of write data by the data storage array. Responsive to the write operation, the control system is configured to cache the write data in first storage regions of two or more of the storage drives prior to transfer of the write data into at least an SMR storage region of a storage drive associated with the write operation.

Abstract: To provide enhanced operation of data storage devices and systems, various systems, apparatuses, methods, and software are provided herein. In a first example, a data storage device accumulates write data into a cache storage region prior to committing into an archive storage region and maintains a data structure that tracks the write data in the cache storage region. Responsive to receiving first write data into the cache storage region, the data storage device establishes first tracking elements in the data structure for the first write data in the cache storage region. Responsive to receiving second write data directed to storage locations overlapping the first write data, the data storage device accepts the second write data into the cache storage region and establishes second tracking elements in the data structure for the second write data in the cache storage region without modifying the first tracking elements.

Abstract: A data storage array is presented that includes a plurality of storage drives each comprising storage media with a first storage region and a shingled magnetic recording (SMR) storage region. The data storage array includes a control system communicatively coupled to the storage drives and configured to receive a write operation over a host interface for storage of write data by the data storage array. Responsive to the write operation, the control system is configured to cache the write data in first storage regions of two or more of the storage drives prior to transfer of the write data into at least an SMR storage region of a storage drive associated with the write operation.

Abstract: To provide enhanced operation of data storage devices and systems, various systems, apparatuses, methods, and software are provided herein. In a first example, a data storage device is presented with storage media comprising a cache storage region and a shingled magnetic recording (SMR) storage region that is divided into burst zones. A storage control system receives write operations and accumulates write data in the cache storage region until a commit threshold condition. Responsively, the storage control system transfers the write data into a burst zone of the SMR storage region, and verifies the write data written into the burst zone once the burst transfer is complete. Responsive to data verify errors in the write data written into the burst zone, the storage control system writes data associated with the data verify errors into an exception location associated with the burst zone.

Abstract: Method and apparatus for adaptive arrangement of data on storage media, such as in a multi-device storage array across which data are stored. A virtual hot space is formed to store frequently accessed data. The virtual hot space comprises at least one hot data zone which extends across storage media of a plurality of arrayed storage devices over a selected seek range less than an overall radial width of the media. The frequently accessed data are stored to the hot data zone(s) in response to a host level request, such as from a host level operating system (OS) or by a user which identifies the data as frequently accessed data. Alternatively or additionally, access statistics are accumulated and frequently accessed data are migrated to the hot data zone(s) in relation thereto. Lower accessed data sets are further preferably migrated from the hot data zone(s) to another location of the media.

Abstract: A data storage system and associated method comprising system configuration information; a first processor adapted for identifying a portion of the system configuration information in response to a configuration change request to the memory space, and for signaling an update request incident with the configuration change request to a second processor; and a second processor adapted for updating the portion in response to the update request and independently of the first processor.

Abstract: A generic storage container system is provided for a grid-based storage architecture, comprising a generic storage container comprising a plurality of storage domains along one axis against a plurality of rows of stripes along another axis defining a preselected storage capacity, and configuration information allocating the stripes in response to a storage format specified by an allocation request. A method is provided for storing the data, comprising: providing the generic storage container; providing configuration information adapted for selectively allocating the stripes in relation to a data storage format; specifying a desired storage format; and allocating the stripes in response to the desired format.

Abstract: Apparatus and associated method that stores first metadata only at the same addressable storage location of a computer readable medium as that where associated first user data is stored, and afterward satisfies a read request for the first user data by retrieving the first user data from the addressable location of the computer readable medium where the first metadata is stored if the first metadata has a first value, and by reconstructing the first user data from other metadata stored at another addressable location of the computer readable medium than where the first metadata is stored if the first metadata has a second value.

Abstract: Apparatus and method for highly efficient data queries. In accordance with various embodiments, a data structure is provided in a memory space with a first portion characterized as a virtual data space storing non-sequential entries and a second portion characterized as a first data array of sequential entries. At least a first sequential entry of the data array points to a skip list, at least a second sequential entry of the data array points to a second data array, and at least a third sequential entry points to a selected non-sequential entry in the first portion.

Abstract: A management interface for a virtualized storage system including a virtualized logical disk object representing a virtual storage container, wherein the logical disk is an abstract representation of physical storage capacity provided by plurality of physical stores. A virtual disk object represents a virtual storage container. The virtual disk object is an abstract representation of one or more logical disk objects, the virtual disk object including an exposed management interface. Wherein the virtual disk object is managed through the management interface to select the one or more logical disk objects represented by the virtual disk object.

Abstract: An apparatus and associated method are provided for performing a storage transaction associated with a network I/O command by employing an ASIC having an interconnect selectively coupling a plurality of dedicated purpose function controllers in the ASIC to a policy processor via a list manager in the ASIC communicating on a peripheral device bus to which the policy processor is connected.

Abstract: Apparatus and associated method that stores first metadata only at the same addressable storage location of a computer readable medium as that where associated first user data is stored, and afterward satisfies a read request for the first user data by retrieving the first user data from the addressable location of the computer readable medium where the first metadata is stored if the first metadata has a first value, and by reconstructing the first user data from other metadata stored at another addressable location of the computer readable medium than where the first metadata is stored if the first metadata has a second value.

Abstract: Metadata architecture and associated methodology for a data storage system employing a grid-based storage capacity wherein each grid defines a storage unit in terms of a plurality of storage domains along one axis against one or more rows of a plurality of storage stripes along another axis, and wherein a grid grouping of two or more grids defines a sheet of data storage capacity. The metadata comprises identification information stored in a memory space characterizing an allocation status of the sheets in the storage capacity. A method is provided for allocating memory for the grid-based storage capacity comprising determining whether the allocation is associated with an existing logical device. If the determining step is associated with an existing logical device, then a logical device allocation map and a sheet allocation table are accessed to allocate a selected storage unit. Otherwise, a sheet allocation descriptor and a sheet allocation map are accessed to allocate a selected storage unit.

Abstract: An apparatus and associated method are provided for performing a storage transaction associated with a network I/O command by employing an ASIC having an interconnect selectively coupling a plurality of dedicated purpose function controllers in the ASIC to a policy processor via a list manager in the ASIC communicating on a peripheral device bus to which the policy processor is connected.

Abstract: A system and method for high performance multi-controller processing is disclosed. Independent Network storage controllers (NSCs) are connected by a high-speed data link. The NSCs control a plurality of storage devices. connected by a Fiber Channel Arbitrated Loop (FCAL). To provide redundancy, for a given logical unit of storage one NSC will function as the primary controller and the other NSC will function as the primary controller and the enhance the efficiency of command-response data transfers between NSCs, mirror memory is correlated with primary memory and named resources are used for command-response data transfers. Methods are disclosed to provide for efficient active mirroring of data.

Abstract: Apparatus and method for highly efficient data queries. In accordance with various embodiments, a data structure is provided in a memory space with a first portion characterized as a virtual data space storing non-sequential entries and a second portion characterized as a first data array of sequential entries. At least a first sequential entry of the data array points to a skip list, at least a second sequential entry of the data array points to a second data array, and at least a third sequential entry points to a selected non-sequential entry in the first portion.

Abstract: Apparatus and method for accessing a virtual storage space. The space is arranged across a plurality of storage elements, and a skip list is used to map as individual nodes each of a plurality of non-overlapping ranges of virtual block addresses of the virtual storage space from a selected storage element.

Abstract: A directory structure for a sparsely filled data container comprises a linked list, doubly linked list, skip list, or other non-fully populated list technique. One or more hierarchical levels of such lists may be used for sparsely filled directories. The directory structure may be converted to a conventional look-up table directory by reconstructing the directory when the directory becomes populated to certain point.

Abstract: Method and apparatus for performing distributed processing in a multi-processing unit environment. A first processing unit modifies a complex operation to provide an operational request packet comprising a corresponding simplex operation and remainder. The packet is communicated to a second processing unit which processes the packet to arrive at a result for the complex operation, preferably by arriving at a result for the simplex operation and combining this result with the remainder. In this way, inter-processor operations can be efficiently encoded and distributed to meet the requirements of a given architecture. Preferably, the first processing unit determines the remainder by separately arriving at the result for the complex operation. The complex operation is preferably characterized as a mathematical operation on a non-power of two operand (e.g., 30), and the simplex operation is characterized as a mathematical operation on a power of two operand (e.g., 32).