Abstract: A system can present computer storage resources as a consumer storage system, which abstracts resources as chunks in a chunkmanager, which abstracts resources in an uberstore, wherein the uberstore abstracts drives that implement a flexible data placement capability, and wherein the flexible data placement capability facilitates an effect of garbage collection that comprises deallocating data ranges that correspond to reclaim units that comprise groups of blocks. The system can, based on receiving a request to write to the consumer storage system, convert the request to the chunk manager and to the uberstore, and write data to the storage drives, comprising writing to groups of consecutive ubers of the uberstore to a same group of storage drives of the storage drives, via respective reclaim unit handles that correspond to the respective storage drives. The system can garbage collect chunks according to a chunk order and starting at an uber group boundary.

Abstract: A system can store data in a chunk domain of a log filesystem, wherein the chunk domain comprises a group of chunks. The system can, based on determining to perform an operation on the data, wherein the operation comprises modifying the storing of the data from a first redundant array of inexpensive devices configuration to a second redundant array of inexpensive devices configuration, wherein the operation comprises a tiering operation, wherein the operation comprises a re-keying operation, wherein the operation comprises a restriping operation, or wherein the operation comprises a re-encrypting operation, as part of performing forward garbage collection, moving data of the data according to the operation and based on a flexible data placement command that is supported by a storage device that stores the data after the forward garbage collection is performed.

Abstract: A system can store a first encryption key for a first data chunk of a log filesystem in a first virtual chunk extent that comprises first virtual pointers that point to the first data chunk, wherein the first data chunk is encrypted with the first encryption key. The system can, based on performing garbage collection on the first data chunk, to produce surviving data that remains from the first data chunk after the garbage collection, move the surviving data to a second data chunk, wherein the surviving data is encrypted in the second data chunk with a second encryption key, wherein the second encryption key is stored in a second virtual chunk extent corresponds to the second data chunk, and delete the first virtual chunk extent while refraining from deleting the first data chunk, wherein, after the deleting, the first encryption key is deleted.

Abstract: A system can store computer data on a cluster that comprises nodes, wherein nodes of comprise storage drives, wherein the computer data is stored as ubers, wherein respective ubers comprise complete, self-consistent redundant arrays of inexpensive drives groups, and wherein the ubers comprise slices from multiple storage drives. The system can store mappings on the nodes, wherein the mappings comprise associations between the ubers and corresponding drive allocations. The system can, based on determining to perform, by a first node, a direct input-output operation to an uber, determine that at least part of the uber is stored on a storage drive that is part of a second node of the nodes, based on a mapping of the respective mappings that is stored on the first node. The system can perform the direct input-output operation to the uber as stored on the second node and based on the mapping.

Abstract: A system can execute virtual machines (VMs) that are configured to access computer data stored on a storage cluster that comprises instance storage and persistent storage, wherein the VMs address the instance storage via a first abstraction layer that comprises chunks, and wherein the chunks are stored to the instance storage via a second abstraction layer that comprises ubers. The system can, based on being unable to allocate more chunks s in a chunk domain, wherein the chunks correspond to the ubers, identify candidate ubers of the ubers for destaging. The system can read uberlets of the candidate ubers, to produce read identified uberlets, and can compact the read identified uberlets. The system can write the compacted uberlets to the persistent storage. The system can, after the writing, allocate more chunks. The system can write to the more chunks of the chunks and from the VMs.

Abstract: Example implementations relate to preserving data availability in a constrained deployment of an HA system (e.g., an HA storage system) in the presence of pending faults. According to an example, a first arbiter, acting as a witness to facilitate maintaining quorum for the HA system, and a first node are provided within a first failure domain; and a second arbiter, serving as a backup arbiter, and a second node are provided within a second failure domain. Responsive to receipt of an indication of a pending fault impacting the first failure domain by a member of the current configuration of the HA system, establishment of a new configuration, excluding the first arbiter and including the second arbiter, is initiated. Responsive to a majority of the current configuration installing the new configuration, the second arbiter is enabled to serve as the active arbiter by transferring state information to the second arbiter.

Abstract: Example implementations relate to preserving data availability in a constrained deployment of an HA system (e.g., an HA storage system) in the presence of pending faults. According to an example, a first arbiter, acting as a witness to facilitate maintaining quorum for the HA system, and a first node are provided within a first failure domain; and a second arbiter, serving as a backup arbiter, and a second node are provided within a second failure domain. Responsive to receipt of an indication of a pending fault impacting the first failure domain by a member of the current configuration of the HA system, establishment of a new configuration, excluding the first arbiter and including the second arbiter, is initiated. Responsive to a majority of the current configuration installing the new configuration, the second arbiter is enabled to serve as the active arbiter by transferring state information to the second arbiter.

Abstract: A storage system includes data storage devices, bus conductors, and mobile reader/writer devices. Each of the storage devices is positioned between insulators, is at one of a plurality of locations on one of one or more shelf assemblies, and comprises a processor coupled to a memory and an interface device. One of the bus conductors is adjacent each of the insulators. Each of the reader/writer devices includes a transport apparatus, a processor and a memory. The transport apparatus is configured to move one of the reader/writer devices to one or more of the locations when engaged. The processor is coupled to the transport apparatus and the memory and is configured to execute machine executable code to: engage the transport apparatus to position one of the reader/writer devices to one of the locations in response to a received operation; couple power to one of the storage devices; and execute the operation.

Abstract: A storage system includes data storage devices, bus conductors, and mobile reader/writer devices. Each of the storage devices is positioned between insulators, is at one of a plurality of locations on one of one or more shelf assemblies, and comprises a processor coupled to a memory and an interface device. One of the bus conductors is adjacent each of the insulators. Each of the reader/writer devices includes a transport apparatus, a processor and a memory. The transport apparatus is configured to move one of the reader/writer devices to one or more of the locations when engaged. The processor is coupled to the transport apparatus and the memory and is configured to execute machine executable code to: engage the transport apparatus to position one of the reader/writer devices to one of the locations in response to a received operation; couple power to one of the storage devices; and execute the operation.

Abstract: A flash-based storage warehouse system includes flash memory devices and reader/writer devices that are moveable to different locations in a structure. Each of the flash memory devices are at one of the different locations in the structure. Each of the reader/writer devices includes a locomotion apparatus configured to move the corresponding one of the reader/writer devices to a different location in the structure and a processor coupled to a memory and the locomotion apparatus that is configured to execute machine executable code to: engage the locomotion apparatus to adjustably position one of reader/writer devices to one of the locations in the structure in response to a received operation; couple power via the corresponding one of the reader/writer devices to one of the flash memory devices at the one of the locations in the structure; and execute the operation on the flash memory device at the location in the structure.

Abstract: An on-disk structure of a file system has the capability to maintain snapshot and file system metadata on a storage system. The on-disk structure arranges file system data sequentially on disk within regions, wherein each region comprises a predetermined amount of disk space represented by blocks. The snapshot and file system metadata is maintained within level 1 (L1) indirect blocks of the on-disk structure. Each L1 indirect block describes (i.e., represents) a corresponding region of the on-disk structure of the file system; in the case of an active region, e.g., an L1 indirect block represents an active file data portion of a large file. The L1 indirect block that references an active region also performs file block number-to-disk block number mapping for the region.

Abstract: An on-disk structure of a file system has the capability to maintain snapshot and file system metadata on a storage system. The on-disk structure arranges file system data sequentially on disk within regions, wherein each region comprises a predetermined amount of disk space represented by blocks. The snapshot and file system metadata is maintained within level 1 (L1) indirect blocks of the on-disk structure. Each L1 indirect block describes (i.e., represents) a corresponding region of the on-disk structure of the file system; in the case of an active region, e.g., an L1 indirect block represents an active file data portion of a large file. The L1 indirect block that references an active region also performs file block number-to-disk block number mapping for the region.

Abstract: A storage server maintains a number of datasets (e.g., exported file systems or other resources). For each dataset, certain clients are allowed to have access (e.g., read access, write access, root access, etc.) and certain other clients are not allowed to have access. Access permission information is maintained to specify which clients are allowed to have access and what kind of access. A method and system are introduced to use a radix tree to store access permission information in a cache, therefore allowing the storage server to quickly retrieve access information relevant to a particular client. One advantage of using radix tree to maintain access permission information is that radix tree is very efficient at storing hierarchical information, such as IP addresses. Radix tree is also very efficient at representing subnets in particular.

Abstract: A system and method that provides users of network data storage with the ability to gain advantages of a clustered storage server system, in which volumes from multiple server nodes are linked into a virtual global hierarchical namespace, without first having to migrate their data to the clustered storage server system. The system and method extends the global namespace of the clustered storage server system to allow access to one or more volumes stored on one or more remote storage servers over at least one network pathway communicably connecting the remote storage servers and the clustered storage server system. In addition, the system and method allows loads to the clustered system and to the remote storage servers to be balanced or shared by generating at least one set of mirrored volumes accessible via the extended global namespace of the clustered system.

Abstract: A storage controller is operable concurrently as an independent storage server and as at least a portion of a node of a storage server cluster. A network storage system comprises multiple storage controllers and multiple independent storage servers, each storage server implemented in a separate storage controller, each of the storage server configured to present to users a separate system image of stored data. The storage servers are independently operable and manageable. The system further includes a storage server cluster that includes cooperating storage server nodes, distributed among the storage controllers. The storage server cluster presents to users a single system image of data stored in the server cluster independently of the node or nodes in which said data resides. The storage server cluster is operable independently of the independent storage servers and is operable concurrently with operation of at least one of the independent storage servers.

Abstract: A system and method that provides users of network data storage systems with the ability to gain the advantages of a clustered storage server system, in which volumes stored on multiple server nodes are linked into a virtual global hierarchical namespace, without first having to migrate their data to the clustered storage server system. The system employs an extended virtual global hierarchical namespace that allows client systems to access, via the extended global namespace, volumes stored on the clustered storage server system and on one or more storage servers that are remote from and do not constitute a part of the clustered system. The extended global namespace can also be employed to perform migration of volume data among the multiple nodes of the clustered storage server system and the remote storage servers.

Abstract: A system and method that provides users of network data storage systems with the ability to gain the advantages of a clustered storage server system, in which volumes stored on multiple server nodes are linked into a virtual global hierarchical namespace, without first having to migrate their data to the clustered storage server system. The system employs an extended virtual global hierarchical namespace that allows client systems to access, via the extended global namespace, volumes stored on the clustered storage server system and on one or more storage servers that are remote from and do not constitute a part of the clustered system. The extended global namespace can also be employed to perform migration of volume data among the multiple nodes of the clustered storage server system and the remote storage servers.

Abstract: A uniform and symmetric, double failure-correcting technique protects against two or fewer disk failures in a disk array of a storage system. A RAID system of the storage system generates two disks worth of “redundant” information for storage in the array, wherein the redundant information (e.g., parity) is illustratively derived from computations along both diagonal parity sets (“diagonals”) and row parity sets (“rows”). Specifically, the RAID system computes row parity along rows of the array and diagonal parity along diagonals of the array. However, the contents of the redundant (parity) information disks interact such that neither disk contains purely (solely) diagonal or row redundancy information; the redundant information is generated using diagonal parity results in row parity computations (and vice versa).

Abstract: A method for enabling recovery from concurrent failure of a plurality of storage devices in a storage array is disclosed. The method stores data on a first plurality of storage devices of the storage array. The first plurality of storage devices may have a number of storage devices equal to a prime number greater then three. Row parity is stored on one or more storage devices of the storage array. A diagonal parity set is computed for the plurality of storage devices. The diagonal parity set is stored on an additional diagonal parity device, the diagonal parity device separate from the first plurality of storage devices.

Abstract: A lightweight coherency control protocol ensures consistency of data containers, such as a file, and associated data buffers stored on one or more volumes served by a plurality of nodes, e.g., storage systems, connected as a cluster. Each data buffer is associated with a current cache sequence number comprising a load generation value and an update count value. The load generation value is incremented every time an inode of a file is loaded into a memory of the storage system. Once the inode is loaded and its load generation value is set, then the appropriate buffer of a buffer tree for the file is loaded into the memory. The update count value is incremented each time the buffer is updated with a write request/operation. Therefore, each buffer loaded into memory is tagged with the load generation value and an update count from the time that buffer is loaded.