Abstract: A storage network is operable to de-select a sequence of input encoded data slices based on de-selection information to produce deselected encoded data slices of a set of encoded data slices. At least some of the deselected encoded data slices are de-sequenced to produce a sequence of the at least a decode threshold number of encoded data slices. The sequence of the at least the decode threshold number of encoded data slices of the deselected encoded data slices is error decoded in accordance with error decoding parameters to reproduce a data segment, and the data segment is outputted to a requesting computing device of the storage network.

Abstract: A list of a available zones across respective SSD storage portions of a plurality of zoned storage devices of a storage system is maintained. Data is received from multiple sources, wherein the data is associated with processing a dataset, the dataset including multiple volumes and associated metadata. Shards of the data are determined such that each shard is capable of being written in parallel with the remaining shards. The shards are mapped to a subset of the available zones, respectively. The shards are written to the subset of the available zones in parallel.

Abstract: Volume migration among a set of storage systems synchronously replicating a dataset for a volume, where volume migration includes: initiating a transfer of the volume in dependence upon determining that a performance metric for accessing the volume stored on a first storage system would improve if transferred to a second storage system; and during the transfer of the volume: determining status information for the transfer; intercepting an I/O operation directed to the volume; and directing, in dependence upon the status information, the I/O operation to either the first storage system or the second storage system.

Abstract: A system and method comprising: receiving a request to write data stored at a first range of a first volume to a second range of a second volume, where first metadata for the first range of the first volume is associated with a range of physical addresses where the data is stored in the storage system; and responsive to receiving the request: creating second metadata for the second range of the second volume, wherein the second metadata is associated with the range of physical addresses where the data is stored in the storage system; and associating the second volume with the second metadata.

Abstract: A method is disclosed for managing transformed datasets in a compute cluster environment. The method includes identifying, based on one or more machine learning models to be executed on a compute cluster comprising a plurality of GPU servers, one or more transformations to apply to a dataset. The method further includes generating a transformed dataset based on the one or more transformations, storing the transformed dataset, receiving a request to transmit the transformed dataset to at least one GPU server of the plurality of GPU servers, and, responsive to the request, transmitting the stored transformed dataset to the at least one GPU server without re-performing the one or more transformations on the dataset.

Abstract: Fingerprint-based database container deployment, including: identifying, in dependence upon data collected from one or more storage systems in a storage environment, characteristics of a plurality of database workloads on the one or more storage systems; identifying, in dependence upon the characteristics, fingerprint information for a plurality of database workload types; and deploying, in dependence upon the fingerprint information for a particular database workload type, a database container for the particular database workload type in the storage environment.

Abstract: A storage network operates by: obtaining audit records, wherein each of the audit records indicates: a timestamp for a corresponding message, at least one event type code selected from a plurality of event type codes for a corresponding audit event of the corresponding message, and an identifier for a corresponding storage network entity associated with at least one event corresponding to the at least one event type code; generating an audit file to include a number of audit records over a period of time and integrity information; and facilitating storage of the audit file.

Abstract: One or more operations to be performed by a storage system are identified by a first storage node having a processing device and one or more authorities that determine types of erasure coding applied to data stored in the storage system. One or more instructions are transmitted to a second storage node to perform the one or more storage operations, wherein the one or more instructions cause the one or more operations to be performed by the second storage node.

Abstract: Performing disaster recovery in a cloud-based storage system, including: creating, by a storage system a snapshot of a dataset; uploading, from the storage system to a cloud computing environment, the snapshot; storing, by the cloud computing environment, the snapshot; detecting, by the cloud computing environment, that the dataset is not available on the storage system; and creating, by the cloud computing environment using the snapshot that is stored within the cloud computing environment, a cloud-based storage system that includes the dataset.

Abstract: A system, method, and product for flexible RAID layouts in a storage system, including: determining a reliability of an individual storage device of a plurality of storage devices, the individual storage device containing a plurality of portions of a Redundant Array of Independent Disks (RAID) stripe in a storage system, wherein the RAID stripe includes user data and inter-device parity data; detecting a change in the reliability of the individual storage device that contains the portion corresponding to the RAID stripe; and changing an amount of intra-device protection corresponding to the RAID stripe by decreasing, in the RAID stripe, an amount of space used to store the inter-device protection data.

Abstract: Estimates of amounts of time to transfer data to be replicated based on sizes of expected data transfers resulting from accumulated data since a previous data transfer are monitored. A determination as to whether an estimated amount of time to transfer the data exceeds an interval for replicating the data is made. The interval is determined based on a recovery point objective (RPO) for replicating the data. In response to determining that the estimated amount of time to transfer the data exceeds the interval, a subsequent interval for replicating the data is determined that satisfies the RPO.

Abstract: A processing module is operable to perform monitoring of a plurality of storage units storing a plurality of data, where a first set of data is stored via first memory of the plurality of storage units. The first memory is identified as out-of-service memory based on error rate history data. The error rate history data is utilized to identify in-service memory of the plurality of storage units, where the in-service memory is separate from the first memory. A vault corresponding to the in-service memory for storage of the first set of data objects is created based on reassignment of an address range associated with the out-of-service memory to the in-service memory. The first set of data objects are securely stored via the in-service memory based on creating the vault corresponding to the in-service memory.

Abstract: A storage network operates by: identifying, by a processing module of the storage network, a subset of encoded data slices stored in a set of storage units associated with an access request from a requesting entity that increases a time requirement relative to one or more other storage network operations; determining a listing type corresponding to the subset of encoded data slices; associating the listing type with each of the subset of encoded data slices via a listing identifier; and issuing, by the processing module, slice access information to the requesting entity based on the listing type for at least some of the subset of encoded data slices, wherein the requesting entity receives the slice access information from at least some of the set of storage units.

Abstract: Methods and apparatus for storing data and metadata in a storage network. In a method, one or more processing modules of a storage network establishes a vault as a virtual memory block that maps to memory of the storage network. The method further includes receiving data for storage in the vault, selecting a first vault parameter set regarding distributed storage of the data, and encoding at least a portion of the data in accordance with the first vault parameter set to produce a set of encoded data slices. The method further includes obtaining metadata regarding the set of encoded data slices, selecting a second vault parameter set regarding distributed storage of the metadata, and encoding the metadata in accordance with the second vault parameter set to produce metadata encoded slices. The method further includes facilitating storage of the set of encoded slices and the metadata encoded slices in the vault.

Abstract: A plurality of storage nodes in a single chassis is provided. The plurality of storage nodes in the single chassis is configured to communicate together as a storage cluster. Each of the plurality of storage nodes includes nonvolatile solid-state memory for user data storage. The plurality of storage nodes is configured to distribute the user data and metadata associated with the user data throughout the plurality of storage nodes such that the plurality of storage nodes maintain the ability to read the user data, using erasure coding, despite a loss of two of the plurality of storage nodes. A plurality of compute nodes is included in the single chassis, each of the plurality of compute nodes is configured to communicate with the plurality of storage nodes. A method for accessing user data in a plurality of storage nodes having nonvolatile solid-state memory is also provided.

Abstract: Methods, computer systems, and computer readable medium are described for low latency reads using cached deduplicated data, including: receiving a request to read data from a storage system; query, using a generated hash value associated with the request to read data, one or more deduplication tables that corresponds to the hash value; and responsive to determining that the one or more deduplication tables includes an entry that corresponds to the hash value, using a mapping contained in the entry to perform the requested to read data, wherein the mapping includes a pointer to a physical location where at least a portion of the data is stored.

Abstract: A processing system of a storage network operates by receiving a write request associated with a data object; identifying dispersed storage error encoding parameters; and determining a number of available storage units. When the number of available storage units is determined to exceed a first number, the processing system operates by: determining a first write threshold number in accordance with the dispersed storage error encoding parameters; dispersed error encoding the data object to produce a first write threshold number of encoded data slices; and writing, to available storage units, the first write threshold number of encoded data slices.

Abstract: A storage system switching between mediation models within a storage system, where the switching between mediation models includes: determining, among one or more of the plurality of storage systems, a change in availability of a mediator service, wherein one or more of the plurality of storage systems are configured to request mediation from the mediator service in response to a fault; and communicating, among the plurality of storage systems and responsive to determining the change in availability of the mediator service, a fault response model to be used as an alternate to the mediator service among one or more of the plurality of storage systems.

Abstract: A storage controller includes a processing device to send a storage command to a queue without routing the storage command through a kernel space. The queue is reserved for direct access by the application and may be associated with a set of permissions, a set of quality-of-service parameters, and/or a set of blocks on the storage devices of a storage system.

Abstract: Use of multivariate data backup retention policies, including: generating a snapshot of a dataset; identifying respective subsets of the dataset that correspond to respective retention policies of a plurality of retention policies; and generating tracking information indicating the respective subsets of the dataset corresponding to the respective retention policies of the plurality of retention policies.