Abstract: A storage network operates by: receiving first data for storage in a vault that maps to memory of the storage network; encoding at least a portion of the first data in accordance with a first vault parameter set to produce a set of encoded slices; encoding metadata in accordance with a second vault parameter set to produce metadata encoded slices; and facilitating storage of the set of encoded slices and the metadata encoded slices in the vault.

Abstract: A storage network operates by: receiving a write request associated with a data object; determining a write threshold number by: when the number of available storage units is determined to exceed a first number: determining, via the processing system, the write threshold number to be equal to a first write threshold number; dispersed error encoding the data object to produce a first write threshold number of encoded data slices; and writing, to available storage units, the first write threshold number of encoded data slices; and when the number of available storage units is determined to not exceed the first number: determining, via the processing system, the write threshold number to be equal to a second write threshold number, wherein the second write threshold number is less than the first write threshold number; dispersed error encoding the data object to produce a second write threshold number of encoded data slices; and writing, to the available storage units, the second write threshold number of encode

Abstract: Using machine learning to dynamically select data reduction techniques, including: generating data describing resource usage in a storage system; determining, by a machine learning model and based on the data, a change to one or more data reduction processes of the storage system; and applying the change to the one or more data reduction processes.

Abstract: A request to read data from a storage system is received. One of an interruptible write operation or an interruptible erase operation being performed on flash memory of the storage system are paused by a storage system controller. A read operation for the request to read the data is performed. The one of the interruptible write operation or interruptible erase operation are resumed.

Abstract: Cost optimizing storage management of cloud-based storage systems, including: determining, based on a cost model associated with a cloud computing environment, one or more policies of a cloud-based storage system implemented in the cloud computing environment; and executing, based on the one or more policies, one or more processes in the cloud-based storage system.

Abstract: A method for execution by one or more computing devices includes generating current slice integrity check value information for a rebuilt appended encoded data slice of a set of appended encoded data slices stored in a set of storage units of the storage network, where an appended encoded data slice of the set of appended encoded data slices includes an encoded data slice of a set of encoded data slices and slice integrity check value information for the encoded data slice. The method further includes determining the current slice integrity check value information compares favorably to the slice integrity check value information to produce a trusted rebuilt appended encoded data slice. When the current slice integrity check value information compares favorably to the slice integrity check value information, the method further includes storing the rebuilt appended encoded data slice as the trusted rebuilt appended encoded data slice.

Abstract: Utilizing data transfer estimates for active management of a storage environment, including: determining an estimated data transfer time from a source storage environment to a destination storage environment; determining whether the estimated data transfer time exceeds a threshold; and performing, in response to the estimated data transfer time exceeding the threshold, a remedial action associated with data transfers between the source storage environment and the destination storage environment.

Abstract: A system and method for efficient use of zones in a storage system. The method includes: building a frontier set comprising one or more zones of one or more storage devices for writing to; writing data to at least one zone of the one or more zones included in the frontier set; and during a bootup sequence: accessing a frontier set list to identify the one or more zones in the frontier set; and scanning the one or more zones to identify the at least one zone that data was written to.

Abstract: Methods and apparatus for storage pool tiering in a storage network. In an embodiment, a method executed by one or more processing modules of a storage network includes maintaining a storage network access control list (ACL) registry. The ACL registry includes a storage network sub-registry and one or more vault sub-registries, and each of the sub-registries includes one or more ACLs. The method further includes receiving a storage network access request from a requesting entity, identifying a request type of the storage network access request, and identifying the one or more ACLs of a sub-registry associated with the request type. The method continues with retrieving the one or more ACLs, identifying an ACL of the one or more ACLs based on an identifier associated with the requesting entity, and comparing the storage network access request to permissions of the identified ACL to determine whether the access request is authorized.

Abstract: A first set of physical units of a storage device of a storage system is selected for performance of low latency access operations, wherein other access operations are performed by remaining physical units of the storage device. A determination as to whether a triggering event has occurred that causes a selection of a new set of physical units of the storage device for the performance of low latency access operations is made. A second set of physical units of the storage device is selected for the performance of low latency access operations upon determining that the triggering event has occurred.

Abstract: A single request is received by a storage controller of a storage system from an application deployed on a data source. The request includes objects that are to be stored at the storage system. The objects included in the request have corresponding object sizes that are below a threshold. Upon receiving the request, the objects are stored at one or more storage devices of the storage system.

Abstract: Buffering and persisting artificial intelligence (AI) training checkpoints, including: storing a plurality of artificial intelligence (AI) training checkpoints in a write buffer comprising a first storage memory type; determining that a condition for persisting an AI training checkpoint of the plurality of AI training checkpoints has been satisfied; and storing, in response to the condition being satisfied, the AI training checkpoint to persistent storage comprising a second storage memory type.

Abstract: A method of data transfer between storage systems includes determining to transfer a dataset stored at a first storage system to a second storage system and invoking an operation to retrieve, for portions of the dataset having a size less than a threshold size, an identifier, metadata, and data stored in the portions of the dataset. The method further includes transmitting the identifiers, the metadata, and the data for the portions of the dataset having a size less than the threshold size to the second storage system.

Abstract: Modifying storage distribution in a storage system that includes one or more storage devices, including: detecting, for a storage device among the one or more storage devices, that a storage capacity of the storage device is different from a storage capacity of another storage device of the one or more storage devices, and responsive to detecting that the storage capacity for the storage device is different from the storage capacity of the other storage devices of the one or more storage devices, modifying a distribution of shards of data for a data stripe among the one or more storage devices.

Abstract: A data structure including a first set of storage devices is generated. Storage devices included in the data structure are to be used to form resiliency groups in a storage system. One or more resiliency groups are formed using the first set of storage devices. The data structure is modified to include a second set of storage devices. One or more subsequent resiliency groups are formed using the second set of storage devices.

Abstract: A computing network is operable to determine to rebuild at least one data object. Rebuilding activity capacity data for rebuilding at least one data object is determined, and a set of utilization level data for of a set of rebuilding modules is determined. Autonomous allocation of rebuilding resources for rebuilding the at least one data object is performed based on generating a ranking of at least some of the set of rebuilding modules based on the set of utilization level data and the rebuilding activity capacity data, and rebuilding the at least one data object via at least one top-ranked one of the set of rebuilding modules in the ranking.

Abstract: A storage network is operable to de-select a sequence of input encoded data slices based on de-selection information to produce deselected encoded data slices of a set of encoded data slices. At least some of the deselected encoded data slices are de-sequenced to produce a sequence of the at least a decode threshold number of encoded data slices. The sequence of the at least the decode threshold number of encoded data slices of the deselected encoded data slices is error decoded in accordance with error decoding parameters to reproduce a data segment, and the data segment is outputted to a requesting computing device of the storage network.

Abstract: A list of a available zones across respective SSD storage portions of a plurality of zoned storage devices of a storage system is maintained. Data is received from multiple sources, wherein the data is associated with processing a dataset, the dataset including multiple volumes and associated metadata. Shards of the data are determined such that each shard is capable of being written in parallel with the remaining shards. The shards are mapped to a subset of the available zones, respectively. The shards are written to the subset of the available zones in parallel.

Abstract: Volume migration among a set of storage systems synchronously replicating a dataset for a volume, where volume migration includes: initiating a transfer of the volume in dependence upon determining that a performance metric for accessing the volume stored on a first storage system would improve if transferred to a second storage system; and during the transfer of the volume: determining status information for the transfer; intercepting an I/O operation directed to the volume; and directing, in dependence upon the status information, the I/O operation to either the first storage system or the second storage system.