Abstract: A storage network operates by: obtaining audit records, wherein each of the audit records indicates: a timestamp for a corresponding message, at least one event type code selected from a plurality of event type codes for a corresponding audit event of the corresponding message, and an identifier for a corresponding storage network entity associated with at least one event corresponding to the at least one event type code; generating an audit file to include a number of audit records over a period of time and integrity information; and facilitating storage of the audit file.

Abstract: One or more operations to be performed by a storage system are identified by a first storage node having a processing device and one or more authorities that determine types of erasure coding applied to data stored in the storage system. One or more instructions are transmitted to a second storage node to perform the one or more storage operations, wherein the one or more instructions cause the one or more operations to be performed by the second storage node.

Abstract: Performing disaster recovery in a cloud-based storage system, including: creating, by a storage system a snapshot of a dataset; uploading, from the storage system to a cloud computing environment, the snapshot; storing, by the cloud computing environment, the snapshot; detecting, by the cloud computing environment, that the dataset is not available on the storage system; and creating, by the cloud computing environment using the snapshot that is stored within the cloud computing environment, a cloud-based storage system that includes the dataset.

Abstract: A system, method, and product for flexible RAID layouts in a storage system, including: determining a reliability of an individual storage device of a plurality of storage devices, the individual storage device containing a plurality of portions of a Redundant Array of Independent Disks (RAID) stripe in a storage system, wherein the RAID stripe includes user data and inter-device parity data; detecting a change in the reliability of the individual storage device that contains the portion corresponding to the RAID stripe; and changing an amount of intra-device protection corresponding to the RAID stripe by decreasing, in the RAID stripe, an amount of space used to store the inter-device protection data.

Abstract: Estimates of amounts of time to transfer data to be replicated based on sizes of expected data transfers resulting from accumulated data since a previous data transfer are monitored. A determination as to whether an estimated amount of time to transfer the data exceeds an interval for replicating the data is made. The interval is determined based on a recovery point objective (RPO) for replicating the data. In response to determining that the estimated amount of time to transfer the data exceeds the interval, a subsequent interval for replicating the data is determined that satisfies the RPO.

Abstract: A processing module is operable to perform monitoring of a plurality of storage units storing a plurality of data, where a first set of data is stored via first memory of the plurality of storage units. The first memory is identified as out-of-service memory based on error rate history data. The error rate history data is utilized to identify in-service memory of the plurality of storage units, where the in-service memory is separate from the first memory. A vault corresponding to the in-service memory for storage of the first set of data objects is created based on reassignment of an address range associated with the out-of-service memory to the in-service memory. The first set of data objects are securely stored via the in-service memory based on creating the vault corresponding to the in-service memory.

Abstract: A storage network operates by: identifying, by a processing module of the storage network, a subset of encoded data slices stored in a set of storage units associated with an access request from a requesting entity that increases a time requirement relative to one or more other storage network operations; determining a listing type corresponding to the subset of encoded data slices; associating the listing type with each of the subset of encoded data slices via a listing identifier; and issuing, by the processing module, slice access information to the requesting entity based on the listing type for at least some of the subset of encoded data slices, wherein the requesting entity receives the slice access information from at least some of the set of storage units.

Abstract: Methods and apparatus for storing data and metadata in a storage network. In a method, one or more processing modules of a storage network establishes a vault as a virtual memory block that maps to memory of the storage network. The method further includes receiving data for storage in the vault, selecting a first vault parameter set regarding distributed storage of the data, and encoding at least a portion of the data in accordance with the first vault parameter set to produce a set of encoded data slices. The method further includes obtaining metadata regarding the set of encoded data slices, selecting a second vault parameter set regarding distributed storage of the metadata, and encoding the metadata in accordance with the second vault parameter set to produce metadata encoded slices. The method further includes facilitating storage of the set of encoded slices and the metadata encoded slices in the vault.

Abstract: A plurality of storage nodes in a single chassis is provided. The plurality of storage nodes in the single chassis is configured to communicate together as a storage cluster. Each of the plurality of storage nodes includes nonvolatile solid-state memory for user data storage. The plurality of storage nodes is configured to distribute the user data and metadata associated with the user data throughout the plurality of storage nodes such that the plurality of storage nodes maintain the ability to read the user data, using erasure coding, despite a loss of two of the plurality of storage nodes. A plurality of compute nodes is included in the single chassis, each of the plurality of compute nodes is configured to communicate with the plurality of storage nodes. A method for accessing user data in a plurality of storage nodes having nonvolatile solid-state memory is also provided.

Abstract: Methods, computer systems, and computer readable medium are described for low latency reads using cached deduplicated data, including: receiving a request to read data from a storage system; query, using a generated hash value associated with the request to read data, one or more deduplication tables that corresponds to the hash value; and responsive to determining that the one or more deduplication tables includes an entry that corresponds to the hash value, using a mapping contained in the entry to perform the requested to read data, wherein the mapping includes a pointer to a physical location where at least a portion of the data is stored.

Abstract: A processing system of a storage network operates by receiving a write request associated with a data object; identifying dispersed storage error encoding parameters; and determining a number of available storage units. When the number of available storage units is determined to exceed a first number, the processing system operates by: determining a first write threshold number in accordance with the dispersed storage error encoding parameters; dispersed error encoding the data object to produce a first write threshold number of encoded data slices; and writing, to available storage units, the first write threshold number of encoded data slices.

Abstract: A storage system switching between mediation models within a storage system, where the switching between mediation models includes: determining, among one or more of the plurality of storage systems, a change in availability of a mediator service, wherein one or more of the plurality of storage systems are configured to request mediation from the mediator service in response to a fault; and communicating, among the plurality of storage systems and responsive to determining the change in availability of the mediator service, a fault response model to be used as an alternate to the mediator service among one or more of the plurality of storage systems.

Abstract: A storage controller includes a processing device to send a storage command to a queue without routing the storage command through a kernel space. The queue is reserved for direct access by the application and may be associated with a set of permissions, a set of quality-of-service parameters, and/or a set of blocks on the storage devices of a storage system.

Abstract: Use of multivariate data backup retention policies, including: generating a snapshot of a dataset; identifying respective subsets of the dataset that correspond to respective retention policies of a plurality of retention policies; and generating tracking information indicating the respective subsets of the dataset corresponding to the respective retention policies of the plurality of retention policies.

Abstract: A first set of blocks of storage memory is allocated as durable and a second set of blocks of the storage memory is allocated as semi-durable. The durable first set of blocks are provided power loss protection (PLP) and the semi-durable second set of blocks lack PLP. Data generated by one or more background operations of the storage system is identified. The data generated by the one or more background operations is stored in one or more blocks of the semi-durable second set of blocks.

Abstract: Write requests to store data at one or more solid-state storage devices are received by a storage controller from clients external to a storage system. A number of open segments in the storage system is identified. A determination as to whether to open one or more subsequent segments for the write requests is made based on the number of open segments and a target parallelism for the storage system. In response to determining that the one or more subsequent segments are to be opened based on the number of open segments and the target parallelism, the one or more subsequent segments are opened.

Abstract: Converting data formats in a storage system: converting first data in a first format to second data in a second format, wherein second data in the second format includes a reference to the first data, wherein the first data and the second data are associated with a dataset, including updating the second data to include: a reference to first data associated with a portion of the dataset that precedes a data-converted portion of the dataset; second data associated with the data-converted portion of the dataset, wherein the second data associated with the data-converted portion of the dataset is in the second data format; and a reference to first data associated with a portion of the dataset that follows the data-converted portion of the dataset; and replacing first data associated with the data-converted portion of the dataset with a reference to the second data associated with the data-converted portion of the dataset.

Abstract: The embodiments provide for a method and system for dynamic configuration of a storage system to facilitate independent scaling of resources. The method and system include detecting a change to a topology of a storage system consisting of different sets of storage nodes, where at least one of the different sets of storage nodes has solid-state memory having differing storage capacities. Responsive to detecting the change, the storage system reconfigures to change an allocation of resources to one or more authorities that control a range of identifiers.

Abstract: An indication that a die of the solid-state storage device has been marked as likely to fail based on a number of failed input/output (I/O) operations performed on the die satisfying a threshold may be received by a storage system controller from a solid-state storage device. In response to receiving the indication, one or more remedial actions associated with the die of the solid-state storage device may be performed.

Abstract: Enabling data portability between systems, including: submitting, to a cloud-based metadata store storing metadata describing data stored in a plurality of storage systems each coupled for data communications with a corresponding on-premises cloud infrastructure of a plurality of on-premises cloud infrastructures, a query; selecting a subset of the data responsive to the query and stored in at least one first storage system coupled to at least one first on-premises cloud infrastructure; and storing, from the at least one first storage system to a second storage system coupled to a second on-premises cloud infrastructure, the subset of the data responsive to the query.