Abstract: A system, method, and product for flexible RAID layouts in a storage system, including: determining a reliability of an individual storage device of a plurality of storage devices, the individual storage device containing a plurality of portions of a Redundant Array of Independent Disks (RAID) stripe in a storage system, wherein the RAID stripe includes user data and inter-device parity data; detecting a change in the reliability of the individual storage device that contains the portion corresponding to the RAID stripe; and changing an amount of intra-device protection corresponding to the RAID stripe by decreasing, in the RAID stripe, an amount of space used to store the inter-device protection data.

Abstract: An operation to be performed by a hardware accelerator is identified by a storage system controller. The operation is inserted into a queue comprising other operations from other storage system controllers to be performed by the hardware accelerator. A queue state indication is received from the hardware accelerator that includes information associated with performance of the operation and the other operations in the queue by the hardware accelerator.

Abstract: A storage system controller provides operating data associated with multiple storage devices to one or more models to generate a predicted operating condition for at least one storage device. The storage system controller evaluates whether execution of a workload by the storage devices results in the predicted operating condition. In response to determining that execution of the workload results in the predicted operating condition, the storage system controller adjusts execution of the workload across the storage devices to prevent occurrence of the predicted operating condition.

Abstract: A plurality of storage nodes in a single chassis is provided. The plurality of storage nodes in the single chassis is configured to communicate together as a storage cluster. Each of the plurality of storage nodes includes nonvolatile solid-state memory for user data storage. The plurality of storage nodes is configured to distribute the user data and metadata associated with the user data throughout the plurality of storage nodes such that the plurality of storage nodes maintain the ability to read the user data, using erasure coding, despite a loss of two of the plurality of storage nodes. A plurality of compute nodes is included in the single chassis, each of the plurality of compute nodes is configured to communicate with the plurality of storage nodes. A method for accessing user data in a plurality of storage nodes having nonvolatile solid-state memory is also provided.

Abstract: A method for proactively rebuilding user data in a plurality of storage nodes of a storage cluster is provided. The method includes distributing user data and metadata throughout the plurality of storage nodes such that the plurality of storage nodes can read the user data, using erasure coding, despite loss of two of the storage nodes. The method includes determining that one of the storage nodes is unreachable and determining to rebuild the user data for the one of the storage nodes that is unreachable. The method includes reading the user data across a remainder of the plurality of storage nodes, using the erasure coding and writing the user data across the remainder of the plurality of storage nodes, using the erasure coding. A plurality of storage nodes within a single chassis that can proactively rebuild the user data stored within the storage nodes is also provided.

Abstract: Methods, computer systems, and computer readable medium are described for low latency reads using cached deduplicated data, including: receiving a request to read data from a storage system; query, using a generated hash value associated with the request to read data, one or more deduplication tables that corresponds to the hash value; and responsive to determining that the one or more deduplication tables includes an entry that corresponds to the hash value, using a mapping contained in the entry to perform the requested to read data, wherein the mapping includes a pointer to a physical location where at least a portion of the data is stored.

Abstract: A storage system switching between mediation models within a storage system, where the switching between mediation models includes: determining, among one or more of the plurality of storage systems, a change in availability of a mediator service, wherein one or more of the plurality of storage systems are configured to request mediation from the mediator service in response to a fault; and communicating, among the plurality of storage systems and responsive to determining the change in availability of the mediator service, a fault response model to be used as an alternate to the mediator service among one or more of the plurality of storage systems.

Abstract: A request is received from an initiator application to migrate data from a plurality of blocks of a storage area network (SAN) volume resident on a storage array to a network attached storage (NAS) volume resident on the storage array. Metadata is generated for the NAS volume, the metadata to reference the plurality of data blocks of the SAN volume storing the data. A file is generated at the NAS volume using the metadata, wherein the file is associated with the plurality of data blocks of the SAN volume storing the data.

Abstract: An exemplary system includes a storage system controller configured to receive requests to read and write data; a flash-based storage device providing an application programming interface (API) for the storage system controller to read and write to flash blocks at the direction of the storage controller; a storage device providing non-volatile random access memory (NVRAM) configured to provide staging for pending writes to flash memory of the flash-based storage device to ensure that partially completed writes to the flash memory of the flash-based storage device can be completed subsequent to an interruption of the writes to the flash memory of the flash-based storage device. The storage system controller is further configured to determine that a particular write is associated with a checkpoint, and instruct, based on the determining, the flash-based storage device to store data of the particular write to the flash memory, bypassing writing to the NVRAM.

Abstract: An indication that a die of the solid-state storage device has been marked as likely to fail based on a number of failed input/output (I/O) operations performed on the die satisfying a threshold may be received by a storage system controller from a solid-state storage device. In response to receiving the indication, one or more remedial actions associated with the die of the solid-state storage device may be performed.

Abstract: Creating a modifiable cloned image of a dataset, including: generating, based on a dataset stored within a source data repository, a tracking copy of replica data on a target data repository; generating, after receiving an indication to begin accepting modifications to the tracking copy of the replica data, a cloned image of the dataset that is modifiable without modifying the tracking copy of the replica data; and responsive to a storage operation directed to the target data repository, modifying the cloned image of the dataset without modifying the tracking copy of the replica data.

Abstract: Providing Quality of Service (QoS) for replicating datasets including: receiving, by a target data repository from a source data repository, a checkpoint describing one or more updates to one or more datasets stored in the source data repository and the target data repository; adding, by the target data repository, the checkpoint to a first queue for checkpoints directed to one or more volumes in the target data repository, wherein the first queue is included in a plurality of queues for the target data repository; selecting, by the target data repository, one or more queues from the plurality of queues; and servicing an operation from each of the selected one or more queues.

Abstract: A method includes generating, in accordance with a data protection parameter set, a snapshot of data maintained by a storage system, the data protection parameter set specifying a retention duration for the snapshot; detecting, subsequent to the generating the snapshot, an anomaly associated with a file written to one or more storage structures included in the storage system; transmitting, a copy of only a header of the file and only a portion of a payload of the file to a data analysis system remote from the storage system, the data analysis system configured to perform a corruption analysis of the file; performing, based on the corruption analysis of the file, an operation with respect to the file; and modifying, based on the detecting of the anomaly and on the corruption analysis, the retention duration for the snapshot.

Abstract: Determining effective space utilization in a storage system, including: identifying an amount of data stored within the storage system that is associated with a user-visible entity; identifying an amount of data stored within the storage system that is associated with all snapshots of the user-visible entity; and reporting, in dependence upon the an amount of data stored within the storage system that is associated with the user-visible entity and the amount of data stored within the storage system that is associated with all snapshots of the user-visible entity, a total capacity utilization associated with the user-visible entity.

Abstract: A system and method for performing replication using mediums. A snapshot ‘S’ is selected for replication, and the anchor medium ‘M’ of S is identified. The replica storage array ‘R’ to which M is being replicated determines a list of medium extents which are available. R sends this list to an original storage array ‘O’ and O generates a list of medium extents which need to be sent to R. Only those medium extents corresponding to M which R does not already have will be sent from O to R. Also, R can obtain medium extents from other source storage arrays during the replication process.

Abstract: A method of cache management, the method comprising: identifying, among a plurality of storage items, storage items having an access count above a first threshold to generate a set of storage items; identifying, among the set of storage items, storage items having an updated access count above a second threshold to generate a subset of storage items, wherein, for each storage item, the updated access count is dependent upon a number of accesses subsequent to generating the set of storage items; and adding the storage items of the subset of storage items to a cache.

Abstract: A processing device receives operating data associated with one or more storage devices and analyzes the operating data using one or more artificial intelligence (AI) models to generate voltage threshold offsets for memory pages of the one or more storage devices. The processing device applies the generated voltage threshold offsets to read operations to read data from the memory pages. The AI models may be trained using data from other storage systems and can be executed by a storage system controller, by storage device controllers of the storage devices, or by both in a coordinated configuration. The disclosed techniques dynamically adjust voltage thresholds based on current device conditions to improve read accuracy, reduce error rates, and enhance overall system reliability and endurance.

Abstract: A request is received from an initiator application to migrate data from a plurality of blocks of a storage area network (SAN) volume resident on a storage array to a network attached storage (NAS) volume resident on the storage array. Metadata is generated for the NAS volume, the metadata to reference the plurality of data blocks of the SAN volume storing the data. A file is generated at the NAS volume using the metadata, wherein the file is associated with the plurality of data blocks of the SAN volume storing the data.

Abstract: A system and method for efficient execution of I/O operations in a storage environment including receiving, by a storage controller, an incoming I/O operation that can be serviced by a storage device while at least one pending operation is to be processed using the storage device, determining, based on an analysis by the storage controller of an operational state of a storage system that includes the storage device, whether processing the at least one pending operation is more efficient than issuing an alternative operation to the storage device, and issuing, by the storage controller, one or more instructions to the storage device.

Abstract: Redundant array of independent drives (RAID) sub-stripes are formed across one or more solid-state storage devices of storage nodes of a storage system. The RAID sub-stripes include corresponding shards of data to be stored at the solid-state storage devices, wherein at least one of the RAID sub-stripes has at least two of the corresponding shards of data on a same storage node. At least one global parity shard is generated for the RAID sub-stripes. The at least one global parity shard is to be stored on a first storage node that is different from each of the same storage nodes storing the at least two of the corresponding shards of data.