Abstract: A method is provided. The method includes accumulating a set of data blocks for a data segment in a first type of flash memory and determining whether a size of the data segment exceeds a threshold value as the set of blocks is accumulated for the data segment. The method includes identifying a second type of flash memory to store the set of data blocks and storing the set of data blocks in the second type of flash memory.

Abstract: A method is provided. The method includes monitoring an incoming workload for a storage system and adjusting an amount of differing solid state memory types within a buffer of the storage system based on the monitoring.

Abstract: A storage system has a first memory, a second memory that include solid-state storage memory, and a processing device. The processing device is to select a mode for each portion of data to be written. Selection of the mode is based at least on size of the portion of data. Selection of the mode is from among modes that include a first mode of writing the portion of data in mirrored RAID form to the first memory for later transfer from the first memory to the second memory, a second mode of writing the portion of data in parity-based RAID form to the first memory for later transfer from the first memory to the second memory, and a third mode of writing the portion of data to the second memory, bypassing the first memory. The processing device is to handle portions of data to be written according to such selection.

Abstract: A storage system is provided. The storage system includes a plurality of non-volatile memory modules a storage controller operatively coupled to the plurality of non-volatile memory modules, the storage controller comprising a processor. The process is to receive a set of data blocks to be stored in the plurality of non-volatile memory modules. The processor is further to program the set of data blocks at a first location of the plurality of non-volatile memory modules. The processor is further to determine whether a failure occurred while programming the set of data blocks in the plurality of non-volatile memory modules. The processor is further to reprogram a subset of the data blocks at a second location of the plurality of non-volatile memory modules, a number of blocks in the subset of data blocks based on durabilities of the set of data blocks, in response to determining that a failure occurred while programming the set of data blocks at the first location.

Abstract: A die-aware scheduler that has a hierarchical queue is suitable for use in data storage systems. The hierarchical queue includes a priority queue, a die queue, a write queue and a power token queue, and may also include an admission queue. The die queue, the write queue and the power token queue have a width and lanes corresponding to dies in solid-state storage. The hierarchy of queues has dynamic adjustability of a ratio relating to handling queue items in the hierarchy of queues, to optimize latency and throughput.

Abstract: A system establishes spools that have spool regions in first memory. The system communicates first spool insertions into the spools, and from the spools to the storage devices, to write into a first partition of second memory of the storage devices. The first spool insertions include data and are optimized towards a first spool insertion size. The system communicates second spool insertions into the spools, and from the spools to the storage devices, to write into a second partition of the second memory of the storage devices. The second spool insertions include metadata and are optimized towards a second spool insertion size.

Abstract: A storage system has a first memory, a second memory that include solid-state storage memory, and a processing device. The processing device is to select a mode for each portion of data to be written. Selection of the mode is based at least on size of the portion of data. Selection of the mode is from among modes that include a first mode of writing the portion of data in mirrored RAID form to the first memory for later transfer from the first memory to the second memory, a second mode of writing the portion of data in parity-based RAID form to the first memory for later transfer from the first memory to the second memory, and a third mode of writing the portion of data to the second memory, bypassing the first memory. The processing device is to handle portions of data to be written according to such selection.

Abstract: A method for migration of data is provided. The method includes triggering a rebuild of data according to a first migration mechanism from a first storage drive to a second storage drive. Monitoring space utilization associated with the second storage drive, and adaptively switching the migration of the data from the first migration mechanism to a second migration mechanism based on the monitoring.

Abstract: A system establishes spools that have spool regions in first memory. The system communicates first spool insertions into the spools, and from the spools to the storage devices, to write into a first partition of second memory of the storage devices. The first spool insertions include data and are optimized towards a first spool insertion size. The system communicates second spool insertions into the spools, and from the spools to the storage devices, to write into a second partition of the second memory of the storage devices. The second spool insertions include metadata and are optimized towards a second spool insertion size.

Abstract: A method for elective garbage collection in storage memory, performed by a storage system is provided. The method includes monitoring storage space available in each of a plurality of portions of storage memory of a storage system and detecting an imbalance in the storage space available across the plurality of portions of storage memory. The method includes performing garbage collection to rebalance the space available across the plurality of portions of storage memory, responsive to the detecting. A storage system is also provided.

Abstract: A method for migration of data is provided. The method includes triggering a rebuild of data according to a first migration mechanism from a first storage drive to a second storage drive. Monitoring space utilization associated with the second storage drive, and adaptively switching the migration of the data from the first migration mechanism to a second migration mechanism based on the monitoring.

Abstract: A method for migration of data is provided. The method includes triggering a rebuild of data according to a first migration mechanism from a first storage drive to a second storage drive. Monitoring space utilization associated with the second storage drive, and adaptively switching the migration of the data from the first migration mechanism to a second migration mechanism based on the monitoring.

Abstract: Automatically creating a data analytics pipeline, including: receiving, from a user, information describing a plurality of components to include in a data analytics pipeline; receiving, from the user, information describing a manner in which the plurality of components in the data analytics pipeline should be connected; and creating the data analytics pipeline in dependence upon the information describing the plurality of components to include in the data analytics pipeline and the information describing the manner in which the plurality of components in the data analytics pipeline should be connected.

Abstract: A method for elective garbage collection in storage memory, performed by a storage system is provided. The method includes monitoring storage space available in each of a plurality of portions of storage memory of a storage system and detecting an imbalance in the storage space available across the plurality of portions of storage memory. The method includes performing garbage collection to rebalance the space available across the plurality of portions of storage memory, responsive to the detecting. A storage system is also provided.

Abstract: A method for elective garbage collection in storage memory, performed by a storage system is provided. The method includes monitoring storage space available in each of a plurality of portions of storage memory of a storage system and detecting an imbalance in the storage space available across the plurality of portions of storage memory. The method includes performing garbage collection to rebalance the space available across the plurality of portions of storage memory, responsive to the detecting. A storage system is also provided.

Abstract: A method for migration of data is provided. The method includes triggering a rebuild of data according to a first migration mechanism from a first storage drive to a second storage drive. Monitoring space utilization associated with the second storage drive, and adaptively switching the migration of the data from the first migration mechanism to a second migration mechanism based on the monitoring.

Abstract: A method for migration of data is provided. The method includes triggering a rebuild of data according to a first migration mechanism from a first storage drive to a second storage drive. Monitoring space utilization associated with the second storage drive, and adaptively switching the migration of the data from the first migration mechanism to a second migration mechanism based on the monitoring.

Abstract: A method for elective garbage collection in storage memory, performed by a storage system is provided. The method includes monitoring storage space available in each of a plurality of portions of storage memory of a storage system and detecting an imbalance in the storage space available across the plurality of portions of storage memory. The method includes performing garbage collection to rebalance the space available across the plurality of portions of storage memory, responsive to the detecting. A storage system is also provided.

Abstract: A method for migration of data is provided. The method includes triggering a rebuild of data according to a first migration mechanism from a first storage drive to a second storage drive. Monitoring space utilization associated with the second storage drive, and adaptively switching the migration of the data from the first migration mechanism to a second migration mechanism based on the monitoring.