Abstract: Rebalancing the workload of logical devices across multiple nodes may include dynamically modifying preferred paths for one or more logical devices in order to rebalance the I/O workload of the logical devices among the nodes of the data storage system. Determining whether to rebalance the I/O workload between the two nodes may be performed in accordance with one or more criteria. Processing may include monitoring the current workloads of both nodes over time and periodically evaluating, in accordance with the one or more criteria, whether the current workloads of the nodes are imbalanced. Responsive to determining, in accordance with the criteria, that rebalancing of workload between the nodes is needed, the rebalancing may be performed. A notification may be sent to the host regarding any path state changes made as a result of the workload rebalancing.

Abstract: Methods, systems, and techniques are disclosed for managing replication in a deployable object, such as a pod (e.g., a group of one or more containers). For example, when a pod is started in a cluster, the deployable object may start one or more virtual computer systems (e.g., containers), which may pull (e.g., initiate and run) container images from a registry server. The processing device may thus identify, such as on the file level, which container image should be pulled first. A scheduler of the one or more virtual computer systems may prioritize, based on the computed scores, a subsequent replication of archived data of the one or more virtual computer systems to be performed. The processing device may then execute, based on the prioritization by the scheduler, the subsequent replication of the archived data of the one or more virtual computer systems in the deployable object.

Abstract: One or more requests are received by a processing device managing one or more memory devices of a memory sub-system from a host system to store a set of data items. A zone group corresponding to a size of the set of data items is identified. A set of zones of the zone group which satisfies a programming parallelism criterion is identified among two or more zones defined in the memory sub-system. The set of data items are programmed to memory cells of the identified set of zones.

Abstract: A storage system has a first memory, a second memory that include solid-state storage memory, and a processing device. The processing device is to select a mode for each portion of data to be written. Selection of the mode is based at least on size of the portion of data. Selection of the mode is from among modes that include a first mode of writing the portion of data in mirrored RAID form to the first memory for later transfer from the first memory to the second memory, a second mode of writing the portion of data in parity-based RAID form to the first memory for later transfer from the first memory to the second memory, and a third mode of writing the portion of data to the second memory, bypassing the first memory. The processing device is to handle portions of data to be written according to such selection.

Abstract: High priority host applications are protected from data loss associated with failure of multiple drives associated with the same protection group by preemptively relocating associated host application image data to protections groups that do not have failed drives. New storage allocations for the high priority host applications are preferentially located on protections groups that do not have failed drives. Following replacement of the failed drive, the preemptively relocated data and new allocations are redistributed across protection groups in a balanced manner. Protection groups are characterized as targets, sources, or neutral based on allocations of high priority host application image data relative to other protection groups. Sources and paired with targets and portions of the high priority host application image data are iteratively relocated until all protection groups are neutral.

Abstract: Data associated with a first storage media of a cloud-based storage system is provided as an input to a machine learning model executed by a processing device that identifies one or more characteristics of the first storage media from the data. A type of change associated with the second storage media is determined by the machine learning model based on a comparison of the one or more characteristics of the first storage media and one or more characteristics of a second storage media. The type of change associated with the second storage media is provided to a cloud services provider of the cloud-based storage system.

Abstract: One or more aspects of the present disclosure relate to dynamically selecting a storage array and corresponding input/output (IO) paths between a host and the storage array. In embodiments, a virtual storage volume (VSV) can be established for a host entity using one or more storage device portions from a plurality of storage arrays. In addition, IO servicing metric parameters can be dynamically measured. For example, the servicing metric parameters can define metrics corresponding to the VSV's assigned ports on each storage array or network latency between the host and each storage array. Further, a primary storage array from the plurality of storage arrays can be selected based on the IO servicing metrics.

Abstract: A method may include operating a first storage device and a second storage device as a redundant array configured to use parity information to recover information from a faulty storage device, operating the first storage device in a fault resilient mode with at least partial read capability based on a fault condition of the first storage device, and rebuilding information from the first storage device in a parity space of the second storage device. Rebuilding the information from the first storage device in the parity space of the second storage device may include copying the information from the first storage device to the parity space of the second storage device. The method may further include copying the rebuilt information from the parity space of the second storage device to a replacement storage device.

Abstract: A method comprises collecting data from a computing environment comprising one or more storage devices, wherein the data comprises information identifying assignments of the one or more storage devices to one or more servers in the computing environment. In the method, the data is analyzed using one or more machine learning algorithms, wherein the analyzing comprises predicting whether a given configuration of the one or more storage devices in combination with the one or more servers is a specified configuration. The method also includes generating a storage configuration recommendation for a user based on the analysis, and transmitting the storage configuration recommendation to the user.

Abstract: A data write method, a data read method, a device, and a system are provided. The data write method is applied to a computer device, which includes a storage device and a plurality of nodes in a non-uniform memory access architecture (NUMA) system, and each node has a buffer and a controller that controls the buffer. The data write method includes: obtaining a write request of target data; determining, in response to the write request, a target page that is in the storage device and that stores the target data; determining, from a plurality of buffers corresponding to the plurality of nodes, a target buffer corresponding to the target page; writing the target data into a page of the target buffer by using a target controller that controls the target buffer; and writing data of the page of the target buffer into the target page in the storage device.

Abstract: Technologies are described herein for remotely configuring multi-mode dual in-line memory modules (“multi-mode DIMMs”) using a firmware or a baseboard management controller (“BMC”). Technologies are also described for simultaneously initiating multiple commands for configuring multi-mode DIMMs using a BMC and for updating inventory data regarding multi-mode DIMMs stored by a BMC.

Abstract: In one or more embodiments, the present invention is directed to a blockchain secured, software-defined network and monitoring system comprising: a multi-controller software-defined network (SDN) network layer; a blockchain based security and autonomy layer; a deep learning-driven decision making layer comprising the one or more computational centers and a horizontal data plane layer. In some embodiments, the present invention is directed to methods for ensuring the integrity of a control commands and optimizing performance and security using the blockchain secured, software-defined network and monitoring system. In various embodiments, the present invention relates to methods for extracting useful features from said labelled and non-labelled data contained in the horizontal data plane layer in the blockchain secured, software-defined network and monitoring system using a knowledge domain-enabled hybrid semi-supervision learning method.

Abstract: Systems and methods that relate to memory devices are disclosed. In some implementations, a memory system includes a first data storage device and a second data storage device. Each of the first and second data storage devices includes a plurality of memory blocks, each memory block including a plurality of memory cells each operable to store one or more data bits, and page buffers that cache data to be written to the memory blocks or read from the plurality of memory blocks on a page basis, and a controller including a cache memory configured to temporarily store first data, and configured to move the first data from a portion of the cache memory to one or more of the page buffers of the first data storage device and allocate the portion of the cache memory as a temporary buffer for storing data.

Abstract: Various embodiments enable a memory sub-system to perform a read operation based on consolidated memory region description data, which can be generated based on a memory region description data (e.g., SGL) provided by a host system for the read operation.

Abstract: A distributed database system maintains a database including a data shard for which a primary computing node is responsible. The primary computing node identifies a data storage plan for the data shard. The plan identifies a file subset of data storage files of the shard to be merged into a larger data storage file, and a node subset of computing nodes of the system that subscribe to the data shard. The primary node identifies which computing nodes of the node subset each have sufficient computing resources to execute the plan, as candidate computing nodes. The primary node identifies which files of the file subset each candidate computing node locally caches. The primary node selects one candidate computing node to execute the plan, based on the files of the file subset that each candidate computing node locally caches. The primary node causes the selected candidate computing node to execute the plan.

Abstract: A method of upgrading a VIM server appliance includes: creating a snapshot of logical volumes mapped to physical volumes that store configuration and database files of virtual infrastructure management (VIM) services provided by a first VIM server appliance to be upgraded; after the snapshot is created, expanding the configuration and database files to be compatible with a second VIM server appliance; replicating the logical volumes which have been modified as a result of expanding the configuration and database files, in the second VIM server appliance; after replication, performing a switchover of VIM services that are provided, from the first VIM server appliance to the second VIM server appliance; and upon failure of any of the steps of expanding, replicating, and performing the switchover, aborting the upgrade, and reverting to a version of the configuration and database files that was preserved by creating the snapshot.

Abstract: A random number generator selects addresses while a ‘scoreboard’ bank of registers (or bits) tracks which addresses have already been output (e.g., for storing or retrieval of a portion of the data.) When the scoreboard detects an address has already been output, a second address which has not been used yet is output rather than the randomly selected one. The second address may be selected from nearby addresses that have not already been output.

Abstract: Computer-readable media, methods, and systems are disclosed for linear interval-based dynamic range partitioning in one or more database systems. A request is received by a database management system to insert a new row into a partitioned database table. The partitioned database table may include a plurality of existing partitions and a partition others partition. Based on determining that the new row should be inserted into the partition others partition a series of steps are performed. First, one or more new partitions are added to the partitioned database table. Then, the new row is inserted into the one of the one or more new partitions in the partitioned database table.

Abstract: A communications circuit with an input port, a switching circuit coupled to the input port, and a first and second memory coupled to the switching circuit. The communications circuit also includes controlling circuitry adapted to operate the switching circuit to couple data received at the input port to the first memory while the second memory is disabled from power and to couple data received at the input port to the second memory once the first memory is filled with valid data.

Abstract: A system, method and device for ingesting data files into remote computing environments is disclosed. The method includes receiving a plurality of data files and processing same according to a modified round-robin (MRR) process. The MRR assigns data files for processing by determining which of a plurality of remote processors are active, and by determining an amount of queued processing for the active remote processors. The method includes assigning each data file of the plurality of data files to a remote processor of the plurality of remote processors based on the remote processor (1) being active, and (2) having a relatively lower amount of queued processing. The method includes instructing a storage writer to store processed data files.

Abstract: A system can receive a file in parts. The system can write a first part to a first temporary file that corresponds to the first part's length at a first location of the first temporary file based on the its part number. The system can for a second part having a same length as the first part, write the second part to the first temporary file at a second location of the first temporary file based on its part number. The system can, in response to receiving a third part that has a different length than the first part, write the third part to a second temporary file at a third location of the second temporary file based on its part number. The system can, after receiving the parts, write data of the second temporary file to an end of the first temporary file, and rename the temporary file.

Abstract: A method includes updating a first metadata log in an NVRAM of a host device corresponding to one or more recent input/output (I/O) operations received by the host device, periodically checking whether the size of the updated first metadata log is greater than a flush limit maintained in the host device, triggering a meta flush thread when the updated first metadata log size exceeds the flush limit maintained in the host device, sending, by a non-volatile memory express (NVMe) driver, a first command for synchronizing the updated first metadata log to one or more solid state drives (SSDs) for updating a second metadata log in the one or SSDs, and discarding, by the host device, metadata of the first metadata log updated in the host device after receiving a second command for acknowledging synchronization completion from the one or more SSDs.

Abstract: Techniques for storage management involve determining a plurality of storage units to be reconstructed on a group of disks, the plurality of storage units being distributed on different disks in the group of disks. Such techniques further involve selecting, based on the distribution of the plurality of storage units on the group of disks, a group of storage units from the plurality of storage units so that different storage units in the group of storage units are distributed on different disks. Such techniques further involve performing concurrent reconstruction on the group of storage units.

Abstract: A computer-implemented method according to one aspect includes monitoring a current usage of a backup storage space for a storage volume; comparing the current usage to a capacity threshold; and conditionally increasing a size of the backup storage space, based on the comparing and a predetermined size limitation.

Abstract: The ICT resource management device includes: a configuration information management part that manages configuration information of physical nodes and virtual nodes; a layer mapping part that performs mapping between the physical layer and the virtual layer; a location specifying part that specifies a location of a physical node; a device connect destination determination part that determines a physical node to which to connect the device in response to a request for configuration change based on at least one of the specified location, information relating to a service, a network connection configuration of the network connecting the device to the physical node, and quality of the network; a blueprint creation part that creates a blueprint based on the configuration information, the mapping information, and the connection destination; and an orchestrator part that performs orchestration.

Abstract: The disclosure herein describes enhancing data durability of a base component using a delta component. A delta component is generated based on the base component becoming unavailable. The delta component is configured to include unwritten storage space with an address space matching the base component and a tracking bitmap associated with data blocks of the address space of the delta component. Write operations targeted for the base component are routed to the delta component. Based on the routed write operations, bits associated with data blocks affected by the write operations are changed in the tracking bitmap. Based on the base component becoming available, data blocks affected by routed write operations are identified based on the tracking bitmap and the identified data blocks are synchronized from the delta component to the base component. The delta component is then removed.

Abstract: Techniques for managing metadata storage units involve: in response to receiving, from a client, a request for allocating a target number of metadata storage units, determining a first number of available metadata storage units remaining in a metadata storage space of a storage system after the allocation is performed; and if the first number is not less than a reserved number, allocating the target number of metadata storage units from the metadata storage space for the client to use, wherein the reserved number is associated with a usage condition of the metadata storage units in the storage system. Accordingly, such techniques can effectively manage metadata and improve the performance of a system.

Abstract: A system can include a plurality of sequencers each configured to provide a number of sequenced output signals responsive to assertion of a respective sequencer enable signal provided thereto. The system can include chaining circuitry coupled to the plurality of sequencers. The chaining circuitry can comprise logic to: responsive to assertion of a primary enable signal received thereby, assert respective sequencer enable signals provided to the plurality of sequencers in accordance with a first sequence; and responsive to deassertion of the primary enable signal, assert the respective sequencer enable signals provided to the plurality of sequencers in accordance with a second sequence.

Abstract: A method and system are provided for assigning a particular record into a chunk of a partition within a non-relational database system. When a number of records in a particular candidate chunk is greater than a particular threshold number, an application performs an auto-balancing operation to split the particular candidate chunk such that records originally assigned to the particular candidate chunk are divided among the particular candidate chunk and a new chunk. Some of the number of records that were originally part of the particular candidate chunk are assigned to a new chunk and the other remaining ones of the number of records that were originally part of the particular candidate chunk remain assigned to the particular candidate chunk.

Abstract: Coordinated snapshots among storage systems implementing a promotion/demotion model, including monitoring a set of two or more target storage systems, wherein the two or more target storage systems are replication targets for respective portions of a source dataset; associating a first coordinated tracking dataset with two or more local tracking datasets maintained on the two or more target storage systems, wherein each local tracking dataset is a tracking copy for one portion of the source dataset; and advancing, in dependence upon a first coordinated target checkpoint, the first coordinated tracking dataset.

Abstract: A data storage device comprises a plurality of storage elements, each storage element configured for storing a piece of information. The plurality of storage elements is accessible as a plurality of word sets, each word set comprising a set of storage elements, and is accessible as a plurality of slice sets, each slice set comprising a set of storage elements. Each storage element is a part of a word set and a part of a slice set. The device further comprises a control unit configured for obtaining word information and slice information and for executing a write operation to parallelly write the word information into a first word set of the plurality of word sets and the slice information into a first slice set of the plurality of slice sets, wherein the first word set and the first slice set comprise a common storage element defined by an overlap of the first word set and the first slice set in a layout of the plurality of storage elements.

Abstract: The present disclosure provides a method and system for storage management, a storage medium and a device. The method includes: making hard disks in a storage pool network with several controllers via network hard disk enclosures, respectively sending hard disk information to proxy drivers which are pre-configured in the controllers, and selecting one of the controllers as a main controller; respectively sending, the hard disk information to cluster drivers which are pre-configured in respective controllers; acquiring the hard disk information from each cluster driver via the main controller, and sending the total hard disk information sent to each cluster driver; acquiring information of a logical unit space corresponding to the request, and allocating an idle hard disk in the storage pool for the logical unit space according to the total hard disk information; processing, the read/write request in parallel in the idle hard disk.

Abstract: Disclosed are systems and methods for providing read-modify-writes during relocation of overlapping of logical blocks. A method includes receiving a host write command from a host interface. The method also includes translating a logical block address for the host write command to a physical address on a device memory. The physical address corresponds to a plurality of indirection units. The method also includes, in accordance with a determination that the physical address does not correspond to an aligned address, processing a read-modify-write operation for one or more indirection units of the plurality of indirection units during a relocation, in accordance with a determination that a relocation block has an overlapping indirection unit with the one or more indirection units.

Abstract: It is made possible to pursue both higher speeds of rebuilds in the distributed RAID scheme and high availability due to acquisition of DE-failure tolerance. A virtual chunk includes k (k is an integer that is equal to or larger than two) virtual parcels including a virtual parcel having user data and a virtual parcel having element data that is redundant data for repairing the user data, the virtual parcels included in the same virtual chunk is stored by mapping the virtual parcels in storage areas of k mutually different physical storage drives among N (k<N) of the physical storage drives, and the maximum value of the numbers of the same virtual parcels to be mapped to the physical storage drives housed in the same drive enclosures is equal to or smaller than a predetermined value.

Abstract: A system can include a plurality of sequencers each configured to provide a number of sequenced output signals responsive to assertion of a respective sequencer enable signal provided thereto. The system can include chaining circuitry coupled to the plurality of sequencers. The chaining circuitry can comprise logic to: responsive to assertion of a primary enable signal received thereby, assert respective sequencer enable signals provided to the plurality of sequencers in accordance with a first sequence; and responsive to deassertion of the primary enable signal, assert the respective sequencer enable signals provided to the plurality of sequencers in accordance with a second sequence.

Abstract: Orchestrated disaster recovery is provided in which replication volumes are automatically configured as part of a failover procedure. An example method includes obtaining replication volume configuration information identifying configuration of a replication volume in a data replication relationship in which data is replicated from a replication source to a replication target. The replication volume is configured for the replication source and replication volume remains at least partially non-configured for the replication target during data replication from the replication source to the replication target. Based on an indication of failover, the obtained configuration information is used in automatically configuring the replication volume for the replication target in preparation for use by application(s) of the replication target site. Automatically configuring includes configuring, for the replication volume, a volume group and a mount point.

Abstract: A garbage collection process is performed in a storage system which comprises a storage control node, and storage nodes which implement a striped volume comprising a plurality of stripes having strips that are distributed over the storage nodes. The storage control node selects a victim stripe for garbage collection, and an empty stripe in the striped volume. The storage control node determines a data strip of the victim stripe having predominantly valid data based on a specified threshold, and sends a copy command to a target storage node which comprises the predominantly valid data strip, to cause the target storage node to copy the predominantly valid data strip to a data strip of the empty stripe which resides on the target storage node. The storage control node writes valid data blocks of the victim stripe to remaining data strips of the empty stripe, and releases the victim stripe for reuse.

Abstract: Communication between target devices using protocol commands being carried out by a target device includes accessing a key for mapping of a plurality of defined patterns of stimuli and defined patterns of resultant protocol commands to a plurality of messages. A defined pattern of stimuli is sent from a target device to an initiator device to prompt a resultant defined pattern of protocol commands to be sent from the initiator device to all target devices that identify as the same device. The protocol commands including Small Computer System Interface (SCSI) specification compliant commands. A selected pattern of protocol command stimuli is sent from a first target device to the initiator device to prompt a resultant pattern of protocol commands from the initiator device to all target devices that identify as the same device thereby communicating the mapped message to other target devices.

Abstract: A method includes encoding data in accordance with a width parameter to produce a first set of data slices. Storage of the first set of data slices is maintained in a set of storage units of a storage pool. An expanded set of storage units of the storage pool is determined based on an additional subset of storage units added to the storage pool. Storage of the first set of data slices is maintained in the set of storage units after addition of the additional subset of storage units added to the storage pool. An updated width parameter is determined by increasing the width parameter based on the expanded set of storage units. The data is encoded in accordance with the updated width parameter to produce a second set of data slices. Storage of the second set of data slices is maintained in the expanded set of storage units.

Abstract: A volume for object storage encompasses a single logical block address space and the first range of logical block addresses being within the single logical block address space. A first and second range of logical block addresses are initially allocated within the single logical block address space of the volume for storing respective object metadata and object data. One or both of the first and second ranges of logical block addresses are reallocated to increase storage utilized by one of the object metadata and the object data.

Abstract: A size associated with a first content file is determined to be less than a threshold size. In response to determining that the size associated with the first content file is less than the threshold size, a combined metadata structure is updated at least in part by combining metadata of the first content file with metadata of a second content file in the combined metadata structure. A snapshot tree is updated to reference a first portion of the combined metadata structure corresponding to the first content file and to reference a second portion of the combined metadata structure corresponding to the second content file.

Abstract: A method for migration of data is provided. The method includes triggering a rebuild of data according to a first migration mechanism from a first storage drive to a second storage drive. Monitoring space utilization associated with the second storage drive, and adaptively switching the migration of the data from the first migration mechanism to a second migration mechanism based on the monitoring.

Abstract: A method of operating a storage system, and related storage system, are provided. The storage system establishes resiliency groups, each having a defined level of redundancy of resources of the storage system. The resiliency groups include at least one compute resources resiliency group and at least one storage resources resiliency group. The storage system supports capability of configurations that have multiples of each of the resiliency groups. Blades of the storage system perform distributed data and metadata storage across modular storage devices, in accordance with the resiliency groups.

Abstract: An apparatus comprises at least one processing device configured to, in a monitoring system in which at any given time at least one monitoring node has a primary monitoring role responsible for monitoring operation of system nodes of a distributed system and other monitoring nodes have a secondary monitoring role responsible for monitoring operation of the at least one monitoring node having the primary monitoring role, identify a first monitoring node having the primary monitoring role at a current time. The processing device is also configured to determine, based at least in part on a time-based ranking of the monitoring nodes, a second monitoring node having the secondary monitoring role at the current time to transition to the primary monitoring role, and to transition the second monitoring node to the primary monitoring role at a subsequent time.

Abstract: Storage devices store not only host data, but also control data related to operations of the storage device associated with the data. Control data is stored within blocks of memory called control blocks. As storage devices are configured to communicate with numerous hosts and namespaces, proper management of the available control blocks can avoid numerous problems such as mixed control block usage that punish certain hosts based on actions of other, non-related hosts. Methods and devices that efficiently manage control blocks include a control block management logic configured to process a request to generate a new namespace and parse the namespace request to determine the number of control blocks required. These separate control blocks for the requested namespace can be partitioned. Finally, control block activity for the requested namespace is directed only to the partitioned control blocks. Thus, the various control block activity between hosts is separate and not mixed.

Abstract: Data associated with storage media utilized by one or more storage systems is received. The data is provided as an input to a machine learning model executed by a processing device. The machine learning model identifies one or more deterministic characteristics from the data. The one or more deterministic characteristics associated with the storage media are received from the machine learning model. A data structure comprising the one or more deterministic characteristics is generated for use in a telemetry process to qualify types of storage media.

Abstract: A method of operating a storage system having solid-state storage memory with segment level heterogeneity is provided. The method includes mapping data into data segments, and mapping the data segments into data stripes. The method includes writing a first data stripe from a first data segment across a first plurality of blades of the storage system comprising heterogeneous total amounts of the solid-state storage memory per blade, and writing a second data stripe from the first data segment across a second plurality of blades of the storage system.

Abstract: Each of a plurality of events associated with a workspace or stream are stored to a functional data structure. Each of the plurality of events includes at least an indication of when an operation in the workspace or stream occurred and who performed the operation. Nodes of a change set history tree corresponding to the events can be recursively identified until a node corresponding to a change set of interest is identified. Responsive to identifying the node corresponding to the change set of interest, the event corresponding to such node can be identified as an event that added the change set of interest to the workspace or stream. The indication of when the operation represented by the event occurred and who performed the operation can be retrieved from the subject event. The indication of when the operation represented by the event occurred, and who performed the operation, can be output.

Abstract: In a method of operating storage devices including a first storage device and a second storage device connected to each other via a host device, a data migration request for a first namespace included in the first storage device is received. A second namespace is generated in the second storage device. The second namespace corresponds to the first namespace. A pointer table that is used to perform a data migration operation corresponding to the data migration request is set. First data and second data are migrated to the second namespace based on the pointer table. The first data is stored in the first namespace. The second data is stored in a first buffer memory included in the first storage device and corresponds to the first namespace. Based on the data migration operation being performed, the second data is directly transmitted from the first buffer memory to the second namespace.

Abstract: The present disclosure provides methods, systems, and non-transitory computer readable media for optimizing data storing. An exemplary system comprises: a flash drive comprising a plurality of dies; and a memory configured to store a mapping associating a first virtual machine with a first set of dies of the plurality of dies and a second virtual machine with a second set of dies of the plurality of dies, wherein: the first set of dies are hibernated in response to the first virtual machine changing to an inactive state; and the first set of dies are activated in response to the first virtual machine changing to an active state.