Abstract: A method of operating a computing system comprises defining a zoned namespace for non-volatile memory (NVM) of a memory device of the computing system, the zoned namespace including multiple NVM zones of multiple non-overlapping logical block addresses (LBAs) of the NVM, mapping persistence logging (PLOG) identifiers (IDs) to the NVM zones, a PLOG ID identifying a PLOG zone of one or more NVM zones, and performing a PLOG-specific access operation on a PLOG zone of the NVM in response to a PLOG-specific command received from a host device of the computing system.

Abstract: Embodiments relate to determining legal positions as candidate positions for inserting a memory device in memory devices and determining a namespace range migration cost for the candidate positions based on a balanced state for a namespace range distributed across the memory devices. An insertion position to insert the memory device in the memory devices is selectable from the candidate positions. A given candidate position is selected with a minimum namespace range migration cost corresponding to a requirement to transfer data between the memory devices to result in the balanced state for the namespace range across the memory devices. The given candidate position is the insertion position to insert the memory device in the memory devices. Responsive to inserting the memory device at the insertion position in the memory devices, a transfer occurs of the data in the memory devices in accordance with the insertion position of the memory device.

Abstract: A data storage method and apparatus are provided. The method includes: obtaining running parameters of a plurality of hard disks, where the running parameters of the plurality of hard disks comprise information for measuring individual differences of the plurality of hard disks in performance; selecting at least one target hard disk based on the running parameters of the plurality of hard disks; and writing data into the target hard disk.

Abstract: The disclosure herein describes converting a disk cluster to a different format. A format conversion instruction associated with a disk cluster is received. A first subgroup of disks of the disk cluster that are the emptiest disks of the disk cluster are identified and all data is evacuated from the first subgroup of disks to other disks of the disk cluster. The first subgroup of disks is reformatted based on the received format conversion instruction. A group of data objects stored in the disk cluster is converted based on the format conversion instruction and the converted group of data objects are written to the reformatted first subgroup of disks. The process iterates through the disks of the disk cluster to reformat all disks and convert all data objects based on the received format conversion instruction. The process reduces the write operations required to convert the format of the disk cluster.

Abstract: A method may include operating a first storage device and a second storage device as a redundant array configured to use parity information to recover information from a faulty storage device, operating the first storage device in a fault resilient mode with at least partial read capability based on a fault condition of the first storage device, and rebuilding information from the first storage device in a parity space of the second storage device. Rebuilding the information from the first storage device in the parity space of the second storage device may include copying the information from the first storage device to the parity space of the second storage device. The method may further include copying the rebuilt information from the parity space of the second storage device to a replacement storage device.

Abstract: One or more parameters corresponding to a targeted energy characteristic of a computing client device are received. A ratio of types of storage devices allocated to the computing client device is adjusted based on the one or more parameters. A storage volume for the computing client device is provisioned according to the ratio of the types of the storage devices.

Abstract: A size associated with a first content file is determined to be less than a threshold size. In response to determining that the size associated with the first content file is less than the threshold size, a combined metadata structure is updated at least in part by combining metadata of the first content file with metadata of a second content file in the combined metadata structure. A snapshot tree is updated to reference a first portion of the combined metadata structure corresponding to the first content file and to reference a second portion of the combined metadata structure corresponding to the second content file.

Abstract: A system can determine respective health statuses for respective microservices of respective instances of a group of microservices. The system can monitor the requests to determine a correlation between respective requests of the requests and respective subgroups of microservices of the group of microservices that carry out the respective requests. The system can determine a subgroup of container clusters of container clusters that are available to serve a first request type, based on determining an intersection between the respective subgroups of microservices of the group of microservices that carry out the respective requests, and the respective health statuses for respective microservices of respective instances of the group of microservices. The system can, in response to receiving a first request of the first request type, assign, by a load balancer, the first request to be served by a first container cluster of the subgroup of container clusters.

Abstract: Provided are a computer program product, system, and method for replicating and migrating files to secondary storage sites. Files in a fileset at the primary storage site are migrated to a file container, wherein data for the files migrated to the file container is distributed among the secondary storage sites. File metadata for each of the migrated files is updated to include access information on the migrated file in the file container. Data for the migrated files is deleted in a local storage. The file metadata for the migrated files is replicated to the secondary storage sites over the network to store in filesets at the secondary storage sites without replicating file data for the migrated files to store in the filesets the secondary storage sites.

Abstract: A processing system is operable to encode data to produce a first set of data slices based on a value of a width parameter. The data is stored based on maintaining storage of the first set of data slices across a set of storage units of a storage pool. Storage of the first set of data slices is maintained in the set of storage units of the storage pool after addition of an additional set of storage units added to the storage pool. The value of the width parameter is increased to an increased value to produce an updated width parameter. The data is re-encoded in accordance with the updated width parameter to produce a second set of data slices. The data is re-stored based on maintaining storage of the second set of data slices across the expanded set of storage units of the storage pool.

Abstract: A method may include operating a first storage device and a second storage device as a redundant array configured to use parity information to recover information from a faulty storage device, operating the first storage device in a fault resilient mode with at least partial read capability based on a fault condition of the first storage device, and rebuilding information from the first storage device in a parity space of the second storage device. Rebuilding the information from the first storage device in the parity space of the second storage device may include copying the information from the first storage device to the parity space of the second storage device. The method may further include copying the rebuilt information from the parity space of the second storage device to a replacement storage device.

Abstract: Methods, systems, and media for detecting the presence of a digital media device on a network are provided. In some embodiments, methods for detecting a presence of a particular type of digital media device is provided, the methods comprising: identifying cached device details for devices previously associated with the network; performing a simple device discovery protocol (SSDP) on the network, and substantially concurrently sending a unicast message to an address associated with the identified cached digital media device using hypertext transfer protocol (HTTP); and indicating the presence of a digital media device on the network in response to either (i) receiving a response to the unicast message, or (ii) determining that a type of a device discovered using SSDP is the same as the particular device type.

Abstract: A direct-attached storage device software RAID hibernation system includes a chassis having an operating system, a bus driver subsystem, controller devices coupled to physical storage devices, and a software RAID subsystem coupled to the operating system and the controller devices. While in a runtime mode, the software RAID subsystem presents the operating system a primary controller device as being connected to a logical storage device provided by the physical storage devices, and provides a filter subsystem in a secondary controller device that controls at least one of the physical storage devices. While in the runtime mode, the filter subsystem identifies a controller initialization request from the operating system that requests initialization of the secondary controller device and, in response, transmits a power-down prevention communication to the bus driver subsystem that is configured to prevent the bus driver subsystem from powering down the secondary controller device during a hibernation mode.

Abstract: A direct-attached storage device software RAID boot system includes a chassis housing PCIe subsystems coupled to a UEFI subsystem and a software RAID subsystem. The software RAID subsystem identifies a first PCIe subsystem that is not claimed by a UEFI driver provided by the UEFI subsystem, and determines that the first PCIe subsystem is one of a PCIe bridge device or a PCIe root device. In response, the software RAID subsystem claims the first PCIe subsystem, installs a RAID protocol on the first PCIe subsystem, attaches at least one RAID logical storage subsystem provided by at least one PCIe endpoint device in the PCIe subsystems to the first PCIe subsystem, and presents the UEFI subsystem with a PCIe controller device in the first PCIe subsystem as being connected to the at least RAID logical storage subsystem.

Abstract: A system and method for performing an image level restore of data is described. In some examples, the system receives a request to restore a file and transmits the request to an intermediate component. The intermediate component may then retrieve a directory file from an image of a secondary copy of a data set, identify a location of the file from the directory file, and provide the location to the requestor.

Abstract: A method for configurable caching, deduplication, and rate limit handling of user interface data requests according to an embodiment includes receiving a data request initiated by a user interface element of a user interface, determining whether a deduplication cache includes a deduplication entry associated with the data request, determining whether a main cache includes a cache entry associated with the data request in response to determining that the deduplication cache does not include the deduplication entry, determining whether the data request is associated with a rate-limited group of application programming interface endpoints in response to determining that the main cache does not include the cache entry or determining that the cache entry has expired, and making the data request to a backend system after a predefined server retry period associated with the rate-limited group has elapsed in response to determining that the data request is associated with the rate-limited group.

Abstract: An example method for adjusting IO profiles in a distributed storage system comprises: determining, by a storage system that provides a volume as persistent storage for a container application running in a container system, a characteristic of the container application; and adjusting, by the storage system and based on the characteristic of the container application, an input/output (IO) profile of the volume.

Abstract: The disclosure provides a system, computer readable medium, and computer-implemented method for managing data access. The method includes obtaining a data access request from a requestor for client data redundantly stored in at least two storage providers that are unknown to the requestor; identifying a service level objective for servicing the data access request; ranking the at least two storage providers based on the service level objective to identify one of the at least two storage providers to service the data access request; and providing the requestor with access to a copy of the client data using the one of the at least two storage providers.

Abstract: Various implementations described herein relate to systems and methods for a storage device (e.g., a Solid State Drive (SSD)) to perform a Compute Function (CF). One or more embodiments include a method by which a data transfer is annotated to call out a computation to be performed by the storage device on data before, after, or in parallel with reading the data from or writing the data to the storage device. One or more embodiments include a storage device including a controller, wherein the controller is configured to perform a method including receiving a command from a host, the command identifying the CF, and in response to receiving the command, performing the CF on at least one of internal data stored in the storage device or external data transferred from the host to determine the computation result of the CF.

Abstract: A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. A plurality of failure resilient stripes is distributed across the plurality of storage devices such that each of the plurality of failure resilient stripes spans a plurality of the storage devices. The plurality of computing devices maintains each failure resilient stripe using a bucket. These buckets are operably split and transferred between the computing devices to balance available computing power and storage access.

Abstract: The present technology includes a storage device including a memory device including a first storage region and a second storage region and a memory controller configured to, in response to a write request in the first storage region from an external host, acquire data stored the first region based on a fail prediction information provided from the memory device and to perform a write operation corresponding to the write request, wherein the first storage region and the second storage region are allocated according to logical addresses of data to be stored in by requests of the external host.

Abstract: A memory system includes a first semiconductor memory device, a second semiconductor memory device, and a controller for controlling operations thereof. Each of the first and second semiconductor memory devices includes a normal area and a preliminary area. The controller is configured to determine a data migration operation on target data stored in the first semiconductor memory device and in response thereto control the first semiconductor memory device to read the target data, generate migration data including a plurality of group migration complete data indicating that the data migration operation has been partially completed based on the target data, and control the second semiconductor memory device to program the migration data in the preliminary area of the second semiconductor memory device.

Abstract: A method may include operating a first storage device and a second storage device as a redundant array configured to use parity information to recover information from a faulty storage device, operating the first storage device in a fault resilient mode with at least partial read capability based on a fault condition of the first storage device, and rebuilding information from the first storage device in a parity space of the second storage device. Rebuilding the information from the first storage device in the parity space of the second storage device may include copying the information from the first storage device to the parity space of the second storage device. The method may further include copying the rebuilt information from the parity space of the second storage device to a replacement storage device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining a terminal idle time. In some implementations, a server can obtain communication data from a plurality of devices in a communication network, wherein the communication data indicates levels of network traffic for the device over time. The server can generate an idle period forecasting model configured to predict occurrence of future communication idle periods in which communication activity is predicted to be below a threshold. The server can provide the idle period forecasting model to each of the plurality of devices such that the devices can respectively use the idle period forecasting model to locally predict future communication idle periods of the devices.

Abstract: An apparatus comprises a processing device configured to receive a request to perform merging in a snapshot mapping structure comprising objects representing a given storage volume and its snapshots. The objects are organized in a tree structure representing data dependencies between the given storage volume and its snapshots. The processing device is also configured to analyze the snapshot mapping structure to identify ones of the objects that are candidates for deletion and to determine merge groups. A given one of the merge groups includes (i) at least a subset of the objects identified as candidates for deletion and (ii) a given object that is a child object of at least one of the subset of the objects identified as candidates for deletion. The processing device is further configured to perform merging in the snapshot mapping structure by merging data items in the given merge group to one of its objects.

Abstract: Methods, systems, and devices for techniques for data transfer operations are described. A memory system may select a source set of memory cells and a destination set of memory cells using one or more counters corresponding to access operations for the source and the destination. For example, as part of a data transfer operation, the memory system may prioritize transferring data from a block with a lower quantity of read operations to a block with a lower quantity of access operations. In some cases, the memory system may prioritize transferring data from a page with a lower quantity of read operations to a page with a slower read duration.

Abstract: Rebalancing the workload of logical devices across multiple nodes may include dynamically modifying preferred paths for one or more logical devices in order to rebalance the I/O workload of the logical devices among the nodes of the data storage system. Determining whether to rebalance the I/O workload between the two nodes may be performed in accordance with one or more criteria. Processing may include monitoring the current workloads of both nodes over time and periodically evaluating, in accordance with the one or more criteria, whether the current workloads of the nodes are imbalanced. Responsive to determining, in accordance with the criteria, that rebalancing of workload between the nodes is needed, the rebalancing may be performed. A notification may be sent to the host regarding any path state changes made as a result of the workload rebalancing.

Abstract: One or more requests are received by a processing device managing one or more memory devices of a memory sub-system from a host system to store a set of data items. A zone group corresponding to a size of the set of data items is identified. A set of zones of the zone group which satisfies a programming parallelism criterion is identified among two or more zones defined in the memory sub-system. The set of data items are programmed to memory cells of the identified set of zones.

Abstract: Methods, systems, and techniques are disclosed for managing replication in a deployable object, such as a pod (e.g., a group of one or more containers). For example, when a pod is started in a cluster, the deployable object may start one or more virtual computer systems (e.g., containers), which may pull (e.g., initiate and run) container images from a registry server. The processing device may thus identify, such as on the file level, which container image should be pulled first. A scheduler of the one or more virtual computer systems may prioritize, based on the computed scores, a subsequent replication of archived data of the one or more virtual computer systems to be performed. The processing device may then execute, based on the prioritization by the scheduler, the subsequent replication of the archived data of the one or more virtual computer systems in the deployable object.

Abstract: A storage system has a first memory, a second memory that include solid-state storage memory, and a processing device. The processing device is to select a mode for each portion of data to be written. Selection of the mode is based at least on size of the portion of data. Selection of the mode is from among modes that include a first mode of writing the portion of data in mirrored RAID form to the first memory for later transfer from the first memory to the second memory, a second mode of writing the portion of data in parity-based RAID form to the first memory for later transfer from the first memory to the second memory, and a third mode of writing the portion of data to the second memory, bypassing the first memory. The processing device is to handle portions of data to be written according to such selection.

Abstract: High priority host applications are protected from data loss associated with failure of multiple drives associated with the same protection group by preemptively relocating associated host application image data to protections groups that do not have failed drives. New storage allocations for the high priority host applications are preferentially located on protections groups that do not have failed drives. Following replacement of the failed drive, the preemptively relocated data and new allocations are redistributed across protection groups in a balanced manner. Protection groups are characterized as targets, sources, or neutral based on allocations of high priority host application image data relative to other protection groups. Sources and paired with targets and portions of the high priority host application image data are iteratively relocated until all protection groups are neutral.

Abstract: Data associated with a first storage media of a cloud-based storage system is provided as an input to a machine learning model executed by a processing device that identifies one or more characteristics of the first storage media from the data. A type of change associated with the second storage media is determined by the machine learning model based on a comparison of the one or more characteristics of the first storage media and one or more characteristics of a second storage media. The type of change associated with the second storage media is provided to a cloud services provider of the cloud-based storage system.

Abstract: One or more aspects of the present disclosure relate to dynamically selecting a storage array and corresponding input/output (IO) paths between a host and the storage array. In embodiments, a virtual storage volume (VSV) can be established for a host entity using one or more storage device portions from a plurality of storage arrays. In addition, IO servicing metric parameters can be dynamically measured. For example, the servicing metric parameters can define metrics corresponding to the VSV's assigned ports on each storage array or network latency between the host and each storage array. Further, a primary storage array from the plurality of storage arrays can be selected based on the IO servicing metrics.

Abstract: A method may include operating a first storage device and a second storage device as a redundant array configured to use parity information to recover information from a faulty storage device, operating the first storage device in a fault resilient mode with at least partial read capability based on a fault condition of the first storage device, and rebuilding information from the first storage device in a parity space of the second storage device. Rebuilding the information from the first storage device in the parity space of the second storage device may include copying the information from the first storage device to the parity space of the second storage device. The method may further include copying the rebuilt information from the parity space of the second storage device to a replacement storage device.

Abstract: A method comprises collecting data from a computing environment comprising one or more storage devices, wherein the data comprises information identifying assignments of the one or more storage devices to one or more servers in the computing environment. In the method, the data is analyzed using one or more machine learning algorithms, wherein the analyzing comprises predicting whether a given configuration of the one or more storage devices in combination with the one or more servers is a specified configuration. The method also includes generating a storage configuration recommendation for a user based on the analysis, and transmitting the storage configuration recommendation to the user.

Abstract: Technologies are described herein for remotely configuring multi-mode dual in-line memory modules (“multi-mode DIMMs”) using a firmware or a baseboard management controller (“BMC”). Technologies are also described for simultaneously initiating multiple commands for configuring multi-mode DIMMs using a BMC and for updating inventory data regarding multi-mode DIMMs stored by a BMC.

Abstract: A data write method, a data read method, a device, and a system are provided. The data write method is applied to a computer device, which includes a storage device and a plurality of nodes in a non-uniform memory access architecture (NUMA) system, and each node has a buffer and a controller that controls the buffer. The data write method includes: obtaining a write request of target data; determining, in response to the write request, a target page that is in the storage device and that stores the target data; determining, from a plurality of buffers corresponding to the plurality of nodes, a target buffer corresponding to the target page; writing the target data into a page of the target buffer by using a target controller that controls the target buffer; and writing data of the page of the target buffer into the target page in the storage device.

Abstract: In one or more embodiments, the present invention is directed to a blockchain secured, software-defined network and monitoring system comprising: a multi-controller software-defined network (SDN) network layer; a blockchain based security and autonomy layer; a deep learning-driven decision making layer comprising the one or more computational centers and a horizontal data plane layer. In some embodiments, the present invention is directed to methods for ensuring the integrity of a control commands and optimizing performance and security using the blockchain secured, software-defined network and monitoring system. In various embodiments, the present invention relates to methods for extracting useful features from said labelled and non-labelled data contained in the horizontal data plane layer in the blockchain secured, software-defined network and monitoring system using a knowledge domain-enabled hybrid semi-supervision learning method.

Abstract: Systems and methods that relate to memory devices are disclosed. In some implementations, a memory system includes a first data storage device and a second data storage device. Each of the first and second data storage devices includes a plurality of memory blocks, each memory block including a plurality of memory cells each operable to store one or more data bits, and page buffers that cache data to be written to the memory blocks or read from the plurality of memory blocks on a page basis, and a controller including a cache memory configured to temporarily store first data, and configured to move the first data from a portion of the cache memory to one or more of the page buffers of the first data storage device and allocate the portion of the cache memory as a temporary buffer for storing data.

Abstract: Various embodiments enable a memory sub-system to perform a read operation based on consolidated memory region description data, which can be generated based on a memory region description data (e.g., SGL) provided by a host system for the read operation.

Abstract: A distributed database system maintains a database including a data shard for which a primary computing node is responsible. The primary computing node identifies a data storage plan for the data shard. The plan identifies a file subset of data storage files of the shard to be merged into a larger data storage file, and a node subset of computing nodes of the system that subscribe to the data shard. The primary node identifies which computing nodes of the node subset each have sufficient computing resources to execute the plan, as candidate computing nodes. The primary node identifies which files of the file subset each candidate computing node locally caches. The primary node selects one candidate computing node to execute the plan, based on the files of the file subset that each candidate computing node locally caches. The primary node causes the selected candidate computing node to execute the plan.

Abstract: A method of upgrading a VIM server appliance includes: creating a snapshot of logical volumes mapped to physical volumes that store configuration and database files of virtual infrastructure management (VIM) services provided by a first VIM server appliance to be upgraded; after the snapshot is created, expanding the configuration and database files to be compatible with a second VIM server appliance; replicating the logical volumes which have been modified as a result of expanding the configuration and database files, in the second VIM server appliance; after replication, performing a switchover of VIM services that are provided, from the first VIM server appliance to the second VIM server appliance; and upon failure of any of the steps of expanding, replicating, and performing the switchover, aborting the upgrade, and reverting to a version of the configuration and database files that was preserved by creating the snapshot.

Abstract: Computer-readable media, methods, and systems are disclosed for linear interval-based dynamic range partitioning in one or more database systems. A request is received by a database management system to insert a new row into a partitioned database table. The partitioned database table may include a plurality of existing partitions and a partition others partition. Based on determining that the new row should be inserted into the partition others partition a series of steps are performed. First, one or more new partitions are added to the partitioned database table. Then, the new row is inserted into the one of the one or more new partitions in the partitioned database table.

Abstract: A random number generator selects addresses while a ‘scoreboard’ bank of registers (or bits) tracks which addresses have already been output (e.g., for storing or retrieval of a portion of the data.) When the scoreboard detects an address has already been output, a second address which has not been used yet is output rather than the randomly selected one. The second address may be selected from nearby addresses that have not already been output.

Abstract: A communications circuit with an input port, a switching circuit coupled to the input port, and a first and second memory coupled to the switching circuit. The communications circuit also includes controlling circuitry adapted to operate the switching circuit to couple data received at the input port to the first memory while the second memory is disabled from power and to couple data received at the input port to the second memory once the first memory is filled with valid data.

Abstract: A method includes updating a first metadata log in an NVRAM of a host device corresponding to one or more recent input/output (I/O) operations received by the host device, periodically checking whether the size of the updated first metadata log is greater than a flush limit maintained in the host device, triggering a meta flush thread when the updated first metadata log size exceeds the flush limit maintained in the host device, sending, by a non-volatile memory express (NVMe) driver, a first command for synchronizing the updated first metadata log to one or more solid state drives (SSDs) for updating a second metadata log in the one or SSDs, and discarding, by the host device, metadata of the first metadata log updated in the host device after receiving a second command for acknowledging synchronization completion from the one or more SSDs.

Abstract: A system, method and device for ingesting data files into remote computing environments is disclosed. The method includes receiving a plurality of data files and processing same according to a modified round-robin (MRR) process. The MRR assigns data files for processing by determining which of a plurality of remote processors are active, and by determining an amount of queued processing for the active remote processors. The method includes assigning each data file of the plurality of data files to a remote processor of the plurality of remote processors based on the remote processor (1) being active, and (2) having a relatively lower amount of queued processing. The method includes instructing a storage writer to store processed data files.

Abstract: A system can receive a file in parts. The system can write a first part to a first temporary file that corresponds to the first part's length at a first location of the first temporary file based on the its part number. The system can for a second part having a same length as the first part, write the second part to the first temporary file at a second location of the first temporary file based on its part number. The system can, in response to receiving a third part that has a different length than the first part, write the third part to a second temporary file at a third location of the second temporary file based on its part number. The system can, after receiving the parts, write data of the second temporary file to an end of the first temporary file, and rename the temporary file.

Abstract: Techniques for storage management involve determining a plurality of storage units to be reconstructed on a group of disks, the plurality of storage units being distributed on different disks in the group of disks. Such techniques further involve selecting, based on the distribution of the plurality of storage units on the group of disks, a group of storage units from the plurality of storage units so that different storage units in the group of storage units are distributed on different disks. Such techniques further involve performing concurrent reconstruction on the group of storage units.

Abstract: The ICT resource management device includes: a configuration information management part that manages configuration information of physical nodes and virtual nodes; a layer mapping part that performs mapping between the physical layer and the virtual layer; a location specifying part that specifies a location of a physical node; a device connect destination determination part that determines a physical node to which to connect the device in response to a request for configuration change based on at least one of the specified location, information relating to a service, a network connection configuration of the network connecting the device to the physical node, and quality of the network; a blueprint creation part that creates a blueprint based on the configuration information, the mapping information, and the connection destination; and an orchestrator part that performs orchestration.