Abstract: A method for operating a controller configured to control subsystems in a network, each subsystem including a plurality of memory regions, includes testing a compressibility ratio of data and selecting, according to the compressibility ratio, memory regions for storing the data and replicated data.

Abstract: The disclosure herein describes placing delta components of a base component in target fault domains. One or more delta components are generated. When a first fault domain that lacks a sibling component of the base component is identified, the first fault domain is selected as a single delta target fault domain and a single delta component is placed on the single delta target fault domain. When a second fault domain that includes a first sibling component of the base component is identified and a third fault domain that includes a second sibling component of the base component is identified, the second fault domain and the third fault domain are selected as a first double delta target fault domain and a second double delta target fault domain, and a first double delta component and a second double delta component are placed on the first and second double delta target fault domains.

Abstract: A distributed, deduplicated storage system according to certain embodiments is arranged in a parallel configuration including multiple deduplication nodes. Deduplicated data is distributed across the deduplication nodes. The deduplication nodes can be networked together and communicate with one another according using a light-weight, customized communication scheme (e.g., a scheme based on FTP or HTTP). In some cases, deduplication management information including deduplication signatures and/or other metadata is stored separately from the deduplicated data in deduplication management nodes, improving performance and scalability.

Abstract: A distributed storage system includes a primary storage system and a secondary storage system. The secondary storage system stores the actual data and the primary storage system stores metadata for the actual data. The metadata references at the primary storage system may be deleted without deleting the corresponding data at the secondary storage system. Snapshots of the metadata at the primary storage system are sent to the secondary storage system. The secondary storage system can compare two metadata snapshots received from the primary storage in order to determine whether data stored at the secondary storage system has been deleted at the primary storage system for longer than a retention period. Such data may be deleted to free up storage space at the secondary storage server.

Abstract: Some embodiments provide a method for migrating a set of data objects from a first database of a first database type to a second database of a second database type. The method retrieves a particular set of data from the first database and performs an automated process to analyze the particular set of data in order to select the second database type from multiple other database types. The method presents on a display the selected second database type and a user interface control for migrating the set of data objects stored in the first database to the second database of the second database type. In response to a selection of the user interface control, the method provisions the second database and transfers the set of data objects from the first database to the second database.

Abstract: Various examples are directed to systems and methods for programming memory. A programming appliance may receive a command file comprising a first pre-generated digital signature. The first pre-generated digital signature may be associated with a memory system, with a first command and with a first memory system counter value. The programming appliance may send to a memory system a first command message. The first command system may comprise the first command and the first pre-generated digital signature.

Abstract: Described are a method, system, and computer program product for deduplicating a storage object. A hash of a window of data of a storage object is determined and a determination is made as to whether the window of data of the storage object corresponds to a chunk boundary. A determination is made as to whether the hash of the object matches one pseudo fingerprints in a list of at least one pseudo fingerprint. A storage object chunk boundary based on the window of data is stored in response to the window of data corresponding to the chunk boundary or in response to determining that the hash of the object matches one of the pseudo fingerprints. A determination is made of a new window of data in the storage object following the window of data when the window of data is not an end of data of the storage object.

Abstract: A method for performing a backup operation includes obtaining, by a backup server, container information associated with a plurality of application containers, generating a container score for each application container in the plurality of application containers based on the container information, identifying a resource availability for a backup agent associated with the plurality of application containers, generating an ordering of the plurality of application containers based on the availability and the container scores, and sending a prioritization list update request to the backup agent based on the ordering.

Abstract: Techniques are used for enabling deduplication for asynchronous replication in a storage system. The techniques may be used to provide, among other things, retrieving, on a source system, a virtual index key corresponding to a logical address, and determining whether a deduplication index table for a target system includes an entry with the same virtual index key.

Abstract: Embodiments are disclosed for a method. The method includes generating a backing layer having a file volume, in a layering file format and representing a portion of a volume snapshot that is backed up on a slower storage, and enabling an associated virtual machine. The method also includes generating an active layer comprising a second file volume, in the layering file format, representing a second portion of the volume snapshot, and enabling the associated virtual machine. The method further includes starting a process to pull a plurality of blocks from the backing layer to the active layer.

Abstract: Relocation of virtual machines is facilitated by obtaining, by a first controller, first power-related information from a first power system set that provides power to a first set of powered hardware components, where the first set of powered hardware components are running a first plurality of virtual machines. The first controller generates a relocation protocol for migrating the first plurality of virtual machines based, at least in part, upon the first power-related information. The relocation protocol includes: a migration of a first subset of one or more virtual machines so that the first subset of virtual machine(s) is to be migrated to and run on a second set of powered hardware components in a manner such that the first subset of virtual machine(s) continues to operation in a substantially continuous manner through the migration; and a snapshotting of a second subset of one or more virtual machines.

Abstract: One example method includes selecting a best performing memory for an operation. A data protection system may maintain a global view of performance data for multiple namespaces. The performance data may reflect latency and/or bandwidth for each of the namespaces. The global view may be updated. When performing an operation, the best performing namespace can be selected from the global view based on performance.

Abstract: Provided is a system for managing the resource limit associated with a user, where the resource limit indicates the amount of compute resources the user is allowed to use. As the user requests and obtains additional resources from a pool of resources, the user's resource usage is increased to reflect the additional resources being used by the user. As the resources used by the user are released, to ensure that the pool of resources has sufficient capacity to handle additional resource requests, the replenishment status of the pool is further checked, and if the replenishment status satisfies a condition for updating the user's resource usage, the user's resource usage is decreased to reflect the resources that are no longer in use by the user. The released resources are torn down and re-provisioned back into the pool of resources.

Abstract: A backup orchestrator for providing backup services to entities includes storage for storing recovery point objectives for the entities and a backup manager. The backup manager selects an optimization periodicity based a number of backups to be generated to meet a portion of the recovery point objectives; makes a determination that at least one of the portion of the recovery point objectives has a maximum allowable unbacked up period of time that is greater than the optimization periodicity; in response to the determination: load balances the number of backups across multiple optimization periods, based on the optimization periodicity, of a balanced backup schedule; selects a backup generation time for each of the to be generated backups in each of the optimization periods of the balanced backup schedule; and generates the number of backups using the balanced backup schedule.

Abstract: Described is a system for detecting corruption in a deduplicated object storage system accessible by one or more microservices while minimizing costly read operations on objects. A testing tool inserts object corruptions in object storage. A verification path is performed by a controller module and one or more worker nodes. The testing tool verifies whether the executed verification path accurately detected the testing tool's inserted object corruptions.

Abstract: Described herein are systems, methods, and software to enhance network traffic management for virtual machines. In one implementation, a host for a virtual machine may identify applications available for execution on the virtual machine from mounted application volumes and identify firewall rules for the applications. Once identified, the host may identify network traffic for the virtual machine, and forward or block the network traffic for the virtual machine based on the firewall rules.

Abstract: A method, computer program product, and computer system for creating, by a computing device, a snapshot related to a snapshot family, wherein an inheritance tree may be maintained for each snapshot family. A write to the snapshot may be received. A hash-based overwrite mapping data structure may be updated based upon, at least in part, receiving the write to the snapshot.

Abstract: Replication operations of replicating data from a production site to a replica site. The replication is performed using independent Merkle trees. The Merkle trees are updated asynchronously using Merkle trees that have been augmented with a time-based value. The synchronization is verified by comprising root hashes of the independent Merkle trees at certain points in time. The replication and Merkle trees are self-healing and trigger a resynchronization when a discrepancy is discovered.

Abstract: A method for performing backup operations includes obtaining, by a stream allocator operating in a backup storage system, a plurality of media management entries, wherein a media management entry of the plurality of media management entries specifies a data object, a relative priority, and a maximum number of streams, selecting the media management entry based on the relative priority, allocating a number of backup streams to the data object based on the maximum number of streams, and initiating a transfer of a backup of the data object from the production host to the backup storage system.

Abstract: Provided are a computer program product, system, and method for hypervisor agnostic interchangeable backup recovery and file level recovery from virtual disks. Data is stored for a first virtual disk that represents data in a first format and metadata for the first virtual disk in a common data format in a storage having a fixed block length. A virtual disk file represents data in a second format that allows variable size blocks. Multiple instances of the fixed block length of blocks of data for the second virtual disk indicated in the virtual disk file are read. Each instance of the read fixed block length of blocks is written to the storage in the common data format with metadata describing the format of the blocks in the second virtual disk, and can be restored to a third virtual disk in the first or second format.

Abstract: A system and method for replicating a file system. The method includes: copying a portion of the file system from a first storage, wherein the at least a portion of the file system includes underlying data and metadata, wherein the metadata includes pointers to the underlying data and metadata defining a file system hierarchy; partitioning the copied data of the file system into a plurality of blobs, wherein the plurality of blobs includes a plurality of data blobs and a plurality of metadata blobs, wherein each data blob includes at least one portion of the underlying data; generating a plurality of filter objects based on the copied data, wherein each filter object includes a list of metadata blobs; and storing the plurality of blobs and the plurality of filter objects in a second storage.

Abstract: An apparatus in an illustrative embodiment comprises at least one processing device comprising a processor coupled to a memory. The apparatus is configured to maintain a snapshot tree data structure having a plurality of volume nodes corresponding to respective ones of (i) a root volume and (ii) multiple snapshots related directly or indirectly to the root volume. The apparatus is further configured to determine a set of data descriptors for a given volume offset, to determine a set of reader volume nodes that are readers of a corresponding data item based at least in part on the set of data descriptors, to adjust one or more of the data descriptors in the set of data descriptors based at least in part on the set of reader volume nodes, and to reclaim storage space previously allocated to the data item responsive to the adjusting of the one or more data descriptors.

Abstract: An example operation may include one or more of recording, by a snapshot node, a plurality of snapshots of a key-value storage based on a plurality of delta offsets from an initial snapshot of the key-value storage, receiving, by the snapshot node, an audit request from an audit node that contains an audit time, generating, by the snapshot node, a current snapshot based on an aggregation of the snapshots from the plurality of the snapshots up to a time of a transaction closest to the audit time, and executing, by the snapshot node, a chaincode based on a delta offset of the current snapshot from the time of the transaction to the audit time to restore a snapshot at the audit time.

Abstract: A storage system is connected to a backup storage system over a Storage Area Network (SAN). The backup storage system is managed by a backup server. The storage system includes a primary volume, a secondary volume configured to be mounted to a backup volume in the backup storage system and configured to be paired with the primary volume, and a processor configured to, for receipt of a backup operation request from the backup server, copy the primary volume to the secondary volume through a pair operation based on an Input/Output (I/O) between the storage system and a host computer managing the storage system, mount the secondary volume to the backup volume, and based on the I/O, copy the secondary volume to the backup volume through the SAN.

Abstract: The disclosed technology teaches recovering a first virtual machine or an instance with an Internet Protocol address, a first root volume and one or more data volumes that are corrupted. The first virtual machine is hosted by a first cloud server that hosts plurality of virtual machines. The disclosed technology includes instructing the first cloud server to launch a recovery virtual machine. The recovery virtual machine launches one or more new data volumes based upon captured file system images in one or more snapshots taken of corrupted data volumes of the first virtual machine prior to becoming corrupted. The recovery virtual machine detaches the corrupted data volumes and attaches the new data volumes launched to the first virtual machine. The Internet Protocol address of the first virtual machine remains unchanged.

Abstract: Embodiments are described for enabling file level recovery (FLR) process for dynamic and VHD disks in a data storage system. For VHD disks, certain intelligence is provided to a FLR agent installed in a helper VM to discover the VHD disks in the source VM. The FLR agent detects the presence of the VHD disk in the source VM, and upon detection, performs an Instant Recover (IR) operation of the source VM. It mounts the VHD disk and contained VHD files in the source VM on the helper VM to expose the VHD files to the FLR operation, and a backup operation copies the exposed VHD files to a destination folder on a destination VM. The memory mapping to the VHD disk is maintained by the helper VM during the FLR operation.

Abstract: A method for managing data includes identifying, by a compute acceleration device (CAD), a first chunk to be health-checked using storage metadata, generating a first chunk identifier using the first chunk, making a determination that the first chunk identifier does not match a second chunk identifier stored in the storage metadata, and in response to the determination: obtaining a plurality of chunks associated with the first chunk, regenerating the first chunk using the plurality of chunks to generate a new first chunk, storing the new first chunk in a data node, wherein the CAD is executing in the data node, updating the storage metadata based on storage of the new first chunk to obtain updated storage metadata, and sending a copy of the updated storage metadata to at least one other CAD in a second data node.

Abstract: Systems and methods for providing data protection services are provided. In one example, data protection services are provided in a high availability system. Server side copies of the data stored in or by nodes or servers of the high availability system are generated. The server side copies are independent of the operating systems and storage hierarchies associated with the actual data. The resulting backup copies can be generated by storing metadata that includes references to the original data. The backup copies can also be restored without being hindered by the operating systems and storage hierarchies of the highly available system.

Abstract: Providing copy data candidates appropriate for a user request. Included are an operational portal that registers user request information; a data catalog that manages information about multiple copy data located at sites configuring a hybrid cloud system; a data allocation service that allocates duplicated copy data to the sites; and a guideline management service that selects a copy data candidate appropriate for user request information. The guideline management service acquires information about copy data containing the same data as user request information from the data catalog and verifies whether there is a copy data candidate satisfying the user request information. When there is consequently no copy data candidate satisfying the user request information, the copy data is allocated to the site on condition that the copy data is optimal enough to satisfy a generation schedule and a processing speed of a copy data candidate satisfying the user request information.

Abstract: A memory system may include: a non-volatile memory device suitable for storing firmware; a volatile memory device comprising a write cache region for temporarily storing write data to be programmed into the non-volatile memory device and a firmware cache region for loading the firmware from the non-volatile memory device; and a controller suitable for: moving, to the write cache region, changeable firmware data that is generated or modified in the firmware cache region during an operation of the controller; programming the changeable firmware data, after it is moved into the write cache region, into the non-volatile memory device; and generating, in the firmware cache region, access information of the changeable firmware data.

Abstract: Techniques involve: receiving an input/output request for data stored in a second storage means of a storage system; determining a use frequency of the data; moving the data from the second storage means into a first storage means in the storage system if it is determined that the use frequency is higher than a threshold frequency and the input/output request is a read request, an input/output speed of the first storage means being higher than that of the second storage means; and writing, if it is determined that the use frequency is higher than the threshold frequency and the input/output request is a write request that includes update data, the update data as the data into the first storage means. Accordingly, the storage performance can be improved without affecting the input/output traffic, which not only can reduce the operating cost, but also can improve user experience.

Abstract: An access method is provided, which is applied to a memory device. The memory device is coupled to a host device, the host device is configured to provide a data, the memory device includes a SSD controller and a volatile memory, the volatile memory is coupled to the SSD controller, and the volatile memory includes a data storage area. The access method includes: the SSD controller receiving the data, the SSD controller generating a corresponding cyclic redundancy check code according to the data, and the SSD controller sequentially storing the data and the cyclic redundancy check code into the data storage area.

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

Abstract: Disclosed are systems and methods for proactive disaster recovery. The described technique monitors for events raised by a system of interconnected external sensors and other devices for obtaining data on the external environment of servers. The system uses these events as a chain of triggers according to which preventative or preparatory actions for disaster recovery are performed.

Abstract: Creating snapshot data sets for a plurality of logical devices of a storage system includes marking an initial set of the logical devices for a snapshot in response to each of the initial set of logical devices having been modified since obtaining a previous snapshot data set, suspending I/O operations, marking an additional set of the logical devices for a snapshot in response to each of the additional set of logical devices having been modified prior to suspending I/O, performing a snapshot of the logical devices in the initial set of logical devices and in the additional set of logical devices, and resuming I/O operations. Pointers to snapshots for the snapshot data set may be placed in a table that includes a plurality of entries for a plurality of snapshot data sets. None of the additional set of logical devices may be part of the initial set of logical devices.

Abstract: A garbage collection method for a data storage device includes steps of: entering a background mode from a foreground mode; selecting a plurality of source data blocks from a plurality of in-use data blocks; dividing a mapping table into a plurality of sub-mapping tables and selecting one of the sub-mapping tables as a target sub-mapping table, wherein the target sub-mapping table is used to manage one of the source data blocks; selecting a destination data block from a plurality of spare data blocks; and sequentially updating a correspondence relationship of data stored in the target sub-mapping table from the source data blocks to the destination data block, wherein the updating comprises copying the data stored in the source data blocks to the destination data block.

Abstract: Embodiments of the present disclosure provide a data migration method and apparatus. The method includes: receiving a migration task of migrating data in a first system to a second system; and calling upper-layer interfaces corresponding to the migration task, and calling underlying operation interfaces of the first system and the second system by the upper-layer interfaces through an abstract interface class to migrate the data of the first system to the second system. Bidirectional data transmission and migration can be implemented between any two data ends. Bidirectional data transmission and migration between any data terminals.

Abstract: An operating method of a data storage system comprising a processor and multiple storage devices, the operating method comprising: a first storage operation of selecting a first storage device, a second storage device, and a third storage device among the multiple storage devices and transmitting and storing data generated by the processor in the first storage device and the second storage device, a second storage operation of transmitting, to the third storage device, the data stored in the second storage device and compressing and storing the data in the third storage device, a first access operation of accessing the data in the first storage device, by the processor, after the first storage operation is completed, and a second access operation of accessing the data in the second storage device after fail of the first access operation.

Abstract: A method of restarting a virtual machine running in a cluster of hosts in a first data center, in a second data center, wherein each virtual machine is assigned a priority level, includes: transmitting virtual machines images running in the cluster at a first time to the second data center; selecting virtual machines to be restarted in the second data center according to priority levels assigned; and for each selected virtual machine, (a) generating difference data in an image of the selected virtual machine at a second time and at the first time, (b) transmitting the difference data to the second data center, (c) setting the virtual machine inactive in the first data center, and (d) communicating with the second data center to set as active; and power on, a virtual machine in the second data center using the image of the virtual machine transmitted to the second data center.

Abstract: A new snapshot of a storage volume is created by instructing computing nodes to suppress write requests. An orchestration layer implements a multi-role application that is provisioned with virtualized storage and computation resources. A snapshot of the application may be created and used to rollback or clone the application. Clones snapshots of storage volumes may be thin clones. An application may use multiple orchestration approaches and objects of the multi-role application may be discovered and added to an application definition. The application definition may be used to create snapshots of the application and perform operations using the snapshots. Rolling back may include deleting objects other than PVCs, followed by rolling back storage volumes mounted to the PVCs, followed by recreating objects according to an application snapshot. PVCs created by a custom resource may be deleted along with the custom resource with the PVCs being recreated before recreating the custom resource.

Abstract: A primary storage system appends a red-hot data indicator to each track of data transmitted on a remote data facility during an initial synchronization state. The red-hot data indicator indicates, on a track-by-track basis, whether the data associated with that track should be stored as compressed or uncompressed data by the backup storage system. The red-hot data indicator may be obtained from the primary storage system's extent-based red-hot data map. If the red-hot data indicator indicates that the track should remain uncompressed, or if the track is locally identified as red-hot data, the backup storage system stores the track as uncompressed data. If the red-hot data indicator indicates that the track should be compressed, the backup storage system compresses the track and stores the track as compressed data. After the initial synchronization process has completed, red-hot data indicators are no longer appended to tracks by the primary storage system.

Abstract: The present disclosure provides a method, system, and device for file replication. To illustrate, based on target replication information corresponding to a version of a file at a target device, a source device may determine one or more portions of a different version of the file at the source device to be provided to the target device. One or more other aspects of the present disclosure further provide sending, to the target device, the one or more portions and replication information corresponding to the version of the file at the source device. Based on the version of the file at the target device, the one or more portions, and the replication information corresponding to the version of the file at the source device, the target device may assemble and store a file that corresponds to the version of the file at the source device.

Abstract: The present invention relates to an edge-computing-oriented construction method for a container image, and the construction method for a container image at least comprising steps of: having an image reconstruction module reconstruct an old container image so as to obtain a new container image comprising an index and a set of spare files that correspond to each other, and having an image management module store the index and the spare files separately from each other in an image repository and a spare file storage module respectively; having a download engine module scrape the index from the image repository to a corresponding container in the edge end, so that a container instance service module conducts search in a local file sharing module according to configuration information contained in the index and thereby retrieves a local shared file corresponding to the configuration information, an image file consulting module is configured to download a default file from the spare file storage module that does no

Abstract: The invention relates to a method, and an apparatus for accessing to data in response to a power-supply event. The method, performed by a flash controller, includes steps for: repeatedly detecting whether a voltage supplied to the flash controller is lower than a first threshold; and issuing a program command to a flash module for programming data into the flash module and performing a supervision procedure when the voltage is lower than the first threshold. The supervision procedure includes steps for: repeatedly detecting whether the voltage is lower than a second threshold during a time period when issuing the program command to the flash module until transmitting the data to the flash module completely; and cancelling the program command when the voltage is lower than the second threshold.

Abstract: An apparatus comprises a processing device configured to generate a tree structure characterizing relationships between storage objects in a storage system represented as logical page nodes specifying respective logical page addresses, arrays of pointers to other logical page addresses, snapshot group identifiers, and logical extent offsets. The processing device is also configured to traverse the generated tree structure to identify (i) a given logical page node specifying a given logical page address, snapshot group identifier and logical extent offset from a query and (ii) other ones of the logical page nodes that specify the given snapshot group identifier and logical extent offset and comprise a pointer to the given logical page address in its associated array of pointers. The processing device is further configured to provide a response to the query specifying the given logical page node and the identified other ones of the logical page nodes.

Abstract: A method and system for verified data restoration in storage systems is described. The method may include calculating a hash sum relating to initial data for storing in an archive and storing the data into the archive and storing the calculated initial hash sum into a blockchain network. The method may further include retrieving the data from the archive and calculating a retrieved hash sum of the retrieved data. The method may also include comparing the initial hash sum from the blockchain network with the retrieved hash sum. The method may additionally include restoring the data from the archive if the initial hash sum is equivalent to the retrieved hash sum.

Abstract: A system, a method and a computer program product for storing data, which include receiving a data stream having a plurality of transactions that include at least one portion of data, determining whether at least one portion of data within at least one transaction is substantially similar to at least another portion of data within at least one transaction, clustering together at least one portion of data and at least another portion of data within at least one transaction, selecting one of at least one portion of data and at least another portion of data as a representative of at least one portion of data and at least another portion of data in the received data stream, and storing each representative of a portion of data from each transaction in the plurality of transactions, wherein a plurality of representatives is configured to form a chain representing the received data stream.

Abstract: Provided are a computer program product, system, and method for archiving data sets in a volume in a primary storage in a volume image copy of the volume in a secondary storage. A volume image in the secondary storage is created comprising a copy of the volume in the primary storage. For each of a plurality of data sets in the volume, data set level archive operations are performed comprising, determining from metadata for the data set whether an archival policy criteria is satisfied, requesting an exclusive lock to the data set, and in response to obtaining the exclusive lock and determining that the archival policy is satisfied, updating a directory for the data set to indicate that the data set is archived in the volume image.

Abstract: In one implementation, a method includes establishing a connection between a new frontend system resource and an existing frontend system resource for a client network. The method further includes transferring, by a processing device, a frontend system resource role from the existing frontend system resource to the new frontend system resource to enable the existing frontend system resource to operate as a backend system resource.

Abstract: An information processing system includes: a first storage device configured to store state data corresponding to processing executed on input data that is stored in a buffer; and a processing device configured to: calculate a first time point when the buffer overflows from an input rate of the input data to the buffer, and determine a second time point by using the input rate, an update amount of the state data per unit time, a first throughput of the backup processing on the state data from the first storage device to the second storage device, a second throughput of restoration processing on the state data from the second storage device to the first storage device, and a third throughput of the processing, the second time being a time point that is before the first time point and when backup processing on the state data is to be started.