Abstract: A backup method is provided for a file system for managing hierarchical storage including one or more storage media on a computer system including one or more computers. Each of the one or more storage media includes a data part which is separated from an index and on which updated information is appended and kept. Each of a plurality of pieces of data within the file system is managed to be migrated to at least any of the one or more storage media. The backup method includes backing up metadata of the plurality of pieces of data migrated within the file system; and backing up the index of each of the one or more storage media to which the plurality of pieces of data have been migrated, substantially at the same time point as the metadata.

Abstract: A storage array that uses NVMEoF to interconnect compute nodes with NVME SSDs via a fabric and NVME offload engines implements flow control based on transaction latency. Transaction latency is the elapsed time between the send side completion message and receive side completion message for a single transaction. Counts of total transactions and over-latency-limit transactions are accumulated over a time interval. If the over limit rate exceeds a threshold, then the maximum allowed number of enqueued pending transactions is reduced. The maximum allowed number of enqueued pending transactions is periodically restored to a default value.

Abstract: Techniques are directed to managing Redundant Array of Independent Disks (RAID) storage space. One technique involves providing, by RAID circuitry, a storage space request to mapper circuitry; receiving, by the RAID circuitry, a storage space reply from the mapper circuitry in response to the storage space request; and performing, by the RAID circuitry, a follow-up operation based on the storage space reply from the mapper circuitry. Another technique involves, receiving, by mapper circuitry, a storage space request from RAID circuitry; performing, by the mapper circuitry, a storage space management operation in response to the storage space request; and providing, by the mapper circuitry, a storage space reply to the RAID circuitry, the storage space reply identifying a result of the storage space management operation.

Abstract: Efficiently transferring data between tiers in a virtual storage system, including: receiving, by the virtual storage system, a request to write data to the virtual storage system; transforming, within storage provided by a first tier of storage of the virtual storage system, the data to generate transformed data; and migrating, from the first tier of storage to a second tier of storage that is more durable than the first tier of storage of the virtual storage system, at least a portion of the transformed data.

Abstract: In one embodiment, a system for managing a virtualization environment includes a set of host machines, each of which includes a hypervisor, virtual machines, and a virtual machine controller, one or more virtual disks comprising a plurality of storage devices, the one or more virtual disks being accessible by the virtual machine controllers, where the virtual machine controllers conduct I/O transactions with the virtual disks, and a deployment system configured to receive a request to deploy a virtualized file server on a plurality of host machines, where the request is associated with deployment parameters, select a deployment image for the host machines based on the deployment parameters, and provide the deployment image to each host machine via the virtual disk. The virtual machine controller located on the host machine stores at least a portion of the deployment image on a storage device associated with the host machine.

Abstract: One example method includes receiving data segments that are not already part of a full disk image of a backup, storing the data segments in storage, determining whether or not an aggregate total of data segments in the storage, that are not already part of a full disk image of a backup, equals or exceeds a threshold, when the aggregate total of data segments in the storage equals or exceeds the threshold, creating a full disk image of a backup that includes the data segments in storage, and storing the created full disk image of the backup to a recovery disk.

Abstract: A memory system may improve the endurance and performance of a plurality of memories included in the memory system mounted on a server system or a data processing system. For example, the memory system may throttle energy of a first memory using a second memory having a different characteristic from the first memory, control accesses to a memory region according to a refresh cycle, and control accesses to memories having different temperatures according to a priority of a request for each of the memories.

Abstract: In the face of ransomware attacks, which can be increasingly difficult to effectively prevent, a solution can be considered to be the minimization of the cost and time taken to recover data and, hence business activities. Embodiments perform a restore operation that include automatically identifying the most recent healthy backup, from which data should be restored, and the prioritizing of the order in which data should be restored.

Abstract: Technologies for providing efficient migration of services include a server device. The server device includes compute engine circuitry to execute a set of services on behalf of a terminal device and migration accelerator circuitry. The migration accelerator circuitry is to determine whether execution of the services is to be migrated from an edge station in which the present server device is located to a second edge station in which a second server device is located, determine a prioritization of the services executed by the server device, and send, in response to a determination that the services are to be migrated and as a function of the determined prioritization, data utilized by each service to the second server device of the second edge station to migrate the services. Other embodiments are also described and claimed.

Abstract: This application discloses an arbitration method and a related apparatus. The method includes: detecting, by the first ABS apparatus, first status information of a service module in the first DC; when determining that a communication link between the first DC and the second DC is faulty, obtaining, by the first ABS apparatus, second status information, wherein the second status information is status information that is of a service module in the second DC and that is detected by the second ABS apparatus; and arbitrating, by the first ABS apparatus, a subsequent service providing capability of the first DC based on the first status information and the second status information.

Abstract: A data deduplication method includes receiving an overwrite request sent by an external device, where the overwrite request carries a data block and a first address into which the data block is to be stored, determining whether an overwrite quantity of the first address exceeds a first threshold within a time period [t1, t2], where both t1 and t2 are time points, and t2 is later than t1, and when the overwrite quantity of the first address exceeds the first threshold within the time period [t1, t2], skipping performing a deduplication operation on the data block or when the overwrite quantity of the first address does not exceed the first threshold within the time period [t1, t2], performing a deduplication operation on the data block.

Abstract: On-the-fly point-in-time recovery operations are disclosed. During a recovery operation, the PiT being restored can be changed on-the-fly or during the existing recovery operation without restarting the recovery process from the beginning. In one example, this improves recovery time operation (RTO) and prevents aspects of the recovery operation to be avoided when changing to a different PiT.

Abstract: A method of capturing a fractional snapshot of a distributed file system includes receiving a snapshot request to generate a factional snapshot of a file system. The request includes an indication of a subset of data of the file system. The method further includes identifying, by a processing device, the subset of data of the file system indicated by the snapshot request and generating the fractional snapshot comprising the subset of data of the file system indicated by the snapshot request.

Abstract: A key-value storage architecture with data compression is shown. During the garbage collection, the controller compresses valid pieces of key-value data to generate a piece of compressed data. Each piece of key-value data is in key-value format. The controller codes the piece of compressed data to generate a first piece of compressed key-value data that is also in key-value format, and programs the first piece of compressed key-value data into the non-volatile memory.

Abstract: Disclosed are an apparatus and method of performing a data file migration to a cloud source. One example method of operation may include establishing via a transmitter an application programming interface (API) connection to an enterprise network, identifying via a processor one or more present allocation parameters being utilized by one or more virtual machines operating on the enterprise network. The method may also provide requesting via the transmitter a directory file structure and identifying via the processor at least one data file for data migration to a remote cloud storage server based on predetermined criteria.

Abstract: A computational device generates a point in time copy of one or more regions of a time locked data set, in response to receiving one or more I/O operations directed to the time locked data set. The one or more I/O operations are performed on the point in time copy of the one or more regions of the time locked data set, in response to generating the point in time copy of the one or more regions of the time locked data set.

Abstract: Back-up procedures for saving configuration data are provided, which enable the restoration of said configuration data on the device when it is reset to default, or on another device when the device is stolen or broken. Since configuration data are sensitive data, it is important to protect their confidentiality and their integrity throughout the back-up and restore process. Current solutions enable a secure back-up and restore process on the same device since the backed-up configuration data are encrypted using credentials that are only known to the device. In order to overcome these drawbacks, a solution is proposed for performing a secure back-up process which enables the restoration of the backed-up data to the same device or to a distinct device. This is made possible by using encryption keys that are common to a pool of devices. Those common encryption keys are provided during the manufacturing of the devices.

Abstract: According to at least one aspect, a database system is provided. The database system includes at least one processor configured to receive a restore request to restore a portion of a dataset to a previous state and, responsive to receipt of the restore request, identify at least one snapshot from a plurality of snapshots of at least some data in the dataset to read based on the restore request and write a portion of the data in the identified at least one snapshot to the dataset to restore the portion of the dataset to the previous state.

Abstract: Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for data processing. According to an exemplary implementation of the present disclosure, a method for data processing includes: determining a type of target data associated with an access request, the type including at least one of: computation data type, recovery data type, and hot data type; selecting, based on the type, a target access mode of a storage device associated with the target data from a direct access mode and a block device mode; and causing the storage device to access the target data in the target access mode. As a result, good management of quality of service can be achieved for storage devices.

Abstract: According to embodiments of the present disclosure, a method, device and computer program product for storage management are proposed. The method comprises: obtaining, in a first virtual storage device, a first portion storing a source file, the source file being used to update a target file; determining a second portion in the first virtual storage device, data stored in the second portion being changed relative to data stored in a second virtual storage device, the data stored in the second virtual storage device including the target file; determining a changed portion based on the first portion and the second portion, the changed portion indicating changed data of the source file relative to the target file; and updating the target file based on the changed portion. Therefore, the present solution can reduce data transmission and resource consumption.

Abstract: When a DBMS receives a suspend instruction in which a suspend completion time of query processing is a future time and between receipt of the suspend instruction and the suspend completion time, if there is a target object (at least a processing object whose execution is in progress upon receipt of the suspend instruction) whose predicted completion time is at or precedes the suspend completion time, the DBMS changes the state of the target object to a state signifying a snapshot suspend. If there is a processing object whose state signifies a snapshot suspend, the DBMS executes the processing object at or before the suspend completion time.

Abstract: In a method of operating a storage device including a plurality of disks, the plurality of disks is divided into a plurality of journal areas and a plurality of data areas, respectively. When a write command for target disks among the plurality of disks is received, a first write operation is performed to store target data to be written into journal areas of the target disks. The target disks are included in a same array. After the first write operation is completed, a second write operation is performed to store the target data into data areas of the target disks.

Abstract: A system for inspecting data, the system comprising: at least one processor configured to: establish a trusted relationship between a source account in a cloud environment and a scanner account; using the established trust relationship, utilize at least one cloud provider API to identify workloads in the source account; use the at least one cloud provider API to query a geographical location of at least one of the identified workloads; receive an identification of the geographic location; use the cloud provider APIs to access block storage volumes of the at least one workload; determine a file-system of the at least one workload; mount the block storage volumes on a scanner based on the determined file-system; activate a scanner at the geographic location; reconstruct from the block storage volumes a state of the workload; and assess the reconstructed state of the workload to extract insights.

Abstract: An industrial machine management system includes circuitry that collects changeable setting data of an industrial machine, determines, based on the setting data at each time point of multiple time points, whether a change has been made to the setting data, obtains change information regarding the change when the change is determined as having been made to the setting data, determines whether a predetermined event has occurred in the industrial machine, identifies, when the predetermined event is determined as having occurred, the change information such that the change information is related to the predetermined event, and outputs the change information that is identified.

Abstract: In the field of data storage, a metadata query method and an apparatus are disclosed to improve metadata searching efficiency. The method is applied to a linked snapshot. A metadata query request is received. A first time sequence identifier is obtained from the first snapshot volume based on the volume identifier of the first snapshot volume. A historical index information is queried based on the data block identifier and the first time sequence identifier. When the data block identifier exists, and the first time sequence identifier falls within a corresponding query time sequence interval a corresponding target volume identifier is obtained from the historical index information. Address metadata corresponding to the data block identifier are obtained from a second snapshot volume indicated by the target volume identifier.

Abstract: Determining effective space utilization in a storage system, including: identifying an amount of data stored within the storage system that is associated with a user-visible entity; identifying an amount of data stored within the storage system that is associated with all snapshots of the user-visible entity; and reporting, in dependence upon the an amount of data stored within the storage system that is associated with the user-visible entity and the amount of data stored within the storage system that is associated with all snapshots of the user-visible entity, a total capacity utilization associated with the user-visible entity.

Abstract: A method and a corresponding system for deploying changes in a computer system, in particular an industrial computer system, includes a database and an old version of the system to be updated. The method includes providing a new version of the system and providing a merge view capable of reading data from the database and furnishing the data to the new version. The database contains at least an old table readable by the old version and the merge view can read data from the old table and furnish them to the new version.

Abstract: An example method of restoring a database includes obtaining information about backup data of a database from a source storage separate from a compute infrastructure. The information includes a list of data blocks of a file, transferring the data blocks on the list from the source storage to a local storage on the compute infrastructure, and tracking which data blocks of the file have been transferred from the source storage to the local storage concurrently when transferring the data blocks.

Abstract: A method for managing a storage includes applying, by a host, a first type of snapshot service to the LU of the storage, wherein the LU is identified by a logical unit number (LUN), in response to applying the first snapshot service, making a first determination that the LU is not visible to the host, wherein the host is operationally coupled to the storage and the first snapshot service continues to be applied to the LU, in response to the first determination, discontinuing applying the first type of snapshot service to the LU, and when the first snapshot service is no longer applied to the LU, applying, by the host, a second type of snapshot service to the LU.

Abstract: Distributed failover of a failed BE, and failback of the failed BE when it recovers, are described. A separate pool of memory may be reserved for each BE on a storage system. Each such pool may be further divided into sub-pools. When a BE fails, the one or more other active BEs on the storage system may be notified, and each such active BE may attempt to take ownership of one or more sub-pools of the BE and execute the one or more pending write operations of the failed BE. Upon completing execution of the pending write operations in a failed-over sub-pool, the ownership of the sub-pool may be returned to the failed BE. When the failed BE recovers, the recovered BE may attempt to take back control of one or more of its sub-pools.

Abstract: In some aspects, a computing system can obfuscate sensitive data based on data aggregation. A sensitive database containing sensitive data records can be joined with a grouping database containing a group identifier. The joining can be performed through a linking key that links a sensitive data record with a grouping data record in the grouping database. A grouping identifier can thus be obtained for each of the sensitive data record. The sensitive data records can be aggregated into aggregation groups based on their respective values of the group identifier. Statistics are calculated for the sensitive attributes of the sensitive data records in each aggregation group and are included in the aggregated data as the obfuscated version of the sensitive data. The aggregated data can be utilized to serve data queries from entities authorized or unauthorized to access the sensitive data.

Abstract: Systems and methods include a snapshot interface to receive, from an application executing within a virtualized execution environment, a request to generate a snapshot of the virtualized execution environment. The snapshot interface forwards the request to generate the snapshot to a virtualization manager. The snapshot interface then receives, from the virtualization manager, a result of the request to generate the snapshot, the result indicating whether the snapshot was generated. Finally, the snapshot interface forwards, to the application, the result of the request.

Abstract: Provided is a method, computer program product, and system for performing automated failover and/or failback recovery analysis using predictive analytics. A processor may monitor a disaster recovery (DR) life cycle during a DR scenario. The processor may monitor failover process activities in a DR production environment over a predetermined time period. Based on data collected during monitoring of the DR life cycle and the failover process activities in the DR production environment over the predetermined time period, the processor may generate, using machine learning, a failback blueprint plan to move production to a new production environment.

Abstract: A redundancy method includes that a first disaster management function (DMF) device on a first site side receives a first request including identification information of a first virtual machine (VM) and a recovery point objective (RPO), allocates a maximum allowable delay time to each node that input/output (IO) data of the first VM passes through in a redundancy process, and sends a second request to a second DMF device on a second site side. The second request includes a maximum allowable delay time of a second replication gateway function (RGF) device on the second site side, and a maximum allowable delay time of an IO writer function (IOWF) device on the second site side and requests the second site side to perform redundancy on the first VM. Hence, the RPO requirements of the tenants can be satisfied in an entire redundancy process.

Abstract: A storage device set includes a storage device configured to communicate with a host, the storage device including a controller configured to generate encrypted input data by encrypting data; and a reconfigurable logic chip configured to receive the encrypted input data from the storage device, generate processed data by processing the encrypted input data according to a configuration, and generate encrypted output data by encrypting the processed data.

Abstract: A data restoration system including a data management server. The data management server receives one or more data restoration requests for restoring a plurality of data blocks. The data management server determines, based on metadata associated with the data blocks, a first subset of warm data blocks corresponding to warm-tier data and a second subset of cold data blocks corresponding to cold-tier data. The data management server retrieves the warm data blocks in the first subset and restores the warm data blocks in the first subset. The data management server groups the cold data blocks based in part on storage times of the cold data blocks to generate a plurality of cold-tier data retrieval requests. The data management server retrieves the cold data blocks by batches, each batch corresponding to one of the cold-tier data retrieval requests. The data management server restores the cold data blocks in the second subset.

Abstract: Techniques for storage management involve: in response to a first disk becoming offline and remaining offline until a first time point, selecting a second storage slice in a second disk as a backup storage slice for a first storage slice in the first disk, the first storage slice being one of slices forming a redundant array of independent disks (RAID), the slices being located in different disks. The techniques further involve: writing, between the first time point and a second time point, data to be written into the first storage slice in the RAID to the second storage slice, the second time point being later than the first time point. The techniques further involve: in response to the first disk remaining offline until the second time point, replacing the first storage slice in the RAID with the second storage slice. Such techniques may improve performance of a RAID-based storage system.

Abstract: In accordance with embodiments disclosed herein, there are provided methods, systems, mechanisms, techniques, and apparatuses for presentation of direct accessed storage under a logical drive model; for implementing a distributed architecture for cooperative NVM Data protection; data mirroring for consistent SSD latency; for boosting a controller's performance and RAS with DIF support via concurrent RAID processing; for implementing arbitration and resource schemes of a doorbell mechanism, including doorbell arbitration for fairness and prevention of attack congestion; and for implementing multiple interrupt generation using a messaging unit and NTB in a controller through use of an interrupt coalescing scheme.

Abstract: A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and processing circuitry operably coupled to the interface and to the memory. The processing circuitry is configured to execute the operational instructions to perform various operations and functions. The computing device determines a number storage units that have been provisioned on the storage network but has not been assigned for storage of data. The computing device then determines a storage utilization level for each of a plurality of active storage units associated with the storage network and based on the storage utilization level, determines whether to activate one or more inactive storage units. The computing device is configured to determine at least a portion of the number of inactive storage units for activation and issue an assignment message to the at least a portion of the number of inactive storage units.

Abstract: A configuration for a component of a primary node is synchronized with a configuration for a component of a partner node in a different cluster by replicating the primary node configuration with the partner node. A baseline configuration replication comprises a snapshot of a component configuration on the primary. The baseline configuration can be generated by traversing through the configuration objects, capturing their attributes and encapsulating them in a package. The baseline package can then be transferred to the partner node. The configuration objects can be applied on the partner node in the order in which they were captured on the primary node. Attributes of the configuration objects are identified that are to be transformed. Values for the identified attributes are transformed from a name space in the primary node to a name space in the partner node.

Abstract: Replication handling during storage system transportation, including: replicating, between a first storage system and a second storage system that are both located at a first physical location, a dataset; connecting, by the first storage system and responsive to movement of the first storage system to an intermediate physical location, to a communication network available at the intermediate physical location; and continuing, between the first storage system at the intermediate physical location and the second storage system at the first physical location, replication of the dataset over the communication network available at the intermediate physical location.

Abstract: An application is provided as a compound virtual appliance having components to be hosted by virtual machines. Each component includes a set of virtual machine disks. Partial versions of the components are created by removing from each component each virtual machine disk determined to be a duplicate of a virtual machine disk of another component. A compact version of the compound virtual appliance is created by packing together the partial versions of the components and a single copy of each virtual machine disk having been determined to be a duplicate. The compact compound virtual appliance is deployed to a customer site. At the customer site, a complete version of the compound virtual appliance is reconstructed by adding back the single copy of each virtual machine disk having been determined to be a duplicate into each component having had the duplicate virtual machine disk removed.

Abstract: Systems and methods are provided for implementing an intelligent data management system for data storage and data management in a cloud computing environment. For example, a system includes an application server, a distributed data storage system, and an intelligent data management system. The application server is configured to host a data processing application. The distributed data storage system is configured to store data generated by a network of devices associated with the data processing application. The intelligent data management system is configured to manage data storage operations for storing the data generated by the network of devices in the distributed data storage system. For example, the intelligent data management system is configured to determine one or more data types of the data generated by the network of devices and select one of a plurality of repositories within the distributed data storage system to store the data based on the determined data types.

Abstract: Transaction processing for a database distributed across availability zones is disclosed, including: determining that a transaction comprising a set of one or more statements is to be executed on a plurality of database servers across at least two availability zones, wherein each availability zone is associated with a respective hybrid logical clock (HLC)-based centralized time service; causing the set of one or more statements to execute on the plurality of database servers across the at least two availability zones; obtaining a plurality of HLC-based prepare timestamps from the plurality of database servers across the at least two availability zones; selecting a maximum HLC-based prepare timestamp to use as a commit timestamp associated with the transaction; and determining whether to return a commit result corresponding to the transaction after a time delay that is determined based at least in part on a predetermined time skew.

Abstract: Data protection operations including recovery operations are disclosed. A recovery operation is performed by downloading the backup to be recovered from multiple identical copies of the backup. Based on factors such as throughput, an optimal amount of data can be downloaded from each of the multiple copies. The portions downloaded from the multiple copies are rebuild or reassembled once downloaded. The assembled backup is then presented to a target for recovery.

Abstract: A folder one-key mounting method includes: determining a size of a target folder when a one-key mounting instruction for the target folder is obtained; determining a size of a mirror image file based on the size of the target folder; determining a storage path of the mirror image file based on the size of the mirror image file; generating a target mirror image file corresponding to the target folder and the size of the mirror image file, and storing the target mirror image file in a position corresponding to the storage path; and mounting the target mirror image file to a server.

Abstract: Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for backing up data. The method comprises: determining historical information of a storage space for backing up the data, the historical information indicating a historical size of the storage space configured to store the data within a historical time period, a size of the data being changeable within the historical time period; determining change information of the historical size of the storage space based on the historical information; determining, based on the change information, a probability that a size of the storage space to be configured to back up the data reaches a predetermined size; and adjusting, based on a determination that the probability is higher than or equal to a predetermined threshold, a backup policy for backing up the data to reduce the probability.

Abstract: A method for maintaining a memory replica of a primary computer system to be used by an alternate computer system is provided. Provided are detecting changes performed on a memory device of the primary computer system by software executed on the primary computer system. Also provided is monitoring at least one memory controller of the primary computer system; triggering, based on the monitoring, a snapshot creation procedure, the snapshot creation procedure comprising creating a memory snapshot that comprises the detected changes.

Abstract: Systems and methods for utilizing virtual memory with a high-level programming language are provided. Multiple address spaces are created in virtual memory, wherein each of the multiple address spaces include data entries, each of which have a value. A machine executable software program is operated which utilizes each of said multiple address spaces. At least a first one of the address spaces is independent from at least a second one of said address spaces, and at least a third one of the address spaces is electronically associated with at least a fourth one of the address spaces.

Abstract: A data management system comprises: a storage appliance configured to store a snapshot of a virtual machine; and one or more processors in communication with the storage appliance. The one or more processors are configured to perform operations including: identifying a plurality of shards of the virtual machine; requesting a snapshot of each of the plurality of shards; receiving the shards asynchronously; ordering the received snapshot shards sequentially into a results queue; and storing a single snapshot of the virtual machine based on the ordered snapshot shards. Operations may further include maintaining a flow control queue that limits the number of snapshot shards requested.