Abstract: A data processing method and system and a client, where a target storage node is determined in a manner of comparing a second vector of received data and first vectors that are corresponding to all storage nodes and prestored on the client that receives the data, and the target storage node no longer needs to be determined in a manner of extracting some fingerprint values as samples from received data and sending the fingerprint values to all storage nodes in a data processing system for query, and waiting for a feedback from the storage nodes.

Abstract: Techniques are provided for an object file system for an object store. Data, maintained by a computing device, is stored into slots of an object. The data within the slots of the object is represented as a data structure comprising a plurality of nodes comprising cloud block numbers used to identify the object and particular slots of the object. A mapping metafile is maintained to map block numbers used to store the data by the computing device to cloud block numbers of nodes representing portion of the data stored within slots of the object. The object is stored into the object store, and the mapping metafile and the data structure are used to provide access through the object file system to portions of data within the object.

Abstract: Techniques are provided for an object file system for an object store. Data, maintained by a computing device, is stored into slots of an object. The data within the slots of the object is represented as a data structure comprising a plurality of nodes comprising cloud block numbers used to identify the object and particular slots of the object. A mapping metafile is maintained to map block numbers used to store the data by the computing device to cloud block numbers of nodes representing portion of the data stored within slots of the object. The object is stored into the object store, and the mapping metafile and the data structure are used to provide access through the object file system to portions of data within the object.

Abstract: A method of resizing a block storage volume for a virtual machine includes executing the virtual machine and attaching a virtual storage device to the virtual machine. The virtual storage device exposes the block storage volume on memory hardware to the virtual machine. The block storage volume includes a first storage capacity. The method also includes mounting the block storage volume to the virtual machine and resizing the block storage volume while the virtual machine continues to execute. The block storage volume is resized without attaching an additional virtual storage device to the virtual machine or mounting an additional block storage volume to the virtual machine.

Abstract: Methods, systems, and computer program products are included for providing snapshot version control. A method includes creating a snapshot corresponding to a file system at a first point in time. After creating the snapshot, a file management data structure of the file system is modified corresponding to a file creation, deletion, or modification. The modified file management data structure is compared to the snapshot to identify differences between the snapshot and the file management data structure. A user may select one or more of the identified differences for merging the selected differences from the snapshot to the file management data structure or from the file management data structure to the snapshot.

Abstract: Techniques delete snapshots. The techniques involve: in response to a data block to which a plurality of snapshots of a file to be deleted point being shared, determining whether a physical address of the data block to which the plurality of snapshots to be deleted point is the same as a target physical address of a data block to which a target snapshot of the file points. The techniques further involve: in response to the physical address of the data block to which the plurality of snapshots to be deleted point being the same as the target physical address, setting flag bits associated with the plurality of snapshots to be deleted to a first state. The techniques further involve: in response to detecting the first state, updating a target weight with a sum of weights of the plurality of snapshots to be deleted (e.g., respective quotas).

Abstract: A data management and storage (DMS) cluster of peer DMS nodes manages data backup and disaster recovery using a service level agreement. The backup data can be replicated from a primary compute infrastructure to the secondary compute infrastructure. For example, primary snapshots of virtual machines of the application in the primary compute infrastructure are generated, and provided to the secondary compute infrastructure. If the primary compute infrastructure is lost, the secondary compute infrastructure is initialized to replicate the primary compute infrastructure. Applications that were running in the primary compute infrastructure can failover to run in the secondary compute infrastructure. The replicated backup data is used to facilitate the migration. During a failover, the primary snapshots are deployed in the secondary compute infrastructure as virtual machines.

Abstract: Methods and systems for reducing the data recovery time when failing back to a primary system from a secondary data backup system using virtual machine conversions and incremental exportation for backed-up virtual machine snapshots are described. Upon detection that the primary system is available to receive replicated snapshots for a virtual machine, the secondary data backup system may identify a first virtual machine snapshot out of a chain of snapshots for the virtual machine (e.g., the earliest in time snapshot within the chain or a middle snapshot in the middle of the chain) and transfer a full image snapshot for the first virtual machine snapshot to the primary system. Thereafter, data changes between the next virtual machine snapshot to be transferred to the primary system and the most-recently hydrated virtual machine on the primary system may be identified and then transferred to the primary system.

Abstract: A storage system comprises a disk array enclosure comprising an enclosure controller, a plurality of data storage devices and a plurality of metadata storage devices. The enclosure controller is configured to receive a write operation comprising data to be stored on at least one of the plurality of data storage devices and to determine a logical identifier for the data based at least in part on the received write operation. The enclosure controller is further configured to determine a metadata identifier corresponding to a metadata page stored on the at least one metadata storage device that is associated with the logical identifier and to update the metadata page based at least in part on the metadata identifier. The enclosure controller is further configured to return the logical identifier and the metadata identifier as a response to the received write operation.

Abstract: Techniques for managing overwrites when archiving data in cloud/object storage are provided. In one set of embodiments, a computer system can overwrite a chunk of data residing in cloud/object storage, where the cloud/object storage only guarantees eventual consistency for overwrites, and where the overwriting is associated with a sequence number. Upon overwriting the chunk of data, the computer system create a new instance of a file in the cloud/object storage, where the new instance of the file has a version number corresponding to the sequence number.

Abstract: The method includes identifying, by one or more computer processors, a live file. The method further includes identifying, by one or more computer processors, a snapshot that corresponds to the live file. The method further includes amending, by one or more computer processors, data corresponding to the identified live file to include tracking data for the identified snapshot. The method further includes amending, by one or more computer processors, data corresponding to the identified snapshot of the live file to include tracking data for the identified live file. The method further includes determining, by one or more computer processors, a difference in the data between the identified live file and the identified snapshot. The method further includes amending, by one or more computer processors, the identified snapshot to include only the determined difference in data between the identified live file and the identified snapshot.

Abstract: The present invention discloses a method for preventing short-term bifurcation and double-spend attack on a block chain network. The method includes the following steps: adding one CA certificate issuance and updating center to the blockchain network; transforming a block data structure and adding a CA certificate-based signature and a public key field; adding certificate effective verification of the signature and the public key to a consensus algorithm of a blockchain network node; improving the consensus algorithm; adding risk identification of a short-term bifurcation malicious double-spending attack to the improved consensus algorithm. The present invention makes minor changes to an original chain and is easy to implement. Because the method only adds the CA center and modifies and adds the necessary consensus algorithms, the method may effectively reduce the possibility of short-term bifurcation double-spending attack.

Abstract: Techniques for maintaining a graph associated with snapshots are described. In some embodiments, a snapshot service maintains one or more graphs in a graph database. The snapshot service maintains a graph data structure having a plurality of vertices corresponding to a plurality of snapshots, wherein each vertex of the plurality of vertices is at least a parent to or a child of another vertex, and each child vertex of the plurality of vertices comprises a value representing a number of chunks of data referenced in the corresponding snapshot corresponding to of the child vertex that are not referenced in the snapshot corresponding to the parent vertex of the child vertex. The snapshot service further determines a total number of unique chunks of data attributed to the plurality of snapshots based at least in part on traversing the graph data structure.

Abstract: Techniques are shown for enabling a network system to index data stored on a third-party server to allow the data stored on the third-party server to be searchable by searching functionality of the network system.

Abstract: Techniques are provided for synchronous replication based cutover. An asynchronous replication process is executed to perform asynchronous incremental transfers of data of a storage object from a first computing environment to a replicated storage object at a second computing environment until a cutover criteria is met. A synchronous replication process is executed to synchronously replicate operations, targeting the storage object, to the replicated storage object based upon the cutover criteria being met. A cutover is performed to direct operations from targeting the storage object to targeting the replicated storage object based upon the synchronous replication process reaching a steady state of synchronous replication for sub-objects of the storage object, where operations are committed to both the storage object and the replicated storage object.

Abstract: In an embodiment, a computer-implemented method comprising: posting, by a broker computing device, device control data to a distributed datastore including distributed ledger and blockchain, wherein the device control data is collected at a plurality of directory services in a federation; receiving, at a computing hardware device, the device control data from the distributed datastore; using, by the computing hardware device, the device control data received from the distributed datastore, remotely managing user accounts and access control and security policies on at least one networked device.

Abstract: A method and system for building a point-in-time snapshot of an eventually-consistent data store. The data store includes key-value pairs stored on a plurality of storage nodes. In one embodiment, the data store is implemented as an Apache® Cassandra database running in the “cloud.” The data store includes a journaling mechanism that stores journals (i.e., inconsistent snapshots) of the data store on each node at various intervals. In Cassandra, these snapshots are sorted string tables that may be copied to a back-up storage location. A cluster of processing nodes may retrieve and resolve the inconsistent snapshots to generate a point-in-time snapshot of the data store corresponding to a lagging consistency point. In addition, the point-in-time snapshot may be updated as any new inconsistent snapshots are generated by the data store such that the lagging consistency point associated with the updated point-in-time snapshot is more recent.

Abstract: In response to detecting that at least one snapshot group identifier has been allocated that has a maximum snapshot group identifier value, snapshot group identifiers are allocated to each newly created snapshot group by finding a previously allocated snapshot group identifier that is currently unused, and allocating the previously allocated snapshot group identifier that is currently unused to the newly created snapshot group.

Abstract: A method, apparatus, and system for recreating a file that corresponds to a specified point in time (PiT) in a data storage system is disclosed. The particular PiT and the name of the file to be restored may be received from a user. A file system inode structure corresponding to the particular PiT may be recreated based on an inode event stream stored in a journal. One or more disk locations associated with the file to be restored may be determined based on the inode structure corresponding to the particular PiT. A temporary file may be constructed with data read from the one or more disk locations in a storage system of the backup site. Thereafter, the file to be restored may be obtained, which may comprise rolling back data of the temporary file to the particular PiT based on a data stream stored in the journal.

Abstract: An efficient data storage system is described. An agent software application on computing devices in a first tier processes snapshot backups and pushes them to an appliance software application on a server in a second tier. The appliance software application processes archive backups and pushes them to cloud storage in a third tier. A cloud application on a management server receives storage policy specifications from customers and promulgates the policies to the agent software application and the appliance software application. The policy specifications include a snapshot specification including a snapshot time period for backups in the second tier and an archive specification including an archive time period for backups in the third tier. The backups are created efficiently such that if a file has not changed, a reference to a file is included in a storage set rather than the data file itself. This reduces the size of storage sets.

Abstract: An embodiment of the invention may include a method, computer program product and system for consensus optimization. The embodiment may include implementing a hierarchy of computing nodes. The hierarchy includes a plurality of levels. An nth level includes a plurality of subgroups of computing nodes. Each subgroup contains a leader computing node. An n+1 level includes all of the leader computing nodes of the nth level. The embodiment may include transmitting messages from a first computing node to a second computing node. The second computing node is within a same subgroup of the first computing node. The embodiment may include transmitting messages from the first computing node to a third computing node. The third computing node is a leader computing node from a different subgroup of the first computing node. The embodiment may include determining a consensus. The consensus is determined by computing nodes located at a highest level.

Abstract: A device implementing purgeable memory mapped files includes at least one processor configured to receive a first request to store a first data object in volatile memory in association with a copy of the first data object stored in non-volatile memory, the first request indicating to lock the copy in the non-volatile memory. The processor is further configured to provide for storing the first data object in the volatile memory, and lock the copy stored in the non-volatile memory. The processor is further configured to receive a second request associated with clearing a portion of the non-volatile memory, provide an indication that a second data object is available for deletion from the non-volatile memory when the first data object is locked, and provide an indication that the first data object is available for deletion from the non-volatile memory when the first data object has been unlocked.

Abstract: An apparatus in one embodiment comprises a first storage system having a plurality of storage devices. The first storage system is configured to participate in a replication process with a second storage system. The first storage system comprises a replication engine configured to request from a data module of the first storage system at least one data page to be replicated to the second storage system as part of the replication process. If the requested data page is already available in compressed form in the data module, the replication engine receives the requested data page in compressed form and transmits it to the second storage system along with at least a portion of a content-based signature of the requested data page. If the requested data page is not already available in compressed form in the data module, the replication engine receives the requested data page in uncompressed form and transmits it to the second storage system.

Abstract: Systems and methods for managing log data are provided. An exemplary system may include a memory storing computer-readable instructions that, when executed by at least one processor, may cause the at least one processor to perform operations. The operations may include accessing a plurality of log records. Each of the plurality of log records may include a time stamp and at least one attribute. The operations may also include identifying a subset of the plurality of log records based on the at least one attribute of each of the plurality of log records. The operations may also include grouping the log records within the subset into at least one group based on the time stamp of each of the log records within the subset. The operations may further include aggregating the log records in the at least one group based on the respective time stamps.

Abstract: A snapshot manager examines a set of entries of a journal of a multi-data-store storage system. Each entry is formatted in a data-store-independent transaction language and various entries contain a respective indication of a committed change to a data object or to a journal schema. Corresponding to various data objects that are materialized at least at a data store of the storage system, respective compact state change representations are generated based on the set of journal entries affecting the data objects. A given compact state change representation, also formatted in the transaction language, may represent cumulative effects of several changes. A snapshot of the journal, comprising the compact state representations, is stored.

Abstract: An apparatus in one embodiment comprises at least one processing platform including a plurality of processing devices. The processing platform is configured to execute a cloud-native application utilizing a plurality of micro-services each associated with a different set of one or more underlying databases, to capture state of the cloud-native application for a particular point in time, and to perform operational recovery of the cloud-native application for the particular point in time utilizing the captured state. Capturing state of the cloud-native application for the particular point in time comprises capturing the state in accordance with a directional dependency graph that characterizes relationships between the micro-services and the associated databases utilized in executing the cloud-native application in order to ensure directional consistency between the databases in the captured state.

Abstract: Adaptive data collections may include various type of data arrays, sets, bags, maps, and other data structures. A simple interface for each adaptive collection may provide access via a unified API to adaptive implementations of the collection. A single adaptive data collection may include multiple, different adaptive implementations. A system configured to implement adaptive data collections may include the ability to adaptively select between various implementations, either manually or automatically, and to map a given workload to differing hardware configurations. Additionally, hardware resource needs of different configurations may be predicted from a small number of workload measurements. Adaptive data collections may provide language interoperability, such as by leveraging runtime compilation to build adaptive data collections and to compile and optimize implementation code and user code together.

Abstract: Assembly of a state of user data as of a particular point in time in the context of the data being spread across multiple storage segment servers. Furthermore, the assembly occurs despite the storage segment servers not needing to coordinate a timing of any snapshots. Rather, the storage segment servers perform a snapshot of the portion of the data that it individually stores without having to coordinate with any other storage segment server. The particular point of time may be any arbitrary time, such as a time selected by a user.

Abstract: The present application relates to a method and device for extracting information from a histogram for display on an electronic device. The method comprises the following steps: inputting, into the electronic device, a document, which includes a histogram to be processed; detecting each element in the histogram to be processed by using a target detection method based on a Faster R-CNN model pre-stored in the electronic device; performing text recognition on each detected text element box by the electronic device; to extract corresponding text information; and converting all the detected elements and text information into structured data for display on the electronic device. The method and the device can detect all the elements in the histogram through deep learning and the use of the Faster R-CNN model for target detection, thus providing a simple and effective solution for information extraction in the histogram.

Abstract: Example embodiments relates to method and systems to restore content of a volume at a given point in time.

Abstract: According to certain aspects, a method can include, at a first time, performing an incremental backup of first data associated with a virtual machine (VM) residing on a source client computing device from the source client computing device to one or more secondary storage devices to create a backup copy of the VM, where the VM is associated with a hypervisor of a first type; receiving an instruction to restore the first data associated with the VM from the one or more secondary storage devices; retrieving the first data from the one or more secondary storage devices; and applying the first data to second data associated with a replicated VM running on the destination client computing device, where the replicated VM is a replicated version of the VM, and where the second data corresponds to data of the VM at a time before the first time.

Abstract: An example operation may include one or more of a network interface configured to receive requests transmitted from client devices, each request comprising a plurality of data attributes, a processor configured to detect a pattern from within the received requests, the detected pattern comprising a plurality of requests that share one or more data attributes in common and a storage configured to store the detected pattern as a hash-linked chain of blocks within a blockchain, wherein the hash-linked chain of blocks comprises a sequence of blocks corresponding to a sequence of the plurality of requests included in the detected pattern, and, after the first block, each subsequent block in the hash-linked chain of blocks includes a hash of request data that is stored in a previous block.

Abstract: Management and configuration of a tiered data storage system are described. An agent software application on computing devices in a first tier processes snapshot backups and pushes them to an appliance software application on a server in a second tier. The agent software application may optionally store checkpoint backups in the first tier. The appliance software application processes archive backups and pushes them to cloud storage in a third tier. A cloud application on a management server receives storage policy specifications from customers and promulgates the policies to the agent software application and the appliance software application. The policy specifications include an optional checkpoint specification including a checkpoint time period for backups in the first tier, a snapshot specification including a snapshot time period for backups in the second tier, and an archive specification including an archive time period for backups in the third tier.

Abstract: A method for monitoring software usage for an application installed in a computer system. The computer system determines whether a change has occurred in a set of files stored in a set of directories for the application in a file system between inventory scans of the file system. The set of the files is associated with the application and the set of the files changes when the application is used. A usage metric for the application is adjusted by the computer system to indicate a use of the application when the change has occurred in the set of the files, increasing accuracy, by the computer system, in identifying application usage.

Abstract: According to some aspects, a database system is provided. The database system may include at least one processor configured to execute a plurality of system components. The plurality of system components may include an interface component configured to receive a read commit command and provide a result, a snapshot component configured to generate a plurality of snapshots of data stored in a first data storage node of a plurality of data storage nodes and identify a committed snapshot representative of data that has been replicated on a majority of the plurality of data storage nodes, and a command processing component configured to read the committed snapshot responsive to receipt of the read commit command and generate the result.

Abstract: Provided are a computer program product, system, and method for performing a remote point-in-time copy to a source and target storages in further mirror copy relationships. Each of a plurality of source copy relationships is from the source storage to one corresponding source copy storage. Each of a plurality of target copy relationships is from the target storage to one corresponding target copy storage, where in each relationship an indicator indicates whether to use a remote first type copy operation. The first type copy operation is used to copy data from the source storage to the target storage and copy data from the source copy storage to the target copy storage for the determined source and target copy relationships having the indicator set. A second type of copy operations is used for source and target relationships not having the indicator set.

Abstract: In one aspect, online iterative data verification for synchronous replication is provided for a storage system that includes a source site and a target site. An aspect includes, during an active synchronous replication process between the source site and the target site, identifying inflight inputs/outputs (IOs). The inflight IOs indicate write operations that are transmitted from the source to the target but are determined to have not yet been stored at the target. A further aspect includes performing a first data verification on the source and target sites. The first data verification is performed for IOs that are not inflight IOs. An aspect also includes performing iterative data verifications during each of one or more replication cycles. The iterative data verifications verify only data written to the target site since one of the first data verification and a previously performed data verification excluding inflight IOs at the time of verification.

Abstract: Evaluating integrity of database workloads includes receiving transactional database lock commands from concurrent users and identifying a usage pattern of lock actions when results of an execution of the transactional database lock commands match a usage pattern for a data integrity rule. The data integrity rule is added to a set of one or more data integrity rules for the transactional database lock commands. The transactional database lock commands and the set of one or more data integrity rules are forwarded from a primary database server to a duplicate database server that is equivalent to the primary database server and configured to execute the transactional database lock commands while applying the one or more data integrity rules. Anomalies indicating a data integrity problem may be detected based on a comparison of the results of the executions at the primary database server and the duplicate database server.

Abstract: The present embodiments relate generally to master image management for a virtualization environment such as a virtual desktop infrastructure. Some embodiments are directed toward using image snapshot technology to identify differences between master images. In these and other embodiments, a methodology includes indexing the contents of snapshots of the same master image taken at different points in time to determine the delta between the snapshots, and thus the states of the master image at the different points in time.

Abstract: One embodiment is related to a method for implementing a reentrant Small Computer System Interface (SCSI) target, comprising: associating each configuration operation for the SCSI target with a namespace identifier; for each namespace identifier, applying a lock preventing simultaneous execution to configuration operations associated with the same namespace identifier; and permitting simultaneous execution in parallel of configuration operations associated with different namespace identifiers.

Abstract: Various embodiments provide for obtaining snapshots of a form. A process design that specifies stages of a lifecycle of a process and a point between the stages is created. Electronic computer executable snapshot instructions for obtaining a snapshot of a form that is part of the process are received. The snapshot instructions are associated with the point. In response to displaying the form on a display screen, a snapshot of the form is obtained at the point that is between the stages the lifecycle of the process based on execution of the snapshot instructions.

Abstract: Disclosed herein are system, method, and computer program product embodiments for allowing a client application to modify failed update requests in an request queue accessible by a mobile device. As a cloud platform may provide offline data services to client applications, a device may need to synchronize a locally stored or otherwise accessible offline store with the cloud platform when connectivity returns. The client application may place failed requests into a request queue, store information about the failed requests in an error archive, and subsequently allow users to directly modify the requests in the request queue for resubmission to the cloud platform. The client application may provide an interface to users to fix the failed requests that is familiar and to the standard interface in the client application.

Abstract: Embodiments described herein detect on-the-fly whether requested subclient data resides on a certain type of storage device, such as cloned Windows Dynamic Disks. The system presents mount requests for the identified disks in a manner that allows for mounting of the disks, where the disks would not be otherwise mountable. For instance, in some embodiments the information management system generates substitute metadata for disk mounting purposes, such as for the purposes of browsing and/or restoring data.

Abstract: A system and method for capturing high frequency snapshots of an entity includes creating, by a storage sub-system associated with a distributed storage system of a virtualized environment, a cached configuration of an entity within the storage sub-system, capturing, by the storage sub-system, a snapshot of the entity from the cached configuration based on a schedule of a snapshot policy, including sending, by the storage sub-system, the snapshot to a repository indicated in the snapshot policy, and determining, by the storage sub-system, that a configuration file associated with the entity has been updated. The system and method also includes updating, by the storage sub-system, the cached configuration based upon the configuration file that has been updated.

Abstract: Methods, non-transitory computer readable media, and computing devices that manages distributed snapshot for low latency storage includes accessing one or more snapshots from one or more solid state devices (SSD), wherein the obtained one or more snapshots are stored in a snapshot allocated capacity of the one or more SSD. A data transfer operation is initiated from a primary storage to a secondary storage using the accessed one or more snapshots. It is determined if the initiated data transfer operation is completed and when it is determined to be completed, the obtained one or more snapshots stored in the snapshot allocated capacity of the one or more SSD are deleted.

Abstract: Security risks associated with scanning a computer are at least mitigated by performing the scanning off node. State data of a target node, or computer, can be acquired in various ways. The acquired state data can be subsequently employed to generate a virtual replica of the target computer or portion thereof on a second computer isolated from the target computer. The virtual replica of the target computer provides a scanner access to the data needed to perform a scan on the second computer without accessing or being able to impact the target computer.

Abstract: Methods and systems for a distributed database cluster are provided. One method for the distributed database cluster having a plurality of logical partitions, where each partition is used to store a plurality of replicas for a database, and each of the plurality of replicas are managed by one of a plurality of nodes includes preventing any topology change in the distributed database cluster; capturing a topology of the distributed database cluster prior to a first backup phase of a backup operation; generating a snapshot of all logical objects used by all active nodes to store the plurality of replicas of the database; initiating a second phase of the backup operation at a recovery node using the backup topology metadata after the first phase of the backup operation; and cloning snapshots of the logical objects from the first phase of the backup operation.

Abstract: Provided are a computer program product, system, and method for serializing access to data objects in a logical entity group in a network storage. Data objects associated with a logical entity at a client storage are generated. A determination is made of a prefix for a container in the network storage associated with the logical entity. The prefix is included in names of the data objects in the logical entity. The prefix is added to a lock queue shared by the client systems having access to the data objects in the container at the network storage. The data objects having the names including the prefix are transmitted to the network storage to store in the container in the network storage.

Abstract: An information processing apparatus includes: a memory that stores a plurality of templates which define different designs from each other with respect to a target object; an acquiring unit that acquires, for individual user, edit information indicating a history of editing performed by the user for the template; and an output unit that outputs information about the template that meets an editing tendency of the user for the template, for the individual user, the editing tendency being acquired from the edit information.

Abstract: An approach for managing a family tree archive is provided. The approach includes creating an electronic archive based on a family tree. The approach also includes automatically discovering Internet-based data associated with at least one member of the family tree. The approach additionally includes adding the Internet-based data to the archive. The approach further includes storing the archive at a storage device.