Abstract: Systems and methods are provided for backing up out-of-band storage. A protection policy is activated for out-of-band storage at a remote host, wherein the out-of-band storage is not physically accessible by the computing device, such that the out-of-band storage is not in communication with the remote host through the computing device. A backup request is transmitted to the remote host comprising data indicative of a volume on the out-of-band storage to back up according to the protection policy. A response to the backup request is received comprising staging disk requirements for the volume, the staging disk requirements comprising a required size for a staging disk to back up the volume. A staging disk is determined based on the response. The staging disk is presented to the remote host. A backup result is received comprising data indicative of whether a backup of the volume to the staging disk succeeded.

Abstract: Systems and methods for backing up data associated with storage area network (SAN) data stores connected to a backup device over a SAN such that the backup is performed without using a local area network (LAN). The systems and methods include receiving a snapshot of a virtual machine (VM), the VM being associated with a VM datastore disk, which is further associated with a unique ID. The unique ID associated with the VM datastore disk is compared with a unique ID associated with a disk available on the computing device. When the unique ID associated with the VM datastore disk matches the unique ID associated with the disk on the computing device, the disk on the computing device with the matching unique ID is opened for reading, and data from the opened disk is copied to a copy data storage pool over a storage area network.

Abstract: Computerized methods and systems for automating a process of creating and mounting live copies of data to applications in accordance with workflows that specify procedures for creating and mounting the live copies of data to the applications. The methods and systems comprise executing at least one workflow associated with a data object based on a triggering event, and executing a set of configurable work actions associated with the at least one workflow; creating a snapshot of data volumes associated with the data object; creating liveclone volumes based on the snapshot of the data volumes, and mounting and dismounting the liveclone volumes to and from at least one application.

Abstract: Systems and methods are provided for synchronizing operational data records in a manner that reduces redundant copying of data. A set of operational data records is stored, wherein each data record is assigned a unique ID in ascending order based on a creation time of the data record. A highest unique ID is identified from the operational data records in the set of operational data records. A tolerance number is identified that is indicative of a range of unique IDs that can be processed at a same time such that it cannot be guaranteed that operational data records with unique IDs separated by less than the tolerance number were assigned unique IDs in the order that the operational data records were created. A synchronization ID is calculated comprising subtracting the tolerance number from the highest unique ID. The synchronization ID is transmitted to the source operational data store.

Abstract: Described herein are systems and methods for garbage collection prediction. A temporal graph is received, the temporal graph including nodes, the nodes including hash references to objects. An accumulated difference count is updated when a node is added to the temporal graph, the accumulated difference count including a number of hash differences between a parent node and its children nodes in the temporal graph. A divested difference count is updated when a node is removed from the temporal graph, the divested difference count including a number of hash differences referenced by the removed node but not by either a parent node of the removed node or any child nodes of the removed node. The outcome of the garbage collection is predicted based on at least one of the accumulated difference count and the divested difference count.

Abstract: Described herein are systems and methods for efficient data replication. A set of hashes for a source object to be replicated is sent from the source local deduplication store to the remote server. The remote server generates a set of object hashes representative of data in the source object that is already present on the remote server, and data indicative of source object hashes that are not present on the remote server. The remote server transmits the generated data to the source local deduplication store. The source local deduplication store identifies portions of the source object that are not already present on the remote server based on the received data. The source local deduplication store transmits the identified portions of the source object to the remote server to replicate the source object on the remote server.

Abstract: Systems and methods are provided for a data management virtualization display. A set of services is stored that includes a set of user interfaces. Each service can communicate with the remaining services using a shared services cache. A request is received to perform a data management virtualization job that, without knowledge of a profile associated with the data management virtualization system, the set of subsystems, or both, would require a user of the data management virtualization system to manually navigate through a sequence of webpages across two or more services in the set of services. A quick link for the data management virtualization job is defined based on the profile associated with the data management virtualization system, the set of subsystems, or both, using the shared services cache, wherein the quick link eliminates one or more of the manual navigations of the data management virtualization job.

Abstract: Systems and methods are provided for caching hashes for deduplicated data. A request to read data from the deduplication data store is received. A persist header stored in a deduplication data store is identified in a first hash structure that is not stored in memory of the computing device. The persist header comprises a set of hashes that includes a hash that is indicative of the data the computing device requested to read. Each hash in the set of hashes represents data stored in the deduplication data store after the persist header that is co-located with other data represented by the remaining hashes in the set of hashes. The set of hashes is cached in a second hash structure stored in the memory, whereby the computing device can identify the additional data using the second hash structure if the additional data is represented by the persist header.

Abstract: Systems and methods are provided for backing up database storage. A protection policy for database storage is activated at a remote host, wherein the database storage is not physically accessible by the computing device, such that the out-of-band storage is not in communication with the remote host through the computing device. A backup request is transmitted to the remote host comprising data indicative of a volume on the database storage to back up according to the protection policy. A response to the backup request is received comprising staging disk requirements including a required size for a staging disk. A staging disk is determined based on the response. The staging disk is presented to the remote host so that the remote host can perform a backup of the volume to the staging disk using a database backup tool provided by a vendor of the database storage.

Abstract: Systems and methods are disclosed for forming deduplicated images of a data object that changes over time using difference information between temporal states of the data object. The method includes organizing the content of the data object for a first temporal state as a plurality of content segments and storing the content segments in a data store; creating an organized arrangement of hash structures to represent the data object in its first temporal state; receiving difference information for the data object; forming at least one hash signature for the changed content; and storing the changed content that is unique in the data store as content segments. The method also includes determining, subsequent to receiving the changed content at the deduplicating content store, whether the changed content should be stored by searching for the hash signature for the changed higher-level hash structure in the global cache of the deduplicating content store.

Abstract: Systems and methods are provided for intra-process communication in a backup framework. A custom requester is registered with a framework configured to run and coordinate one or more requesters and one or more providers, wherein the framework provides an application programmer interface for the requesters and providers. A first requester from the one or more requesters starts a backup process for a first data set associated with a first application. The first requester determines that the data storage device associated with the first data set and the first application is exported by a data management system. The first requester selects a first provider to create a backup of the first data set for the backup process, wherein the first requester and first provider are separate threads in a same process space that can communicate directly with each other using one or more intra-process communication channels.

Abstract: Systems and methods are disclosed for performing a plurality of prescribed data management functions in a manner that reduces redundant access operations to primary storage, where the system includes a data management engine for performing data management functions, including at least a snapshot function and a back-up function. An electronic service level agreement (SLA) specifies a schedule for performing data management functions, where point-in-time images of data include a reference to a baseline image and difference data indicating changes at a later, specific point in time. The data management system also creates a point-in-time image of the primary storage data in response to a schedule requiring some data management functions to be performed concurrently, and communicates the difference information to secondary storage to update the back-up copy of the primary data, such that the primary storage is accessed only once for all updates to the secondary storage.

Abstract: Systems and methods are disclosed for using a first deduplicating store to update a second deduplicating store with information representing how data objects change over time, said method including: at a first and a second deduplicating store, for each data object, maintaining an organized arrangement of temporal structures to represent a corresponding data object over time, wherein each structure is associated with a temporal state of the data object and wherein the logical arrangement of structures is indicative of the changing temporal states of the data object; finding a temporal state that is common to and in temporal proximity to the current state of the first and second deduplicating stores; and compiling and sending a set of hash signatures for the content that has changed from the common state to the current temporal state of the first deduplicating store.

Abstract: Systems and methods are provided for an asynchronous data replication system in which the remote replication reduces bandwidth requirements by copying deduplicated differences in business data from a local storage site to a remote, backup storage site, the system comprising: a local performance storage pool for storing data; a local deduplicating storage pool for storing deduplicated data, said local deduplicating storage pool further storing metadata about data objects in the system and which has metadata analysis logic for identifying and specifying differences in a data object over time; a remote performance storage pool for storing a copy of said data, available for immediate use as a backup copy of said data to provide business continuity to said data; a remote deduplicating storage pool for storing deduplicated data; and a controller for synchronizing the remote performance storage pool to have the second version of the data object using deduplicated data.

Abstract: Systems and methods are disclosed for copying a data object to a target storage pool using a hybrid of storage pools, in which at least one of the storage pools is particularly efficient at identifying data that should be used for copying the data object to the target storage pool, and at least one of the storage pools is particularly efficient at retrieving the data that should be sent to the target storage pool. The system comprises a performance storage pool for storing data and having relatively high performance for retrieving stored data; a deduplicating storage pool for storing deduplicated data and storing metadata about data objects in the system and which has relatively high performance for identifying and specifying differences in a data object over time; and a controller for causing the performance storage pool to retrieve differences and provide the data to the target storage pool.

Abstract: Systems and methods for estimating data similarity between an inserted volume of data and a stored volume of data during file backup of a deduplicated data store when the ancestry of the inserted data to previously-stored data is unknown to identify an ancestor of the inserted volume of data in the stored volume so that only incremental data of the inserted volume is stored, the systems and methods comprising ingesting a volume of data, creating a subset of bits for the ingested volume using a filtering process, creating a subset of bits for each volume of stored data using the filtering process, comparing the subset of bits for the ingested volume with the subset of bits for each of the stored volumes, and determining the subset of bits for a stored volume with the most bits in common with the subset of bits for the ingested volume.

Abstract: Systems and methods are disclosed for checking the data integrity of a data object copied between storage pools by comparing data fingerprints of data objects, comprising scheduling a series of successive copy operations over time for copying a data object from a source data store to a target data store; generating a partial fingerprint of the data object at the source data store that creates a fingerprint from a subset of the data object; sending the partial fingerprint of the data object to the target data store; sending any new data contents to the target data store; and creating a partial fingerprint of the data object at the target data store and comparing it to the received partial fingerprint to determine if they differ, thereby allowing incremental verification that the copy of the data object at the target data store is the same as at the source data store.

Abstract: Systems and methods are disclosed for forming deduplicated images of a data object that changes over time using difference information between temporal states of the data object. The method includes organizing the content of the data object for a first temporal state as a plurality of content segments and storing the content segments in a data store; creating an organized arrangement of hash structures to represent the data object in its first temporal state; receiving difference information for the data object; forming at least one hash signature for the changed content; and storing the changed content that is unique in the data store as content segments. The method also includes determining, subsequent to receiving the changed content at the deduplicating content store, whether the changed content should be stored by searching for the hash signature for the changed higher-level hash structure in the global cache of the deduplicating content store.

Abstract: Systems and methods are disclosed for performing a plurality of prescribed data management functions in a manner that reduces redundant access operations to primary storage, where the system includes a data management engine for performing data management functions, including at least a snapshot function and a back-up function. An electronic service level agreement (SLA) specifies a schedule for performing data management functions, where point-in-time images of data include a reference to a baseline image and difference data indicating changes at a later, specific point in time. The data management system also creates a point-in-time image of the primary storage data in response to a schedule requiring some data management functions to be performed concurrently, and communicates the difference information to secondary storage to update the back-up copy of the primary data, such that the primary storage is accessed only once for all updates to the secondary storage.

Abstract: Described herein are systems and methods for efficient data replication. A set of hashes for a source object to be replicated is sent from the source local deduplication store to the remote server. The remote server generates a set of object hashes representative of data in the source object that is already present on the remote server, and data indicative of source object hashes that are not present on the remote server. The remote server transmits the generated data to the source local deduplication store. The source local deduplication store identifies portions of the source object that are not already present on the remote server based on the received data. The source local deduplication store transmits the identified portions of the source object to the remote server to replicate the source object on the remote server.