Abstract: A folder scan system configured to identify modified folders in a storage module including a plurality of folders during an incremental backup scan is presented. The folder scan system is configured to identify modified folders using a learning-based technique. A related method is also presented.

Abstract: An incremental backup agent performs backup operations that synchronize database on client side to a server database. In one embodiment, such backup operations are incremental backups, where the agent may identify differences between the current directory with the latest backed up version. The agent may issue a direct RPC using SMB protocols or NFS protocols to fetch all entries of directories with metadata in a single RPC call, instead of issuing one call to fetch metadata for each directory entry. The agent may identify changes with efficiency by performing checksum changes in a DFS manner. Starting from a root directory, the agent may generate a checksum for each directory and compare the checksums on the client side with the retrieved fingerprints, and if the backup agent identifies that the fingerprints match, the backup agent may then go to a deeper level and compare the fingerprints for child directories.

Abstract: A folder scan system configured to identify modified folders in a storage module including a plurality of folders during an incremental backup scan is presented. The folder scan system is configured to identify modified folders using a learning-based technique. A related method is also presented.

Abstract: A system and a method for client-side deduplication system for a plurality of backup streams, generated by a backup and recovery client from a client database, is presented. The system includes a stream handler configured to generate a unique file name for an underlying file of each backup stream of the plurality of backup streams based on one or more data blocks in each backup stream. The system further includes a file creator configured to create a data file corresponding to each backup stream of the plurality of backup streams in a local cache of a client database server, wherein each data file has a file name corresponding to the unique file name generated by the stream handler. The client-system furthermore includes a dedupe module configured to dedupe subsequent backup streams based on the data files in the local cache.

Abstract: Disclosed herein are systems, methods, and processes to optimize the storage of pre-allocated units of storage during a backup operation. Null units of storage are identified in pre-allocated units of storage prior to the backup operation. Upon being identified, the null units of storage are inhibited from being written to a backup image during the backup operation.

Abstract: The computer-implemented method for apportioning bandwidth in storage systems may include (i) identifying a plurality of storage media and at least one workload that is assigned a quantity of credits at the beginning of a predetermined time period that regulate a volume of bandwidth for input/output requests from the workload, (ii) detecting an input/output request from the workload, (iii) deducting, before fulfilling the input/output request, a number of credits from a current number of credits available to the workload based on an estimated quantity of bandwidth consumed by the input/output request, (iv) measuring an actual quantity of bandwidth consumed by the input/output request, and (v) adjusting the current number of credits available to the workload for the predetermined time period based on a difference between the estimated quantity of bandwidth and the actual quantity of bandwidth.

Abstract: A system and method having accelerated data recovery in a clustered storage system is provided. The method may include generating an extent map of data having an original order, wherein the extent map associates the original order with a stored order of the data in a plurality of storage units coupled to a server node. After receipt of a request for data recovery of a subset of data, the method may further include optimizing data retrieval of the data to a minimum recovery time using the extent map. For static optimization, the server node can generate a second map indicating the stored order of each fragment of data to be sent prior to the data. Alternatively in dynamic optimization, the server node can send a qualifying identifier with each fragment indicating the storage location. Thereby, the client node is enabled to rearrange the data upon receipt to its original order.

Abstract: A system and method for implementing a Quality of Service based upon data deduplication is provided. The method may include deduplicating data and receiving a corresponding I/O request; wherein the data includes an associated dedupe count. The method may further include performing the I/O request based upon the dedupe count. For example, where no deduplication exists as indicated by a dedupe count of zero, the I/O request may be scheduled for processing when the sum of the current clock tick and the tag ratio are less than or equal to the next clock tick. In the alternative, where deduplication exists as indicated by a dedupe count that is greater than zero, the I/O request may be scheduled for processing, when the sum of the current clock tick, a negative value of the dedupe ratio, and the tag ratio are less than or equal to the next clock tick.

Abstract: Various systems and methods are provided for optimizing Storage Quality of Service (SQoS) by dynamically determining and managing queue depth and system capacity in a computer storage system. In one embodiment, this functionality includes determining a queue depth value for a given epoch, and then advertising that queue depth value to one or more applications. Upon receiving a number of I/O operations that does not exceed the advertised queue depth, the storage tier processes those I/O operations. The system then evaluates the system capacity in light of the current queue depth value and other variables, such as the observed (or “seen”) latency, to determine whether the optimal queue depth value has been reached. Until the optimal queue depth value has been reached, the process outlined above is repeatedly iteratively (with dynamically increasing queue depth values) in each ensuing epoch until the optimal queue depth value is determined.

Abstract: The disclosed computer-implemented method for load balancing backup data may include (1) receiving a request to backup files in a multi-node computing cluster, (2) identifying a backup distribution of the files among multiple backup clients, (3) reading an initial data block of a current file from a data node in the cluster, (4) reading a copy of the initial data block of an additional file from another data node in the cluster, (5) reading a subsequent data block of the current file from the data node in the cluster, and (6) balancing backup of the current and additional files among the data node and the another data node by reading a copy of a subsequent backup data block of the additional file from the another data node in the multi-node computing cluster. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method for load balancing backup data may include (1) receiving a request to backup files in a multi-node computing cluster, (2) identifying a backup distribution of the files among multiple backup clients, (3) reading an initial data block of a current file from a data node in the cluster, (4) reading a copy of the initial data block of an additional file from another data node in the cluster, (5) reading a subsequent data block of the current file from the data node in the cluster, and (6) balancing backup of the current and additional files among the data node and the another data node by reading a copy of a subsequent backup data block of the additional file from the another data node in the multi-node computing cluster. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method for modifying track logs during restore processes may include (1) identifying a backup application that maintains a track log used to identify changed blocks during backup operations, (2) detecting a restore process launched by the backup application to restore at least one block backed up in a backup image, (3) retrieving, from the backup image, block information about the block being restored by the restore process, and then (4) recording the block information to the track log during the restore process such that the backup application does not identify the block as changed during a subsequent backup operation due at least in part to the block already being backed up in the backup image. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method for allocating input/output bandwidth in storage systems may include (1) allocating, in accordance with a pre-defined service-level agreement, an assigned amount of input/output bandwidth to an application that performs actions on a storage system, (2) receiving a request from the application to perform an input/output operation on the storage system, (3) identifying an amount of latency associated with fulfilling the input/output operation, (4) calculating, based at least in part on the amount of latency associated with fulfilling the input/output operation, an amount of input/output bandwidth consumed by the input/output operation, (5) deducting the amount of input/output bandwidth consumed by the input/output operation from the assigned amount of input/output bandwidth allocated to the application, and (6) allocating bandwidth to future input/output requests from the application from the remaining amount of input/output bandwidth allocated to the application.

Abstract: Disclosed herein are systems, methods, and processes to optimize the storage of pre-allocated units of storage during a backup operation. Null units of storage are identified in pre-allocated units of storage prior to the backup operation. Upon being identified, the null units of storage are inhibited from being written to a backup image during the backup operation.

Abstract: The disclosed computer-implemented method for restoring data from opaque data backup streams may include (1) initiating a virtual restore of an opaque data backup stream that is designed to be parsed exclusively by a data backup application that created the stream, (2) determining, for each block of data, an original header and tail of the block based on a restored version of the block on the client, (3) sending the original header and tail of the block to a server, (4) creating, at the server, a mapping between a location of the block of data in the stream on the server and the original header and tail of the block, and (5) restoring, without using the data backup application, data in the stream by using the mapping to restore the original headers and tails of the blocks. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method for allocating input/output bandwidth in storage systems may include (1) allocating, in accordance with a pre-defined service-level agreement, an assigned amount of input/output bandwidth to an application that performs actions on a storage system, (2) receiving a request from the application to perform an input/output operation on the storage system, (3) identifying an amount of latency associated with fulfilling the input/output operation, (4) calculating, based at least in part on the amount of latency associated with fulfilling the input/output operation, an amount of input/output bandwidth consumed by the input/output operation, (5) deducting the amount of input/output bandwidth consumed by the input/output operation from the assigned amount of input/output bandwidth allocated to the application, and (6) allocating bandwidth to future input/output requests from the application from the remaining amount of input/output bandwidth allocated to the application.

Abstract: The disclosed computer-implemented method for restoring data files may include (1) receiving a request to restore a data file to a particular point in time, (2) in response to the request, accessing, in a storage device, (a) a backup copy of the data file and (b) at least one log of actions performed on the data file, (3) storing, in a section of memory that has a faster access time than the storage device, a location of each action within the log that was performed on the data file up until the particular point in time, and (4) when restoring the data file to an additional point in time, accessing at least a portion of the locations in the section of memory to identify at least a portion of the actions required to restore the data file to the additional point in time.

Abstract: The disclosed computer-implemented method for restoring data from opaque data backup streams may include (1) initiating a virtual restore of an opaque data backup stream that is designed to be parsed exclusively by a data backup application that created the stream, (2) determining, for each block of data, an original header and tail of the block based on a restored version of the block on the client, (3) sending the original header and tail of the block to a server, (4) creating, at the server, a mapping between a location of the block of data in the stream on the server and the original header and tail of the block, and (5) restoring, without using the data backup application, data in the stream by using the mapping to restore the original headers and tails of the blocks. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Example apparatus and methods concern creating synthetic backups from existing backups. One example method includes accessing first information that is associated with an existing backup(s). The first information may be computer data that describes data stored on a backup media or appliance. The first information may be referred to as metadata. The existing backup may reside on a backup medium (e.g., tape), on a backup appliance (e.g., disk), or elsewhere. The example method includes instantiating second information (e.g., metadata) associated with a synthetic backup to be created. The second information may be stored on a non-transitory computer-readable medium. The example method also includes selectively manipulating the second information to create the synthetic backup. The manipulating may include copying portions of the first information into the second information. In one embodiment, the synthetic backup is only logically created and thus no data is copied from the existing backup.

Abstract: A method for restoring deduplicated data may include receiving a request to restore a set of deduplicated data segments to a client system, where each data segment in the set of deduplicated data segments is referred to by one or more deduplication references. The method may also include procuring reference data that indicates, for each data segment in the set of deduplicated data segments, the number of deduplication references that point to the data segment. The method may further include using the reference data to select one or more data segments from the set of deduplicated data segments for client-side caching, caching the one or more data segments in a cache on the client system, and restoring the one or more data segments from the cache on the client system. Various other methods, systems, and computer-readable media are also disclosed.