Abstract: Techniques for duplicating deduplicated data include identifying a connection between a source deduplicated data storage and a target deduplicated data storage. A location of a block of data is determined that is located on the source deduplicated data storage for copying to the target deduplicated data storage. A first reference on the target deduplicated data storage is created to the location of the block of data on the source deduplicated data storage. A second reference is created on the source deduplicated data storage to the location of the block of data on the source deduplicated data storage.

Abstract: The disclosed computer-implemented method for distributing information across distributed storage devices may include (1) dividing, at a computing device, each of “K” distributed storage devices (DSDs) in a plurality of DSDs into “P” portions, where “P” is a sum of “M” data portions and “N” parity portions, (2) creating “K” erasure-coded volumes, where each volume includes one portion on different DSDs, “M” data portions, and “N” parity portions, and (3) combining the “K” volumes to create a file system. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method for monitoring data synchronization progress in a multi-hop data recovery system may include (i) calculating a number of data blocks to be synchronized, (ii) setting each element of a synchronization data structure to dirty, (iii) determining a dirty bytes counter, (iv) transmitting a portion of the data blocks to be synchronized, (v) receiving an acknowledgement corresponding to the transmitted portion of the data blocks, (vi) setting a set of elements within the synchronization data structure corresponding to the transmitted portion of the data blocks to clean, (vii) determining a pending dirty bytes counter that indicates a current number of elements within the synchronization data structure that are set to dirty, and (viii) transmitting the dirty bytes counter and the pending dirty bytes counter. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The computer-implemented method for apportioning bandwidth in storage systems may include (i) identifying a plurality of storage media and at least one workload that is assigned a quantity of credits at the beginning of a predetermined time period that regulate a volume of bandwidth for input/output requests from the workload, (ii) detecting an input/output request from the workload, (iii) deducting, before fulfilling the input/output request, a number of credits from a current number of credits available to the workload based on an estimated quantity of bandwidth consumed by the input/output request, (iv) measuring an actual quantity of bandwidth consumed by the input/output request, and (v) adjusting the current number of credits available to the workload for the predetermined time period based on a difference between the estimated quantity of bandwidth and the actual quantity of bandwidth.

Abstract: A computer-implemented method for email journaling may include (1) maintaining, by a journaling mail server, a cache that associates together an update sequence number that indicates a version of an email distribution list and email addresses that are both designated as targets for journaling and included within the version of the email distribution list identified by the update sequence number, (2) receiving, by the server, an email that includes, within at least one header field, a candidate update sequence number and an email distribution list identifier, (3) determining that the update sequence number in the cache is a match for the candidate update sequence number in the header field, and (4) identifying, based on the match between the update sequence number and the candidate update sequence number, the email addresses specified in the cache as the targets for journaling. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method for managing replication of data to a remote storage device may include (1) maintaining a first bitmap and a second bitmap storing data acknowledging persistence of target data, respectively, at source and target gateways, where the target gateway serves the remote storage device, (2) sending replication data from a computing device to the source gateway, (3) setting a bit in the first bitmap, where the set bit corresponds to the replication data sent to the source gateway, (4) receiving a first acknowledgement indicating the source gateway received the replication data, (5) copying, in response to the first acknowledgement, the bit to the second bitmap, (6) clearing, in response to the first acknowledgement, the bit in the first bitmap, and (7) receiving a second acknowledgement indicating the target gateway received the replication data. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Various systems, methods, and processes for optimizing access to production data in application development and testing environments are disclosed. If an input/output (I/O) operation is a read operation, a storage location on a virtual storage unit at which the read operation is to be performed is determined. Also determined is whether an earlier write operation was performed at the storage location. If an earlier write operation was performed at the storage location, the read operation is performed on one or more virtual data files. However, if the earlier write operation was not performed at the storage location, the read operation is performed on allocated storage space.

Abstract: A disclosed computer-implemented method for tokenizing user-annotated names may include (1) identifying an example set of user-annotated names, (2) creating a custom dictionary that includes known keywords by (a) extracting a set of known keywords from the example set of user-annotated names and (b) assigning a frequency score to each known keyword in the set of known keywords based on the respective frequency of each known keyword within the example set, and (3) enabling the computing device to tokenize an additional user-annotated name of arbitrary structure by performing a semantic analysis including (a) assigning, using the custom dictionary, a frequency score to a substring of the additional user-annotated name based on the substring matching the known keyword and (b) splitting the additional user-annotated name into tokens according to a permutation of substrings that received a top combined frequency score. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Various systems and methods can perform block-level deduplication. For example, one method involves sending a chunk of data to a deduplication server for storage in a deduplicated data store. The chunk of data includes multiple blocks. Subsequent to sending the chunk of data to the deduplication server, the method detects that at least one of the blocks has been modified. In response, the method sends associated information as well as the modified blocks, which include at least one but fewer than all of the blocks in the chunk, to the deduplication server. The associated information identifies a location of the included blocks within the chunk of data. The method can be performed by a computing device implementing a deduplication client.

Abstract: Disclosed herein are systems, methods, and processes to perform replication between heterogeneous storage systems. Information associated with a backup stream is recorded during a backup operation by a source server and includes instructions. The instructions include an include instruction to include existing data and a write instruction to write new data during a replication operation. A request to perform the replication operation is received. In response to the request, the information is sent to a target server as part of performing the replication operation.

Abstract: A system and method having accelerated data recovery in a clustered storage system is provided. The method may include generating an extent map of data having an original order, wherein the extent map associates the original order with a stored order of the data in a plurality of storage units coupled to a server node. After receipt of a request for data recovery of a subset of data, the method may further include optimizing data retrieval of the data to a minimum recovery time using the extent map. For static optimization, the server node can generate a second map indicating the stored order of each fragment of data to be sent prior to the data. Alternatively in dynamic optimization, the server node can send a qualifying identifier with each fragment indicating the storage location. Thereby, the client node is enabled to rearrange the data upon receipt to its original order.

Abstract: A computing system locates session state data associated with a preceding data review session corresponding to a user in response to a request to initiate a new data review session for the user. The session state data includes an identifier of a next document to be reviewed, and filter settings of the preceding data review session. The computing system locates the next document to be reviewed based on the session state data and provides the located next document to be reviewed in a graphical user interface when initiating the new data review session for the user. The new data review session is based on the filter settings in the session state data.

Abstract: Disclosed herein are methods, systems, and processes to adjust replication operations in a distributed environment. A set of replicated data is received from a first appliance as a result of a replication operation. The replication operation is initiated by the first appliance and the set of replicated data includes a first timestamp. A write operation is performed to store the set of replicated data and a second timestamp is recorded. Recovery point information is generated based on the first timestamp and the second timestamp. The recovery point information is configured to be utilized in adjusting replication parameters of a subsequent replication operation.

Abstract: A system and method for implementing a Quality of Service based upon data deduplication is provided. The method may include deduplicating data and receiving a corresponding I/O request; wherein the data includes an associated dedupe count. The method may further include performing the I/O request based upon the dedupe count. For example, where no deduplication exists as indicated by a dedupe count of zero, the I/O request may be scheduled for processing when the sum of the current clock tick and the tag ratio are less than or equal to the next clock tick. In the alternative, where deduplication exists as indicated by a dedupe count that is greater than zero, the I/O request may be scheduled for processing, when the sum of the current clock tick, a negative value of the dedupe ratio, and the tag ratio are less than or equal to the next clock tick.

Abstract: The disclosed computer-implemented method for using dynamic templates to create application containers may include (i) identifying an application that is to be deployed in a container, (ii) creating a dynamic template that comprises at least one variable parameter and that defines at least a portion of an operating environment of the container, (iii) generating a value of the variable parameter during deployment of the application, (iv) processing the dynamic template to create a configuration file that comprises the value of the variable parameter, and (v) triggering a container initialization system to create, based on the configuration file, the container such that the container isolates a user space of the application from other software on a host system while sharing a kernel space with the other software. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: One implementation of a method for providing backup storage services for encrypted data includes receiving signatures of convergently encrypted portions of data from client computers, determining whether the encrypted portions are already present on a backup storage, and obtaining only the needed portions. Users unassociated with a particular user account are denied access to information backed up in that account. The backup storage also stores password protected key files holding signatures of the unencrypted portions of data. One implementation of a system includes a memory, a single-instance storage circuit, a user account management circuit, and a signature index. The memory holds a user-account database and backup copies of convergently encrypted portions of data. The single-instance storage circuit uses the signature index to prevent duplicative backup copies. The user account management circuit responds to download requests after authenticating the user information associated with the requested data.

Abstract: The disclosed computer-implemented method for facilitating analytics on remotely stored data sets may include (1) identifying, within a secondary storage system, a secondary copy of a data set duplicated from a primary copy of the data set stored in a primary storage system, (2) generating a set of virtual objects that represent at least a portion of the secondary copy of the data set, (3) exposing the set of virtual objects to a remote analytics engine via a network such that the portion of the secondary copy of the data set appears to be stored locally on the remote analytics engine, and then (4) enabling the remote analytics engine to perform at least one analytics job on the portion of the secondary copy of the data set by way of the set of virtual objects via the network. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method for managing quality of service may include (i) installing, at a network protocol layer, a latency monitoring plug-in that monitors latency at the network protocol layer as distinct from a storage layer beneath the network protocol layer, (ii) providing, by the latency monitoring plug-in, feedback reporting the latency at the network protocol layer to a quality of service engine that monitors characteristics of the storage layer such that the quality of service engine learns about the latency at the network protocol layer, and (iii) adjusting, by the quality of service engine, a calculation of system capacity, based on both the feedback from the latency monitoring plug-in reporting the latency at the network protocol layer and the monitored characteristics of the storage layer to enable an application to adhere to a service level agreement. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A method for providing application functionality protection. The method includes accessing a distributed computer system having a cluster including a plurality of nodes, and receiving an indication of an application failure. The method further includes attempting to restore the application through a number of application restart attempts, and receiving an indication that the restart attempts have not restored the application. An image history is then accessed to obtain a last known good point in time image of the application. The application is restored in accordance with the last known good point in time image.

Abstract: A computer-implemented method for automated document review and quality control may include (1) dividing a set of documents to be reviewed for relevancy into sets of control documents, training documents, quality-control documents, and review documents, (2) calculating, based on a set of reviews performed by a group of reviewers on the set of quality-control documents, an effective speed score for each reviewer in the group of reviewers, (3) assigning, based on the effective speed score, the set of control documents and the set of training documents to the group of reviewers, (4) training a predictive model using a set of training reviews performed by the group of reviewers on both the set of training documents and the set of control documents, and (5) using the predictive model to evaluate the set of review documents. Various other methods, systems, and computer-readable media are also disclosed.