Abstract: Storage array health scores based on alerts are auto-corrected by using alert validation and alert matching to identify missed, stale, and redundant alerts. In response to restoration of an event daemon or reboot of a storage management server, each alert associated with each storage array is validated to determine whether current state of storage array hardware or a logical object differs from the state indicated in the alert. Alerts that differ from current state are updated or invalidated and the health score is recalculated. Responsive to receipt of a new alert, existing alerts associated with the same storage array hardware or logical object are identified and Jaro-Winkler distance between the identified alerts and the new alert is calculated. Any existing alert for which the Jaro-Winkler distance relative to the new alert is greater than or equal to 0.9 is deleted and the health score is recalculated.

Abstract: Files are striped across multiple disparate data repositories. Metadata is stored hierarchically in a tree data structure to allow retrieval and reassembly of the files from the multiple repositories. The metadata is at least partially encrypted. The hierarchical tree data structure may be traversed without decrypting file identifying information. In this way, a file storage coordinator may quickly traverse the metadata without compromising the security of the striped files. Identification and retrieval of files associated with the metadata requires access to a decryption key, generally unavailable to the file storage coordinator. The metadata may be striped across the repositories in much the same way as the files are striped.

Abstract: In some examples, a system receives, in a synchronization buffer stored in a memory, fingerprint index entries for respective data units received by the system, each fingerprint index entry of the fingerprint index entries comprising a fingerprint computed for a corresponding data unit, and a storage location indicator for the corresponding data unit. The system merges the fingerprint index entries in the synchronization buffer with fingerprint index entries of a persistent fingerprint index in a hash data structure stored in persistent storage, the hash data structure comprising a plurality of buckets.

Abstract: An example method can include tracking, by a network device, a plurality of database operations performed and a plurality of expected database operations for an event that executes for a time period, generating, by the network device, a plurality of clusters based on a ratio of the database operations performed compared to the plurality of expected database operations and the time period for the event, classifying, by the network device, the clusters based on performance, and evaluating, by the network device, a system performance metric based on a classification of real time data into the clusters.

Abstract: A system according to certain aspects improves the process of restoring database objects and converting those objects into another database file format. According to certain aspects, a database file is backed up in a block-level fashion. Instead of restoring the entire backup file, which can consume a large amount of time and computing resources, the information management system may restore a particular database object from a backup database file that is stored as multiple blocks or other granular units. Then, the information management system can extract the desired data from the restored block(s). By using block-level mapping and storage techniques described herein, the system can restore a database object in a backup database file without restoring the entire backup database file, thereby speeding up restore operations and reducing consumption of storage and processing resources.

Abstract: A method, computer program product, and computer system for determining, by a computing device, a weight of an indirect block page. The weight of the indirect block page may be compared to a threshold. It may be determined that the weight of the indirect block page is greater than the threshold. A copy of the indirect block page may be created as a backup page based upon, at least in part, determining that the weight of the indirect block page is greater than the threshold.

Abstract: A processor(s) initiates a database transaction, in a computing environment that includes a database that includes one or more memory devices. The processor(s) forks a first address space that represents a current state of the database, to create a second address space. The processor(s) writes an entry indicating timing of the initiating to a log file and generates a file that is mapped to the one or more memory devices. The file includes differences in state between the current state of the database and a state subsequent to executing and committing the database transaction, and a timestamp indicating timing for committing the database transaction. The processor(s) write the database transaction to the second address space.

Abstract: There is disclosed techniques for managing data storage. In one embodiment, the techniques comprise determining whether a part of a file system block is associated with deduplication. The techniques also comprise updating a deduplication record of the file system block, based on the said determination, to indicate a deduplication status in connection with the part such that the updated deduplication record describes for multiple occurrences of one or more parts of the file system block whether the respective one or more parts are associated with deduplication.

Abstract: Methods and apparatus are provided for reporting space savings due to data reduction in storage systems. An exemplary method comprises establishing a leaf pointer for a plurality of allocation units of data in a storage system; for at least a first allocation unit of data matching a second allocation unit of data, replacing the leaf pointer for the first allocation unit with a deduplication pointer to the leaf pointer of the second allocation unit; determining a total number of pointers as a sum of a number of the leaf pointers and a number of the deduplication pointers; determining a difference between the total number of pointers and the number of leaf pointers; and providing a data reduction attributed to deduplication based on the difference. The allocation units of data are optionally also compressed. Data reduction attributed to the compression can optionally be determined independent of the data reduction attributed to the deduplication.

Abstract: A digitally signed file system in which data, metadata and files are objects, each object having a globally unique and content-derived fingerprint and wherein object references are mapped by the fingerprints; the file system has a root object comprising a mapping of all object fingerprints in the file system, such that a change to the file system results in a change in the root object, and tracking changes in the root object provides a history of file system activity.

Abstract: A processing device receives a first notice after a first time period, the first notice indicating that an amount of available free space on a storage component is below a first free space buffer threshold. The processing device determines a first amount of data to delete from an unsolicited content storage area of the storage component. The processing device receives a second notice after a second time period, the second notice indicating that the amount of available free space on the storage component is below the first free space buffer threshold. The processing device then determines a second amount of data to delete from the unsolicited content storage area, where the second amount is larger than the first amount.

Abstract: A computer-implemented method for prioritizing restoration speed with deduplicated backups may include (1) receiving a request to store a backup image within a deduplicating data system, (2) evaluating an amount of data segments that match the backup image within a container of deduplicated data segments, (3) identifying a restoration prioritization value that is assigned to the backup image and that correlates with a desired restoration speed for the backup image, (4) determining that the amount of data segments that match the backup image exceeds the restoration prioritization value by a predetermined degree, and (5) referencing previously stored data segments within the container of deduplicated data segments that match the backup image when storing the backup image based on the amount of data segments that match the backup image exceeding the restoration prioritization value by the predetermined degree. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The present invention provides a system and method for creating and accessing a copy of one or more host-accessible storage entities contained in a persistent consistency point image (PCPI) of a volume served by a storage system. The storage entity may comprise a file system, logical volume, volume group, or “file system on raw device”. The copy of the storage entity is generated using a logical unit number (lun) copying technique in conjunction with a PCPI table of contents (PTOC). The PTOC contains data describing contents of the PCPI, including luns of the storage entity. The PTOC is written to the volume of the storage system, which is configured to store the luns, i.e., in the context of an active file system, immediately prior to generation of the PCPI. After generation of the PCPI, the PTOC is deleted from the volume such that it is only stored within the PCPI and not within the active file system.

Abstract: A method of classifying and monitoring database operations based on a recovery cost may include receiving an indication of a recoverable operation. A count in a persistent storage, such as a catalog, corresponding to an occurrence of the recoverable operation is incremented.

Abstract: A method, article of manufacture, and apparatus for efficiently restoring a target system are disclosed. In some embodiments, a target is analyzed. A target profile is created based on the analysis. The target profile is then compared to a source profile. A profile difference is generated based on the comparison. The source image is modified based on the profile difference, and the modified image is then stored on the target. In some embodiments, modifying the source image may include removing or adding software components.

Abstract: According to embodiments described herein, a backup server maintains backup data for a set of data, which includes data for a first block and a second block. Backup data for the first and second block include backup data for a plurality of versions of the first and second block. A distinct watermark is stored for each version of the first block and each version of the second block. In response to a request to perform a restoration operation on the set of data, a particular version of the first block and a particular version of the second block are selected to use in the restoration operation by comparing a restoration target with the watermarks of the version of the first block and second block. The selected version of the first block has a different watermark than the selected version of the second block.

Abstract: Various systems and methods for restoring data using indexes. For example, one method involves receiving a request that includes a restore criterion. The method involves identifying a storage object in a backup storage device that meets the restore criterion, in response to the request. Detecting the identity of the storage object involves sending a query with the restore criterion to a client computing device that includes an index. The method also involves responding to the request with information identifying the storage object.

Abstract: This patent application relates to enhanced logical recovery techniques for redo recovery operations of a system with an unbundled storage engine. These techniques can be implemented by utilizing an enhanced logical recovery approach in which a dirty page table (DPT) is constructed based on information logged during normal execution. The unbundled storage engine can include a transaction component (TC) that is architecturally independent of a data component (DC). These techniques can enhance redo recovery operations by mitigating the resources needed to determine whether previously executed operations sent from the TC to the DC are to be repeated in response to a recovery-initiating event. This can include using the DPT to avoid fetching every data page corresponding to every previously executed operation received by the DC during recovery and/or pre-fetching data pages and/or index pages that correspond to PIDs in the DPT.

Abstract: Provided are a computer program product, system, and method for using a metadata image of a file system and archive instance to restore files in the file system. A metadata image of the file system for a point-in-time backup as of a point-in-time includes information on files and directories in the file system as of the point-in-time and an archive instance including a copy of database records in the backup database for the files in the point-in-time backup. A restore request is received. A file representation is created of each file to restore in the directory structure of the file system from the metadata image, wherein at least one of the created file representations indicates that the file is stored off-line and has an external identifier used to access information on the file in the database records in the archive instance for the point-in-time backup.

Abstract: Systems and methods for restoring files and metadata records associated with files are provided herein. Some of the methods include identifying a version of the file, evaluating one or more reverse incremental delta increments, and restoring an arbitrary version of the file based on an arbitrary time reference by assembling the arbitrary version of the file based on the one or more reverse incremental delta increments.

Abstract: A cluster network environment may comprise a plurality of nodes configured to perform various tasks, such as data I/O, storage, backup, etc. It may be advantageous to improve disaster recovery and reliability by creating backups that may be used to restore the cluster network environment and/or nodes therein. Accordingly, one or more techniques and/or systems are disclosed for restoring a cluster network environment and/or nodes therein. In particular, cluster configuration data, which may be stored in a healthy node or at a remote source, may be used to restore a node affected by an integrity loss. If the integrity loss affects the cluster network environment (e.g., a majority of healthy nodes are lost), then a new cluster network environment may be created from a healthy node or a restored healthy node. The creation of the new cluster network environment may be based at least in part on cluster configuration data.

Abstract: The present description refers to a computer implemented method, computer program product, and computer system for receiving a start time, selecting one or more database objects for which a database recovery progress report is to be provided, determining, based on an object recovery table generated by the database recovery utility, which of the selected database objects have been recovered since the start time, and outputting a database recovery progress report that identifies at least a number or percentage of the selected database objects that have been recovered by the database recovery utility since the start time.

Abstract: Methods and arrangements for prioritizing customer service restoration, in the event of service failure or compromise such that any adverse effect of the service disruption on the customer is minimized, the perceived drop in quality of service, if any, is minimized and timely and efficient resource reallocation for service restoration is achieved. Input data relating to customer service protocols is assimilated. A service restoration order is implemented responsive to a service disruption and based on the assimilated input data. This implementing includes determining bufferable and non-bufferable services, postponing restoration of the bufferable services, and determining an order of priority of the non-bufferable services.

Abstract: A bulk delete operation with reduced latency allows for retrieval of deleted data. Each database object holds a Delete SCN indicating when a bulk delete operation was last performed. Each row in the database object holds a Row Modification SCN indicating when the row was last updated. A bulk delete is performed by writing the old value of the Delete SCN to the undo tablespace and updating the Delete SCN. No undo information is stored for the rows. A write is performed by finding a deleted row, storing undo information for the deleted row and writing over the deleted row. To read from the database object, a rollback operation is performed, if necessary. Those rows are then retrieved for which the Row Modification SCN is higher than the Delete SCN and is less than or equal to the timestamp for the requested data.

Abstract: Aspects of the subject matter described herein relate to file system technology. In aspects, a mechanism is described that allows a file system to handle corrupted file system metadata in a way that provides high availability. When corrupted metadata is detected, the corrupted metadata may be deleted while the file system remains online and available to service file input/output operations that involve non-corrupted metadata.

Abstract: System, method, computer, and computer program for secure data processing of potentially malicious code and documents or other data that may contain malicious code. System, method, computer for a secure and reliable computing environment to protect against data loss and/or corruption to provide secure and reliable data processing.

Abstract: Aspects of the subject matter described herein relate to analyzing data and providing recommendations regarding computing assets. In aspects, data is collected from computing assets and aggregated in a data repository. A data analyzer analyzes the data to determine problems associated with the computing assets. Work done to identify a problem with one computing asset may be used to identify problems with or provide recommendations for other computing assets controlled by the same or different entities. When a problem is identified in a computing asset, a recommendation may be proactively provided to an entity associated with the computing asset.

Abstract: System, method, computer program product embodiments and combinations and sub-combinations thereof for tuning query execution performance in a database management system are described. In an aspect, query optimization in a database management system (DBMS) with awareness of limited resource usage includes identifying limited resource usage for each possible plan being considered for query execution by a query engine. A determination of whether any possible plan has limited resource usage that does not exceed a threshold level is made, and when at least one possible plan does not exceed the threshold level, the identified limited resource usage is included as a consideration during plan selection by the query engine. In an embodiment, temporary database usage is identified for each possible plan.

Abstract: Systems and methods are disclosed for recovering data following a directory service malfunction, such as a forest-wide disaster in Microsoft® Active Directory. In certain examples, a single management console can be used for remotely recovering selected domain controllers in the forest without necessitating direct operator intervention. Multiple domain controllers can be concurrently restored from one or more backup files. Configurations of the system can advantageously eliminate manual intervention with each domain controller, thereby saving significant amounts of recovery time and effort. Also, certain systems and methods can be used to automatically and remotely quarantine corrupt domain controllers so that those individual domain controllers do not replicate with the newly restored environment, while allowing the domain controllers to remain online and in communication with the attached network.

Abstract: Disclosed are an apparatus, a system, and a method for recovering meta data using fragmentary information. The system for recovering meta data includes: a data server storing recovery information for recovering at least one data file and meta data related to each of the data file; and a meta data server storing the meta data related to the data files and receiving the recovery information from the data server when the meta data are lost to recover the lost meta data. By this configuration, the exemplary embodiment of the present invention stably can the lost meta data of the meta data server by using the recovery the meta data and prevent the phenomenon that the meta data collides with each other on the same directory hierarchical structure.

Abstract: A computer-based system includes a backup server, a production server, a recovery agent that executes on the production server, a database on the production server, a backup database on the backup server, and a meta data file on the backup server. The meta data file includes file names, a file directory, and file attributes. The system is configured to copy the metadata file from the backup server to a production server. When the copying of the metadata file from the backup server to the production server is complete, and before or during a time period in which backup data is copied from the backup server to the production server, the system is configured to receive a request from the production server to restore a file from the backup server with a higher priority than other files on the backup server.

Abstract: A method begins by a processing module determining a slice name of an encoded slice to be rebuilt within a first dispersed storage network (DSN). The method continues with the processing module determining whether a corresponding copy of the encoded slice is stored in a second DSN. The method continues with the processing module retrieving the corresponding copy of the encoded slice from the second DSN and storing the corresponding copy of the encoded slice as a rebuilt encoded slice within the first DSN when the corresponding copy of the encoded slice is stored in the second DSN.

Abstract: An “operate with missing region” feature of this disclosure allows the cluster to continue servicing reads for available regions even when some regions are missing. In particular, upon a given node failure condition, the cluster is placed in an effective read-only mode for all regions. The node failure condition typically is one where there has been a failure of an authoritative region copy and no backup copy is then available. As used herein, “read-only” means that no client write or update requests will succeed while the cluster is in this state. In particular, those requests should fail with an error message (or the like) that indicates failure because of the read-only status. Preferably, such requests are then re-tried. In this mode, all regions are only allowed to perform read operations. During the read-only state, the cluster continues to operate with missing regions, and missing regions are entered on the region map.

Abstract: An information retrieval system having: a client adapted for accessing a plurality of file sets stored on one of a plurality of file servers; a plurality of file servers configured to operate with a federated file system namespace; and a memory for storing re-direction information accessible by the client for identifying a request issued by the client for a file set at a first location in the namespace where the file set is located at a second, different location on one of the file servers and wherein the client in examining the re-direction information in the memory, re-directs the request to the second location in accordance with the re-direction information.

Abstract: A system uses one or more processors and an interface to a backup repository to generate a set of backup objects for a point in time, store the set of backup objects in the backup repository, and store mapping information usable to retrieve appropriate backup objects when desired. A first map relates one or more applications to objects used by the applications. A second map relates the objects to corresponding data blocks or other data locations on volumes. A third map relates the data locations to corresponding backup objects for the point in time.

Abstract: A computer is programmed to parse a network that interconnects databases in a distributed database system, into a number of paths, wherein each path starts in a source database that is a source of changes and ends in a destination database that uses the changes to replicate the source database. The computer identifies databases that occur within each path in the network, and queries the identified databases to obtain statistics for each path. Statistics along each path are analyzed automatically, to identify a component in each path as a candidate for further investigation. The identified component may be marked as a bottleneck e.g. if there are no other paths connected to it. Alternatively the identified component may be a source of changes for another path that has a bottleneck or that has another candidate for further investigation. The identified bottleneck is displayed to the user with recommendations for improvement.

Abstract: A system for restoring data to a storage server generates a lookup data structure based on a backup image, where the lookup data structure defines a correspondence between individual block identifiers and individual data blocks of a plurality of data blocks in the backup image. The system then generates a directory structure on the storage server based on the backup image. After generating the directory structure, the system generates an empty restored file in the directory structure based on the backup image. The system then populates file contents of the restored file based on the lookup data structure.

Abstract: Techniques for maintaining mirrored storage cluster data consistency on systems with two-node, highly available storage solutions can employ an initiator-side agent operable to prevent split-brain scenarios. Split brain syndrome can be avoided, information identifying changes of synchronization states can be maintained, and both graceful and ungraceful shutdowns (or failures) of either one of the nodes or of the intelligent initiator itself can be mitigated. Technology presented herein supports load balancing and hot failover/failback in systems that may feature redundant network connectivity. Moreover, a method is supported for communicating storage cluster status between the storage nodes and the initiator.

Abstract: A cluster network environment may comprise a plurality of nodes configured to perform various tasks, such as data I/O, storage, backup, etc. It may be advantageous to improve disaster recovery and reliability by creating backups that may be used to restore the cluster network environment and/or nodes therein. Accordingly, one or more techniques and/or systems are disclosed for restoring a cluster network environment and/or nodes therein. In particular, cluster configuration data, which may be stored in a healthy node or at a remote source, may be used to restore a node affected by an integrity loss. If the integrity loss affects the cluster network environment (e.g., a majority of healthy nodes are lost), then a new cluster network environment may be created from a healthy node or a restored healthy node. The creation of the new cluster network environment may be based at least in part on cluster configuration data.

Abstract: A method for replicating I/O performance in data replication environments, such as PPRC environments, is described. In selected embodiments, such a method includes monitoring I/O workload at a primary storage device over a period of time, such as a period of hours, days, or months. The method then generates learning data at the primary storage device describing the I/O workload over the selected time period. The learning data is replicated from the primary storage device to a secondary storage device. The method uses the learning data to optimize the secondary storage device to handle the I/O workload of the primary storage device. This will enable the secondary storage device to provide substantially the same I/O performance as the primary storage device in the event a failover occurs. A corresponding system and computer program product are also disclosed and claimed herein.

Abstract: A method for replicating I/O performance in data replication environments, such as PPRC environments, is described. In selected embodiments, such a method includes monitoring I/O workload at a primary storage device over a period of time, such as a period of hours, days, or months. The method then generates learning data at the primary storage device describing the I/O workload over the selected time period. The learning data is replicated from the primary storage device to a secondary storage device. The method uses the learning data to optimize the secondary storage device to handle the I/O workload of the primary storage device. This will enable the secondary storage device to provide substantially the same I/O performance as the primary storage device in the event a failover occurs.

Abstract: A common interface to manage heterogeneous databases and develop enterprise class applications is provided. In particular, it is shown that a client-based system and method can: (a) provide a uniform interface for the DBA or the application developer to use across all the database deployments, (b) provide flexibility in the number and kinds of scenarios it can be used, and finally (c) reduce the total cost of ownership for the enterprise.

Abstract: In one aspect, dynamic determination generates a storage resource graph corresponding to a storage topology. The generating may comprise iterating through storage resources in the storage topology and using a discovery handler to generate a node in the storage resource graph corresponding to each of the iterated storage resources. Dynamic determination generates an operation graph by iterating through nodes in the storage resource graph and using an operating handler to generate operation-specific metadata corresponding to each iterated node of the storage resource graph. Dynamic generating executes the operation graph in a way specific to the operation.

Abstract: A method is used in recovering in deduplication systems. Metadata of a data object is evaluated for determining deduplication status for the data object. Based on the deduplication status, the data object is recovered.

Abstract: A first node apparatus included in a distributed data store acquires first operation information and a first timestamp corresponding to target data. The first operation information specifies a first operation to be executed on the target data. The first timestamp indicates a first receipt time of the first operation information. The first node apparatus determines whether the first receipt time is earlier than some of second receipt times on the basis of second timestamps and the acquired first timestamp. The second timestamp indicates the second receipt time of second operation information. The second operation information specifies a second operation executed on the target data. The first node apparatus re-executes the second operations together with the first operation on the target data in the order of the receipt time when it is determined that the first receipt time is earlier than some of the second receipt times.

Abstract: A data structure embodied on a computer-readable medium in conformance with a database schema for accessing and managing data related to a plurality of watchlists in a relational database system in a high demand environment, wherein the database schema comprising a watchlist table, a watchlist entry table for storing high-level information, and a plurality of detail tables for storing detailed information associated with a watchlist.

Abstract: System and method for distributing volume status information in a storage system. According to one embodiment, a system may include a plurality of volumes configured to store data, where the volumes are configured as mirrors of one another, and a plurality of hosts configured to access the plurality of volumes. A first one of the plurality of hosts may be configured to execute a mirror recovery process and to maintain a progress indication of the mirror recovery process, and the first host may be further configured to distribute the progress indication to another one or more of the plurality of hosts.

Abstract: One aspect of the present invention provides a workflow model to effectively respond to outage events within an IT infrastructure. This workflow model enables a combination of manual and automated processing to effectively deploy a flexible, plannable, and testable recovery to outages and problems encountered within IT infrastructure settings. In one embodiment, a shared processing context is created to accompany the operations of the workflow, thereby collecting useful data in one location related to events and status information during the outage and the outage response. Within the workflow, analysis of the outage event is performed, an appropriate recovery plan is selected, the selected recovery plan is implemented, and recovery to the outage event is completed. Data collected within the processing context can be analyzed to obtain post mortem analysis and continuous service improvements.

Abstract: A method may include creating a backup image of an email database. The method may also include archiving a set of email objects in the backup image by, for each email object in the set of email objects: (1) moving the email object from the backup image to an archival data store; and (2) providing, in the backup image, a shortcut that identifies a location of the email object in the archival data store. The method may further include receiving a request to restore the email database and restoring the email database from the backup image by, for each email object in the set of email objects, restoring the shortcut to the email object instead of restoring the email object. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Systems and methods are disclosed for recovering data following a directory service malfunction, such as a forest-wide disaster in Microsoft® Active Directory. In certain examples, a single management console can be used for remotely recovering selected domain controllers in the forest without necessitating direct operator intervention. Multiple domain controllers can be concurrently restored from one or more backup files. Configurations of the system can advantageously eliminate manual intervention with each domain controller, thereby saving significant amounts of recovery time and effort. Also, certain systems and methods can be used to automatically and remotely quarantine corrupt domain controllers so that those individual domain controllers do not replicate with the newly restored environment, while allowing the domain controllers to remain online and in communication with the attached network.