Abstract: Disclosed are techniques that provide for eventually-complete backups, and restoration thereof. For example, such methods, computer program products, and computer systems can include initiating a backup operation (where the backup operation is configured back up a dataset), detecting termination of the backup operation, detecting termination of the backup operation, and determining whether the backup operation backed up the dataset completely. In response to a determination that the backup operation did not backup the dataset completely, generating an indication that the backup is not complete. In response to a determination that the backup operation did not backup the dataset completely, generating an indication that the backup is complete.

Abstract: Systems, methods, apparatuses, and computer program products for enhancing shared data in a communications system are provided. One method may include receiving or retrieving, at a service consumer, shared data from a service producer. The shared data may include at least one treatment attribute configured to indicate a treatment of at least one attribute in the shared data with respect to at least one attribute in individual subscriber data. The method may also include applying a value provided in the at least one shared data attribute or a value provided in the at least one individual subscriber data attribute based on the at least one treatment attribute.

Abstract: Techniques for securing containerized applications are disclosed. In some embodiments, a system, process, and/or computer program product for securing containerized applications includes detecting a new application container (e.g., an application pod); deploying a security entity (e.g., a firewall) to the application container; and monitoring all traffic to and from the application container (e.g., all layer-7 ingress, egress, and east-west traffic associated with the application container) using the security entity to enforce a policy.

Abstract: Computing systems, methods, and non-transitory storage media are provided for determining raw data and additional information from a first storage space to be backed up, obtaining a first snapshot of the raw data and the additional information at a first time, determining one or more parameters of the backing up process based on current or historical network conditions, generate, according to the one or more parameters, a first backup corresponding to the first snapshot at a second storage space, obtaining a second snapshot of the raw data and the additional information at a second time; and generating an incremental backup corresponding to the second snapshot at the second storage space.

Abstract: A volume rehost tool migrates a storage volume from a source virtual server within a distributed storage system to a destination storage server within the distributed storage system. The volume rehost tool can prevent client access to data on the volume through the source virtual server until the volume has been migrated to the destination virtual server. The tool identifies a set of storage objects associated with the volume, removes configuration information for the set of storage objects, and removes a volume record associated with the source virtual server for the volume. The tool can then create a new volume record associated with the destination virtual server, apply the configuration information for the set of storage objects to the destination virtual server, and allow client access to the data on the volume through the destination virtual server.

Abstract: Techniques described herein relate to a method for generating synthetic full backups. The method may include obtaining a snapshot associated with a previous backup stored in a data domain; obtaining a second snapshot associated with a current state of the source data; generating a snapshot difference report using the first snapshot and the second snapshot and including a delete list, a rename list, and a copy list; storing a copy of the previous backup in the data domain; performing a delete operation on the copy based on the delete list; performing a rename operation on the copy based on the rename list; and performing a copy operation based on the copy list. In one or more embodiments, performing the delete operation, the rename operation, and the copy operation on the copy of the previous backup generates a first synthetic full backup of the source data.

Abstract: Certain embodiments described herein relate to an improved synthetic full backup image generation system. In some embodiments, one or more components in an information management system can identify a file-server-created backup copy in a particular backup format of a plurality of backup formats, determine structure information associated with the particular backup format, and generate a synthetic full backup copy according to the structure information, where the synthetic full backup copy is also in the particular backup format identical to that of the file-server-created backup copy.

Abstract: Techniques are provided for data size and time based replication. In an example, a first daemon monitors data changes that corresponds to a first replication policy, and a second daemon monitors an amount of time since performing a replication for the first replication policy. Where either a data modification threshold is met, or a time threshold is met, the daemons can perform a replication, and reset both a data counter and a timer that determine when next to perform a replication.

Abstract: Technology for identifying relevant data (also called “data of interest”) for applying a machine logic based rule and for increasing the frequency of making backups (for example, snapshots) of the relevant data.

Abstract: Described is a system for managing the expiration of objects storing incremental backup data by leveraging specialized metadata. The system may provide a layer of intelligence when freeing up storage space on an object storage to ensure that a full recovery of client backup data may be performed when storing incremental backup data. The system may maintain metadata indicating the latest and/or earliest backups that reference particular objects. The system may then leverage this information to mark particular objects for removal (e.g. deletion or re-tiering). For example, the system may access the metadata to identify which objects stored by a previous (e.g. expired) backup are still referenced by a subsequent (e.g. non-expired) backup. As a result, the system may ensure that objects are not removed prematurely and that a full recovery of the client data to a point-in-time of any incremental backup may be performed.

Abstract: A method, electronic device, and computer-readable medium for storage management is disclosed. The method for storage management includes acquiring a data change rate of a data source, the data change rate indicating an occurrence rate of data to be backed up in the data source. The method also includes acquiring a recovery capability of a backup system to recover backed-up data and determining, based on the data change rate and the recovery capability, a backup strategy for backing up the data to be backed up.

Abstract: The illustrative storage management system uses snapshot technologies and performs block-level analysis thereof and to synthesize full backups of a database, regardless of the database management system (DBMS) and content of the database and without involving native DBMS utilities. Synthetic full copies are created efficiently and use network transport resources sparingly. Successive snapshots of the database may be hardware snapshots and/or software snapshots. The illustrative storage management system tracks which data blocks in the database change over time after a baseline full copy is saved to secondary storage. Only the changed blocks are subsequently moved to secondary storage as incremental backups and are indexed for future reference. A synthetic full backup of the database, at a given point in time, may be created by synthesizing the original full backup with changed blocks from any number of later incremental backups.

Abstract: A backup management system for providing data integrity services to an application host that hosts an application that uses application data includes storage for storing threshold values for creating an application backup and a processor programmed to monitor: a rate of change associated with the application data, and an input-output rate of the application data; make a determination, based on the threshold values, the rate of change, and the input-output rate, that an unscheduled backup for the application is to be generated; obtain a micro-backup for the application in response to the determination; and obtain a restoration ready backup for the application using the micro-backup and at least one previously generated backup.

Abstract: Techniques for securing containerized applications are disclosed. In some embodiments, a system, process, and/or computer program product for securing containerized applications includes detecting a new application container (e.g., an application pod); deploying a security entity (e.g., a firewall) to the application container; and monitoring all traffic to and from the application container (e.g., all layer-7 ingress, egress, and east-west traffic associated with the application container) using the security entity to enforce a policy.

Abstract: First, second, and third threshold limits are configured. The first threshold limit corresponds to a data change at which a backup of a client should be triggered. The second threshold limit corresponds to a maximum time interval at which the backup should be triggered. The third threshold limit corresponds to a utilization of resources at the client above which the backup should not be triggered. An amount of data change since a last backup, an elapsed time, and level of resource utilization at the client is monitored. A determination is made that at least one of the amount of data change has reached the first threshold limit or the elapsed time has reached the second threshold limit. The backup of the client is prevented from occurring because the level of resource utilization at the client is above the third threshold limit.

Abstract: Enabling point-in-time recovery for databases which change transaction log recovery models is described. If a database is associated with a recovery model that creates independent backups of the database's transaction log, a system identifies most recent backup information and a current transaction log sequence number. If the most recent backup information includes a transaction log sequence number and the current transaction log sequence number is a reset value, the system creates a full backup of the database, without first creating any independent backup of the transaction log. The system creates an independent backup of the transaction log when the independent backup of the transaction log is scheduled next, subsequent to creating the full backup of the database.

Abstract: The present disclosure provides a solution for migrating data. In the solution, a migration tool first receives, from a source server, an index having index values corresponding to a plurality of files stored at the source server. The migration tool then retrieves a location of an index value corresponding to key information file in the index. The migration tool sorts the index based on the retrieved location. The migration tool processes the plurality of files based the sorted index, such that the sorted index causes the key information file to be processed last.

Abstract: A system and method of performing an incremental backup process are disclosed. In certain aspects, the method comprises retrieving a first metadata associated with a previous backup process of a component from a backup location in a storage. The method further comprises passing the first metadata to the component for determining incremental backup data of the component corresponding to a difference between current data of the component and data of the component associated with the previous backup process. The method further comprises receiving information indicative of the incremental backup data from the component. The method further comprises receiving, from the component, a second metadata associated with the incremental backup process. The method also comprises storing the incremental backup data and the second metadata as associated with the incremental backup process.

Abstract: A containerized application is executed within a container in a virtualized container environment. The containerized application exposes service and diagnostic interfaces that allow a container manager to interact with and control different code paths that provide different services from the containerized application. Using the exposed service and diagnostic interfaces, responsive to a container crash and prior to bringing the containerized application back online within the virtualized container environment after the container crash, functionality of the different code paths that provide the different services from the containerized application is validated.

Abstract: According to one embodiment, a computer program product for read-once point-in-time copy includes a computer readable storage medium having program instructions embodied therewith. The computer readable storage medium is not a transitory signal per se, and the program instructions are executable by a storage system manager to cause the storage system manager to perform a method comprising: detecting a read access to one or more data tracks of a target data storage module; setting a value of one or more bits in response to detecting the read access to the one or more data tracks, each of the one or more bits being associated with one of the one or more data tracks. The value of the one or more bits is set to a value configured to prevent a copy-on-write operation being applied to the one or more data tracks to which the read access was detected.

Abstract: A method for managing data includes identifying, by a compute acceleration device (CAD) of a persistent storage device, a first chunk, stored in the persistent storage device, to be health-checked using storage metadata, generating a first chunk identifier using the first chunk, making a determination that the first chunk identifier does not match a second chunk identifier stored in the storage metadata, and in response to the determination: obtaining a plurality of chunks associated with the first chunk from a plurality of persistent storage devices of a storage system, wherein the storage system comprises the persistent storage device and the plurality of persistent storage devices, regenerating the first chunk using the plurality of chunks to generate a new first chunk, storing the new first chunk in the persistent storage device, and updating the storage metadata based on storage of the new first chunk.

Abstract: One example method includes receiving data segments that are not already part of a full disk image of a backup, storing the data segments in storage, determining whether or not an aggregate total of data segments in the storage, that are not already part of a full disk image of a backup, equals or exceeds a threshold, when the aggregate total of data segments in the storage equals or exceeds the threshold, creating a full disk image of a backup that includes the data segments in storage, and storing the created full disk image of the backup to a recovery disk.

Abstract: Various embodiments collect unproductive resources in a network infrastructure. In one embodiment, data relating to resources of a network infrastructure is collected. An analytics model is selected based on a type of the collected data. The selected analytics model is executed to classify a resource unproductive or productive, and to assign a corresponding confidence level. An action plan for each confidence level is determined and the action plan is executed for the resource. The collected data may include resource utilization information, hypervisor information, cloud related meta-data, user knowledge and system knowledge. When data is only resource data, a resource mining model is selected. When the data includes reference data, a reference mining model is selected. When the data comprises reference data and resource data, a combined mining model is selected.

Abstract: Systems and methods are provided for determining a user request to perform a backup of a given application being provided through one or more computing systems, the user request specifying a unique identifier for the backup and an identifier corresponding to the application, determining information for performing the backup of the application based at least in part on the identifier corresponding to the application, the information specifying at least an endpoint to which data associated with the application is to be backed up, and performing a backup of the data associated with the application, wherein the data is backed up at the endpoint.

Abstract: The illustrative storage management system uses snapshot technologies and performs block-level analysis thereof and to synthesize full backups of a database, regardless of the database management system (DBMS) and content of the database and without involving native DBMS utilities. Synthetic full copies are created efficiently and use network transport resources sparingly. Successive snapshots of the database may be hardware snapshots and/or software snapshots. The illustrative storage management system tracks which data blocks in the database change over time after a baseline full copy is saved to secondary storage. Only the changed blocks are subsequently moved to secondary storage as incremental backups and are indexed for future reference. A synthetic full backup of the database, at a given point in time, may be created by synthesizing the original full backup with changed blocks from any number of later incremental backups.

Abstract: A rule specifies a data change percent and a backup level to use corresponding to the data change percent. The backup level may be a full backup or a non-full backup. Before backing up a source for an impending backup, a percent of data change of the source from a last backup of the source to the impending backup is calculated. The rule is evaluated against the calculated percent change to select a backup level for the impending backup. Based on the evaluation, the full backup level or non-full backup level is selected and the source is backed up according to the selected backup level.

Abstract: Systems and methods for granularly recovering a backup are provided. An image of a backup is mounted as a file system such that the files can be granularly restored. Image-level recovery and file-level recovery can be achieved from the same backup. The backup may also be de-duplicated.

Abstract: A remote agent for managing virtual machines includes a persistent storage that stores backup/restoration policies. The remote agent includes a resource tagger that applies first tags to the virtual machines based on computing resource consumption of the virtual machines for providing services to clients. The remote agent includes a storage manager that obtains a backup generation request for a virtual machine of the virtual machines; in response to obtaining the backup generation request: makes a determination that a tag of the first tags is associated with the virtual machine; in response to the determination: generates a composite workflow based on: a computing resource limitation indicated by the tag and a backup policy of the backup/restoration policies associated with the virtual machine; and generates a backup for the virtual machine based on the composite workflow.

Abstract: Data compression techniques are provided that remove redundancy across the boundary of compression search engines. An illustrative method comprises splitting the data frame into a plurality of sub-chunks; comparing at least two of the plurality of sub-chunks to one another to remove at least one sub-chunk from the plurality of sub-chunks that substantially matches at least one other sub-chunk to generate a remaining plurality of sub-chunks; generating matching sub-chunk information for data reconstruction identifying the at least one removed sub-chunk and the corresponding substantially matched at least one other sub-chunk; grouping the remaining plurality of sub-chunks into sub-units; removing substantially repeated patterns within the sub-units to generate corresponding compressed sub-units; and combining the compressed sub-units with the matching sub-chunk information to generate a compressed data frame.

Abstract: A method, and associated computer program product and mobile computing device, for backing-up information stored in the mobile computing device. The mobile computing device detects one or more support computing devices located within a corresponding communication range and being available to support the mobile computing device for backing-up the information stored in the mobile computing device. The mobile computing device detects a dangerous condition indicative of a risk of inoperability of the mobile computing device. The mobile computing device sends back-up information corresponding to selected information stored in the mobile computing device to at least one of the support computing devices in response to the detection of the dangerous condition to cause the at least one support computing device to upload the back-up information to a back-up computing system.

Abstract: A system identifies a first partition and another partition in a full backup created at a first time for a dataset. The system identifies a revision of the first partition in a first incremental backup created at a second time for the dataset, and links the first incremental backup to the full backup based on the first partition and the revision of the first partition. The system identifies a revision of the other partition in another incremental backup created at a third time for the dataset, and links the other incremental backup to the full backup based on the other partition and the revision of the other partition. The system restores the other partition in the dataset based on the link from the other incremental backup to the full backup, in response to receiving a request to restore the other partition in the dataset.

Abstract: Backup policies specifying backup frequencies are stored. An identification of a logical unit number (LUN) to which a virtual volume of a virtual machine has been mapped and an input/output (IO) rate of the LUN are gathered from a storage array. A backup policy having a range of IO rates that correspond to the IO rate of the LUN gathered from the storage array is selected. The virtual volume is backed up according to a particular backup frequency as specified in the selected backup policy.

Abstract: The illustrative storage management system uses snapshot technologies and performs block-level analysis thereof and to synthesize full backups of a database, regardless of the database management system (DBMS) and content of the database and without involving native DBMS utilities. Synthetic full copies are created efficiently and use network transport resources sparingly. Successive snapshots of the database may be hardware snapshots and/or software snapshots. The illustrative storage management system tracks which data blocks in the database change over time after a baseline full copy is saved to secondary storage. Only the changed blocks are subsequently moved to secondary storage as incremental backups and are indexed for future reference. A synthetic full backup of the database, at a given point in time, may be created by synthesizing the original full backup with changed blocks from any number of later incremental backups.

Abstract: Monitoring the health status of a distributed storage network (DSN) can include obtaining first status information indicating a first operational status of at least one DSN memory at a first point in time, the first operational status indicating one or more first operational issues. Second status information indicating a second operational status of the at least one DSN memory at a later point in time is obtained. The first operational status is compared to the second operational status to identify outstanding operational issues, e.g. issues that are indicated in both the first status information and the second status information. Each outstanding operational issue is mapped to an impact category, and an escalation level is determined based, at least in part, on the impact category. Notifications for a particular issue can be sent based on the escalation level for that issue.

Abstract: Embodiments disclosed herein provide systems, methods, and computer readable media to enhance the organization, storage, and retrieval of data. In a particular embodiment, a method provides storing a plurality of incremental data versions in a data repository and maintaining first time information for data items in each of the incremental data versions. The method further provides identifying a first data version of the plurality of incremental data versions and writing data in the data repository to create a second data version based the first data version. The method then provides second time information associated with the creation of the second data and creation of the first data version.

Abstract: A storage system maintains copies of a source database to allow virtual databases to be provisioned. Transaction logs received from the source database are applied to database blocks stored in the storage system to update the database blocks. The storage system checks if there are defect in the transaction logs of the source database. If a defect in transaction logs is detected, the storage system obtains a latest copy of the source database. The storage system matches database blocks of the received copy with database blocks already available in the storage system to determine whether a corresponding database block is already available in the storage system. If a received database block is different from database blocks already available at the storage system, the received database block is stored in the storage system. The database blocks may be matched using a hash value of the database blocks.

Abstract: Disclosed herein are system, method, and computer program product embodiments for providing point in time recovery on a database. An embodiment operates by determining that one or more values were written to one of a plurality of database nodes of a database as part of a write transaction. The one or more data pages to which the one or more values were written are copied to a storage location of a backup corresponding to the write transaction. The storage location of the one or more data pages in the backup are written to a location in a transaction log corresponding to the write transaction.

Abstract: The illustrative storage management system uses snapshot technologies and performs block-level analysis thereof and to synthesize full backups of a database, regardless of the database management system (DBMS) and content of the database and without involving native DBMS utilities. Synthetic full copies are created efficiently and use network transport resources sparingly. Successive snapshots of the database may be hardware snapshots and/or software snapshots. The illustrative storage management system tracks which data blocks in the database change over time after a baseline full copy is saved to secondary storage. Only the changed blocks are subsequently moved to secondary storage as incremental backups and are indexed for future reference. A synthetic full backup of the database, at a given point in time, may be created by synthesizing the original full backup with changed blocks from any number of later incremental backups.

Abstract: A method and associated systems for backing up a target computer application that comprises identifying and backing up databases and other information repositories upon which the target application depends. The target application is identified and related to a backup requirement that specifies a minimum application-backup frequency. The application's “dependencies” are automatically identified from sources that include configuration files, where each dependency identifies one or more databases or other information repositories that store information upon which the application directly or indirectly depends. If any of these databases or repositories is associated with a backup frequency less than the application's minimum backup frequency, the database or repository is flagged. Each flagged entity's backup schedule is then revised so that the flagged entity's backup frequency is equal to or greater than the application's minimum backup frequency.

Abstract: One or more techniques and/or computing devices are provided for resynchronization. For example, a request may be received to create pseudo snapshots of a first consistency group, hosted by a first storage controller, and a second consistency group, hosted by a second storage controller, having a synchronous replication relationship with the first consistency group. Incoming client write requests are logged within an intercept tracking log at the first storage controller. After a first drain without hold of incoming write requests is performed, a first pseudo common snapshot of the second consistency group is created. After a second drain without hold of incoming write operations is performed, a second pseudo common snapshot of the first consistency group and the intercept tracking log is created. The pseudo snapshots and the intercept tracking log (e.g., indicating a delta between the pseudo snapshots) are used to resynchronize the first and second consistency groups.

Abstract: Exemplary methods, apparatuses, and systems that can intelligently copy data to a plurality of datastores using performance monitoring are described. In one embodiment, a shortest path tree determines the most efficient paths available for copying data from a source datastore to one or more destination datastores. During the copying of the data between a source datastore and the one or more destination datastores, a performance value of each of the datastores involved in the copying process is compared to a threshold. In response to determining that the performance value of a given source or destination datastore involved in the copying exceeds the threshold, the copying of the data to the corresponding destination datastore is suspended. An updated shortest path tree is determined to locate a more efficient path for copying data to the suspended destination datastore. Copying is resumed to the suspended destination datastore using the updated shortest path tree.

Abstract: Embodiments of the present invention provide a method, system and computer program product for single program code message retrieval for message queues. In an embodiment of the invention, a message queue data processing system can be configured for single program code message retrieval for message queues. The system can include a message queue executing in a host server and providing an API to applications communicatively coupled to the message queue over a computer communications network. The API exposed by the message queue can include a single program call including program code enabled to open a queuing resource in the message queue, to retrieve all messages in a message buffer from the queuing resource and to close the queuing resource.

Abstract: Provided are a computer program product, system, and method for merging entries in a deduplication index. An index has chunk signatures calculated from chunks of data in the data objects in the storage, wherein each index entry includes at least one of the chunk signatures and a reference to the chunk of data from which the signature was calculated. Entries in the index are selected to merge and a merge operation is performed on the chunk signatures in the selected entries to generate a merged signature. An entry is added to the index including the merged signature and a reference to the chunks in the storage referenced in the merged selected entries. The index of the signatures is used in deduplication operations when adding data objects to the storage.

Abstract: An approach is provided for managing data being transmitted from a mobile device. The mobile device receives a request from a user to initiate a transmission of data. The mobile device determines whether the data includes sensitive information based on a format of the data, and if so, the mobile device determines a country in which the mobile device is currently located, determines a privacy policy of the country in which the mobile device is currently located, and determines whether the privacy policy applies to a type of the data corresponding to the format of the data; and if so, the mobile device notifies the user of the privacy policy of the country, identifies to the user the type of the data for which the privacy policy applies, and queries the user whether to transmit the data as requested by the user.

Abstract: A method of classifying and monitoring database operations based on a recovery cost may include receiving an indication of a recoverable operation. A count in a persistent storage, such as a catalog, corresponding to an occurrence of the recoverable operation is incremented.

Abstract: A storage control apparatus includes a memory configured to store access management information concerning access from a host to each of a plurality of logical volumes, and a controller configured to refer to the access management information read from the memory, when receiving an entirety of updated data from the host, to set a write mode for data transfer from each of the plurality of logical volumes to the corresponding physical volume on the basis of the access management information to one of a difference data write mode in which difference data indicating a difference between an entirety of data stored in a storage apparatus and the entirety of updated data is written into a storage apparatus and an entire data write mode in which the entirety of updated data is written into the storage apparatus.

Abstract: A system and method provide for backing up and restoring using patch level data for operating system and application files. Patch level data for the files in the backup image may be displayed along with current patch level data. Further, files in a backup image may be replaced based on current patch level data indicating a patched version of the file in the backup image is available. Further, upon a restore, if a patched file is available for a corresponding file in a backup image, the patched file may be retrieved from a patch source and used in place of the file that would have been restored from the backup image.

Abstract: A multi-tenancy storage node is provided. The storage node hosts partitions of multiple databases accessed by multiple applications. Each database is governed by a corresponding service-level agreement (SLA) or policy that specifies a maximum load or level of operation of the database in terms of one or more metrics (e.g., number or frequency of reads/writes, maximum size of reads/writes). To determine whether another database can be hosted by the node, a snapshot of the node's database operations is replayed on a test node, along with operations that exercise the other database. If maximum thresholds of the node for the metrics are not exceeded, the other database can be added to the storage node. An SLA is generated for it automatically, based on the metrics it exhibited during the operations on the test node. The storage node may enforce the SLA by rate-limiting activity of one or more applications.

Abstract: Featured are a method and apparatus for managing various point-in-time copies of workloads or applications using a software system called workload manager. An aspect of the invention is to receive backup images of point-in-time backup images of workload from a backup client and realize corresponding virtual resource from backup image on the cloud platform that is part of the workload manager appliance. Workload manager maintains catalog of point-in-time copies of workloads. Each item in the catalog refers resource entries on the cloud platform. When user wishes to instantiate a point-in-time copy, workload manager instantiates all the resources identified in the catalog entry. User can also restore a particular point-in-time workload to production system or migrate a particular point-in-time workload to remote application.

Abstract: A system for building a restore list includes a processor and a memory. The processor is configured to determine whether a next sibling record includes a directory. The directory is popped from a directory stack. In the event that the next sibling record includes a subdirectory of the directory, the processor is configured to push a directory path associated with the next sibling record onto the directory stack. In the event that the next sibling record does not include a subdirectory, the processor is configured to add the latest index record associated with the latest index record to a restore list. The memory coupled to the processor and configured to provide the processor with instructions.