Abstract: In some aspects, an apparatus includes a processor and a memory. In some embodiments, the memory includes programmed instructions that, when executed by the processor, cause the apparatus to receive a request to create a bucket. In some embodiments, the memory includes programmed instructions that, when executed by the processor, cause the apparatus to, in response to receiving the request to create the bucket, write, to a first object store, a first mapping that maps an identifier of global metadata to an identifier of a second object store where the bucket is to be created, write, to the second object store, a second mapping that maps the identifier of global metadata to local metadata, and replicate, to the second object store, the first mapping.

Abstract: Systems for application configuration backup and restore. Techniques establish high frequency restore points of application configuration metadata. Processing commences upon receiving instructions to periodically take snapshots of application configuration metadata. To avoid incurring unnecessary costs to process snapshots of application configuration metadata when the application configuration metadata is slow-changing, the method performs a low-cost check to get the latest update time of the application configuration metadata. That time is compared to the time of the most recent snapshot of the application configuration metadata. When the time of the latest update time of the application configuration metadata is equal to the time of the most recent snapshot of the application configuration metadata, then rather than incurring the cost of generating a duplicate snapshot, the method waits for a duration without generating a new snapshot.

Abstract: The disclosed systems emulate high-frequency application-consistent snapshots by forming restore point data sets based on remote site replay of I/O commands. A method embodiment commences upon identifying a primary computing site and a secondary computing site, then identifying an application to be restored from the secondary computing site after a disaster. Prior to the disaster, a group of computing entities of the application to be restored from the secondary computing site are identified. Input/output operations that are performed over any of the computing entities at the primary site are streamed to the secondary site where they are stored. An I/O map that associates a time with an indication of a last received I/O command that had been performed over a changing set of computing entities is sent to the secondary site. An agent at the secondary site accesses the I/O map and the streamed-over I/Os to construct recovery data.

Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor having programmed instructions to detect an operation associated with a first object instance in a first cluster, determine that the first object instance is configured for replication to a second cluster, create an object information (info) metadata entry for the first object instance, create an object replication metadata entry for the first object instance, and simultaneously write the object info metadata entry and the object replication metadata entry to a first data structure and a second data structure, respectively.

Abstract: Systems for high performance restore of data to storage devices. A method embodiment commences upon identifying a plurality of virtual disks to be grouped together into one or more consistency sets. Storage I/O commands for the plurality of virtual disks of the consistency sets are captured into multiple levels of backup data. On a time schedule, multiple levels of backup data for the virtual disks are cascaded by processing data from one or more higher granularity levels of backup data to one or more lower granularity levels of backup data. A restore operation can access the multiple levels of backup data to construct a restore set that is consistent to a designated point in time or to a designated state. Multiple staging areas can be maintained using lightweight snapshot data structures that each comprise a series of captured I/Os to be replayed over other datasets to generate a restore set.

Abstract: Systems for high performance restore of data to storage devices. A method embodiment commences upon identifying a plurality of virtual disks to be grouped together into one or more consistency sets. Storage I/O commands for the plurality of virtual disks of the consistency sets are captured into multiple levels of backup data. On a time schedule, multiple levels of backup data for the virtual disks are cascaded by processing data from one or more higher granularity levels of backup data to one or more lower granularity levels of backup data. A restore operation can access the multiple levels of backup data to construct a restore set that is consistent to a designated point in time or to a designated state. Multiple staging areas can be maintained using lightweight snapshot data structures that each comprise a series of captured I/Os to be replayed over other datasets to generate a restore set.

Abstract: The disclosed systems emulate high-frequency application-consistent snapshots by forming restore point data sets based on remote site replay of I/O commands. A method embodiment commences upon identifying a primary computing site and a secondary computing site, then identifying an application to be restored from the secondary computing site after a disaster. Prior to the disaster, a group of computing entities of the application to be restored from the secondary computing site are identified. Input/output operations that are performed over any of the computing entities at the primary site are streamed to the secondary site where they are stored. An I/O map that associates a time with an indication of a last received I/O command that had been performed over a changing set of computing entities is sent to the secondary site. An agent at the secondary site accesses the I/O map and the streamed-over I/Os to construct recovery data.

Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor having programmed instructions to detect an operation associated with a first object instance in a first cluster, determine that the first object instance is configured for replication to a second cluster, create an object information (info) metadata entry for the first object instance, create an object replication metadata entry for the first object instance, and simultaneously write the object info metadata entry and the object replication metadata entry to a first data structure and a second data structure, respectively.

Abstract: Systems and methods for using snapshots to establish operable portions of computing entities on secondary sites for use on the secondary sites before the computing entity is fully transferred to the secondary site. Embodiments commence upon initiating replication of an entity from an originating site to a secondary site. While replication of the entire entity from the originating site to the secondary site is being carried out, the originating site transfers entity metadata to the secondary site. A non-replication user process queries the metadata to determine completion status and/or other characteristics of subcomponents of the entity. After determining the completion status of subcomponents of the entity, the non-replication user process operates on subcomponent data of the entity even before the data of the entity has been completely copied to the secondary site. The subcomponents may comprise certain tables of a database or certain rows of a table of a database.

Abstract: The disclosed systems emulate high-frequency application-consistent snapshots by forming restore point data sets based on remote site replay of I/O commands. A method embodiment commences upon identifying a primary computing site and a secondary computing site, then identifying an application to be restored from the secondary computing site after a disaster. Prior to the disaster, a group of computing entities of the application to be restored from the secondary computing site are identified. Input/output operations that are performed over any of the computing entities at the primary site are streamed to the secondary site where they are stored. An I/O map that associates a time with an indication of a last received I/O command that had been performed over a changing set of computing entities is sent to the secondary site. An agent at the secondary site accesses the I/O map and the streamed-over I/Os to construct recovery data.

Abstract: Techniques for replay of groups of I/Os for disaster recovery. At a primary site, a plurality of primary site computing entities that are to be restored from the secondary computing site after a disaster recovery event are identified as belonging to an entity group. At the primary site, I/O commands that are performed over any of the entities of the entity group are observed and streamed to the secondary site, where they are persisted into a log. Periodically, the primary site sends the secondary site an I/O map that associates a time with an indication of the last performed I/O commands pertaining to any observed I/O commands that had been performed over any one or more of the computing entities of the entity group. Upon receiving a disaster recovery request, the most recent I/O map and the secondary site log are processed to construct a snapshot for the entity group.

Abstract: Examples of a distributed message service include a virtualized file system including a virtual disk configured to store messages for a message topic, and a broker logically allocated to the message topic. The broker is configured to cause a message directed to the message topic provided from a publisher to be stored at the virtual disk, and to route the message to a subscriber of the message topic that is registered with the broker. The distributed message service further includes an operating system configured to manage the virtualized file system and includes a message service configured to manage logical allocation of the broker and manage allocation of the virtual disk to the message topic.

Abstract: The present disclosure provides a method, apparatus, and computer program product for generating consistent snapshots without quiescing applications. The snapshots correspond to consistency groups that in turn correspond to one or more vDisks on one or more nodes. Some embodiments of the present disclosure address the problem of generating consistent backup snapshots that cover cases of multiple virtual machines (VMs) that operate in a multi-node distributed computing environment (e.g., in clusters) without quiescing the accessing entity(ies). In some embodiments, the process includes identification of a triggering snapshot event, disabling of write complete responses to requesting entities for the resources corresponding to the snapshot to be generated, generating snapshots while one or more additional write requests are received, and using one or more techniques to insure that all actions corresponding to the snapshotting function do not occur outside of a specified time frame.

Abstract: Systems for application configuration backup and restore. Techniques establish high frequency restore points of application configuration metadata. Processing commences upon receiving instructions to periodically take snapshots of application configuration metadata. To avoid incurring unnecessary costs to process snapshots of application configuration metadata when the application configuration metadata is slow-changing, the method performs a low-cost check to get the latest update time of the application configuration metadata. That time is compared to the time of the most recent snapshot of the application configuration metadata. When the time of the latest update time of the application configuration metadata is equal to the time of the most recent snapshot of the application configuration metadata, then rather than incurring the cost of generating a duplicate snapshot, the method waits for a duration without generating a new snapshot.

Abstract: The present disclosure provides a method, apparatus, and computer program product for generating consistent snapshots without quiescing applications. The snapshots correspond to consistency groups that in turn correspond to one or more vDisks on one or more nodes. Some embodiments of the present disclosure address the problem of generating consistent backup snapshots that cover cases of multiple virtual machines (VMs) that operate in a multi-node distributed computing environment (e.g., in clusters) without quiescing the accessing entity(ies). In some embodiments, the process includes identification of a triggering snapshot event, disabling of write complete responses to requesting entities for the resources corresponding to the snapshot to be generated, generating snapshots while one or more additional write requests are received, and using one or more techniques to insure that all actions corresponding to the snapshotting function do not occur outside of a specified time frame.

Abstract: Systems and methods for using snapshots to establish operable portions of computing entities on secondary sites for use on the secondary sites before the computing entity is fully transferred to the secondary site. Embodiments commence upon initiating replication of an entity from an originating site to a secondary site. While replication of the entire entity from the originating site to the secondary site is being carried out, the originating site transfers entity metadata to the secondary site. A non-replication user process queries the metadata to determine completion status and/or other characteristics of subcomponents of the entity. After determining the completion status of subcomponents of the entity, the non-replication user process operates on subcomponent data of the entity even before the data of the entity has been completely copied to the secondary site. The subcomponents may comprise certain tables of a database or certain rows of a table of a database.

Abstract: Systems for high performance restore of data to storage devices. A method embodiment commences upon identifying a plurality of virtual disks to be grouped together into one or more consistency sets. Storage I/O commands for the plurality of virtual disks of the consistency sets are captured into multiple levels of backup data. On a time schedule, multiple levels of backup data for the virtual disks are cascaded by processing data from one or more higher granularity levels of backup data to one or more lower granularity levels of backup data. A restore operation can access the multiple levels of backup data to construct a restore set that is consistent to a designated point in time or to a designated state. Multiple staging areas can be maintained using lightweight snapshot data structures that each comprise a series of captured I/Os to be replayed over other datasets to generate a restore set.

Abstract: Systems for high performance restore of data to storage devices. A method embodiment commences upon identifying a plurality of virtual disks to be grouped together into one or more consistency sets. Storage I/O commands for the plurality of virtual disks of the consistency sets are captured into multiple levels of backup data. On a time schedule, multiple levels of backup data for the virtual disks are cascaded by processing data from one or more higher granularity levels of backup data to one or more lower granularity levels of backup data. A restore operation can access the multiple levels of backup data to construct a restore set that is consistent to a designated point in time or to a designated state. Multiple staging areas can be maintained using lightweight snapshot data structures that each comprise a series of captured I/Os to be replayed over other datasets to generate a restore set.

Abstract: The disclosed systems emulate high-frequency application-consistent snapshots by forming restore point data sets based on remote site replay of I/O commands. A method embodiment commences upon identifying a primary computing site and a secondary computing site, then identifying an application to be restored from the secondary computing site after a disaster. Prior to the disaster, a group of computing entities of the application to be restored from the secondary computing site are identified. Input/output operations that are performed over any of the computing entities at the primary site are streamed to the secondary site where they are stored. An I/O map that associates a time with an indication of a last received I/O command that had been performed over a changing set of computing entities is sent to the secondary site. An agent at the secondary site accesses the I/O map and the streamed-over I/Os to construct recovery data.

Abstract: Techniques for replay of groups of I/Os for disaster recovery. At a primary site, a plurality of primary site computing entities that are to be restored from the secondary computing site after a disaster recovery event are identified as belonging to an entity group. At the primary site, I/O commands that are performed over any of the entities of the entity group are observed and streamed to the secondary site, where they are persisted into a log. Periodically, the primary site sends the secondary site an I/O map that associates a time with an indication of the last performed I/O commands pertaining to any observed I/O commands that had been performed over any one or more of the computing entities of the entity group. Upon receiving a disaster recovery request, the most recent I/O map and the secondary site log are processed to construct a snapshot for the entity group.