Abstract: In accordance with an embodiment, described herein is a system and method for capture of change data from a distributed data source system, for example a distributed database or a distributed data stream, and preparation of a canonical format output, for use with one or more heterogeneous targets, for example a database or message queue. The change data capture system can include support for features such as distributed source topology-awareness, initial load, deduplication, and recovery. A technical purpose of the systems and methods described herein includes determination and communication of changes performed to data at a distributed data source that includes a large amount of data across a plurality of nodes, to one or more target computer systems.

Abstract: In accordance with an embodiment, described herein is a system and method for capture of change data from a distributed data source system, for example a distributed database or a distributed data stream, and preparation of a canonical format output, for use with one or more heterogeneous targets, for example a database or message queue. The change data capture system can include support for features such as distributed source topology-awareness, initial load, deduplication, and recovery. A technical purpose of the systems and methods described herein includes determination and communication of changes performed to data at a distributed data source that includes a large amount of data across a plurality of nodes, to one or more target computer systems.

Abstract: In accordance with an embodiment, described herein is a system and method for heterogeneous database replication from a remote server, for example a remote database server. A capture process can be registered as a replication slave to the remote server, and configured to receive transaction event data from that server. Transaction log events associated with a modification to the database at the remote server can be processed, and output as change data, in a canonical format output, for use with one or more heterogeneous targets, for example a target database server or message queue. The process enables capture of transaction log events associated with database transactions at a remote server that may be located on a different computer or network, or within an access-restricted environment such as a cloud environment, without the need to create additional copies of its transaction logs.

Abstract: In accordance with an embodiment, described herein is a system and method for heterogeneous database replication from a remote server, for example a remote database server. A capture process can be registered as a replication slave to the remote server, and configured to receive transaction event data from that server. Transaction log events associated with a modification to the database at the remote server can be processed, and output as change data, in a canonical format output, for use with one or more heterogeneous targets, for example a target database server or message queue. The process enables capture of transaction log events associated with database transactions at a remote server that may be located on a different computer or network, or within an access-restricted environment such as a cloud environment, without the need to create additional copies of its transaction logs.

Abstract: In accordance with an embodiment, described herein is a system and method for heterogeneous database replication from a remote server, for example a remote database server. A capture process can be registered as a replication slave to the remote server, and configured to receive transaction event data from that server. Transaction log events associated with a modification to the database at the remote server can be processed, and output as change data, in a canonical format output, for use with one or more heterogeneous targets, for example a target database server or message queue. The process enables capture of transaction log events associated with database transactions at a remote server that may be located on a different computer or network, or within an access-restricted environment such as a cloud environment, without the need to create additional copies of its transaction logs.

Abstract: In accordance with an embodiment, described herein is a system and method for capture of change data from a distributed data source system, for example a distributed database or a distributed data stream, and preparation of a canonical format output, for use with one or more heterogeneous targets, for example a database or message queue. The change data capture system can include support for features such as distributed source topology-awareness, initial load, deduplication, and recovery. A technical purpose of the systems and methods described herein includes determination and communication of changes performed to data at a distributed data source that includes a large amount of data across a plurality of nodes, to one or more target computer systems.

Abstract: A computer readable storage medium includes executable instructions to read source node transaction logs to capture transaction data, including local transaction data, global transaction identifiers and participating node data. The global transaction identifiers and participating node data are stored in target node queues. The target node queues are accessed to form global transaction data. Target tables are constructed based upon the local transaction data and the global transaction data.

Abstract: A computer readable storage medium includes executable instructions to receive a specification for requested data in a log based replication system where data changes are retrieved from both a transaction log and a database. It is determined that the requested data is compromised. A search for a data image containing the requested data is initiated. The data image is accessed to secure the requested data. The requested data is returned.

Abstract: A computer readable medium includes executable instruction to compare databases. The executable instructions are configured to identify when a segment of a first database is conditionally out of synchronization with a corresponding segment of a second database to establish a conditionally out of synchronization state at a first time. Executable instructions allow a latency period after the first time in which changes are made to the first database and the second database. Executable instructions also determine after the latency period whether the segment of the first database is in synchronization with the corresponding segment of the second database. Executable instructions also populate a resynchronization table, which is used by a replication mechanism to bring asynchronous rows into synchronization.

Abstract: A computer readable storage medium includes executable instructions to read source node transaction logs to capture transaction data, including local transaction data, global transaction identifiers and participating node data. The global transaction identifiers and participating node data are stored in target node queues. The target node queues are accessed to form global transaction data. Target tables are constructed based upon the local transaction data and the global transaction data.