Abstract: A computer software implemented method for transforming a first extract transform load (ETL) job having at least some unload transform load (UTL) portions. The method includes the following steps: (i) decomposing the first ETL job into an intermediate set of one or more jobs; and (ii) for each job of the intermediate set, transforming the job into a transactionally equivalent job to yield a final set of one or more jobs. The decomposing is performed so that each job of the intermediate jobs set is a Simple UTL job. The transforming is performed so that each job of the final set includes no UTL portions.

Abstract: A method facilitates auditing of database transactions by maintaining logical consistency between a source database table and a shadow database table. A bulk command is received that specifies edits to a plurality of rows in the source database table. The bulk command is executed on the source database table. The shadow database table is queried to obtain an indication of the plurality of rows edited by the bulk command. The indication is stored as part of an audit trail for the source database table.

Abstract: A method facilitates auditing of database transactions by maintaining logical consistency between a source database table and a shadow database table. A bulk command is received that specifies edits to a plurality of rows in the source database table. The bulk command is executed on the source database table. The shadow database table is queried to obtain an indication of the plurality of rows edited by the bulk command. The indication is stored as part of an audit trail for the source database table.

Abstract: A method facilitates auditing of database transactions by maintaining logical consistency between a source database table and a shadow database table. A bulk command is received that specifies edits to a plurality of rows in the source database table. The bulk command is executed on the source database table. The shadow database table is queried to obtain an indication of the plurality of rows edited by the bulk command. The indication is stored as part of an audit trail for the source database table.

Abstract: A processor-implemented method for replicating structured query language (SQL) in a heterogeneous replication environment is provided. The method includes receiving a first statement for a multi-row operation, whereby the multi-row operation is directed to one or more tables of a database, and whereby the first statement includes a text of a SQL statement in a DBMS transaction log. The method also provides for evaluating whether to create a source tree structure from the received first statement. In response to creating the source tree structure, the method evaluates whether the source tree structure is transformable. The method transforms the source tree structure to a target tree structure in response to evaluating that the source tree structure is transformable.

Abstract: In an approach for balancing latency and consistency requirements during data replication, a processor defines a set of strategies representative of different types of inconsistencies between a first database and a second database, wherein the different types of inconsistencies vary with respect to details of a particular replication technology. A processor specifies a latency threshold at which a first type of inconsistency is allowed, based on user input of business information to enhance business value, wherein the type of inconsistency is selected from the set of strategies. A processor determines that a requested replication crosses the latency threshold. A processor pushes data into a target database, wherein latency is dynamically balanced with data consistency, based on the latency threshold.

Abstract: A computer-implemented method, carried out by one or more processors, for managing replication configurations. In an embodiment, the method comprises receiving, by one or more processors, a replication configuration for replicating data, wherein the replication configuration defines at least a target table in a target database based on a source table in a source database; initializing, by one or more processors, a federated view, wherein the federated view is based on at least the source table in the source database as defined in the replication configuration; utilizing, by one or more processors, the federated view to satisfy requesting applications, where requesting applications obtain data from the federated view; responsive to determining the replication of data is in spec, utilizing, by one or more processors, the target table in the target database to satisfy requesting applications.

Abstract: Provided are techniques for workload discovery using real-time analysis of input streams. For a meta workload, changes to data objects made by change operations that are in a replication change stream are stored into a recovery log. Using an analytics engine, one of the recovery log and the replication change stream are analyzed to identify associations between the data objects based on usage and access patterns. The associations are used to identify sub-workloads of the meta workload that form consistency groups for replication.

Abstract: A computer program product for managing replication configurations includes program instructions to receive a replication configuration for replicating data, wherein the replication configuration defines at least a target table in a target database based on a source table in a source database. The program instructions initialize a federated view, wherein the federated view is based on at least the source table in the source database as defined in the replication configuration. The program instructions utilize the federated view to satisfy requesting applications, where requesting applications obtain data from the federated view. The program instructions to, responsive to determining the replication of data is in spec, utilize the target table in the target database to satisfy requesting applications.

Abstract: A computer-implemented method, carried out by one or more processors, for managing replication configurations. In an embodiment, the method comprises receiving, by one or more processors, a replication configuration for replicating data, wherein the replication configuration defines at least a target table in a target database based on a source table in a source database; initializing, by one or more processors, a federated view, wherein the federated view is based on at least the source table in the source database as defined in the replication configuration; utilizing, by one or more processors, the federated view to satisfy requesting applications, where requesting applications obtain data from the federated view; responsive to determining the replication of data is in spec, utilizing, by one or more processors, the target table in the target database to satisfy requesting applications.

Abstract: According to an aspect, a database management system (DBMS) is operated to perform data replication. The DBMS includes a source database and a target database. The source database includes a plurality of first tables respectively comprising one or more first columns, and the target database includes a plurality of second tables respectively comprising one or more second columns. Each of multiple ones of the first columns is mapped to one of the second columns, and each one of the second columns is adapted to store replicated data changes of the first column mapped to the second column. Each of the second columns has an assigned update time, the update time being a moment in time when the second column most recently received incremental data changes from its mapped first column. The DBMS operates to process requested database statements while providing data replication.

Abstract: Embodiments of the present invention provide, systems, methods, and computer program products for asynchronously replicating data from source tables of a source computer system to target tables of a target computer system. Embodiments of the present invention implement an external buffer table (EBT) from which changed data statements can be selectively applied to target tables, which can reduce the number of statements applied to the target tables of the target computer system.

Abstract: Embodiments of the present invention provide, systems, methods, and computer program products for asynchronously replicating data from source tables of a source computer system to target tables of a target computer system. Embodiments of the present invention implement an external buffer table (EBT) from which changed data statements can be selectively applied to target tables, which can reduce the number of statements applied to the target tables of the target computer system.

Abstract: A computer-implemented method, carried out by one or more processors, for managing replication configurations. In an embodiment, the method comprises receiving, by one or more processors, a replication configuration for replicating data, wherein the replication configuration defines at least a target table in a target database based on a source table in a source database; initializing, by one or more processors, a federated view, wherein the federated view is based on at least the source table in the source database as defined in the replication configuration; utilizing, by one or more processors, the federated view to satisfy requesting applications, where requesting applications obtain data from the federated view; responsive to determining the replication of data is in spec, utilizing, by one or more processors, the target table in the target database to satisfy requesting applications.

Abstract: A computer software implemented method for transforming a first extract transform load (ETL) job having at least some unload transform load (UTL) portions. The method includes the following steps: (i) decomposing the first ETL job into an intermediate set of one or more jobs; and (ii) for each job of the intermediate set, transforming the job into a transactionally equivalent job to yield a final set of one or more jobs. The decomposing is performed so that each job of the intermediate jobs set is a Simple UTL job. The transforming is performed so that each job of the final set includes no UTL portions.

Abstract: A method for implementing a change capture system using an event publishing system as a database recovery log is provided. The method may include determining a set of data based on a description of events for which change capture is possible. The method may also include selecting at least one item of data from within the determined set of data, wherein the at least one item of data requires change capture to be performed. Additionally, the method may include identifying at least one published event, wherein the at least one published event is produced by the event publishing system. The method may include instructing the event publishing system to deliver the at least one identified published event to the change capture system. Furthermore, the method may include receiving the at least one identified published event. The method may also include processing the at least one published event.

Abstract: A method for implementing a change capture system using an event publishing system as a database recovery log is provided. The method may include determining a set of data based on a description of events for which change capture is possible. The method may also include selecting at least one item of data from within the determined set of data, wherein the at least one item of data requires change capture to be performed. Additionally, the method may include identifying at least one published event, wherein the at least one published event is produced by the event publishing system. The method may include instructing the event publishing system to deliver the at least one identified published event to the change capture system. Furthermore, the method may include receiving the at least one identified published event. The method may also include processing the at least one published event.

Abstract: A computer-implemented method for operating a database management system which includes a source database and a target database. A database management system is configured for asynchronously replicating data changes of the source database to the target database. The database management system receiving a request to perform a database statement. The method can identify the most recently committed one of a plurality of transactions having been committed in the source database before the receiving of the request. Identifying repeatedly the one of the plurality of transactions having been replicated most recently to the target database. Execution of the requested statement in the target database is delayed until an evaluation of the repeatedly identified most recently replicated transaction returns that the identified most recently committed transaction has been replicated to the target database. After the delaying execution, the method executes the requested statement in the target database.

Abstract: A computer software implemented method for transforming a first extract transform load (ETL) job having at least some unload transform load (UTL) portions. The method includes the following steps: (i) decomposing the first ETL job into an intermediate set of one or more jobs; and (ii) for each job of the intermediate set, transforming the job into a transactionally equivalent job to yield a final set of one or more jobs. The decomposing is performed so that each job of the intermediate jobs set is a Simple UTL job. The transforming is performed so that each job of the final set includes no UTL portions.

Abstract: According to one embodiment of the present invention, a system reduces re-reading of database logs by persisting long running transaction data. The system processes the database log records of the database transaction log; generates a snapshot of the database log records at periodic intervals, wherein each snapshot includes database log records for pending transactions; and in response to an interruption in processing of the database log records, utilizes a snapshot to restore database log records for the pending transactions and resume processing of the database transaction log from a position succeeding the database log records of the selected snapshot.