Abstract: A processor-implemented method for replicating structured query language (SQL) in a heterogeneous replication environment is provided. The method includes receiving a first statement for a multi-row operation, whereby the multi-row operation is directed to one or more tables of a database, and whereby the first statement includes a text of a SQL statement in a DBMS transaction log. The method also provides for evaluating whether to create a source tree structure from the received first statement. In response to creating the source tree structure, the method evaluates whether the source tree structure is transformable. The method transforms the source tree structure to a target tree structure in response to evaluating that the source tree structure is transformable.

Abstract: A computer-implemented method for operating a database management system which includes a source database and a target database. A database management system is configured for asynchronously replicating data changes of the source database to the target database. The database management system receiving a request to perform a database statement. The method can identify the most recently committed one of a plurality of transactions having been committed in the source database before the receiving of the request. Identifying repeatedly the one of the plurality of transactions having been replicated most recently to the target database. Execution of the requested statement in the target database is delayed until an evaluation of the repeatedly identified most recently replicated transaction returns that the identified most recently committed transaction has been replicated to the target database. After the delaying execution, the method executes the requested statement in the target database.

Abstract: A computer-implemented method for operating a database management system which includes a source database and a target database. A database management system is configured for asynchronously replicating data changes of the source database to the target database. The database management system receiving a request to perform a database statement. The method can identify the most recently committed one of a plurality of transactions having been committed in the source database before the receiving of the request. Identifying repeatedly the one of the plurality of transactions having been replicated most recently to the target database. Execution of the requested statement in the target database is delayed until an evaluation of the repeatedly identified most recently replicated transaction returns that the identified most recently committed transaction has been replicated to the target database. After the delaying execution, the method executes the requested statement in the target database.

Abstract: An approach for inter-table parallel refresh in a database management system (DBMS). An inter-table refresher receives DBMS source and target databases comprising source parent and related source child datasets. The inter-table refresher determines a collection of the source parent and the related source child datasets and creates a collection of parent and child refresh segments based on the collection of the source parent and child datasets. The inter-table refresher creates a collection of parent and child refresh batches based on the collection of parent and child refresh segments respectively and outputs an inter-table refresh batch schedule based on the collection of the parent refresh batches and the collection of the child refresh batches where the collection of the parent refresh batches and the collection of the child refresh batches operate concurrently and a current child refresh batch follows the completion of a respective current parent refresh batch.

Abstract: Embodiments of the present invention provide systems and methods for enabling cross object synchronization. An algorithm is applied in order to obtain a consistent view of multiple Kafka topics. One set of objects are associated with a first Kafka topic and another set of objects are associated with a second Kafka topic. The first Kafka topic and the second Kafka topic are processed as a single Kafka topic which leads to common transactional coordinate points associated with the first and second Kafka topics. The common transaction coordinate point is indicative of a consistent view of the multiple Kafka topics.

Abstract: A computer-implemented method for operating a database management system which includes a source database and a target database. A database management system is configured for asynchronously replicating data changes of the source database to the target database. The database management system receiving a request to perform a database statement. The method can identify the most recently committed one of a plurality of transactions having been committed in the source database before the receiving of the request. Identifying repeatedly the one of the plurality of transactions having been replicated most recently to the target database. Execution of the requested statement in the target database is delayed until an evaluation of the repeatedly identified most recently replicated transaction returns that the identified most recently committed transaction has been replicated to the target database. After the delaying execution, the method executes the requested statement in the target database.

Abstract: According to an aspect, a database management system (DBMS) is operated to perform data replication. The DBMS includes a source database and a target database. The source database includes a plurality of first tables respectively comprising one or more first columns, and the target database includes a plurality of second tables respectively comprising one or more second columns. Each of multiple ones of the first columns is mapped to one of the second columns, and each one of the second columns is adapted to store replicated data changes of the first column mapped to the second column. Each of the second columns has an assigned update time, the update time being a moment in time when the second column most recently received incremental data changes from its mapped first column. The DBMS operates to process requested database statements while providing data replication.

Abstract: A primary system is established at a first site. The primary system hosts an application and a primary database for remote users that use the application to manage data of the primary database. A unified data layer is established at a remote site. The unified data layer provides access to data of the primary database without providing access to the primary database. A triggering event that impairs the ability of the primary system to host the application is detected. A recovery system is instantiated in response to detecting the triggering event. The recovery system includes both a recovery instance of the application and a recovery database for the data of the application. The recovery database is populated using the unified data layer. The recovery system is activated such that remote users can access the recovery instance of the application to manage data of the recovery database.

Abstract: A primary system is established at a first site. The primary system hosts an application and a primary database for remote users that use the application to manage data of the primary database. A unified data layer is established at a remote site. The unified data layer provides access to data of the primary database without providing access to the primary database. A triggering event that impairs the ability of the primary system to host the application is detected. A recovery system is instantiated in response to detecting the triggering event. The recovery system includes both a recovery instance of the application and a recovery database for the data of the application. The recovery database is populated using the unified data layer. The recovery system is activated such that remote users can access the recovery instance of the application to manage data of the recovery database.

Abstract: A method for handling of open transactions in a data replication environment. The method includes querying one or more tables of a source database to determine a first open transaction associated with the one or more tables of the source database. The method further includes determining a database user that initiated the first open transaction. The method further includes querying one or more tables of the target database corresponding to the one or more tables of the source database associated with the first open transaction, to determine whether the database user has access privileges for the one or more tables of the target database and dynamically skipping replication of the first open transaction to the target database, such that the data replication system no longer waits for the first open transaction to complete.

Abstract: Provided are techniques for workload discovery using real-time analysis of input streams. For a meta workload, changes to data objects made by change operations that are in a replication change stream are stored into a recovery log. Using an analytics engine, one of the recovery log and the replication change stream are analyzed to identify associations between the data objects based on usage and access patterns. The associations are used to identify sub-workloads of the meta workload that form consistency groups for replication.

Abstract: A mechanism is provided in a data processing system for executing queries referencing data stored in a unified data layer. A relational engine executing on the data processing system receives a structured query language (SQL) query from a client. A query processor executing on the data processing system accesses integrated data sources including a unified data layer (UDL) data source storing UDL topic files via a data virtualization layer to form query results. The data virtualization layer projects the UDL topic files into relational form. The relational engine returns the query results to the client.

Abstract: A mechanism is provided in a data processing system for executing queries referencing data stored in a unified data layer. A relational engine executing on the data processing system receives a structured query language (SQL) query from a client. A query processor executing on the data processing system accesses integrated data sources including a unified data layer (UDL) data source storing UDL topic files via a data virtualization layer to form query results. The data virtualization layer projects the UDL topic files into relational form. The relational engine returns the query results to the client.

Abstract: An approach for inter-table parallel refresh in a database management system (DBMS). An inter-table refresher receives DBMS source and target databases comprising source parent and related source child datasets. The inter-table refresher determines a collection of the source parent and the related source child datasets and creates a collection of parent and child refresh segments based on the collection of the source parent and child datasets. The inter-table refresher creates a collection of parent and child refresh batches based on the collection of parent and child refresh segments respectively and outputs an inter-table refresh batch schedule based on the collection of the parent refresh batches and the collection of the child refresh batches where the collection of the parent refresh batches and the collection of the child refresh batches operate concurrently and a current child refresh batch follows the completion of a respective current parent refresh batch.

Abstract: A primary system is established at a first site. The primary system hosts an application and a primary database for remote users that use the application to manage data of the primary database. A unified data layer is established at a remote site. The unified data layer provides access to data of the primary database without providing access to the primary database. A triggering event that impairs the ability of the primary system to host the application is detected. A recovery system is instantiated in response to detecting the triggering event. The recovery system includes both a recovery instance of the application and a recovery database for the data of the application. The recovery database is populated using the unified data layer. The recovery system is activated such that remote users can access the recovery instance of the application to manage data of the recovery database.

Abstract: An approach for inter-table parallel refresh in a database management system (DBMS). An inter-table refresher receives DBMS source and target databases comprising source parent and related source child datasets. The inter-table refresher determines a collection of the source parent and the related source child datasets and creates a collection of parent and child refresh segments based on the collection of the source parent and child datasets. The inter-table refresher creates a collection of parent and child refresh batches based on the collection of parent and child refresh segments respectively and outputs an inter-table refresh batch schedule based on the collection of the parent refresh batches and the collection of the child refresh batches where the collection of the parent refresh batches and the collection of the child refresh batches operate concurrently and a current child refresh batch follows the completion of a respective current parent refresh batch.

Abstract: According to an aspect, a database management system (DBMS) is operated to perform data replication. The DBMS includes a source database and a target database. The source database includes a plurality of first tables respectively comprising one or more first columns, and the target database includes a plurality of second tables respectively comprising one or more second columns. Each of multiple ones of the first columns is mapped to one of the second columns, and each one of the second columns is adapted to store replicated data changes of the first column mapped to the second column. Each of the second columns has an assigned update time, the update time being a moment in time when the second column most recently received incremental data changes from its mapped first column. The DBMS operates to process requested database statements while providing data replication.

Abstract: A method for handling of open transactions in a data replication environment. The method includes querying one or more tables of a source database to determine a first open transaction associated with the one or more tables of the source database. The method further includes determining a database user that initiated the first open transaction. The method further includes querying one or more tables of the target database corresponding to the one or more tables of the source database associated with the first open transaction, to determine whether the database user has access privileges for the one or more tables of the target database and dynamically skipping replication of the first open transaction to the target database, such that the data replication system no longer waits for the first open transaction to complete.

Abstract: A method for handling of open transactions in a data replication environment. The method includes querying one or more tables of a source database to determine a first open transaction associated with the one or more tables of the source database. The method further includes determining a database user that initiated the first open transaction. The method further includes querying one or more tables of the target database corresponding to the one or more tables of the source database associated with the first open transaction, to determine whether the database user has access privileges for the one or more tables of the target database and dynamically skipping replication of the first open transaction to the target database, such that the data replication system no longer waits for the first open transaction to complete.

Abstract: A method for handling of open transactions in a data replication environment. The method includes querying one or more tables of a source database to determine a first open transaction associated with the one or more tables of the source database. The method further includes determining a database user that initiated the first open transaction. The method further includes querying one or more tables of the target database corresponding to the one or more tables of the source database associated with the first open transaction, to determine whether the database user has access privileges for the one or more tables of the target database and dynamically skipping replication of the first open transaction to the target database, such that the data replication system no longer waits for the first open transaction to complete.