Abstract: In an example embodiment, a solution is provided for coordinating transactions across both relational databases and open format tables on object storage. This technology addresses the challenge of integrating open table formats, such as Delta and Iceberg, with relational databases like SAP HANA. These technical challenges include subtleties imposed by database transaction isolation, asynchronous parallelism, and dealing with instabilities. More specifically, transactions are broken down a transaction into smaller, independent sub-transactions. Each sub-transaction is executed independently. If a sub-transaction fails, compensating actions are performed to undo its effects. This approach ensures that the overall transaction is applied atomically.

Abstract: System, method, and various embodiments for a resource efficient schema object creation system are described herein. An embodiment operates by receiving a schema-change request at a first node of a cluster of computing nodes. The first node creates and populates a schema object in a shared storage, based on the schema-change request. An entry is generated in a reverse transaction log, the entry corresponding to the schema object stored in the shared storage device. A coordinator node is configured to read the entry from the reverse transaction log, update a schema, and generate an entry in a forward transaction log. The first node executes the entry in the forward transaction log, wherein the executing comprises updating a catalog of the first node to include the schema object stored in the shared storage, wherein upon a completion of the updating, the schema object is accessible by the first node.

Abstract: System, method, and various embodiments for a resource efficient schema object creation system are described herein. An embodiment operates by receiving a schema-change request at a first node of a cluster of computing nodes. The first node creates and populates a schema object in a shared storage, based on the schema-change request. An entry is generated in a reverse transaction log, the entry corresponding to the schema object stored in the shared storage device. A coordinator node is configured to read the entry from the reverse transaction log, update a schema, and generate an entry in a forward transaction log. The first node executes the entry in the forward transaction log, wherein the executing comprises updating a catalog of the first node to include the schema object stored in the shared storage, wherein upon a completion of the updating, the schema object is accessible by the first node.