Abstract: A database management system includes a cluster of nodes over which a columnar database has been sharded into shards to which the nodes are subscribed. Source nodes of the cluster store up-to-date metadata objects for the shards, and target nodes of the cluster storing out-of-date metadata objects for the shards. A coordinator node initiates a parallel batch metadata transfer update process in which the out-of-date metadata objects at the target nodes are updated in parallel from the up-to-date metadata objects at the source nodes. The coordinator node can determine pairs of source nodes and target nodes; the source node and the target node of each pair respectively store an up-to-date metadata object and an out-of-date metadata object for a same shard.

Abstract: A database management system includes a cluster of nodes over which a columnar database has been sharded into shards to which the nodes are subscribed. Source nodes of the cluster store up-to-date metadata objects for the shards, and target nodes of the cluster storing out-of-date metadata objects for the shards. A coordinator node initiates a parallel batch metadata transfer update process in which the out-of-date metadata objects at the target nodes are updated in parallel from the up-to-date metadata objects at the source nodes. The coordinator node can determine pairs of source nodes and target nodes; the source node and the target node of each pair respectively store an up-to-date metadata object and an out-of-date metadata object for a same shard.

Abstract: A technique includes modeling assignments of a plurality of nodes to a plurality of shards associated with a database operation based on a target throughput for the plurality of nodes. The modeling includes constraining the assignments based on an aggregate outflow from the plurality of nodes. The technique includes initializing the aggregate outflow to be less than the target throughput; and determining the assignments based on the modeling.

Abstract: A technique includes applying a first mapping to associate a plurality of data records for a plurality of database nodes with a plurality of segments of a storage that is shared by the database nodes; and applying a many-to-many second mapping to associate the segments with the database nodes.

Abstract: A technique includes determining an earliest query start time associated with a plurality of queries currently being processed by a node; and based on the identified earliest query start time, selecting a version of a global catalog existing at the earliest start time. The global catalog represents objects stored in a storage shared by the node and at least one other node. The technique includes communicating the selected version of the global catalog to an object garbage collector for the storage.

Abstract: A technique includes applying a first mapping to associate a plurality of data records for a plurality of database nodes with a plurality of segments of a storage that is shared by the database nodes; and applying a many-to-many second mapping to associate the segments with the database nodes.

Abstract: A technique includes modeling assignments of a plurality of nodes to a plurality of shards associated with a database operation based on a target throughput for the plurality of nodes. The modeling includes constraining the assignments based on an aggregate outflow from the plurality of nodes. The technique includes initializing the aggregate outflow to be less than the target throughput; and determining the assignments based on the modeling.

Abstract: A method, system, and computer-readable storage device for transferring data from a database management system to a data analytics system is described herein. In one aspect, a database management node storing a data partition of a database table that is distributed across a plurality of database management nodes of a database management system receives a data transfer request from a data analytics node of a data analytics node cluster. The data transfer request may include a data transfer policy for splitting the data partition onto the data analytics node cluster. A data split may be identified from the data partition. The data split may be a subset of the data partition. The data split is communicated to the data analytics node according to the data transfer policy.

Abstract: A method, system, and computer-readable storage device for transferring data from a database management system to a data analytics system is described herein. In one aspect, a database management node storing a data partition of a database table that is distributed across a plurality of database management nodes of a database management system receives a data transfer request from a data analytics node of a data analytics node cluster. The data transfer request may include a data transfer policy for splitting the data partition onto the data analytics node cluster. A data split may be identified from the data partition. The data split may be a subset of the data partition. The data split is communicated to the data analytics node according to the data transfer policy.