Abstract: A transfer segment group task processing module of a database system is operable to send a first begin segment group transfer instruction to a first storage cluster based on a determination to transfer a set of segments stored via the first storage cluster to a second storage cluster. A target first ownership sequence number is received from the first storage cluster. A second begin segment group transfer instruction to the second storage cluster. A transfer complete notification is received from the second storage cluster. A complete storage instruction is sent to the second storage cluster. An updated second ownership sequence number is received from the second storage cluster indicating updating of second data ownership information of the second storage cluster. A commit transfer instruction is sent to the first storage cluster based on updated second ownership sequence number received from the second storage cluster.

Abstract: A database system is operable to assign a first node as a task monitoring node for a task and assign a second node as a task execution node for the task. The task is executed via the first node and the second node based on the first node sending a plurality of polls to the second node, the second node initiating execution of the task based on one of the plurality of polls, the second node sending a plurality of task status data to the first node, the first node maintaining current task status data for the task a shared metadata state based on the plurality of task status data, the second node completing execution of the task and caching task results in memory resources, the first node receiving the task results from the second node; and the second node removing the task results from the memory resources.

Abstract: A transfer segment group task processing module of a database system is operable to send a first begin segment group transfer instruction to a first storage cluster based on a determination to transfer a set of segments stored via the first storage cluster to a second storage cluster. A target first ownership sequence number is received from the first storage cluster. A second begin segment group transfer instruction to the second storage cluster. A transfer complete notification is received from the second storage cluster. A complete storage instruction is sent to the second storage cluster. An updated second ownership sequence number is received from the second storage cluster indicating updating of second data ownership information of the second storage cluster. A commit transfer instruction is sent to the first storage cluster based on updated second ownership sequence number received from the second storage cluster.

Abstract: A node of a database system is operable to determine, at a first time, to prepare for a shutdown. The shutdown of the node is performed at a second time that is a period of time after the first time based on the node delaying the shutdown until a plurality of currently running processes being run by the node that initiated prior to the first time are determined to be complete. During the period of time after the first time and prior to performing the shutdown, a set of new processing requests are rejected by the node.

Abstract: A node of a database system is operable to determine, at a first time, to prepare for a shutdown. The shutdown of the node is performed at a second time that is a period of time after the first time based on the node delaying the shutdown until a plurality of currently running processes being run by the node that initiated prior to the first time are determined to be complete. During the period of time after the first time and prior to performing the shutdown, a set of new processing requests are rejected by the node.

Abstract: A database system operates by: determining a set of assigned segments based on data ownership information; generating a plurality of segment handles and a corresponding plurality of segment metadata for the set of assigned segments based on performing a segment activation step for the set of assigned segments; determining a first query for execution requiring access to a first segment of the set of assigned segments; and executing an IO operator of the first query based on loading the first segment by utilizing a corresponding one of the plurality of segment handles.

Abstract: A database system is operable to, during a first temporal period, facilitate execution of a first query to generate a first query resultant based on access to an initial set of segments. During a second temporal period after the first temporal period, an updated segment is generated based on determining to re-store corresponding column values of an initial segment via applying at least one storage optimization technique. During the second temporal period, execution of a second query is facilitated to generate a second query resultant via access to the initial segment. After the second temporal period, storage of the initial segment is replaced with storage of the updated segment. During a third temporal period after the second temporal period, execution of a third query is facilitated to generate a third corresponding query resultant via access to the updated segment.

Abstract: A record processing and storage system operates by: automatically determining a buffer interval for a mapping function of batch size to estimated memory utilization; automatically selecting a first batch size for performance of a first data format conversion based a first intersection between an upper bound of the buffer interval and a current memory availability; performing the first data format conversion upon a first batch of data having the first batch size; automatically updating the buffer interval based on a difference between an actual amount of memory utilized in performing the first data format conversion and an estimated memory utilization mapped to the first batch size via the mapping function; automatically selecting a second batch size for performance of a second data format conversion based a second intersection between an upper bound of the updated buffer interval and the current memory availability; and performing the second data format conversion upon a second batch of data having the second

Abstract: A method includes generating a predictive model mapping batch size to estimated memory utilization based on a plurality of prior batch sizes applied for performing a corresponding plurality of prior data format conversions, and further based on a plurality of prior actual memory utilization occurring in performing the corresponding plurality of prior data format conversions. A next batch size is automatically selected for performance of a subsequent data format conversion based on the predictive model and a current memory availability. A batch of data for performance of the subsequent data format conversion is identified based on the batch of data having the next batch size. The subsequent data format conversion is performed the batch of data, and an actual amount of memory utilized in performing the subsequent data format conversion is determined. The predictive model is updated based on the next batch size and the actual amount of memory utilized.

Abstract: A node of a database system is operable to determine, at a first time, to prepare for a shutdown. The shutdown of the node is performed at a second time that is a period of time after the first time based on the node delaying the shutdown until a plurality of currently running processes being run by the node that initiated prior to the first time are determined to be complete. During the period of time after the first time and prior to performing the shutdown, a set of new processing requests are rejected by the node.

Abstract: A database system is operable to generate and a first plurality of column-formatted segments from a first plurality of rows. A query indicates parameters for generating a result set, and further indicating an instruction to store the result set. A query operator execution flow that includes a loading operator is generated. The query is executed based on accessing at least one of the first plurality of rows, processing the at least one of the first plurality of rows to generate a second plurality of rows as the result set, and executing the loading operator. At least one new column-formatted segment is from the second plurality of rows based on execution of the loading operator. The at least one new column-formatted segment is stored access in future query executions.

Abstract: A method includes generating a predictive model mapping batch size to estimated memory utilization based on a plurality of prior batch sizes applied for performing a corresponding plurality of prior data format conversions, and further based on a plurality of prior actual memory utilization occurring in performing the corresponding plurality of prior data format conversions. A next batch size is automatically selected for performance of a subsequent data format conversion based on the predictive model and a current memory availability. A batch of data for performance of the subsequent data format conversion is identified based on the batch of data having the next batch size. The subsequent data format conversion is performed the batch of data, and an actual amount of memory utilized in performing the subsequent data format conversion is determined. The predictive model is updated based on the next batch size and the actual amount of memory utilized.