Abstract: A database system includes a plurality of computing devices. Each computing device includes a plurality of processing modules, a computing device operating system, and an application specific operating system. The computing device operating system includes a computing device operating system file system management instruction set. The application specific operating system includes at least one custom file system management instruction set operable to configure operation of a configurable set of processing modules of the plurality of processing modules based on generating a corresponding file system management configuration signal for each processing module of the configurable set of processing modules indicating a selected file system management instruction set of the computing device operating system or the application specific operating system.

Abstract: A database system is operable to generate a query operation energy utilization estimation function based on historic energy utilization data and historic query operation execution data. A query is determined for execution and energy utilization estimation input data is determined for the query operation. The query operation energy utilization estimation function is performed upon the energy utilization estimation input data to generate energy utilization estimate data for the query operation. An energy efficiency strategy for the database system is applied based on the energy utilization estimate data generated for the query operation.

Abstract: A node of a computing system includes a main memory and a plurality of processing core resources that each can adjust a power level. The main memory includes a computing device section and a database section. The computing device section includes a computing device operating system area and a computing device general area. The database section includes a database section that includes a database operating system area, a disk area, a network area, and a database general area. The database operating system area allocates at least one portion of the main memory for database operations that is locked from access by the computing device operating system area.

Abstract: A networked database management system (DBMS) is disclosed. In particular, the disclosed DBMS includes a plurality of nodes, one of which is elected as a designated leader. The designated leader is elected using a consensus algorithm, such as tabulated random votes, RAFT or PAXOS. The designated leader is responsible for managing open coding lines, and determining when to close an open coding line.

Abstract: A database system operates by: determining a query for execution against a dataset that indicates a filtering predicate denoting a disjunction between a first range-based predicate and a second range-based predicate; accessing distribution data for the dataset indicating a plurality of kernels for a plurality of points in a multi-dimensional space; identifying a first sub-region within the multi-dimensional space corresponding to the first range-based predicate; identifying a second sub-region within the multi-dimensional space corresponding to the second range-based predicate; computing a disjunction probability approximation value based on an average portion summation value across a plurality of portion summation values generated for the plurality of kernels; and executing the query based on the disjunction probability approximation value.

Abstract: A database system is operable to determine power usage policy data and generate operation requirement data based on the power usage policy data. A database operation is determined for execution, and an energy utilization-based operation limitation enforcement function is performed upon energy utilization-based operation restriction enforcement input data to generate energy utilization-based operation restriction enforcement data for the database operation based on applying the operation requirement data. The database operation is executed when the energy utilization-based operation restriction enforcement data indicates execution of the operation is allowed based on execution of the database operation adhering to the operation requirement data. Execution of database operation is foregone when the energy utilization-based operation restriction enforcement data indicates execution of the operation is disallowed based on execution of the database operation not adhering to the operation requirement data.

Abstract: A database system is operable to perform a power supply strategy selection function based on first energy utilization-based operation optimizer input data to generate first energy utilization-based power supply strategy data denoting, for each power supply type of a plurality of power supply types, a corresponding first proportion of power supply resources that be implemented as the each power supply type. A first set of power supply resources is selected to execute a first database operation based on the first energy utilization-based power supply strategy data. The first set of power supply resources are utilized to power a first set of computing devices to enable the first set of computing devices to participate in execution of the first database operation in accordance with the first energy utilization-based power supply strategy data.

Abstract: A record processing and storage system operates by: generating a set of pages from a plurality of row data via a plurality of processing core resources, wherein each processing core resource in the plurality of processing core resources generate a corresponding subset of the set of pages, independently from and in parallel with processing of other subsets of the set of pages via other ones of the plurality of processing core resources; facilitating performance of a single storage transaction to store the set of pages; identifying a page set interval based on a plurality of row number intervals of the set of pages; generating, based on completing the single storage transaction, row durability data indicating a least favorably ordered row number of a plurality of row numbers corresponding to the plurality of row data; and transmitting the row durability data to a computing device associated with the plurality of row data.

Abstract: A database system is operable to generate an energy utilization-based operation scheduling function based on power usage policy data for the database system. A storage-formatted data generation operation is determined for execution, and energy utilization-based operation scheduling input data is determined for the storage-formatted data generation operation. The storage-formatted data generation operation energy utilization-based operation scheduling function is performed upon the energy utilization-based operation scheduling input data to generate energy utilization-based operation scheduling data for the storage-formatted data generation operation. A plurality of storage-formatted data structures are generated from a plurality of records for storage based on executing the storage-formatted data generation operation in accordance with the energy utilization-based operation scheduling data.

Abstract: A node of a database system is operable to determine, at a first time, to prepare for a shutdown. The shutdown of the node is performed at a second time that is a period of time after the first time based on the node delaying the shutdown until a plurality of currently running processes being run by the node that initiated prior to the first time are determined to be complete. During the period of time after the first time and prior to performing the shutdown, a set of new processing requests are rejected by the node.

Abstract: A computing system is operable to generate a first plurality of lines of coding blocks that includes a first plurality of data blocks and a first plurality of parity blocks. A first set of segments of a first segment group that collectively include the first plurality of lines of coding blocks are generated, and the first set of segments of the first segment group are stored via a first plurality of computing devices of a first storage cluster of the computing system. A second plurality of lines of coding blocks that includes a second plurality of data blocks and a second plurality of parity blocks are generated. A second set of segments of a second segment group that collectively include the second plurality of lines of coding blocks are generated. The second set of segments of the second segment group are stored via a second plurality of computing devices of a second storage cluster of the computing system.

Abstract: A method for execution, by a first intermediate node of a plurality of nodes in a database management system, includes receiving a message, where the first intermediate node is limited to communication with a subset of nodes of the plurality of nodes, where the message: includes data that is being sent in accordance with a routing path, is a first size, and indicates a next node of the routing path, and where the subset of nodes includes the next node. The method continues by generating a revised message, wherein the revised message includes the data and has a second size. The method continues by determining whether there is at least one additional intermediate node after the next node in the routing path. When yes, determining an optimal route for forwarding the revised message via a node of the subset of nodes, and sending the revised message to the node.

Abstract: A node of a database system is operable to receive a plurality of data blocks from a set of source nodes via a set of relay nodes. At least one feedback data block to be sent to at least one of the set of source nodes is generated. Feedback relay node selection data selecting at least one of a plurality of nodes in the database system for facilitating routing of the at least one feedback data block from the node to the at least one of the set of source nodes via a prioritized feedback communication mechanism is generated. The at least one feedback data block is sent to the at least one of the plurality of nodes selected in the feedback relay node selection data. The at least one feedback data block is routed from the node to the at least one of the set of source nodes via the prioritized feedback communication mechanism.

Abstract: A method includes generating a plurality of pages from a plurality of records received from a plurality of data sources. Deduplication of the plurality of pages is facilitated based on a plurality of page metadata of the plurality of pages based on, for the each page of the plurality of pages. A filtered set of potentially-intersecting pages is identified for each given page as a proper subset of the plurality of pages stored in the page storage system based on first comparison parameters, and an intersecting set of pages that include a row number intersection with the given page is identified as a proper subset of the filtered set of potentially-intersecting pages based on second comparison parameters. Records with records with row numbers included in row number intersections with other pages in the intersecting set of pages are removed from the each page.

Abstract: A storage system is operable to transition from operation in accordance with a first storage scheme to operation in accordance with a second storage scheme by, for each storage device of the plurality of storage devices, expanding a storage size of a single storage structure of the corresponding plurality of data storage structures identified to implement the second storage scheme from an initial size to a final size consuming full storage resources of the each storage device based on writing all new data of a plurality of write requests to the single storage structure in accordance with the second storage scheme, performing at least one expansion of the single storage structure within the each storage device in response to an expansion condition being met, and completing transition based on the single storage structure reaching the final size consuming the full storage resources of the each storage device.

Abstract: A database system operates by: generating a plurality of pages that include a plurality of records in accordance with a row-based format; storing the plurality of pages via a page storage system; generating segment generation determination data based on storage utilization data of the page storage system; generating a plurality of segments from the plurality of pages that include the plurality of records in a column-based format based on the segment generation determination data indicating segments be generated; storing the plurality of segments via a segment storage system; receiving a query; generating an operator execution flow for execution of the query that includes an IO operator, generating a modified operator execution flow for execution of the query by replacing the IO operator of the operator execution flow with a segment IO operator in parallel with a page IO operator, and facilitating execution of the query.

Abstract: A computing device includes a plurality of nodes, wherein a first node of the plurality of nodes operates in accordance with a computing device operation system (OS) and remaining nodes of the plurality of nodes operate in accordance with a database OS and process a plurality of threads of an application. The computing device further includes a divided main memory that is divided into a computing device memory section and a database memory section, and the database OS determines an allocation of the divided main memory between the computing device memory section and the database memory section, where a first database thread is assigned a buffer of a plurality of buffers of the database memory section, and a first computing device thread utilizes the computing device memory section of the divided main memory.

Abstract: A method for execution, by a first intermediate node of a plurality of nodes in a database management system, includes processing a message that includes data that is being sent in accordance with a routing path from a source node to a destination node, is a first size, and indicates a next node of the routing path, wherein the first intermediate node is limited to communication with a subset of nodes of the plurality of nodes, and wherein the subset of nodes includes the next node. The method further includes maintaining a tracking table that indicates a total amount of data sent to each node of the subset of nodes during a first time period. The method further includes resetting the total amount of data sent to each of the subset of nodes to zero based one or more of a command and an initiation of a second time period.

Abstract: A database system is operable to determine a set of segments that include a set of rows required to execute at least one query. At least one virtual segment in the set of segments is determined. At least two data portions in a first segment of the at least one virtual segment are identified. A locally rebuilt set of rows for the at least two data portions is generated based on retrieving at least two corresponding data portions of at least one other segment from storage and rebuilding at least two data portions utilizing the retrieved at least two corresponding data portions. Query resultant data is generated based on performing execution of the at least one query by utilizing the locally rebuilt set of rows.

Abstract: A database system includes a plurality of computing devices. Each computing device includes a plurality of processing modules, a computing device operating system, and an application specific operating system. The computing device operating system includes a computing device operating system file system management instruction set. The application specific operating system includes at least one custom file system management instruction set operable to configure operation of a configurable set of processing modules of the plurality of processing modules based on generating a corresponding file system management configuration signal for each processing module of the configurable set of processing modules indicating a selected file system management instruction set of the computing device operating system or the application specific operating system.