Abstract: In one respect, there is provided a distributed database system that includes hosts configured to store and/or manage data, a first query processing engine comprising a master node and an executor node, and a second query processing engine. The master node can be implemented on programmable processors and configured to perform operations. The operations can include: offloading, to the second query processing engine, a creation of a first and a second table such that the first and the second table are partitioned by the second query processing engine; generating an execution plan for a query on data in the distributed database system, the execution plan including a distributed join operation that combines data from the first and second table; determining to push down, to the second query processing engine, the distributed join operation; and dispatching, to the executor node, a portion of the execution plan including the distributed join operation.

Abstract: In one respect, there is provided a distributed database system. The distributed database system can include a plurality of hosts configured to store and/or manage data, a first query processing engine comprising a master node and an executor node, and a second query processing engine. The master node can be implemented on one or more programmable processors and configured to perform operations. The operations can include: generating an execution plan for a query on data that is stored at and/or managed by one or more of the plurality of hosts; determining to push down, to the second query processing engine, at least one data processing operations in the execution plan; and dispatching, to the executor node, at least a portion of the execution plan, the portion of the execution plan including the at least one data processing operation that is pushed down to the second query processing engine.

Abstract: In one respect, there is provided a distributed database system that includes hosts configured to store and/or manage data, a first query processing engine comprising a master node and an executor node, and a second query processing engine. The master node can be implemented on programmable processors and configured to perform operations. The operations can include: offloading, to the second query processing engine, a creation of a first and a second table such that the first and the second table are partitioned by the second query processing engine; generating an execution plan for a query on data in the distributed database system, the execution plan including a distributed join operation that combines data from the first and second table; determining to push down, to the second query processing engine, the distributed join operation; and dispatching, to the executor node, a portion of the execution plan including the distributed join operation.

Abstract: Embodiments include a metadata application programming interface (API) for processing ad hoc database queries. Embodiments can be configured to process ad hoc database queries to determine the structure of the resulting data set and to provide metadata in the form of a result table, for example, in response to the queries that describes the structure of the data to be accessed by the queries. In one embodiment, this may be performed without accessing the data that would be retrieved upon executing the query. Certain embodiments may be adapted to prevent execution of the query and to return the metadata describing the structure of the data structure(s) in the resulting data set. A new “describe” statement can be incorporated into a query language expression and configured to work in a functionally coordinated manner with the API to implement a “describe” function in accordance with the techniques described in this disclosure.

Abstract: In one respect, there is provided a distributed database system. The distributed database system can include a plurality of hosts configured to store and/or manage data, a first query processing engine comprising a master node and an executor node, and a second query processing engine. The master node can be implemented on one or more programmable processors and configured to perform operations. The operations can include: generating an execution plan for a query on data that is stored at and/or managed by one or more of the plurality of hosts; determining to push down, to the second query processing engine, at least one data processing operations in the execution plan; and dispatching, to the executor node, at least a portion of the execution plan, the portion of the execution plan including the at least one data processing operation that is pushed down to the second query processing engine.