Abstract: Provided are methods and systems for improved data management, data analysis, and processing. A computing device may receive one or more global queries. Each of the global queries may be associated with one or more local components, such as individual nodes of a cloud network. The computing device may determine one or more indexlets associated with each local component. The computing device may then generate query results for the one or more global queries using a global query plan and the one or more indexlets.

Abstract: Systems and methods for processing a query are provided. A method for processing a query of a tree-based dataset, comprises receiving the query, and analyzing the query and the dataset to create an execution plan for the query, wherein creating the execution plan comprises partitioning traversals over the dataset into sequential and parallel components, and distributing the components across a plurality of processing threads that independently traverse their portion of the dataset and compute local results. The method further comprises merging the local results to compute a final result.

Abstract: Systems and methods for processing a query are provided. A method for processing a query of a tree-based dataset, comprises receiving the query, and analyzing the query and the dataset to create an execution plan for the query, wherein creating the execution plan comprises partitioning traversals over the dataset into sequential and parallel components, and distributing the components across a plurality of processing threads that independently traverse their portion of the dataset and compute local results. The method further comprises merging the local results to compute a final result.

Abstract: A multidimensional operation provider is provided for processing a multidimensional query against a relational datasource. The multidimensional operation provider comprises a query interceptor, a query decomposer and a query replacer. The query interceptor detects and intercepts a multidimensional query that is issued against one or more relational data sources. The query decomposer decomposes expressions of the multidimensional query into one multidimensional expression and/or one or more relational expressions. The query replacer replaces the multidimensional query with a stack of operations expressed by the decomposed multidimensional expressions and/or the relational expressions.

Abstract: A query processing visualization system comprises a visualization module. The visualization module visualizes logging information of query processing events occurring during processing of a client query requesting data from one or more data sources by analyzing the logging information to identify dependency of the query processing events, formatting visual presentation components representing the logging information in a hierarchy to reflect the dependency of the query processing events, and presenting the visual presentation components in the context of the hierarchy of the visual components as formatted.

Abstract: A method receives a query containing at least a statement, and analyzes the statement to determine a query structure of elements forming the statement. The text of the statement is formatted to reflect the query structure. The formatted text is replaced with an equivalent tree of logical blocs representing the statement in a higher level. The representation of one or more of the logical blocks is shortened. A data flow tree of macro operation nodes is generated based on the logical blocks for presentation to a user.

Abstract: A query framework system is provided. The query framework system comprises a query framework service for consuming a query and returning a result set, a provider application programming interface for defining a consistent application programming interface for providers, one or more providers incorporating query processing logic, and a configuration repository for storing the list of the providers in the query framework system and their properties.

Abstract: A query processing coordination planning unit coordinates a query processing to obtain requested data from one or more data sources. The query processing coordination planning unit comprises a request preparation coordinator and a request execution coordinator. The request planning unit invokes one or more query operation providers in a conditional query processing sequence for translating a logical representation of the user request into a physical representation of a user request, and generates an execution plan expressed by the physical representation of a user request. The request execution coordinator executes the physical representation of the user request in accordance with the execution plan using the query operation providers.

Abstract: A query processing visualization system comprises a visualization module. The visualization module visualizes logging information of query processing events occurring during processing of a client query requesting data from one or more data sources by analyzing the logging information to identify dependency of the query processing events, formatting visual presentation components representing the logging information in a hierarchy to reflect the dependency of the query processing events, and presenting the visual presentation components in the context of the hierarchy of the visual components as formatted.

Abstract: A coordination planner is suitably used for a query framework system for processing a user request for data from one or more data sources. The query framework system comprises multiple query processing components including a set of query operation providers, each being capable of providing a specific query operation. The coordination planner prepares a user request for execution by translating a logical representation of the user request into a physical representation of the user request using the query operation providers, and executes the physical representation of the user request to obtain a result data stream using the query operation providers.

Abstract: A master-detail provider is provided for processing user requests for data stored in one or more data source. The master-detail provider has a query analyzer, a master-detail link handler, a master query handler and a detail query handler. The query analyzer analyzes one or more queries included in a user request, and determines any set of the queries in which the queries are linked by one or more master-detail links. The master-detail link handler relates the queries of each set that are linked by one or more master-detail links as a master query and one or more detail queries. The master query handler causes preparation of the master queries to generate master query plans, and generates provider queries by incorporating the master query plans with related detail queries and related master-detail links. The detail query handler handles the detail queries causing preparation of the detail queries to generate detail query plans.

Abstract: A query processing coordination planning unit coordinates a query processing to obtain requested data from one or more data sources. The query processing coordination planning unit comprises a request preparation coordinator and a request execution coordinator. The request planning unit invokes one or more query operation providers in a conditional query processing sequence for translating a logical representation of the user request into a physical representation of a user request, and generates an execution plan expressed by the physical representation of a user request. The request execution coordinator executes the physical representation of the user request in accordance with the execution plan using the query operation providers.

Abstract: A query framework system is provided. The query framework system comprises a query framework service for consuming a query and returning a result set, a provider application programming interface for defining a consistent application programming interface for providers, one or more providers incorporating query processing logic, and a configuration repository for storing the list of the providers in the query framework system and their properties.

Abstract: A multidimensional operation provider is provided for processing a multidimensional query against a relational datasource. The multidimensional operation provider comprises a query interceptor, a query decomposer and a query replacer. The query interceptor detects and intercepts a multidimensional query that is issued against one or more relational data sources. The query decomposer decomposes expressions of the multidimensional query into one multidimensional expression and/or one or more relational expressions. The query replacer replaces the multidimensional query with a stack of operations expressed by the decomposed multidimensional expressions and/or the relational expressions.

Abstract: A coordination planner is suitably used for a query framework system for processing a user request for data from one or more data sources. The query framework system comprises multiple query processing components including a set of query operation providers, each being capable of providing a specific query operation. The coordination planner prepares a user request for execution by translating a logical representation of the user request into a physical representation of the user request using the query operation providers, and executes the physical representation of the user request to obtain a result data stream using the query operation providers.

Abstract: A master-detail provider is provided for processing user requests for data stored in one or more data source. The master-detail provider has a query analyzer, a master-detail link handler, a master query handler and a detail query handler. The query analyzer analyzes one or more queries included in a user request, and determines any set of the queries in which the queries are linked by one or more master-detail links. The master-detail link handler relates the queries of each set that are linked by one or more master-detail links as a master query and one or more detail queries. The master query handler causes preparation of the master queries to generate master query plans, and generates provider queries by incorporating the master query plans with related detail queries and related master-detail links. The detail query handler handles the detail queries causing preparation of the detail queries to generate detail query plans.