Abstract: A materialized XML view matching system and method for processing of SQLXML queries using view matching of materialized XML views. The view matching process of the embodiments of the system and method use a multi-path tree (MPT) data structure. Embodiments of the materialized XML view matching system and method construct an MPT data structure for each input query and view expression. View matching is performed on the MPT data structures to generate a set of partial matches, which then are cleaned to generate a set of candidate matches. A valid match definition is generated by testing each candidate match for different forms of compliance. Using the valid match definition, a set of valid matches is identified and extracted. For each valid match, a substitute query expression is constructed that can serve as a replacement for the original query. These substitute queries can be used to evaluate the original query.

Abstract: A distributed job-processing environment including a server, or servers, capable of receiving and processing user-submitted job queries for data sets on backend storage servers. The server identifies computational tasks to be completed on the job as well as a time frame to complete some of the computational tasks. Computational tasks may include, without limitation, preprocessing, parsing, importing, verifying dependencies, retrieving relevant metadata, checking syntax and semantics, optimizing, compiling, and running. The server performs the computational tasks, and once the time frame expires, a message is transmitted to the user indicating which tasks have been completed. The rest of the computational tasks are subsequently performed, and eventually, job results are transmitted to the user.

Abstract: Embodiments of the present invention relate to systems, methods, and computer-storage media for affinitizing datasets based on efficient query processing. In one embodiment, a plurality of datasets within a data stream is received. The data stream is partitioned based on efficient query processing. Once the data stream is partitioned, an affinity identifier is assigned to datasets based on the partitioning of the dataset. Further, when datasets are broken into extents, the affinity identifier of the parent dataset is retained in the resulting extent. The affinity identifier of each extent is then referenced to preferentially store extents having common affinity identifiers within close proximity of one other across a data center.

Abstract: This disclosure provides techniques for asynchronously maintaining database indexes or sub-indexes. For example, a database management server may receive a data manipulation statement to modify particular data stored in a database and determine whether an index associated with executing the statement is maintained asynchronously. When the index is maintained asynchronously, maintenance of the index to reflect changes made to the particular data by executing the data manipulation statement may be delayed until an index maintenance event. The index maintenance may be based on an isolation level of a transaction including a query that triggered the index maintenance.

Abstract: Parameterized queries are optimized by a transformational optimizer. The optimizer produces a dynamic plan that embeds multiple plan options that may be selected to execute a particular query. Parameter distribution improves query execution efficiency and performance by exploring a sample parameter space representative of the parameter values actually used. The dynamic plans can be simplified while maintaining an acceptable level of optimality by reducing the number of plan options. The reduction is achieved by eliminating switch unions to alternatives that are close in cost. Both approaches of parameter space exploration and dynamic plan generation are deeply integrated into the query optimizer.

Abstract: An optimizer uses comprehensive reasoning regarding partitioning, sorting, and grouping properties for query optimization. When optimizing an input query expression, logical exploration generates alternative logical expressions. Physical optimization explores physical operator alternatives for logical operators. Required partitioning, sorting, and grouping properties of inputs to physical operators are determined. Additionally, delivered partitioning, sorting, and grouping properties of outputs from physical operators are determined. In some embodiments, enforcer rules are employed to modify structural property requirements to introduce alternatives for consideration. Property matching identifies valid execution plans in which the delivered partitioning, sorting, and grouping properties satisfy corresponding required partitioning, sorting, and grouping properties. An execution plan having the lowest cost is selected as the optimized execution plan.

Abstract: This disclosure provides techniques for asynchronously maintaining database indexes or sub-indexes. For example, a database management server may receive a data manipulation statement to modify particular data stored in a database and determine whether an index associated with executing the statement is maintained asynchronously. When the index is maintained asynchronously, maintenance of the index to reflect changes made to the particular data by executing the data manipulation statement may be delayed until an index maintenance event. The index maintenance may be based on an isolation level of a transaction including a query that triggered the index maintenance.

Abstract: Embodiments of the present invention relate to systems, methods and computer storage media for providing Structured Computations Optimized for Parallel Execution (SCOPE) that facilitate analysis of a large-scale dataset utilizing row data of those data sets. SCOPE includes, among other features, an extract command for extracting data bytes from a data stream and structuring the data bytes as data rows having strictly defined columns. SCOPE also includes a process command and a reduce command that identify data rows as inputs. The reduce command also identifies a reduce key that facilitates the reduction based on the reduce key. SCOPE additionally includes a combine command that identifies two data row sets that are to be combined based on an identified joint condition. Additionally, SCOPE includes a select command that leverages SQL and C# languages to create an expressive script that is capable of analyzing large-scale data sets in a parallel computing environment.

Abstract: Methods and systems for integrating use of materialized transient views into generation of an optimized query execution plan. Features and aspects hereof provide rapid identification of common expressions in a query as transient view candidates and then rapidly select among the transient view candidates for those transient views that most benefit the cost of execution of the query. The selected transient views are incorporated into a generated final, optimized query execution plan including operator to materialize the selected transient views for re-use in execution of the query.

Abstract: A materialized XML view matching system and method for processing of SQLXML queries using view matching of materialized XML views. The view matching process of the embodiments of the system and method use a multi-path tree (MPT) data structure. Embodiments of the materialized XML view matching system and method construct an MPT data structure for each input query and view expression. View matching is performed on the MPT data structures to generate a set of partial matches, which then are cleaned to generate a set of candidate matches. A valid match definition is generated by testing each candidate match for different forms of compliance. Using the valid match definition, a set of valid matches is identified and extracted. For each valid match, a substitute query expression is constructed that can serve as a replacement for the original query. These substitute queries can be used to evaluate the original query.

Abstract: A system for optimizing queries against a database is described. The system comprises a memo structure that encodes a plurality of query expressions. The system also includes a signature mechanism that enables an assignment of the query expressions into equivalence classes. Methods of using such a system are additionally provided.

Abstract: Described herein is a materialized view or index maintenance system that includes a task generator component that receives an indication that an update transaction has committed against a base table in a database system. The task generator component, in response to the update transaction being received, generates a maintenance task for one or more of a materialized view or an index that is affected by the update transaction. A maintenance component transparently performs the maintenance task when a workload of a CPU in the database system is below a threshold or when an indication is received that a query that uses the one or more of the materialized view or the index has been received.

Abstract: Maintenance of materialized view for query optimization in a database. The architecture provides the first practical algorithms for incrementally maintaining views with multiple outer joins and aggregated outer-join views. Materialized views with any combination of inner joins, one-sided outer joins and full outer joins, plus an optional aggregation on top, can be processed by algorithm(s) that construct incremental maintenance expressions based on converting the view definition a join-disjunctive normal form and exploiting database constraints to reduce maintenance overhead. A system comprises a view creation component for creating a materialized view definition that includes outer-joins, a conversion component for converting an outer-join view expression into a normal form, and a maintenance component for updating the stored materialized view result associated with the materialized view definition.

Abstract: A system and method that facilitates and effectuates estimating the result of performing a data analysis operation on a set of data. Employing an approximation of the data analysis operation on a statistically valid random sample view of the data allows for a statistically accurate estimate of the result to be obtained. Sequential sampling in the view enables the approximated operation to evaluate accuracy conditions at intervals during the scan of the sample view and obtain the estimated result without having to scan the entire sample view. Feedback regarding the accuracy of the estimated result can be captured when the data analysis operation is performed against the set of data. Process control techniques can be employed with the feedback to maintain the statistical validity of the sample view.

Abstract: A computer implemented system that facilitates view matching for outer join views comprises an interface component that receives at least one query that includes one or more outer join operators. A view matching-component converts the at least one query and outputs a substitute query expression. In accordance with one aspect of the subject invention, the view-matching component can comprise a normalization component that converts the at least one query and at least one materialized view into a normalized query expression and a normalized view expression. Furthermore, the view-matching component can include an analysis component that receives the normalized query expression and the normalized view expression, and a construction component that constructs the substitute query expression.

Abstract: Parameterized queries are optimized by a transformational optimizer. The optimizer produces a dynamic plan that embeds multiple plan options that may be selected to execute a particular query. Parameter distribution improves query execution efficiency and performance by exploring a sample parameter space representative of the parameter values actually used. The dynamic plans can be simplified while maintaining an acceptable level of optimality by reducing the number of plan options. The reduction is achieved by eliminating switch unions to alternatives that are close in cost. Both approaches of parameter space exploration and dynamic plan generation are deeply integrated into the query optimizer.

Abstract: Methods and systems for integrating use of materialized transient views into generation of an optimized query execution plan. Features and aspects hereof provide rapid identification of common expressions in a query as transient view candidates and then rapidly select among the transient view candidates for those transient views that most benefit the cost of execution of the query. The selected transient views are incorporated into a generated final, optimized query execution plan including operator to materialize the selected transient views for re-use in execution of the query.

Abstract: Maintenance of materialized view for query optimization in a database. The architecture provides the first practical algorithms for incrementally maintaining views with multiple outer joins and aggregated outer-join views. Materialized views with any combination of inner joins, one-sided outer joins and full outer joins, plus an optional aggregation on top, can be processed by algorithm(s) that construct incremental maintenance expressions based on converting the view definition a join-disjunctive normal form and exploiting database constraints to reduce maintenance overhead. A system comprises a view creation component for creating a materialized view definition that includes outer-joins a conversion component for converting an outer-join view expression into a normal form, and a maintenance component for updating the stored materialized view result associated with the materialized view definition.

Abstract: A computer implemented system that facilitates view matching for outer join views comprises an interface component that receives at least one query that includes one or more outer join operators. A view matching-component converts the at least one query and outputs a substitute query expression. In accordance with one aspect of the subject invention, the view-matching component can comprise a normalization component that converts the at least one query and at least one materialized view into a normalized query expression and a normalized view expression. Furthermore, the view-matching component can include an analysis component that receives the normalized query expression and the normalized view expression, and a construction component that constructs the substitute query expression.

Abstract: A system for optimizing queries against a database is disclosed. The system comprises a memo structure that encodes a plurality of query expressions. The system also includes a signature mechanism that enables an assignment of the query expressions into equivalence classes. Methods of using such a system are additionally provided.