Abstract: Example embodiments relate to providing real-time monitoring and analysis of query execution. In example embodiments, a query plan is obtained for a database query that is scheduled for execution in a database. A query tree is then generated based on the query plan, where the query tree includes operator nodes that are associated corresponding operators in the query plan. At this stage, performance metrics are collected from the database during the execution of the database query. Next, the query tree is displayed with the performance metrics, where a related portion of the performance metrics are displayed in each of the operator nodes.

Abstract: Disclosed herein are techniques for adjusting a map reduce execution environment. It is determined whether some operations in a sequence of operations should be implemented in a map reduce execution environment. If it is determined that some operations in a sequence of operations should be implemented in a map reduce execution environment, the map reduce execution environment is adjusted to achieve a predefined performance objective.

Abstract: Described herein are techniques for generating a visualization relating to execution of a workload. Multiple measurements of a plurality of metrics relating to execution of the workload may be aggregated at multiple levels of execution. A visualization may be generated that comprises a representation of the measurements of a metric at one of the levels of execution.

Abstract: A computer implemented method and apparatus display an information integration flow graph, receive user input selecting a modification to apply to the displayed information integration flow graph and modify the information integration flow graph based on the selected modification to form a modified information integration flow graph, wherein the modified information integration flow graph is displayed.

Abstract: Described herein are techniques for identifying a path in a workload that may be associated with a deviation. A workload may be associated with multiple measurements of a plurality of metrics generated during execution of the workload. The multiple measurements may be aggregated at multiple levels of execution. One or more measurements may be compared to one or more other measurements or estimates to determine whether there is a deviation from an expected correlation. If determined that there is a deviation, a path can be identified in the workload that may be associated with the deviation.

Abstract: Described herein are techniques for determining which data points in a time series to discard. A time series may include multiple data points. Spaced intervals over the time series may be determined. The data points can be ranked at least in part based on their respective distance from a nearest spaced interval. A data point may be discarded based on the ranking.

Abstract: Processing a hybrid flow containing a continuous flow can include connecting a continuous flow to a finite flow of a hybrid flow using a continuous connector operator, and processing the data flow graph of the hybrid flow.

Abstract: A computer cluster with objectives-based resource sharing. The cluster includes cloud nodes each with one or more resources, a terminal, data storage, and an allocation node to monitor cloud node resources, provide information descriptive of the cloud node resources to a customer through the terminal, receive a reservation for cloud node resources from the customer, store the reservation in the data storage, determine assignments of the cloud node resources for the reservation and any other pending reservations according to one or more objectives, and allocate the cloud node resources to customers according to the resource assignments.

Abstract: Example embodiments relate to predicting execution times of concurrent queries. In example embodiments, historical data is iteratively generated for a machine learning model by varying a concurrency level of query executions in a database, determining a query execution plan for a pending concurrent query, extracting query features from the query execution plan, and executing the pending concurrent query to determine a query execution time. The machine learning model may then be created based on the query features, variation in the concurrency level, and the query execution time. The machine learning model is used to generate an execution schedule for production queries, where the execution schedule satisfies service level agreements of the production queries.

Abstract: Described herein are techniques for processing hybrid flows. A hybrid flow may be associated with one of a plurality of service classes and may include sub-flows directed to multiple execution environments. An execution schedule may be generated based on an objective associated with the service class and resource allocation or availability. An action may be taken according to a policy associated with the service class if execution of the hybrid flow fails to meet the objective.

Abstract: Described herein are techniques for modifying an analytic flow. A flow may be associated with an execution engine. A flow graph representative of the flow may be obtained. The flow graph may be modified using a logical language. For example, a new flow graph expressed in the logical language may be generated. A program may be generated from the modified flow graph.

Abstract: Disclosed herein are techniques for managing operations. A distribution of operations across a plurality of execution environments is determined in order to achieve a performance objective. Another distribution of the operations is determined, if the status of the execution environments renders the distribution suboptimal or incapable of achieving the performance objective.

Abstract: A system, method, and computer readable medium for generating an information integration flow design (IIFD). The system includes a processor to receive a conceptual model of the IIFD, having an extract phase, a load phase, and a transformation phase, an extract unit to model an interface between a data source information object and a transformation function based on at least one extract hypercube, a load unit to specify at least one load hypercube and a data warehouse target object, a transformation unit to express one or more steps as a hypercube operation, and a translation unit to generate the IIFD based on the conceptual model. The method includes receiving a conceptual model of the IIFD having an extract phase, a load phase, and a transformation phase. The method generates logical information integration operations based on the conceptual model. A computer readable medium may include instructions to generate the IIFD.

Abstract: Disclosed herein are techniques for arranging a series of operations. It is determined whether an operation executes more efficiently when divided. It is further determined whether a plurality of operations execute more efficiently when combined.

Abstract: A flow of operations is to be executed in a plurality of execution environments according to a distribution. In response to determining that the distribution is unable to achieve at least one criterion, the distribution is modified according to at least one policy that specifies at least one action to apply to the flow of operations in response to a corresponding at least one condition relating to a characteristic of the flow of operations.

Abstract: Disclosed herein are techniques for selecting execution environments. Each operation in a sequence of operations is implemented using a selected execution environment. Each operation is converted into code executable in the selected execution environment. If some operations in the sequence were implemented in different execution environments, execution of the operations is coordinated.

Abstract: Disclosed herein are techniques for measuring or assessing the costs of executing operations across a plurality of computing systems. The cost of transferring data across at least one arrangement of computing systems is determined. The cost of executing at least one arrangement of the operations is also determined.

Abstract: A method of assigning resources of a computer duster with resource sharing according to objectives. The method includes monitoring resources of each of a plurality of cloud nodes, providing information descriptive of the cloud node resources, receiving a reservation, determining whether resources are available to satisfy the reservation and any other pending reservations, if resources are available, using a rapid search to determine resource assignments for the reservation and any other pending reservations according to one or more objectives, and allocating resources according to the resource assignments.

Abstract: A method of managing the execution of a workload of transactions of different transaction types on a computer system. Each transaction type may have a different resource requirement. The method may include intermittently, during execution of the workload, determining the performance of each transaction type. A determination may be made of whether if there is an overloaded transaction type in which performance is degraded with an increase in the number of transactions of the transaction type. If there is an overloaded transaction type, the number of transactions of at least one transaction type may be changed.

Abstract: A computer implemented method and apparatus calculate a freshness cost for each of a plurality of information integration flow graphs and select one of the plurality of information integration flow graphs based upon the calculated freshness cost.