Abstract: Techniques for data skipping that may be user defined and extensible may be provided. A method may include receiving a query, at a computer system comprising a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor, modifying, at the computer system, the received query to utilize at least one data skipping index to evaluate at least one criterion of the query, wherein the at least one data skipping index comprises an index on at least one attribute of data that excludes index information for at least a portion of those data items that do not meet the at least one criterion, and wherein the at least one data skipping index is generated based on information received from an application programming interface, and evaluating, at the computer system, the query.

Abstract: A device may identify a query for a database system, wherein the query is a candidate for optimization. The device may determine a first execution plan according to a first hint for executing the query and a second execution plan according to a second hint for executing the query, wherein the first execution plan is associated with a first execution time and the second execution plan is associated with a second execution time. The device may select the first execution plan or the second execution plan as a selected execution plan. The device may generate, based on selecting the selected execution plan, a profile for the query, wherein the profile is based on the selected execution plan. The database system may execute the query according to the profile.

Abstract: Performance-based caching may be implemented for query plan caches that are used to provide query plans to perform queries instead of generating query plans to perform queries. Performance metrics for queries performed at a database may be collected and used to cache query plans generated for the queries. When a query is received that matches one of the queries, the cached plan corresponding to the matching query may be used to perform the query.

Abstract: A system and method for fetching data using an SQL query from the execution of an external code that may be in any language and executed in any environment. The system includes a query engine that can receive a query from a SQL interface and parses the query to the desired format. The system also includes a protocol server that can trigger a code executor to execute an external code based on the query and transmits the data returned by the external code to the query engine. The query engine can process the data to an SQL understandable format and present the processed data on the SQL interface.

Abstract: A method of processing a query to a graph database using processors. The method comprises providing threads to be executed on processors, each the thread is associated with one of a plurality of unique thread identifiers, providing a graph database having a plurality of graph database nodes and a plurality of graph database edges, each the graph database edge represents a relationship between two of the plurality of graph database nodes, receiving a query tree that defines a tree comprising plurality of query nodes connected by a plurality of query tree edges, and searching at least part of the graph database for a match with the query tree, wherein the searching is executed by the processors, and wherein each processor searches one of a plurality of sub-graphs of the graph database, each the sub-graph is defined by one of the plurality of thread identifiers.

Abstract: Methods, computer program products, and systems are presented. The method, computer program products, and systems can include, for instance: initiating evaluating of a tree data structure expression having nodes and edges between the nodes, wherein a plurality of nodes of the tree data structure expression express functions, and wherein a hierarchy of the tree data structure expression defines an order of execution of functions expressed by nodes of the plurality of nodes; and in response to the initiating, reading, processing and writing tile data of a dataset according to node expressed functions of the tree data structure expression.

Abstract: An analysis system connects to a set of data sources and perform natural language questions based on the data sources. The analysis system connects with the data sources and retrieves metadata describing data assets stored in each data source. The analysis system generates an execution plan for the natural language question. The analysis system finds data assets that match the received question based on the metadata. The analysis system ranks the data assets and presents the ranked data assets to users for allowing users to modify the execution plan. The analysis system may use execution plans of previously stored questions for executing new questions. The analysis system supports selective preprocessing of data to increase the data quality.

Abstract: Disclosed herein are system, method, and computer program product embodiments for accelerating queries with zone map enhancements. An embodiment operates by receiving a query including a condition on one or more values from a column of a database table. It is determined that the values from the column are divided into a plurality of data zones, and that a sorted dictionary includes an ordered arrangement of the values from the column. A min value and a max value from a satisfaction array that indicates which values satisfy the condition are determined. Which of the data zones are disqualified are determined based on the values of the disqualified data zone falls outside of the range between the minimum value and the maximum value. The values of any remaining zones are evaluated to determine a result of the query. The result set is returned.

Abstract: If a query indicates joining of N (N is an integer of no less than 3) relation tables, a database management system calculates a query cost that is based on a power consumption amount for query execution, for each of a first query plan candidate in which a temporary table is generated and the temporary table is stored in a storage device unit with a first access cost, a second query plan candidate in which a temporary table is generated and the temporary table is stored in a storage device unit with a second access cost that is higher than the first access cost and a third query plan candidate in which the N relation tables are joined in a pipelined manner without generation of a temporary table, selects a relatively low-query cost query plan candidate and executes the query based on the query plan candidate.

Abstract: A system includes reception of a database query, determination of a first logical query execution plan to execute the database query, determination of a second logical query execution plan to execute the database query, determination of a first plurality of resource usage estimates associated with the first logical query execution plan, determination of a second plurality of resource usage estimates associated with the second logical query execution plan, and determination, based on the first plurality of resource usage estimates and the second plurality of resource usage estimates, whether it is determinable to a suitable degree of certainty that one of the first logical query execution plan and the second logical query execution plan will be associated with a smaller amount of resource usage than the other one of the first logical query execution plan and the second logical query execution plan.

Abstract: Methods, systems, and devices for processing and answering a natural language query at a database server are described. An end user may submit a question in natural language over a communication platform. An answer engine running on the database server may receive the question, and may process the content of the question using natural language processing (NLP) techniques. The answer engine may construct a search query based on the NLP, and may retrieve a set of documents from a database using the search query. The answer engine may rank the documents, prune the number of documents, modify the documents for the given communication platform, or perform any combination of these functions. In some cases, an intermediate user may review the documents, and may select one or more documents for publication. The answer engine may send the selected documents to the end user as answers in response to the question.

Abstract: A first query is received by a computing device to access data in a database. A first access path is identified based on optimization information about a second query. The first access path is applied.

Abstract: According to some embodiments, a system to manage a query plan cache for a Database Management System (“DBMS”) includes a DBMS query plan cache data store. The DBMS query plan cache data store may contain, for example, electronic records representing a plurality of query plans each associated with a set of instructions created in response to a query previously submitted by a user. A DBMS query plan cache management platform may then calculate a utility score for each query plan in the DBMS query plan cache data store. At least one query plan may be evicted from the DBMS query plan cache data store based on the calculated utility score, wherein the evicting is not based on a size of the DBMS query plan cache.

Abstract: A method, computing system and computer program product are provided. A nested loop join access plan for a query is executed and processed records of a most outer table of a nested loop join that satisfy local predicates are counted. When a count of the processed records is not less than a threshold value, a cost to complete execution of the nested loop join access plan and a cost of executing a new access plan based on recalculated filter factors for local predicates of the query are compared. When the cost to complete is less, execution of the nested loop join access plan is resumed to complete running of the query. When the cost of executing the new access plan is less, the new access plan is executed to rerun the query. A result of the query is provided.

Abstract: In accordance with embodiments, there are provided mechanisms and methods for performing transparent object migration across storage tiers. In an embodiment and by way of example, a method for appending data to large data volumes is provided. The method embodiment includes a) setting a CustomEntityOption bit that determines (at object creation time) where the object is stored, either in the relational or the non-relational data store portion, b) loading the CustomEntityOption bit in a cached CustomEntityDefinition, c) showing the CustomEntityOption bit as EntityInfo, and d) allowing custom object definition and Metadata API functionality when the bit is shown.

Abstract: Techniques herein generate a query plan that combines a global reporting aggregate calculation and an organizing operation. A method detects an organizing operation, a group aggregate function, and a global aggregate function within a database statement. The organizing operation specifies organizational activities such as grouping, joining, or sorting rows. The method generates an execution plan that specifies calculating all values in a single pass. For each row, the single pass applies the organizing operation and updates an access structure. The pass updates one of multiple cumulative group calculations based on the group aggregate function and updates a cumulative global calculation based on the global aggregate function. Each cumulative group calculation is associated with some of the access structure. Based on the access structure, result rows that satisfy the database statement are generated. Result rows contain a final result of each group calculation and a final result of the global calculation.

Abstract: A cost based optimizer and a cost estimation method and device. The method includes: in response to deciding that acquired statistical information is incomplete, determining a corresponding cost estimation manner according to an operation type of an operation tree relying on the statistical information (S11); determining a cost estimate of the corresponding operation type based on the cost estimation manner (S12); and determining an accumulative cost estimate of the operation tree according to the cost estimate corresponding to the operation type relying on the statistical information and a cost estimate corresponding to an operation type not relying on the statistical information (S13). Therefore, cost estimation may be performed for a temporary table and a subquery created in a running process, and is not limited by a data scale in a scenario of massive data.

Abstract: A method includes obtaining a symbolic AI model, where the symbolic AI model is configured to produce an outcome state responsive to an input based on events. The method also includes obtaining a first scenario and a second scenario, where the first scenario causes the failure of a condition associated with a norm of the symbolic AI model and the second scenario satisfies the condition associated with the norm of the symbolic AI model. The method also includes obtaining a failure penalty value, determining a first outcome state based on the symbolic AI model, the first scenario, and the failure penalty value. The method also includes determining a second outcome state based on the symbolic AI model and the second scenario. The method also includes determining an outcome score based on the first outcome state and the second outcome state.

Abstract: Embodiments are disclosed for a network switch appliance with a traffic broker that facilitates routing of network traffic between pairs of end nodes on a computer network through a configurable sequence of in-line tools.

Abstract: A system and method for generating a data set structured for recognition of time series data by a machine learning computer are provided. The method includes acquiring time series data, generating tensor units based on the time series data, and identifying a target tensor unit including a time of failure of a mainframe computer system. The method further includes generating tensor sets, in which at least one tensor set includes the target tensor unit. The generated tensor sets are then migrated to a machine learning computer for generating or updating of a computer model based on the time series data, the computer model recognizing a data pattern preceding the time of failure of the mainframe computer system. The computer model is then applied to data in a production environment for identifying a production data pattern corresponding to a data pattern recognized in the tensor sets.

Abstract: A data system is provided for analyzing and maintaining data obtained from one or more data sources on which the data system depends. The system includes a primary database including current values used by the system and a collection of executable algorithms used to generate the data maintained in the primary database. In response to receiving a notification regarding a change in one of the data sources, a dependency database is used to establish an execution order for algorithms of the algorithm collection that are directly or indirectly dependent on the changed data. The algorithms identified in the execution order are then executed in accordance with the execution order and the corresponding result is stored in the primary database. The system may include data harvesters adapted to recognize changes in the data sources and to generate and transmit corresponding change notifications when such changes occur.

Abstract: A method and system for executing database queries in parallel using a shared metadata store. The metadata store may reside on a master node, and the master node may distribute this metadata with query plans to worker nodes. The worker nodes may request additional metadata from the master node when necessary.

Abstract: Disclosed is a computer-readable medium including a computer program including encoded commands. The computer program is configured to cause one or more processors to perform operations for optimizing a database application when the computer program is executed by the one or more processors of a computer system and the operations include: operation for receiving a query including a bind parameter from an application source; operation for obtaining information related to the bind parameter included in the received query; and operation for rewriting the received query by reflecting the obtained information related to the bind parameter within the received query as hint information.

Abstract: Independent scheduling of resources may be performed for distributed data processing programs. When a request is received that causes the performance of a distributed data processing program, a plan to perform the distributed data processing program may be generated. Different resources may be obtained to perform different portions of the distributed data processing program according to different portions of the generated plan. A result of the request may be provided to a user. In some embodiments, resources obtained for different portions of the distributed data processing program may be returned for use by other programs.

Abstract: Described are methods, systems and computer readable media for persistent query connection architecture.

Abstract: A query is received. Based on statistics for a database, a first query access plan is generated for executing the query on the database. A first result set for the query is obtained by implementing the first query access plan on the database. Based on at least one trend in the statistics, a target time after which implementing the first query access plan will fail a set of criteria is forecasted. In response to the forecasting and based on the statistics, a replacement query access plan is generated prior to the target time. After the target time, a second result set for the query is obtained by implementing the replacement query access plan rather than the first query access plan.

Abstract: A system and method for handling queries where the queries and the answers to those queries are transmitted by means of a network which may have significantly variable latencies. The system and method involve copying the queries and calculating a response to each copy of the query and sending each response over the network. The first-received response can then be acted upon. The query may be divided up into sub-queries which are then replicated and sent for determination.

Abstract: Computer-implemented systems and associated operating methods take measurements and landmarks associated with robustness maps and perform tests evaluating the robustness of a database engine's operator implementations and/or query components. The illustrative computer-implemented system comprises logic that receives one or more robustness maps of measured database system performance acquired during database execution in a predetermined range of runtime conditions and uses information from the robustness map or maps to perform regression testing wherein landmarks in the robustness maps are operated upon as a robustness bugs describing conditions under which a predetermined implementation of a database operator or query component degrades in a manner different from a predetermined expected manner.

Abstract: Disclosed herein is a platform for translating various user input into a standardized input used to cause a database to sort data in a specified manner and present the data in a graphic user interface according to user instruction. User input is a text string that includes a first set of characters and a second set of characters split by a dividing symbol. Based on the choice of dividing symbol and the arrangement of the first set of character and second set of characters the system converts the input into a standardized form.

Abstract: Embodiments of the present invention are directed to facilitating distributed data processing for machine learning. In accordance with aspects of the present disclosure, a set of commands in a query to process at an external computing service is identified. For each command in the set of commands, at least one compute unit including at least one operation to perform at the external computing service is identified. Each of the at least one compute unit associated with each command is analyzed to identify an optimized manner in which to execute the set of commands at the external computing service. An indication of the optimized manner in which to execute the set of commands and a corresponding set of data is provided to the external computing service to utilize for executing the set of commands at the external computing service.

Abstract: In an approach for semantically translating data. Aspects of an embodiment of the present invention include an approach for semantically translating data, wherein the approach includes a processor selecting a first node. A processor identifies a parent node of the first node. A processor determines that a value of the first node is unknown. A processor responsive to determining that the value of the first node is unknown, annotates the first node to indicate that the first node is at least partially unknown. A processor identifies a common table expression of the first node. A processor determines that the common table expression of the first node matches, within a predetermined threshold, a common table expression of the second node. A processor merges information from the common table expression of the second node with the common table expression of the first node.

Abstract: A system displays summaries of relationships of a selected data asset with other data assets at a limited number of levels upstream and downstream from the selected data asset in rows above and below the selected data asset. In each row, data assets are arranged in order of usage, with most used data asset displayed directly above or below the selected data asset. The user views grandparent-level data assets of a parent-level data asset that is directly above the selected data asset. The system includes a carousal feature to further navigate the lineage data upstream or downstream. By selecting a new data asset in the parent row, the user can view grandparent-level data assets of the newly selected data asset. The user can view multiple upstream or downstream levels arranged in respective rows displayed above or below the selected data asset. The system can analyze data from any application.

Abstract: A system displays summaries of relationships of a selected data asset with other data assets at a limited number of levels upstream and downstream from the selected data asset in rows above and below the selected data asset. In each row, data assets are arranged in order of usage, with most used data asset displayed directly above or below the selected data asset. The user views grandparent-level data assets of a parent-level data asset that is directly above the selected data asset. The system includes a carousal feature to further navigate the lineage data upstream or downstream. By selecting a new data asset in the parent row, the user can view grandparent-level data assets of the newly selected data asset. The user can view multiple upstream or downstream levels arranged in respective rows displayed above or below the selected data asset. The system can analyze data from any application.

Abstract: Systems and methods for performing hash-based mount point lookup in virtual file systems. An example method may include: receiving a first character string representing a file name; identifying, within an array of mount point strings, a second character string comprised by the first character string; identifying a file system object associated with a mount point path represented by the second character string; and utilizing the file system object to access a file referenced by the file name.

Abstract: A data query method and apparatus, and a database system, where the method includes receiving a data query request, generating an original query plan according to the data query request, obtaining a candidate query plan set according to the original query plan, restructuring a join predicate in the original query plan, determining basic information of a restructured join predicate in the original query plan, determining a constraint condition of the restructured join predicate in the original query plan, determining an equal-cost query plan for the original query plan according to the basic information of the restructured join predicate in the original query plan and the constraint condition of the restructured join predicate in the original query plan, and performing querying according to the equal-cost query plan for the original query plan. Hence, data query performance can be improved.

Abstract: Techniques for implementing logical queries in a distributed stream processing system using automatic branching and joins. An exemplary technique includes determining a query is a logical query. The logical query includes two or more summaries based on different groups configured to execute in a single query stage of a stream analytics application. The technique further includes converting the logical query into one or more physical queries. The one or more physical queries are separated into individual query stages, and each of the query stages includes a summary from the two or more summaries that is based on an associated group. The technique further includes generating a directed acyclic graph for the one or more physical queries. The directed acyclic graph includes a physical query transformation for each of the individual query stages.

Abstract: A system can provide a visual representation of an inventory of data entities for a distributed computing system. Inventory data including cost and operational data for data entities such as data centers, servers, and virtual machines, can be converted into a format file. The format file can be used to create a tree of nodes and node summaries corresponding to the data entities. A user interface can display hierarchical and isolated views of the tree revealing parent child relationships between data entities within a computing system infrastructure. Node summaries including cost and utilization data can be displayed to reveal how specific sub-costs such as labor and licensing, are driven by data entities in one level of the infrastructure and pushed to respective parent or child data entities in other levels. Views of the tree can be used to determine areas of inefficiency or reduced value within the computing system.

Abstract: A system for hash collision tables for relational operations is provided. In some implementations, the system performs operations comprising generating a plurality of hash values for at least a portion of one or more database tables based on a database query, and generating a hash table for at least a portion of the plurality of hash values. The operations can further include generating first results based on execution of a first operation in the database query using the hash table. Additionally, the operations can further include generating second results based on the first results and execution of a second operation in the database query using the hash table. Related systems, methods, and articles of manufacture are also described.

Abstract: Control component and method for registering device names assigned to industrial automation devices or communication devices in a name service system, wherein in order to register device names assigned to industrial automation devices or communication devices in a name service system, at least selected automation or communication devices each comprise a name service component where the selected automation or communication devices control transmission of a registration request containing an assignment between their respectively assigned device name and at least one respectively configured communication network address to a name service server via their name service component, and where a control component is respectively assigned to the name service components and enables or blocks transmission of a registration request.

Abstract: Systems, apparatuses and methods may provide a query response. A value of a time-to-live (TTL) for data associated with a computation unit may be determined, wherein the computation unit may disallow access to the data when the TTL is expired. Additionally, a determination may be made whether the data associated with the computation unit satisfies a query. Also, a query response may be generated including the data associated with the computation unit that satisfies the query. In one example, a context for the data associated with the computation unit may be determined, wherein the computation unit may disallow access to the data based on the context. Data may be represented as a network of computation units which may provide data with a TTL that is contextual, which may be handled in a massively distributed fashion.

Abstract: Disclosed aspects relate to transforming a user-defined table function (UDTF) to a derived table in a database management system (DBMS). It may be detected by the DBMS that a query indicates the UDTF. A derived table may be constructed from the UDTF. The derived table may be derived from a set of statements of the UDTF. The derived table may be introduced to the query to fulfill the UDTF. A query plan may be generated for the query by the DBMS. The query plan may be generated in response to introducing the derived table in the query.

Abstract: Disclosed herein are system, method, and computer program product embodiments for interactive exploration of graph data. An embodiment operates by compiling a data query in any database-readable language based upon an input parameter. A data query of a graph data set is then conducted but is halted when a breakpoint generated from the input parameter is reached. Halting the data query includes partitioning a data subset from the graph data set. The data subsets is then displayed.

Abstract: A method implements optimization of database queries by computing domain cardinality estimates. A client sends a database query to a server. The method parses the query to identify data columns. For each of the data columns, the method computes a lower bound and an upper bound of distinct data values using a pre-computed table size. The method also computes a patch factor by applying a pre-computed function to a ratio between a number of distinct data values that appear exactly once in a data sample and a number of distinct data values in the sample. Based on the patch factor, the lower bound, and the upper bound, the method computes an estimate of distinct values for each of the data columns. The method subsequently generates an execution plan for the query according to the computed estimates, executes the execution plan, and returns a result set to the client.

Abstract: Generally discussed herein are devices, systems, and methods for database management. A method may include determining a first hyperloglog (HLL) sketch of a first column of data, determining a second HLL sketch of a second column of data, estimating an inclusion coefficient based on the first and second HLL sketches, and performing operations on the first column of data or the second column of data in response to determining the inclusion coefficient is greater than, or equal to, a specified threshold.

Abstract: A database engine receives a query and parses the query to form a first intermediate query. The engine compiles the first intermediate query to form a first executable plan that includes in-memory operators that execute within memory without swapping to secondary memory. While executing a first in-memory operator in the first executable plan, the engine detects insufficient memory and aborts execution of the first executable plan. The engine optimizes the first intermediate query to form a second intermediate query, and compiles the second intermediate query to form a second executable plan. The second plan includes spooling operators that execute within fixed memory budgets and are configured to swap to the secondary memory when needed. The engine executes the second executable plan, including the spooling operators, to retrieve results from the database that are responsive to the query. The engine then returns the retrieved results.

Abstract: Implementations of the present disclosure include methods, systems, and computer-readable storage mediums for receiving an annotated query execution plan (aQEP), the aQEP being processed to execute a query on an in-memory database in a hybrid memory system, and including one or more annotations, each annotation indicating an output of a respective operator that is to be provided as input to a join operator, determining a payload size at least partially based on an estimated size of an intermediate output of the join operator, selecting a memory type from a plurality of memory types in the hybrid memory system based on the payload size and a cache size, and storing, after execution of the aQEP, the intermediate output on the memory type in the hybrid memory system.

Abstract: A technique relates to determining when to skip a group by clause in a query. A computer checks that a condition is satisfied for a table. The condition is selected from the group consisting of having a unique index on one or more columns of the table or having a function on the one or more columns that makes rows in the GROUP BY clause unique. The group by clause is part of the query on the table. In response to the condition being satisfied, the group by clause associated with the one or more columns is skipped. In response to the condition not being satisfied, the group by clause associated with the one or more columns is executed.

Abstract: A system for memory management that comprises: a computing system having a finite amount of memory and a physical computer readable storage memory readable by a processing circuit and storing instructions for execution by the circuit to: set, by a memory coordinator, the urgency of each memory consumer; adjust, by the memory coordinator, the memory quota of each memory consumer—such that the sum of the memory quota of each memory consumer does not exceed the memory; and adjust, by each memory consumer, its memory usage in response to a quota input and an urgency input from the memory coordinator to the memory consumer. The memory is managed by a memory coordinator and memory consumers; and consumed by the memory consumers. Each memory consumer has: a memory quota, an urgency and a memory usage. Also, the urgency of each memory consumer increases as the sum of the memory usage of the plurality of memory consumers approaches the finite amount of memory.

Abstract: A computer system has a plurality of computers each executing stream data processing and a management computer assigning a plurality of divided queries to the plurality of computers. The management computer includes a parameter input module configured to receive an analysis scenario including a plurality of queries and division information for dividing the analysis scenario into the plurality of divided queries; and a query analysis module configured to analyze the analysis scenario to generate a query graph. The query analysis module specifies, based on the analysis scenario and the division information, at least one of the divided queries that requires flow control; and sets the flow control for the plurality of computers to each of which the at least one of the divided queries that requires the flow control is to be assigned.

Abstract: Aspects automatically provisioning of cloud resources for ETL job execution as a function of optimizer output data. Access paths identify overall cost and individual step operator costs and statistics relative to cloud resources for executing an SQL commands against a relational database. In one aspect operator steps having high step costs are identified and amounts, types or speeds of a cloud resources associated with the step are adjusted to thereby reduce the step cost and the access path overall cost. In another aspect SQL text descriptors and step costs and function statistics are compared to knowledge base criteria for matches to criteria associated inefficient configurations cloud resources for revision to improve corresponding operation efficiency. In another aspect usages of cloud resources by operator steps are monitored and logged and compared to historic data of similar steps to determine under or over-utilization of resources.