Abstract: A data request that references an external data environment object (foreign object) is identified. A Data Manipulation Language (DML) statement for accessing the object is traversed in a defined order to identify foreign servers having the foreign object. Connections are attempted to foreign servers in the defined order and a selection to one of the foreign servers is made based on server and/or data conditions. The selected server is used for the request to process the portion of the request that includes the foreign object. In an embodiment and during execution of data request, the server and/or the data conditions can be dynamically overridden to change selection criteria for the selected server.

Abstract: Various techniques may be employed in a system, method, and computer-readable medium to allow declarative database syntax language to accommodate matrix multiplication.

Abstract: In a database system, wherein data is stored as objects within an object storage system, a system and method for estimating object cardinality, determining query execution plan costs, and selecting a query plan for execution by the database system. Multiple object cardinality estimation approaches for estimating the number of objects to be accessed for a given query condition on a column of a relation composed of a set of objects, where each object maintains the minimum value and the maximum value of individual columns are presented. A set of global statistics is also maintained, consisting of the total number of objects and the minimum and maximum values of individual columns. The object cardinality estimation is determined based on the global statistics without retrieving individual object-level statistics.

Abstract: In some examples, in response to a join query to join a plurality of tables, a first processing engine retrieves tuples of a first table from a subset of objects of a data store, and adds content of the retrieved tuples to an in-memory table, where the objects are range partitioned across a plurality of processing engines based on respective ranges of values of at least one join attribute in the join query. The first processing engine retrieves, from the data store, tuples of a second table of the plurality of tables based on a range of values of the at least one join attribute in the retrieved tuples of the first table. The first processing engine performs an in-memory join of the plurality of tables based on the retrieved tuples of the second table and the in-memory table.

Abstract: A method, apparatus and computer program product for estimating resource consumption for steps in a query execution plan for a query performed by a relational database management system (RDBMS) in a computer system. Past execution data for the steps are used to train a machine learning (ML) model and its model parameters to predict execution times for the steps. A prediction module comprised of the ML model configured by the model parameters predicts an execution time for a current step of the query execution plan for the query, based on current step information and current system load. A boosting module boosts the current step either up or down for processing by the RDBMS to meet a service level goal (SLG) for the query, based on the predicted execution time for the current step, as well as an elapsed query time, a query SLG time, and/or a query CPU time.

Abstract: A multi-parameter data type framework can, among other things, provide a more comprehensive, systematic, and/or formal mechanisms for determining an appropriate data type for a data set. For example, the multi-parameter data type framework can be used to allow analytic tools to virtually automatically figure out an appropriate data type for a set of data values.

Abstract: In a cloud database system employing multiple types of storage, such as external object store, managed object store. block storage, and compute node memory, each type of storage having different kinds of file organization, different types of data organization, different forms of storage access, and different latency and throughput costs, a system and method for caching different data transformations created during query executions involving different data stores. Transformed versions of data read from external object storage are saved to a multi-layered warehouse cache for use in subsequent query executions.

Abstract: A query is received. It is determined that the query does not fit a profile for a run-the-business set of queries, where the profile for the run-the-business set of queries excludes queries that are not routine parts of running a business and that do not require priority processing. The query is executed with a dynamically-created compute capacity that is not part of a compute capacity used to run the run-the-business set of queries.

Abstract: Improved techniques for management of memory (or memory management) for computing systems and environments are disclosed. The improved techniques are especially well suited for computing systems that operate in highly complex and/or demanding computing environments (e.g., massively parallel database systems that may be required to process many complex database queries in parallel. Memory can be managed dynamically at run time to determine and designate one of multiple memories that are available for execution of executable components (e.g., database queries, Opcodes of a Virtual Machine). In addition, memory can be managed dynamically at run time to effectively reuse memory locations of a memory (e.g., stack memory) being used for execution of one or more executable components (e.g., Opcodes of a Virtual Machine) at run time when the memory is being actively used to execute the one or more executable components.

Abstract: A computer system executes a database management system (DBMS). The DBMS manages a database comprised of DBMS resources. The DBMS receives a request to be executed. The request is a DBMS action to be executed using the DBMS resources. The request includes a predicate specifying a maximum cost for executing the request, and a deadline, specifying a deadline by which the request is to be completed in its execution. The DBMS determines a plurality of workloads under which the request is qualified to execute. Each workload of the plurality of workloads includes a respective set of requests that have common characteristics. Each workload of the plurality of workloads includes a respective cost criterion and a respective elapsed time criterion. The DBMS selects a selected workload from among the plurality of workloads. The selected workload has a selected cost criterion and a selected elapsed time criterion. The DBMS begins execution of the request using the selected workload.

Abstract: A SQL query performs a function. The SQL query includes a SQL operator that has two input relations. The first input relation is a script relation having a plurality of script records. Each script record includes a transformation field, the contents of which specify a transformation to be performed by the SQL operator. The second input relation is a parameter relation having a plurality of parameter records. Each parameter record includes a data-to-process field that identifies data to be processed by the transformation specified in the transformation field of a selected script record. The selected script record is determined by a mapping. The SQL operator has one output relation having a plurality of output records. Each output record contains the result of transformation specified in a respective selected script record using the data to be processed identified in the data-to-be-processed field in a respective selected parameter record.

Abstract: An apparatus, method and computer program product for query optimization in a Relational Database Management System (RDBMS), wherein an optimizer accesses a query expression repository (QER) storing planning and execution information for QEs from previous queries, wherein the QEs comprise table relations, intermediate results and/or final results of operations in the previous queries. Additionally, dynamic join indexes representing QE results are created for high-value QEs selected from the QER and maintained within a DJI repository. During query plan creation for a current or subsequent query, the optimizer searches the QER and DJI repository for DJIs created for high-value QEs corresponding to QEs contained in the current or subsequent query. DJIs corresponding to the matching QEs are used in the query planning phase to rewrite the current or subsequent user query so that stored QE results are used to answer QEs contained in the current or subsequent query.

Abstract: A database system enumerates one-column candidate referential integrities (1CRIs) from a plurality of input columns in one or more relations. The database system applies one or more disqualification tests to the 1CRIs to eliminate illegitimate 1CRIs resulting in a list of non-disqualified 1CRIs, wherein the disqualification tests are applied to an 1CRI being tested (hereinafter (A*,B*), A* representing a set of values of a referenced column or columns and B* representing a set of values of a referencing column or columns) until (A*,B*) is disqualified or until all of the disqualification tests have been executed and (A*,B*) has not been disqualified, in which case (A*,B*) is added to the list of non-disqualified 1CRIs, wherein each of the disqualification tests reduces the likelihood of incorrectly adding (A*,B*) to the list of non-disqualified 1CRIs.

Abstract: Techniques for improving the execution of database queries in a multi-processor system or distributed processing system environment are provided. In a database system including multiple parsing engines (PEs) for parsing database queries, or requests, received by the system and generating execution plans for the requests, execution plans generated for requests can be saved in a global request cache accessible to each of the parsing engines. Requests which have been parsed and cached by a PE can be retrieved for use by other PEs, thereby avoiding unnecessarily parsing the same database request in multiple PEs. The global request cache may be a distributed cache consisting of request caches local to each parsing engine, with execution plans allocated to the local request caches using hashing techniques applied to the database requests associated with the execution plans.

Abstract: Improved techniques for performing Spatial Joins multi-processing computing systems and environments are disclosed. One or more intersection of bounds (or limits) of data sets is determined as a join bounding space. The join bounding space is in a space (Global space or Global universe) where a spatial join between (or for) the data can be performed. The determined join bounding space can be partitioned into sub-partitions of the join bounding space. The sub-partitions of the join bounding space can assigned respectively to multiple processing unit for processing in parallel in. In addition, distribution cost information associated with the cost of distribution of the datasets (and/or their components) to the processing units of a multi-processing system can be provided and/or used to effectively distribute and/or redistribute processing of the Spatial Join between the processing units of a multi-processing system.

Abstract: In some examples, a system receives an input graph representation of one or more query plans for one or more database queries, and generates, by an embedding machine learning model based on the input graph representation, a feature vector that provides a distributed representation of the one or more query plans. The system determines, using the feature vector, one or more user behaviors and/or workload characteristics of one or more workloads in one or more database systems.

Abstract: A database system receives a query that includes a reference to a foreign table. The foreign table is used to access an Object Store (OS) outside the database system. The OS stores objects. The objects have path names, which are pointers to the objects. When the foreign table was created one or more wildcards were used to specify the path names for the objects in the OS to be accessed by the query. The database system directing the OS to provide a list containing the path names of the objects in the OS. The database system receiving the list and applying the one or more wildcards to identify the path names of the objects to be accessed by the query. The database system producing a result by executing the query, accessing the objects in the OS identified by the path names of the objects to be accessed by the query.

Abstract: A data store system may include a storage device configured to store a plurality of data store tables and may include a processor in communication with the storage device. The processor may receive a plurality of requests. For each request, the processor may: (1) determine an associated workload type for the request; (2) determine a first respective rate at which the request is to be released for scheduling of execution; and (3) release the request for scheduling of execution based on the first respective rate. For each released request, the processor may: (1) determine a second respective rate based on the associated workload type at which each released request is scheduled to be executed; and (2) in response to execution being scheduled for a released request, execute the released request. A method and computer-readable medium are also disclosed.

Abstract: Artificial Intelligence-based (AI-based) modeling can be used to predict “Critical Times” when “bottlenecks” in a processing of data would occur. Moreover, for each one of the predicted Critical Times, it can be determined which one of multiple Computing Resources would cause the bottleneck, so that more precise measures can be taken and taken before a Critical Time, in an effort to prevent bottlenecks from happening in computing systems, especially more complex database systems with more demeaning service needs and requirements.

Abstract: A system and method for caching data objects retrieved from a network object store or cloud storage remotely accessible by a database management node. Retrieved data objects are stored within the database management node in a cache memory having multiple cache zones providing different input/output (I/O) latencies with respect to cache data access. Retrieved data objects are placed within the cache zones in accordance with access and storage costs associated with the retrieved data objects, wherein data objects having higher associated costs are placed in cache zones having lower I/O latencies. The costs associated a data object may be determined from object store vendor costs, object store storage tier levels, locations of the data management node and the object store, method of connection to the object store, or read from a pricing matrix containing predetermined object costs associated with stored data objects.