Abstract: A unified access layer (UAL) and scalable query engine receive queries from various interfaces and executes the queries with respect to non-heterogeneous data management and analytic computing platforms that are sources of record for data they store. Query performance is monitored and used to generate a query performance model. The query performance model may be used to generate alternatives for queries of users or groups of users or to generate policies for achieving a target performance. Performance may be improved by monitoring queries and retrieving catalog data for databases referenced and generating a recommendation model according to them. Duplicative or overlapping sources may be identified based on the monitoring and transformations to improve accuracy and security may be suggested. A recommendation model may be generated based on analysis of queries received through the UAL. Transformations may be performed according to the recommendation model in order to improve performance.
Type:
Grant
Filed:
August 15, 2019
Date of Patent:
September 20, 2022
Assignee:
Datameer, Inc
Inventors:
Kelly Nawrocke, Matt McManus, Martin Nettling, Frank Henze, Raghu Thiagarajan
Abstract: A unified access layer (UAL) and scalable query engine receive queries from various interfaces and executes the queries with respect to non-heterogeneous data management and analytic computing platforms that are sources of record for data they store. Query performance is monitored and used to generate a query performance model. The query performance model may be used to generate alternatives for queries of users or groups of users or to generate policies for achieving a target performance. Performance may be improved by monitoring queries and retrieving catalog data for databases referenced and generating a recommendation model according to them. Duplicative or overlapping sources may be identified based on the monitoring and transformations to improve accuracy and security may be suggested. A recommendation model may be generated based on analysis of queries received through the UAL. Transformations may be performed according to the recommendation model in order to improve performance.
Type:
Grant
Filed:
August 15, 2019
Date of Patent:
January 4, 2022
Assignee:
Datameer, Inc
Inventors:
Kelly Nawrocke, Matt McManus, Martin Nettling, Frank Henze, Raghu Thiagarajan
Abstract: A system has a master node with instructions executed by a master node processor to receive a query over a network from a client machine and distribute query segments over the network. Worker nodes receive the query segments. Each worker node includes instructions executed by a worker node processor to construct from a columnar file a term map characterizing a term from the columnar file, row identifications from the columnar file and a Boolean indicator for each row identification that characterizes whether the term is present in the row specified by the row identification. The term map is cached in dynamic memory. Values responsive to the query segment are collected from the term map. The values are sent to the master node. The master node aggregates values from the worker nodes to form a result that is returned to the client machine over the network.
Type:
Grant
Filed:
March 20, 2017
Date of Patent:
March 10, 2020
Assignee:
Datameer, Inc.
Inventors:
Matthew McManus, Peter Voss, Holger Schulze, Johannes Zillmann, Martin Nettling
Abstract: A server has a processor and a memory storing instructions executed by the processor to access scheduling tools including an entity workload profile with a work flow tasks schedule and work flow task dependencies. Processed data associated with a work flow task within the entity workload profile is identified. The work flow task dependencies are analyzed to alter the work flow tasks schedule to prioritize work flow tasks that rely upon the processed data.
Type:
Grant
Filed:
October 3, 2014
Date of Patent:
November 5, 2019
Assignee:
Datameer, Inc.
Inventors:
Peter Voss, Kelly Nawrocke, Matthew McManus
Abstract: A system has a master node with instructions executed by a master node processor to receive a query over a network from a client machine and distribute query segments over the network. Worker nodes receive the query segments. Each worker node includes instructions executed by a worker node processor to construct from a columnar file a term map characterizing a term from the columnar file, row identifications from the columnar file and a Boolean indicator for each row identification that characterizes whether the term is present in the row specified by the row identification. The term map is cached in dynamic memory. Values responsive to the query segment are collected from the term map. The values are sent to the master node. The master node aggregates values from the worker nodes to form a result that is returned to the client machine over the network.
Type:
Application
Filed:
March 20, 2017
Publication date:
September 20, 2018
Applicant:
Datameer, Inc.
Inventors:
Matthew McManus, Peter Voss, Holger Schulze, Johannes Zillmann, Martin Nettling
Abstract: A server has a processor and a memory storing instructions executed by the processor to access scheduling tools including an entity workload profile with a work flow tasks schedule and work flow task dependencies. Processed data associated with a work flow task within the entity workload profile is identified. The work flow task dependencies are analyzed to alter the work flow tasks schedule to prioritize work flow tasks that rely upon the processed data.
Type:
Application
Filed:
October 3, 2014
Publication date:
April 7, 2016
Applicant:
DATAMEER, INC.
Inventors:
Peter Voss, Kelly Nawrocke, Matthew McManus