Patents by Inventor Luke Lonergan
Luke Lonergan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10936588Abstract: A query is executed in a massively parallel processing data storage system comprising a master node communicating with a cluster of multiple segments that access data in distributed storage by producing a self-described query plan at the master node that incorporates changeable metadata and information needed to execute the self-described query plan on the segments, and that incorporates references to obtain static metadata and information for functions and operators of the query plan from metadata stores on the segments. The distributed storage may be the Hadoop distributed file system, and the query plan may be a full function SQL query plan.Type: GrantFiled: August 29, 2017Date of Patent: March 2, 2021Assignee: EMC IP Holding Company LLCInventors: Lei Chang, Zhanwei Wang, Tao Ma, Luke Lonergan, Lirong Jian, Lili Ma
-
Patent number: 10769146Abstract: Data location-based query optimization for scan operators in a large-scale distributed database system is disclosed. In various embodiments, a set of query processing segments to be used to process a query is identified. It is determined for each of a plurality of data blocks to be scanned to process the query a corresponding storage location in which the data block is stored in a distributed storage system. Each of the plurality of data blocks is assigned to be scanned by a query processing segment selected based at least in part on a location of the query processing segment relative to the corresponding storage location in which the data block is stored.Type: GrantFiled: March 29, 2013Date of Patent: September 8, 2020Assignee: EMC IP Holding Company LLCInventors: Lirong Jian, Lei Chang, Zhanwei Wang, Tao Ma, Luke Lonergan, Lili Ma
-
Patent number: 10698891Abstract: M×N dispatching in a large scale distributed system is disclosed. In various embodiments, a query is received. A query plan is generated to perform the query. A subset of query processing segments is selected, from a set of available query processing segments, to perform an assigned portion of the query plan. An assignment to perform the assigned portion of the query plan is dispatched to the selected subset of query processing segments.Type: GrantFiled: August 4, 2017Date of Patent: June 30, 2020Assignee: EMC IP Holding Company LLCInventors: Lei Chang, Tao Ma, Zhanwei Wang, Luke Lonergan, Lirong Jian, Lili Ma
-
Publication number: 20180129707Abstract: A query is executed in a massively parallel processing data storage system comprising a master node communicating with a cluster of multiple segments that access data in distributed storage by producing a self-described query plan at the master node that incorporates changeable metadata and information needed to execute the self-described query plan on the segments, and that incorporates references to obtain static metadata and information for functions and operators of the query plan from metadata stores on the segments. The distributed storage may be the Hadoop distributed file system, and the query plan may be a full function SQL query plan.Type: ApplicationFiled: August 29, 2017Publication date: May 10, 2018Inventors: Lei Chang, Zhanwei Wang, Tao Ma, Luke Lonergan, Lirong Jian, Lili Ma
-
Patent number: 9898469Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for streaming external data in parallel from a second distributed system to a first distributed system. One of the methods includes receiving a query that requests a join of first rows of a first table in a first distributed system with second rows of an external table, the external table representing data in a second distributed system. Each of the segment nodes communicates with a respective extension service that obtains fragments from one or more data nodes of the second distributed system according to location information for the respective fragments, and provides to the segment node a stream of data corresponding to second rows of the external table. Each of the segment nodes computes joined rows between the first rows of the first table and the stream of data corresponding to second rows of the external table.Type: GrantFiled: August 25, 2014Date of Patent: February 20, 2018Assignee: Pivotal Software, Inc.Inventors: Dov Yaron Dorin, Alon Goldshuv, Alex Shacked, Luke Lonergan
-
Patent number: 9888048Abstract: A system for sending a command stream comprises a first input interface, a processor, and an output interface. The first input interface is configured to receive a call. The processor is configured to determine one or more packets for the call. The one or more packets are able to be reassembled to form the call. The processor is configured to assign a first packet of the one or more packets to a first output queue and assign the second packet to a second output queue in the event there is a second packet of the one or more packets for the call. The output interface configured to send the first packet from the first output queue.Type: GrantFiled: March 29, 2013Date of Patent: February 6, 2018Assignee: EMC IP Holding Co. LLCInventors: Lili Ma, Zhanwei Wang, Lei Chang, Tao Ma, Lirong Jian, Luke Lonergan
-
Publication number: 20180025057Abstract: M×N dispatching in a large scale distributed system is disclosed. In various embodiments, a query is received. A query plan is generated to perform the query. A subset of query processing segments is selected, from a set of available query processing segments, to perform an assigned portion of the query plan. An assignment to perform the assigned portion of the query plan is dispatched to the selected subset of query processing segments.Type: ApplicationFiled: August 4, 2017Publication date: January 25, 2018Inventors: Lei Chang, Tao Ma, Zhanwei Wang, Luke Lonergan, Lirong Jian, Lili Ma
-
Patent number: 9792327Abstract: A query is executed in a massively parallel processing data storage system comprising a master node communicating with a cluster of multiple segments that access data in distributed storage by producing a self-described query plan at the master node that incorporates changeable metadata and information needed to execute the self-described query plan on the segments, and that incorporates references to obtain static metadata and information for functions and operators of the query plan from metadata stores on the segments. The distributed storage may be the Hadoop distributed file system, and the query plan may be a full function SQL query plan.Type: GrantFiled: March 6, 2017Date of Patent: October 17, 2017Assignee: EMC IP Holding Company LLCInventors: Lei Chang, Zhanwei Wang, Tao Ma, Luke Lonergan, Lirong Jian, Lili Ma
-
Patent number: 9753980Abstract: M×N dispatching in a large scale distributed system is disclosed. In various embodiments, a query is received. A query plan is generated to perform the query. A subset of query processing segments is selected, from a set of available query processing segments, to perform an assigned portion of the query plan. An assignment to perform the assigned portion of the query plan is dispatched to the selected subset of query processing segments.Type: GrantFiled: March 15, 2013Date of Patent: September 5, 2017Assignee: EMC IP Holding Company LLCInventors: Lei Chang, Tao Ma, Zhanwei Wang, Luke Lonergan, Lirong Jian, Lili Ma
-
Publication number: 20170177665Abstract: A query is executed in a massively parallel processing data storage system comprising a master node communicating with a cluster of multiple segments that access data in distributed storage by producing a self-described query plan at the master node that incorporates changeable metadata and information needed to execute the self-described query plan on the segments, and that incorporates references to obtain static metadata and information for functions and operators of the query plan from metadata stores on the segments. The distributed storage may be the Hadoop distributed file system, and the query plan may be a full function SQL query plan.Type: ApplicationFiled: March 6, 2017Publication date: June 22, 2017Inventors: Lei Chang, Zhanwei Zhanwei, Tao Ma, Luke Lonergan, Lirong Jian, Lili Ma
-
Patent number: 9626411Abstract: A query is executed in a massively parallel processing data storage system comprising a master node communicating with a cluster of multiple segments that access data in distributed storage by producing a self-described query plan at the master node that incorporates changeable metadata and information needed to execute the self-described query plan on the segments, and that incorporates references to obtain static metadata and information for functions and operators of the query plan from metadata stores on the segments. The distributed storage may be the Hadoop distributed file system, and the query plan may be a full function SQL query plan.Type: GrantFiled: March 29, 2013Date of Patent: April 18, 2017Assignee: EMC IP Holding Company LLCInventors: Lei Chang, Zhanwei Wang, Tao Ma, Luke Lonergan, Lirong Jian, Lili Ma
-
Patent number: 9582520Abstract: A transaction model for data stores using a distributed file system is disclosed. In various embodiments, a transaction-related metadata is sent to each of a plurality of segments to which a corresponding assigned portion of a query plan is assigned. A metadata modification record is received from zero or more of the segments, reflecting changes, if any, to system metadata required to be made to reflect changes to data made by that segment in processing the portion of the query plan assigned to that segment. It is determined whether a metadata modification record has been received from each of the segments in the plurality of segments. In the event a metadata modification record is determined to have been received from each of the segments in the plurality of segments, a system metadata store is updated to reflect the respective metadata modification records received from the plurality of segments.Type: GrantFiled: March 29, 2013Date of Patent: February 28, 2017Assignee: EMC IP Holding Company LLCInventors: Zhanwei Wang, Lei Chang, Tao Ma, Luke Lonergan, Lirong Jian, Lili Ma
-
Patent number: 9514188Abstract: A computer readable storage medium includes executable instructions to define a map-reduce document that coordinates processing of data in a distributed database. The map-reduce document complies with a map-reduce specification that integrates map-reduce functions with queries in a query language. The operations specified by the map-reduce document are executed in the distributed database.Type: GrantFiled: April 28, 2014Date of Patent: December 6, 2016Assignee: Pivotal Software, Inc.Inventors: Jeffrey Ira Cohen, Luke Lonergan, Caleb E. Welton
-
Publication number: 20160224630Abstract: A computer readable storage medium includes executable instructions to define a map-reduce document that coordinates processing of data in a distributed database. The map-reduce document complies with a map-reduce specification that integrates map-reduce functions with queries in a query language. The operations specified by the map-reduce document are executed in the distributed database.Type: ApplicationFiled: April 28, 2014Publication date: August 4, 2016Inventors: JEFFREY IRA COHEN, LUKE LONERGAN, CALEB E. WELTON
-
Patent number: 9058351Abstract: A computer readable storage medium includes executable instructions to store load data in new rows of an append only table within a data warehouse, without updating or deleting existing rows in the append only table. The new rows are added in a database transaction that guarantees that the distributed reads and writes of all transactions are processed reliably and that the transactions obey snapshot isolation rules. Data changes associated with the load data are maintained in a separate update table. Data from the append only table is merged with data changes from the update table to supply read data.Type: GrantFiled: April 29, 2014Date of Patent: June 16, 2015Assignee: Pivotal Software, Inc.Inventors: Matthew C. McCline, Luke Lonergan, Kurt Harriman, John Glenn Eshleman, Alon Goldshuv, Jeffrey Ira Cohen
-
Publication number: 20140351202Abstract: A computer readable storage medium includes executable instructions to store load data in new rows of an append only table within a data warehouse, without updating or deleting existing rows in the append only table. The new rows are added in a database transaction that guarantees that the distributed reads and writes of all transactions are processed reliably and that the transactions obey snapshot isolation rules. Data changes associated with the load data are maintained in a separate update table. Data from the append only table is merged with data changes from the update table to supply read data.Type: ApplicationFiled: April 29, 2014Publication date: November 27, 2014Applicant: Pivotal Software, Inc.Inventors: Matthew C. McCline, Luke Lonergan, Kurt Harriman, John Glenn Eshleman, Alon Goldshuv, Jeffrey Ira Cohen
-
Patent number: 8762333Abstract: A computer readable storage medium includes executable instructions to store load data in new rows of an append only table within a data warehouse, without updating or deleting existing rows in the append only table. The new rows are added in a database transaction that guarantees that the distributed reads and writes of all transactions are processed reliably and that the transactions obey snapshot isolation rules. Data changes associated with the load data are maintained in a separate update table. Data from the append only table is merged with data changes from the update table to supply read data.Type: GrantFiled: July 8, 2009Date of Patent: June 24, 2014Assignee: Pivotal Software, Inc.Inventors: Matthew Clark McCline, Luke Lonergan, Kurt Harriman, John Glenn Eshleman, Alon Goldshuv, Jeffrey Ira Cohen
-
Patent number: 8713038Abstract: A computer readable storage medium includes executable instructions to define a map-reduce document that coordinates processing of data in a distributed database. The map-reduce document complies with a map-reduce specification that integrates map-reduce functions with queries in a query language. The operations specified by the map-reduce document are executed in the distributed database.Type: GrantFiled: April 2, 2009Date of Patent: April 29, 2014Assignee: Pivotal Software, Inc.Inventors: Jeffrey Ira Cohen, Luke Lonergan, Caleb E. Welton
-
Publication number: 20110010330Abstract: A computer readable storage medium includes executable instructions to store load data in new rows of an append only table within a data warehouse, without updating or deleting existing rows in the append only table. The new rows are added in a database transaction that guarantees that the distributed reads and writes of all transactions are processed reliably and that the transactions obey snapshot isolation rules. Data changes associated with the load data are maintained in a separate update table. Data from the append only table is merged with data changes from the update table to supply read data.Type: ApplicationFiled: July 8, 2009Publication date: January 13, 2011Inventors: Matthew Clark McCline, Luke Lonergan, Kurt Harriman, John Glenn Eshleman, Alon Goldshuv, Jeffrey Ira Cohen
-
Publication number: 20100257198Abstract: A computer readable storage medium includes executable instructions to define a map-reduce document that coordinates processing of data in a distributed database. The map-reduce document complies with a map-reduce specification that integrates map-reduce functions with queries in a query language. The operations specified by the map-reduce document are executed in the distributed database.Type: ApplicationFiled: April 2, 2009Publication date: October 7, 2010Inventors: Jeffrey Ira Cohen, Luke Lonergan, Caleb E. Welton