Patents by Inventor Alexander Douglas James
Alexander Douglas James has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230244673Abstract: Operational machine components of an information technology (IT) or other microprocessor- or microcontroller-permeated environment generate disparate forms of machine data. Network connections are established between these components and processors of data intake and query system (DIQS). The DIQS conducts network transactions on a periodic and/or continuous basis with the machine components to receive disparate data and ingest certain of the data as entries of a data store that is searchable for DIQS query processing. The DIQS may receive queries to process against the received and ingested data via an exposed network interface. In one example embodiment, the DIQS receives a query identifying data to be processed, dynamically generates a query processing scheme based on the state of the data to be processed, such as streaming or at rest, and dynamically communicates the query processing scheme to a query executor based on the state of the data to be processed.Type: ApplicationFiled: March 29, 2023Publication date: August 3, 2023Inventors: Alexander Douglas James, Joseph Gabriel Echeverria, Eric Sammer
-
Patent number: 11669551Abstract: Systems and methods for rule-based data stream processing by data collection, indexing, and visualization systems. An example method includes: receiving, by the computer system, an input data stream comprising raw machine data; processing the raw machine data by a data processing pipeline that produces transformed machine data, wherein the data processing pipeline comprises an ordered plurality of pipeline stages, wherein a pipeline stage of the ordered plurality of pipeline stages applies a rule of a set of rules to an input of the pipeline stage, wherein the rule specifies an action to be performed on the input of the pipeline stage responsive to evaluating a conditional expression applied to the input of the pipeline stage, wherein the action generates an output of the pipeline stage, and wherein the rule is selected based on a source type associated with the input data stream; and supplying the transformed machine data to a data collection, indexing, and visualization system.Type: GrantFiled: October 16, 2020Date of Patent: June 6, 2023Assignee: Splunk Inc.Inventors: Alexander Douglas James, Shyam Mundhra, Manikandan Vellore Muneeswaran, Arun Ramani, Thor Taylor, Steve Zhang
-
Patent number: 11663212Abstract: Systems and methods are disclosed for processing and executing queries in a data intake and query system. The data intake and query system receives a query identifying a set of data to be processed and a manner of processing the set of data. The data intake and query system parses the query and uses a metadata catalog to dynamically identify configuration parameters of datasets and/or rules associated with the query. The identified configuration parameters are communicated to a query processing component of the data intake and query system for use in executing the query.Type: GrantFiled: July 27, 2021Date of Patent: May 30, 2023Assignee: Splunk Inc.Inventors: Alexander Douglas James, Manu Jose, Sourav Pal, Christopher Madden Pride, Nicholas Robert Romito, Igor Braylovskiy, Arun Ramani, Ankit Jain
-
Patent number: 11657057Abstract: Systems and methods are disclosed for annotating a metadata catalog in a data intake and query system based on a query received by the data intake and query system. The metadata catalog can store information about datasets associated with the data intake and query system, including dataset configuration records of the datasets, which can be used to process queries for execution by the data intake and query system. The data intake and query system can receive a query identifying a set of data to be processed and a manner of processing the set of data. The data intake and query system can parse the query to identify datasets and/or data fields associated with the query. Based on the identified datasets and/or fields, the data intake and query system can generate one or more annotations, and use the annotations to update the metadata catalog.Type: GrantFiled: January 27, 2022Date of Patent: May 23, 2023Assignee: Splunk Inc.Inventors: Alexander Douglas James, Scott Calvert, Manu Jose, Andrew Peters, Christopher Madden Pride, Arun Ramani
-
Patent number: 11645286Abstract: Operational machine components of an information technology (IT) or other microprocessor- or microcontroller-permeated environment generate disparate forms of machine data. Network connections are established between these components and processors of data intake and query system (DIQS). The DIQS conducts network transactions on a periodic and/or continuous basis with the machine components to receive disparate data and ingest certain of the data as entries of a data store that is searchable for DIQS query processing. The DIQS may receive queries to process against the received and ingested data via an exposed network interface. In one example embodiment, the DIQS receives a query identifying data to be processed, dynamically generates a query processing scheme based on the state of the data to be processed, such as streaming or at rest, and dynamically communicates the query processing scheme to a query executor based on the state of the data to be processed.Type: GrantFiled: April 21, 2021Date of Patent: May 9, 2023Assignee: Splunk Inc.Inventors: Alexander Douglas James, Joseph Gabriel Echeverria, Eric Sammer
-
Patent number: 11620288Abstract: Systems and methods are disclosed for mapping search nodes to a search head in a data intake and query system based on a tenant identifier in order to execute a query received by the data intake and query system. The mapping may allow same or similar search nodes to be used to execute queries that are associated with a particular tenant identifier, in order to take advantage of caching and local data stored with those search nodes. In some cases, search nodes can be mapped based on the tenant identifier using a hashing algorithm, such as a consistent hashing algorithm.Type: GrantFiled: February 25, 2022Date of Patent: April 4, 2023Assignee: Splunk Inc.Inventors: Alexandros Batsakis, Scott Calvert, Alexander Douglas James, Bei Li, Ashish Mathew, James Monschke, Sogol Moshtaghi, Christopher Madden Pride, Xiaowei Wang
-
Patent number: 11586692Abstract: Systems and methods are disclosed for processing streaming data. The data can come from various sources. Worker nodes can be configured to process the streaming data, without delays that may be caused by indexing the data. The data can be filtered and/or transformed as it is processed. In some cases, data can be stored in a data store without transformation. The data in the data store can be accessed and processed at a later time.Type: GrantFiled: January 31, 2022Date of Patent: February 21, 2023Assignee: Splunk Inc.Inventors: Arindam Bhattacharjee, Alexander Douglas James, Sourav Pal
-
Publication number: 20230049579Abstract: Systems and methods are disclosed for generating a distributed execution model with untrusted commands. The system can receive a query, and process the query to identify the untrusted commands. The system can use data associated with the untrusted command to identify one or more files associated with the untrusted command. Based on the files, the system can generate a data structure and include one or more identifiers associated with the data structure in the distributed execution model. The system can distribute the distributed execution model to one or more nodes in a distributed computing environment for execution.Type: ApplicationFiled: October 5, 2022Publication date: February 16, 2023Inventors: Arindam Bhattacharjee, Sourav Pal, Alexander Douglas James
-
Patent number: 11573955Abstract: Systems and methods are disclosed for flexibly applying a query term to heterogeneous data. A query system can receive a query that includes a data-determinant query term. As the system executes the query it can generate interim search results. As the system query processes the interim search results based on the query, it can apply the data-determinant query term to records of the interims search results based on the structure of the records.Type: GrantFiled: October 18, 2019Date of Patent: February 7, 2023Assignee: Splunk Inc.Inventors: Alexander Douglas James, Andrew Peters, Arun Ramani
-
Publication number: 20230015186Abstract: A method includes receiving an initial pipeline including a sequence of commands for execution on a computing system, and obtaining, for each command in the sequence of commands, semantic information. The sequence of commands includes a command with incomplete semantic information. The method further includes generating an abstract semantic tree (AST) with the semantic information and a placeholder for the incomplete semantic information, and manipulating the AST to generate a revised AST. The revised AST corresponds to a revised pipeline that reduces an execution time on the computing system. The method further includes executing the revised pipeline.Type: ApplicationFiled: September 13, 2022Publication date: January 19, 2023Applicant: Splunk Inc.Inventors: Alexander Douglas James, David Ryan Marquardt, Karthikeyan Sabhanatarajan
-
Publication number: 20220382755Abstract: Systems and methods are disclosed for mapping search nodes to a search head in a data intake and query system based on a tenant identifier in order to execute a query received by the data intake and query system. The mapping may allow same or similar search nodes to be used to execute queries that are associated with a particular tenant identifier, in order to take advantage of caching and local data stored with those search nodes. In some cases, search nodes can be mapped based on the tenant identifier using a hashing algorithm, such as a consistent hashing algorithm.Type: ApplicationFiled: February 25, 2022Publication date: December 1, 2022Inventors: Alexandros Batsakis, Scott Calvert, Alexander Douglas James, Bei Li, Ashish Mathew, James Monschke, Sogol Moshtaghi, Christopher Madden Pride, Xiaowei Wang
-
Patent number: 11487759Abstract: A method includes receiving an initial pipeline including a sequence of commands for execution on a computing system, and obtaining, for each command in the sequence of commands, semantic information. The sequence of commands includes a command with incomplete semantic information. The method further includes generating an abstract semantic tree (AST) with the semantic information and a placeholder for the incomplete semantic information, and manipulating the AST to generate a revised AST. The revised AST corresponds to a revised pipeline that reduces an execution time on the computing system. The method further includes executing the revised pipeline.Type: GrantFiled: October 30, 2019Date of Patent: November 1, 2022Assignee: Splunk Inc.Inventors: Alexander Douglas James, David Ryan Marquardt, Karthikeyan Sabhanatarajan
-
Patent number: 11481396Abstract: Systems and methods are disclosed for generating a distributed execution model with untrusted commands. The system can receive a query, and process the query to identify the untrusted commands. The system can use data associated with the untrusted command to identify one or more files associated with the untrusted command. Based on the files, the system can generate a data structure and include one or more identifiers associated with the data structure in the distributed execution model. The system can distribute the distributed execution model to one or more nodes in a distributed computing environment for execution.Type: GrantFiled: April 17, 2020Date of Patent: October 25, 2022Assignee: Splunk Inc.Inventors: Arindam Bhattacharjee, Sourav Pal, Alexander Douglas James
-
Publication number: 20220327149Abstract: Systems and methods are disclosed for processing and executing queries against one or more dataset sources, where the queries identify a set of data to be processed and a manner of processing the set of data. To query the dataset sources, a query coordinator generates a query processing scheme that includes a dynamic allocation of multiple layers of partitions. The query is then executed based on the query processing scheme.Type: ApplicationFiled: March 17, 2022Publication date: October 13, 2022Inventors: Sourav Pal, Arindam Bhattacharjee, Kishore Reddy Ramasayam, Alexander Douglas James
-
Patent number: 11461334Abstract: Systems and methods are disclosed for processing queries against one or more dataset sources utilizing dynamically allocated partitions operating on one or more worker nodes. The results of the processing are stored in a dataset destination. The queries can identify data in the one or more dataset sources for processing and a manner for processing the data. In addition, the queries can identify the dataset destination for storing results of the query. To process the query, a query coordinator can dynamically allocate partitions operating on worker nodes to retrieve data for processing, process the data, and communicate the data to the dataset sources. In addition, the query coordinator can dynamically allocate partitions based on an identification of the dataset destination.Type: GrantFiled: July 31, 2017Date of Patent: October 4, 2022Assignee: Splunk Inc.Inventors: Arindam Bhattacharjee, Sourav Pal, Alexander Douglas James, Christopher Pride
-
Patent number: 11392578Abstract: Systems and methods are disclosed for annotating a metadata catalog in a data intake and query system based on a detected change to the metadata catalog. The metadata catalog can store information about datasets associated with the data intake and query system, including dataset configuration records of the datasets, which can be used to process queries for execution by the data intake and query system. Based on a detected change to the metadata catalog, such as a manual or system annotation, the data intake and query system can generate additional annotations for the metadata catalog and use the annotations to update the metadata catalog.Type: GrantFiled: January 31, 2019Date of Patent: July 19, 2022Assignee: Splunk Inc.Inventors: Alexander Douglas James, Scott Calvert, Manu Jose, Andrew Peters, Christopher Madden Pride, Arun Ramani
-
Publication number: 20220156267Abstract: Systems and methods are disclosed for annotating a metadata catalog in a data intake and query system based on a query received by the data intake and query system. The metadata catalog can store information about datasets associated with the data intake and query system, including dataset configuration records of the datasets, which can be used to process queries for execution by the data intake and query system. The data intake and query system can receive a query identifying a set of data to be processed and a manner of processing the set of data. The data intake and query system can parse the query to identify datasets and/or data fields associated with the query. Based on the identified datasets and/or fields, the data intake and query system can generate one or more annotations, and use the annotations to update the metadata catalog.Type: ApplicationFiled: January 27, 2022Publication date: May 19, 2022Inventors: Alexander Douglas James, Scott Calvert, Manu Jose, Andrew Peters, Christopher Madden Pride, Arun Ramani
-
Publication number: 20220156335Abstract: Systems and methods are disclosed for processing streaming data. The data can come from various sources. Worker nodes can be configured to process the streaming data, without delays that may be caused by indexing the data. The data can be filtered and/or transformed as it is processed. In some cases, data can be stored in a data store without transformation. The data in the data store can be accessed and processed at a later time.Type: ApplicationFiled: January 31, 2022Publication date: May 19, 2022Inventors: Arindam Bhattacharjee, Alexander Douglas James, Sourav Pal
-
Patent number: 11314759Abstract: The disclosed embodiments include a method performed by a data intake and query system. The method includes populating each metric including a measure value, cataloging metadata in an in-memory metrics catalog, where the metadata is related to the metrics. The method further includes receiving a search query including search criteria, evaluating the search query by applying the search criteria to the metadata of the metrics catalog to obtain results that satisfy the search criteria, and causing display, on a display device, of the results or data indicative of the results.Type: GrantFiled: February 27, 2020Date of Patent: April 26, 2022Assignee: SPLUNK INC.Inventors: Thomas Allan Haggie, Clint Sharp, Alexander Douglas James, David Ryan Marquardt
-
Publication number: 20220121689Abstract: Systems and methods for rule-based data stream processing by data collection, indexing, and visualization systems. An example method includes: receiving, by the computer system, an input data stream comprising raw machine data; processing the raw machine data by a data processing pipeline that produces transformed machine data, wherein the data processing pipeline comprises an ordered plurality of pipeline stages, wherein a pipeline stage of the ordered plurality of pipeline stages applies a rule of a set of rules to an input of the pipeline stage, wherein the rule specifies an action to be performed on the input of the pipeline stage responsive to evaluating a conditional expression applied to the input of the pipeline stage, wherein the action generates an output of the pipeline stage, and wherein the rule is selected based on a source type associated with the input data stream; and supplying the transformed machine data to a data collection, indexing, and visualization system.Type: ApplicationFiled: October 16, 2020Publication date: April 21, 2022Inventors: Alexander Douglas James, Shyam Mundhra, Manikandan Vellore Muneeswaran, Arun Ramani, Thor Taylor, Steve Zhang