Patents by Inventor Richard Clinkenbeard

Richard Clinkenbeard has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11972217
    Abstract: System and method for displaying a user interface of an evaluation system configured to evaluate predicted answers generated by a machine learning system. For example, the method includes receiving textual data and a predicted answer to a question associated with a text object. The text object includes a structured data field of the textual data. The predicted answer includes a confidence level. The confidence level is determined by a machine learning system. In response to determining the confidence level being larger than or equal to a predetermined confidence threshold, the predicted answer and a reference is stored in a storage for retrieval and display. The reference indicates a location of the text object in the textual data. In response to determining the confidence level being smaller than the predetermined confidence threshold, the question and the text object associated with the question is displayed.
    Type: Grant
    Filed: November 1, 2022
    Date of Patent: April 30, 2024
    Assignee: RELX INC.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Patent number: 11797849
    Abstract: In one embodiment, a method for adaptive training of a machine learning system configured to predict answers to questions associated with textual data includes receiving predicted answers to questions associated with textual data. The predicted answers are generated based at least in part on one or more first models of a machine learning system. The one or more first models are associated with a first accuracy score. The method further includes determining based at least in part on a quality control parameter whether an evaluation of the questions by one or more external entities is required. In response to determining based at least in part on the quality control parameter that an evaluation of the questions by one or more external entities is required, the questions associated with the textual data and the textual data are sent to the one or more external entities for evaluation.
    Type: Grant
    Filed: September 12, 2022
    Date of Patent: October 24, 2023
    Assignee: RELX INC.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Publication number: 20230115352
    Abstract: System and method for displaying a user interface of an evaluation system configured to evaluate predicted answers generated by a machine learning system. For example, the method includes receiving textual data and a predicted answer to a question associated with a text object. The text object includes a structured data field of the textual data. The predicted answer includes a confidence level. The confidence level is determined by a machine learning system. In response to determining the confidence level being larger than or equal to a predetermined confidence threshold, the predicted answer and a reference is stored in a storage for retrieval and display. The reference indicates a location of the text object in the textual data. In response to determining the confidence level being smaller than the predetermined confidence threshold, the question and the text object associated with the question is displayed.
    Type: Application
    Filed: November 1, 2022
    Publication date: April 13, 2023
    Applicant: RELX Inc.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Publication number: 20230004840
    Abstract: In one embodiment, a method for adaptive training of a machine learning system configured to predict answers to questions associated with textual data includes receiving predicted answers to questions associated with textual data. The predicted answers are generated based at least in part on one or more first models of a machine learning system. The one or more first models are associated with a first accuracy score. The method further includes determining based at least in part on a quality control parameter whether an evaluation of the questions by one or more external entities is required. In response to determining based at least in part on the quality control parameter that an evaluation of the questions by one or more external entities is required, the questions associated with the textual data and the textual data are sent to the one or more external entities for evaluation.
    Type: Application
    Filed: September 12, 2022
    Publication date: January 5, 2023
    Applicant: RELX Inc.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Patent number: 11520990
    Abstract: Systems and methods include receiving textual data and a predicted answer to a question associated with a text object. The text object includes a structured data field of the textual data. The predicted answer includes a confidence level. The confidence level is determined by a machine learning system based at least in part on one or more models of the machine learning system and the textual data. In response to determining the confidence level being larger than or equal to a predetermined confidence threshold, the predicted answer and a reference is stored in a storage for retrieval and display. The reference indicates a location of the text object in the textual data. In response to determining the confidence level being smaller than the predetermined confidence threshold, the question and the text object associated with the question is displayed, at the user interface, to a user for inputting a true answer.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: December 6, 2022
    Assignee: RELX INC.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Patent number: 11475329
    Abstract: System and method for adaptive training of a machine learning system processing textual data. For example, a method for adaptive training of a machine learning system configured to predict answers to questions associated with textual data includes receiving predicted answers to questions associated with textual data. The predicted answers are generated based at least in part on one or more first models of a machine learning system. The one or more first models are associated with a first accuracy score. The method further includes determining based at least in part on a quality control parameter whether an evaluation of the questions by one or more external entities is required. In response to determining based at least in part on the quality control parameter that an evaluation of the questions by one or more external entities is required, the questions associated with the textual data and the textual data are sent to the one or more external entities for evaluation.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: October 18, 2022
    Assignee: RELX INC.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Patent number: 11222174
    Abstract: Systems and methods for generating logical documents for a document evaluation system are provided. For example, a method for generating logical documents for a document evaluation system includes receiving a first child document associated with a master document. The master document includes one or more master terms. The first child document includes one or more first child terms and a first date. The method further includes generating a logical document based at least in part on the master document. The logical document includes one or more current document values. Each current document value corresponds to one master term and is associated with a current date and a current reference. The current reference identifies a region in the master document related to the one master term. The method further includes selecting a first child term from the one or more first child terms.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: January 11, 2022
    Assignee: RELX INC.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Publication number: 20200320250
    Abstract: Systems and methods for generating logical documents for a document evaluation system are provided. For example, a method for generating logical documents for a document evaluation system includes receiving a first child document associated with a master document. The master document includes one or more master terms. The first child document includes one or more first child terms and a first date. The method further includes generating a logical document based at least in part on the master document. The logical document includes one or more current document values. Each current document value corresponds to one master term and is associated with a current date and a current reference. The current reference identifies a region in the master document related to the one master term. The method further includes selecting a first child term from the one or more first child terms.
    Type: Application
    Filed: April 2, 2020
    Publication date: October 8, 2020
    Applicant: RELX Inc.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Publication number: 20200320254
    Abstract: System and method for dynamically displaying a user interface of an evaluation system configured to evaluate predicted answers generated by a machine learning system. For example, the method includes receiving textual data and a predicted answer to a question associated with a text object. The text object includes a structured data field of the textual data. The predicted answer includes a confidence level. The confidence level is determined by a machine learning system based at least in part on one or more models of the machine learning system and the textual data. In response to determining the confidence level being larger than or equal to a predetermined confidence threshold, the predicted answer and a reference is stored in a storage for retrieval and display. The reference indicates a location of the text object in the textual data.
    Type: Application
    Filed: April 2, 2020
    Publication date: October 8, 2020
    Applicant: RELX Inc.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
  • Publication number: 20200320411
    Abstract: System and method for adaptive training of a machine learning system processing textual data. For example, a method for adaptive training of a machine learning system configured to predict answers to questions associated with textual data includes receiving predicted answers to questions associated with textual data. The predicted answers are generated based at least in part on one or more first models of a machine learning system. The one or more first models are associated with a first accuracy score. The method further includes determining based at least in part on a quality control parameter whether an evaluation of the questions by one or more external entities is required. In response to determining based at least in part on the quality control parameter that an evaluation of the questions by one or more external entities is required, the questions associated with the textual data and the textual data are sent to the one or more external entities for evaluation.
    Type: Application
    Filed: April 2, 2020
    Publication date: October 8, 2020
    Applicant: RELX Inc.
    Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu