Patents by Inventor Richard Clinkenbeard
Richard Clinkenbeard has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11972217Abstract: System and method for displaying a user interface of an evaluation system configured to evaluate predicted answers generated by a machine learning system. For example, the method includes receiving textual data and a predicted answer to a question associated with a text object. The text object includes a structured data field of the textual data. The predicted answer includes a confidence level. The confidence level is determined by a machine learning system. In response to determining the confidence level being larger than or equal to a predetermined confidence threshold, the predicted answer and a reference is stored in a storage for retrieval and display. The reference indicates a location of the text object in the textual data. In response to determining the confidence level being smaller than the predetermined confidence threshold, the question and the text object associated with the question is displayed.Type: GrantFiled: November 1, 2022Date of Patent: April 30, 2024Assignee: RELX INC.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Patent number: 11797849Abstract: In one embodiment, a method for adaptive training of a machine learning system configured to predict answers to questions associated with textual data includes receiving predicted answers to questions associated with textual data. The predicted answers are generated based at least in part on one or more first models of a machine learning system. The one or more first models are associated with a first accuracy score. The method further includes determining based at least in part on a quality control parameter whether an evaluation of the questions by one or more external entities is required. In response to determining based at least in part on the quality control parameter that an evaluation of the questions by one or more external entities is required, the questions associated with the textual data and the textual data are sent to the one or more external entities for evaluation.Type: GrantFiled: September 12, 2022Date of Patent: October 24, 2023Assignee: RELX INC.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Publication number: 20230115352Abstract: System and method for displaying a user interface of an evaluation system configured to evaluate predicted answers generated by a machine learning system. For example, the method includes receiving textual data and a predicted answer to a question associated with a text object. The text object includes a structured data field of the textual data. The predicted answer includes a confidence level. The confidence level is determined by a machine learning system. In response to determining the confidence level being larger than or equal to a predetermined confidence threshold, the predicted answer and a reference is stored in a storage for retrieval and display. The reference indicates a location of the text object in the textual data. In response to determining the confidence level being smaller than the predetermined confidence threshold, the question and the text object associated with the question is displayed.Type: ApplicationFiled: November 1, 2022Publication date: April 13, 2023Applicant: RELX Inc.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Publication number: 20230004840Abstract: In one embodiment, a method for adaptive training of a machine learning system configured to predict answers to questions associated with textual data includes receiving predicted answers to questions associated with textual data. The predicted answers are generated based at least in part on one or more first models of a machine learning system. The one or more first models are associated with a first accuracy score. The method further includes determining based at least in part on a quality control parameter whether an evaluation of the questions by one or more external entities is required. In response to determining based at least in part on the quality control parameter that an evaluation of the questions by one or more external entities is required, the questions associated with the textual data and the textual data are sent to the one or more external entities for evaluation.Type: ApplicationFiled: September 12, 2022Publication date: January 5, 2023Applicant: RELX Inc.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Patent number: 11520990Abstract: Systems and methods include receiving textual data and a predicted answer to a question associated with a text object. The text object includes a structured data field of the textual data. The predicted answer includes a confidence level. The confidence level is determined by a machine learning system based at least in part on one or more models of the machine learning system and the textual data. In response to determining the confidence level being larger than or equal to a predetermined confidence threshold, the predicted answer and a reference is stored in a storage for retrieval and display. The reference indicates a location of the text object in the textual data. In response to determining the confidence level being smaller than the predetermined confidence threshold, the question and the text object associated with the question is displayed, at the user interface, to a user for inputting a true answer.Type: GrantFiled: April 2, 2020Date of Patent: December 6, 2022Assignee: RELX INC.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Patent number: 11475329Abstract: System and method for adaptive training of a machine learning system processing textual data. For example, a method for adaptive training of a machine learning system configured to predict answers to questions associated with textual data includes receiving predicted answers to questions associated with textual data. The predicted answers are generated based at least in part on one or more first models of a machine learning system. The one or more first models are associated with a first accuracy score. The method further includes determining based at least in part on a quality control parameter whether an evaluation of the questions by one or more external entities is required. In response to determining based at least in part on the quality control parameter that an evaluation of the questions by one or more external entities is required, the questions associated with the textual data and the textual data are sent to the one or more external entities for evaluation.Type: GrantFiled: April 2, 2020Date of Patent: October 18, 2022Assignee: RELX INC.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Patent number: 11222174Abstract: Systems and methods for generating logical documents for a document evaluation system are provided. For example, a method for generating logical documents for a document evaluation system includes receiving a first child document associated with a master document. The master document includes one or more master terms. The first child document includes one or more first child terms and a first date. The method further includes generating a logical document based at least in part on the master document. The logical document includes one or more current document values. Each current document value corresponds to one master term and is associated with a current date and a current reference. The current reference identifies a region in the master document related to the one master term. The method further includes selecting a first child term from the one or more first child terms.Type: GrantFiled: April 2, 2020Date of Patent: January 11, 2022Assignee: RELX INC.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Publication number: 20200320250Abstract: Systems and methods for generating logical documents for a document evaluation system are provided. For example, a method for generating logical documents for a document evaluation system includes receiving a first child document associated with a master document. The master document includes one or more master terms. The first child document includes one or more first child terms and a first date. The method further includes generating a logical document based at least in part on the master document. The logical document includes one or more current document values. Each current document value corresponds to one master term and is associated with a current date and a current reference. The current reference identifies a region in the master document related to the one master term. The method further includes selecting a first child term from the one or more first child terms.Type: ApplicationFiled: April 2, 2020Publication date: October 8, 2020Applicant: RELX Inc.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Publication number: 20200320254Abstract: System and method for dynamically displaying a user interface of an evaluation system configured to evaluate predicted answers generated by a machine learning system. For example, the method includes receiving textual data and a predicted answer to a question associated with a text object. The text object includes a structured data field of the textual data. The predicted answer includes a confidence level. The confidence level is determined by a machine learning system based at least in part on one or more models of the machine learning system and the textual data. In response to determining the confidence level being larger than or equal to a predetermined confidence threshold, the predicted answer and a reference is stored in a storage for retrieval and display. The reference indicates a location of the text object in the textual data.Type: ApplicationFiled: April 2, 2020Publication date: October 8, 2020Applicant: RELX Inc.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu
-
Publication number: 20200320411Abstract: System and method for adaptive training of a machine learning system processing textual data. For example, a method for adaptive training of a machine learning system configured to predict answers to questions associated with textual data includes receiving predicted answers to questions associated with textual data. The predicted answers are generated based at least in part on one or more first models of a machine learning system. The one or more first models are associated with a first accuracy score. The method further includes determining based at least in part on a quality control parameter whether an evaluation of the questions by one or more external entities is required. In response to determining based at least in part on the quality control parameter that an evaluation of the questions by one or more external entities is required, the questions associated with the textual data and the textual data are sent to the one or more external entities for evaluation.Type: ApplicationFiled: April 2, 2020Publication date: October 8, 2020Applicant: RELX Inc.Inventors: Douglas C. Hebenthal, Cesare John Saretto, James Tracy, Richard Clinkenbeard, Christopher Liu