Patents by Inventor Anna M. Chaney

Anna M. Chaney has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Automatically assessing question answering system performance across possible confidence values
    Patent number: 10628749
    Abstract: A mechanism is provided in a data processing system for assessing question answering system performance. The mechanism receives question answering system results. The question answering system results comprise questions posed to the question answering system, answers returned by the question answering system for each question posed to the question answering system, and a confidence value for each answer. The question answering system is trained or tested using the ground truth questions and answers. The mechanism performs a matching operation comparing each question in the question answering system results to questions in the ground truth. A given question is determined to be on-topic or off-topic based on results of the matching operation. For a plurality of confidence threshold values, the mechanism determines a rightness or wrongness of each answer in the question answering system results.
    Type: Grant
    Filed: November 17, 2015
    Date of Patent: April 21, 2020
    Assignee: International Business Machines Corporation
    Inventors: Alexander M. Block, Anna M. Chaney, Stefan A. Van Der Stockt, Kai G. H. Young
  • Automated similarity comparison of model answers versus question answering system output
    Patent number: 10282678
    Abstract: A mechanism is provided in a data processing system for comparing similarity of questioning answer system ground truth answers to question answering system result answers. The mechanism receives question answering system results. The question answering system results comprise questions posed to the question answering system, answers returned by the question answering system for each question posed to the question answering system, and a confidence value for each answer. The question answering system is trained or tested using the ground truth questions and answers. The mechanism performs a matching operation comparing each result answer in the question answering system results to a corresponding ground truth answer. The matching operation is an asymmetric containment comparison and wherein the matching operation determines similarity of each result answer to the corresponding ground truth answer. The mechanism determines whether each result answer is right or wrong based on results of the matching operation.
    Type: Grant
    Filed: November 18, 2015
    Date of Patent: May 7, 2019
    Assignee: International Business Machines Corporation
    Inventors: Alexander M. Block, Anna M. Chaney, Stefan A. Van Der Stockt, Kai G. H. Young
  • Automated Similarity Comparison of Model Answers Versus Question Answering System Output
    Publication number: 20170140290
    Abstract: A mechanism is provided in a data processing system for comparing similarity of questioning answer system ground truth answers to question answering system result answers. The mechanism receives question answering system results. The question answering system results comprise questions posed to the question answering system, answers returned by the question answering system for each question posed to the question answering system, and a confidence value for each answer. The question answering system is trained or tested using the ground truth questions and answers. The mechanism performs a matching operation comparing each result answer in the question answering system results to a corresponding ground truth answer. The matching operation is an asymmetric containment comparison and wherein the matching operation determines similarity of each result answer to the corresponding ground truth answer. The mechanism determines whether each result answer is right or wrong based on results of the matching operation.
    Type: Application
    Filed: November 18, 2015
    Publication date: May 18, 2017
    Inventors: Alexander M. Block, Anna M. Chaney, Stefan A. Van Der Stockt, Kai G.H. Young
  • Automatically Assessing Question Answering System Performance Across Possible Confidence Values
    Publication number: 20170140289
    Abstract: A mechanism is provided in a data processing system for assessing question answering system performance. The mechanism receives question answering system results. The question answering system results comprise questions posed to the question answering system, answers returned by the question answering system for each question posed to the question answering system, and a confidence value for each answer. The question answering system is trained or tested using the ground truth questions and answers. The mechanism performs a matching operation comparing each question in the question answering system results to questions in the ground truth. A given question is determined to be on-topic or off-topic based on results of the matching operation. For a plurality of confidence threshold values, the mechanism determines a rightness or wrongness of each answer in the question answering system results.
    Type: Application
    Filed: November 17, 2015
    Publication date: May 18, 2017
    Inventors: Alexander M. Block, Anna M. Chaney, Stefan A. Van Der Stockt, Kai G.H. Young