Patents by Inventor Pamela D. Andrejko
Pamela D. Andrejko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10572547Abstract: A primary ingestion pipeline configured for use in natural language processing includes annotators configured for annotating documents. The annotators and documents to be annotated are evaluated. Based on the evaluations, an ingestion risk score is generated for each document. Each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the annotators. Each ingestion risk score is compared to a set of risk criteria. Based on the comparisons, a determination is made that each document of a first set of documents satisfies the set of risk criteria. A further determination is made, based on the comparisons, that each document of a second set of documents does not satisfy the set of risk criteria. In response to these determinations, the first set of documents is entered into the primary ingestion pipeline and the second set of documents is provided special handling.Type: GrantFiled: January 31, 2019Date of Patent: February 25, 2020Assignee: International Business Machines CorporationInventors: Pamela D. Andrejko, Andrew R. Freed, Cynthia M. Murch, Jan M. Nordland, Humberto R. Rivero
-
Patent number: 10423519Abstract: Mechanisms are provided for evaluating test cases for testing a software product based on a requirements change. The mechanisms analyze a test case corpus to identify a plurality of first relationships between elements of test cases in the test case corpus and generate a test case relationship model based on the identified plurality of first relationships. The mechanisms receive a proposed requirements change to change one or more requirements of the software product and then perform a search of the test case relationship model to identify test case relationships corresponding to the proposed requirements change. The mechanisms identify a subset of test cases affected by the proposed requirements change and generate an output specifying the identified subset of test cases.Type: GrantFiled: December 26, 2017Date of Patent: September 24, 2019Assignee: International Business Machines CorporationInventors: Pamela D. Andrejko, Andrew R. Freed, Richard A. Salmon, Charles S. Skinner
-
Patent number: 10318591Abstract: A primary ingestion pipeline configured for use in natural language processing includes annotators configured for annotating documents. The annotators and documents to be annotated are evaluated. Based on the evaluations, an ingestion risk score is generated for each document. Each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the annotators. Each ingestion risk score is compared to a set of risk criteria. Based on the comparisons, a determination is made that each document of a first set of documents satisfies the set of risk criteria. A further determination is made, based on the comparisons, that each document of a second set of documents does not satisfy the set of risk criteria. In response to these determinations, the first set of documents is entered into the primary ingestion pipeline and the second set of documents is provided special handling.Type: GrantFiled: June 2, 2015Date of Patent: June 11, 2019Assignee: International Business Machines CorporationInventors: Pamela D. Andrejko, Andrew R. Freed, Cynthia M. Murch, Jan M. Nordland, Humberto R. Rivero
-
Publication number: 20190163706Abstract: A primary ingestion pipeline configured for use in natural language processing includes annotators configured for annotating documents. The annotators and documents to be annotated are evaluated. Based on the evaluations, an ingestion risk score is generated for each document. Each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the annotators. Each ingestion risk score is compared to a set of risk criteria. Based on the comparisons, a determination is made that each document of a first set of documents satisfies the set of risk criteria. A further determination is made, based on the comparisons, that each document of a second set of documents does not satisfy the set of risk criteria. In response to these determinations, the first set of documents is entered into the primary ingestion pipeline and the second set of documents is provided special handling.Type: ApplicationFiled: January 31, 2019Publication date: May 30, 2019Inventors: Pamela D. Andrejko, Andrew R. Freed, Cynthia M. Murch, Jan M. Nordland, Humberto R. Rivero
-
Patent number: 10007594Abstract: Mechanisms are provided for evaluating test cases for testing a software product based on a requirements change. The mechanisms analyze a test case corpus to identify a plurality of first relationships between elements of test cases in the test case corpus and generate a test case relationship model based on the identified plurality of first relationships. The mechanisms receive a proposed requirements change to change one or more requirements of the software product and then perform a search of the test case relationship model to identify test case relationships corresponding to the proposed requirements change. The mechanisms identify a subset of test cases affected by the proposed requirements change and generate an output specifying the identified subset of test cases.Type: GrantFiled: July 21, 2015Date of Patent: June 26, 2018Assignee: International Business Machines CorporationInventors: Pamela D. Andrejko, Andrew R. Freed, Richard A. Salmon, Charles S. Skinner
-
Patent number: 9996451Abstract: Mechanisms are provided for evaluating test cases for testing a software product based on a requirements change. The mechanisms analyze a test case corpus to identify a plurality of first relationships between elements of test cases in the test case corpus and generate a test case relationship model based on the identified plurality of first relationships. The mechanisms receive a proposed requirements change to change one or more requirements of the software product and then perform a search of the test case relationship model to identify test case relationships corresponding to the proposed requirements change. The mechanisms identify a subset of test cases affected by the proposed requirements change and generate an output specifying the identified subset of test cases.Type: GrantFiled: September 22, 2015Date of Patent: June 12, 2018Assignee: International Business Machines CorporationInventors: Pamela D. Andrejko, Andrew R. Freed, Richard A. Salmon, Charles S. Skinner
-
Publication number: 20180121332Abstract: Mechanisms are provided for evaluating test cases for testing a software product based on a requirements change. The mechanisms analyze a test case corpus to identify a plurality of first relationships between elements of test cases in the test case corpus and generate a test case relationship model based on the identified plurality of first relationships. The mechanisms receive a proposed requirements change to change one or more requirements of the software product and then perform a search of the test case relationship model to identify test case relationships corresponding to the proposed requirements change. The mechanisms identify a subset of test cases affected by the proposed requirements change and generate an output specifying the identified subset of test cases.Type: ApplicationFiled: December 26, 2017Publication date: May 3, 2018Inventors: Pamela D. Andrejko, Andrew R. Freed, Richard A. Salmon, Charles S. Skinner
-
Patent number: 9606980Abstract: Test cases for a text annotator are generated by determining types of inputs to the annotator and analyzing language structures in a corpus to identify sentence types and grammar constructs. An input type can correspond to multiple grammar constructs. Test cases are generated by performing grammar tree transformations on selected fragments from the corpus based on the sentence types and the grammar constructs. Additional test cases are generated by replacing starting phrases in selected fragments with substitute phrases from dictionaries associated with the input types (a dictionary can include a false synonym for an input type for purposes of negative testing). The two generating approaches can be combined, i.e., performing one or more successive (different) grammar tree transformations to yield a sentence which is then subjected to phrase substitution.Type: GrantFiled: December 16, 2014Date of Patent: March 28, 2017Assignee: International Business Machines CorporationInventors: Pamela D. Andrejko, Andrew R. Freed, Cynthia M. Murch, Robert L. Nielsen, Jan M. Nordland, Humberto R. Rivero
-
Publication number: 20170024311Abstract: Mechanisms are provided for evaluating test cases for testing a software product based on a requirements change. The mechanisms analyze a test case corpus to identify a plurality of first relationships between elements of test cases in the test case corpus and generate a test case relationship model based on the identified plurality of first relationships. The mechanisms receive a proposed requirements change to change one or more requirements of the software product and then perform a search of the test case relationship model to identify test case relationships corresponding to the proposed requirements change. The mechanisms identify a subset of test cases affected by the proposed requirements change and generate an output specifying the identified subset of test cases.Type: ApplicationFiled: September 22, 2015Publication date: January 26, 2017Inventors: Pamela D. Andrejko, Andrew R. Freed, Richard A. Salmon, Charles S. Skinner
-
Publication number: 20170024310Abstract: Mechanisms are provided for evaluating test cases for testing a software product based on a requirements change. The mechanisms analyze a test case corpus to identify a plurality of first relationships between elements of test cases in the test case corpus and generate a test case relationship model based on the identified plurality of first relationships. The mechanisms receive a proposed requirements change to change one or more requirements of the software product and then perform a search of the test case relationship model to identify test case relationships corresponding to the proposed requirements change. The mechanisms identify a subset of test cases affected by the proposed requirements change and generate an output specifying the identified subset of test cases.Type: ApplicationFiled: July 21, 2015Publication date: January 26, 2017Inventors: Pamela D. Andrejko, Andrew R. Freed, Richard A. Salmon, Charles S. Skinner
-
Publication number: 20160359894Abstract: A primary ingestion pipeline configured for use in natural language processing includes annotators configured for annotating documents. The annotators and documents to be annotated are evaluated. Based on the evaluations, an ingestion risk score is generated for each document. Each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the annotators. Each ingestion risk score is compared to a set of risk criteria. Based on the comparisons, a determination is made that each document of a first set of documents satisfies the set of risk criteria. A further determination is made, based on the comparisons, that each document of a second set of documents does not satisfy the set of risk criteria. In response to these determinations, the first set of documents is entered into the primary ingestion pipeline and the second set of documents is provided special handling.Type: ApplicationFiled: June 2, 2015Publication date: December 8, 2016Inventors: Pamela D. Andrejko, Andrew R. Freed, Cynthia M. Murch, Jan M. Nordland, Humberto R. Rivero
-
Patent number: 9390374Abstract: An approach is provided in which an information handling system analyzes correction information corresponding to an answer generated by a question answer system. The correction information includes a correction to the answer and captured variable information utilized by the question answer system to generate the answer. The information handling system selects input variables based upon the correction analysis and generates a test case that includes the selected input variables and the variable information. In turn, the information handling system tests the question answer system using the generated test case.Type: GrantFiled: December 10, 2014Date of Patent: July 12, 2016Assignee: International Business Machines CorporationInventors: Pamela D. Andrejko, Andrew R. Freed, Cynthia M. Murch, Richard A. Salmon, Charles S. Skinner
-
Publication number: 20160171371Abstract: An approach is provided in which an information handling system analyzes correction information corresponding to an answer generated by a question answer system. The correction information includes a correction to the answer and captured variable information utilized by the question answer system to generate the answer. The information handling system selects input variables based upon the correction analysis and generates a test case that includes the selected input variables and the variable information. In turn, the information handling system tests the question answer system using the generated test case.Type: ApplicationFiled: December 10, 2014Publication date: June 16, 2016Inventors: Pamela D. Andrejko, Andrew R. Freed, Cynthia M. Murch, Richard A. Salmon, Charles S. Skinner
-
Publication number: 20160170972Abstract: Test cases for a text annotator are generated by determining types of inputs to the annotator and analyzing language structures in a corpus to identify sentence types and grammar constructs. An input type can correspond to multiple grammar constructs. Test cases are generated by performing grammar tree transformations on selected fragments from the corpus based on the sentence types and the grammar constructs. Additional test cases are generated by replacing starting phrases in selected fragments with substitute phrases from dictionaries associated with the input types (a dictionary can include a false synonym for an input type for purposes of negative testing). The two generating approaches can be combined, i.e., performing one or more successive (different) grammar tree transformations to yield a sentence which is then subjected to phrase substitution.Type: ApplicationFiled: December 16, 2014Publication date: June 16, 2016Inventors: Pamela D. Andrejko, Andrew R. Freed, Cynthia M. Murch, Robert L. Nielsen, Jan M. Nordland, Humberto R. Rivero