Patents by Inventor Kevin Minerley
Kevin Minerley has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11836060Abstract: Inputs to a system under test (SUT) are modeled as a collection of attribute-value pairs. A set of testcases is executed using an initial set of test vectors that provides complete n-wise coverage of the attribute-value pairs. For each execution of the testcases, for each attribute-value pair, a non-binary success rate (SAV) is computed based on the binary execution results. in response to a success rate of an attribute-value pair being below a predetermined threshold, a subset of testcases that use the attribute-value pair is identified. Further, sets of code paths for the subset of testcases are identified, each set of code path respectively corresponding to a testcase from the subset of testcases. Further, an intersection of the sets of code paths is determined. Code paths of the SUT that are in the intersection, are highlighted to represent a soft failure with the SUT.Type: GrantFiled: October 25, 2021Date of Patent: December 5, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Andrew C. M. Hicks, Kevin Minerley, Dale E. Blue, Ryan Thomas Rawlins, Daniel Nicolas Gisolfi
-
Patent number: 11609842Abstract: A method for testing a system under test (SUT) in an active environment includes receiving, by a testing system, a code path of the SUT that causes a soft failure in the active environment. The soft failure occurs in the active environment during execution of the SUT based at least on a parameter of the active environment. The method further includes generating, by the testing system, multiple tests for testing the SUT, the tests generated based on a coverage model of the SUT, wherein the coverage model uses several attributes. The method further includes selecting, by the testing system, from the generated tests, a set of tests that are associated with the code path. The method further includes executing, by the testing system, only the set of tests that are selected on the SUT to analyze a cause of the soft failure.Type: GrantFiled: March 16, 2020Date of Patent: March 21, 2023Assignee: International Business Machines CorporationInventors: Andrew C. M. Hicks, Ryan Thomas Rawlins, Dale E. Blue, Kevin Minerley
-
Patent number: 11593256Abstract: A method for testing a system under test (SUT) in an active environment includes executing, by the testing system, on the SUT, a test from a set of tests. The method further includes, monitoring a first execution time to complete the test on the SUT in the active environment. Based on the first execution time being different than a second execution time of the test, marking, by the testing system, a code path associated with the test. The second execution time is a duration to complete execution of the test on the SUT in a clean execution environment. The method further includes communicating, by the testing system, the code path for analyzing a soft failure of the SUT in the active environment, wherein the soft failure occurs in the active environment during execution of the SUT based at least on a parameter of the active environment.Type: GrantFiled: March 16, 2020Date of Patent: February 28, 2023Assignee: International Business Machines CorporationInventors: Andrew C. M. Hicks, Ryan Thomas Rawlins, Dale E. Blue, Kevin Minerley
-
Patent number: 11379352Abstract: Inputs to a system under test (SUT) are modeled as a collection of attribute-value pairs. A set of testcases is executed using an initial set of test vectors that provides complete n-wise coverage of the attribute-value pairs. For each execution of the testcases, for each attribute-value pair, a non-binary success rate (SAV) is computed based on the binary execution results. The method further includes outputting, to a user, in response to the success rate SAV of the attribute-value pair being below a predetermined threshold, an identification of one or more testcases that use the attribute-value pair, wherein the one or more testcases are to be used for diagnosing a soft failure associated with the SUT.Type: GrantFiled: December 15, 2020Date of Patent: July 5, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Andrew C. M. Hicks, Kevin Minerley, Dale E. Blue, Ryan Thomas Rawlins, Daniel Nicolas Gisolfi
-
Publication number: 20220188219Abstract: Inputs to a system under test (SUT) are modeled as a collection of attribute-value pairs. A set of testcases is executed using an initial set of test vectors that provides complete n-wise coverage of the attribute-value pairs. For each execution of the testcases, for each attribute-value pair, a non-binary success rate (SAV) is computed based on the binary execution results. The method further includes outputting, to a user, in response to the success rate SAV of the attribute-value pair being below a predetermined threshold, an identification of one or more testcases that use the attribute-value pair, wherein the one or more testcases are to be used for diagnosing a soft failure associated with the SUT.Type: ApplicationFiled: December 15, 2020Publication date: June 16, 2022Inventors: Andrew C. M. Hicks, Kevin Minerley, Dale E. Blue, RYAN THOMAS RAWLINS, Daniel Nicolas Gisolfi
-
Publication number: 20220188205Abstract: Inputs to a system under test (SUT) are modeled as a collection of attribute-value pairs. A set of testcases is executed using an initial set of test vectors that provides complete n-wise coverage of the attribute-value pairs. For each execution of the testcases, for each attribute-value pair, a non-binary success rate (SAV) is computed based on the binary execution results. in response to a success rate of an attribute-value pair being below a predetermined threshold, a subset of testcases that use the attribute-value pair is identified. Further, sets of code paths for the subset of testcases are identified, each set of code path respectively corresponding to a testcase from the subset of testcases. Further, an intersection of the sets of code paths is determined. Code paths of the SUT that are in the intersection, are highlighted to represent a soft failure with the SUT.Type: ApplicationFiled: October 25, 2021Publication date: June 16, 2022Inventors: Andrew C. M. Hicks, Kevin Minerley, Dale E. Blue, Ryan Thomas Rawlins, Daniel Nicolas Gisolfi
-
Patent number: 11204848Abstract: Inputs to a system under test (SUT) are modeled as a collection of attribute-value pairs. A set of testcases is executed using an initial set of test vectors that provides complete n-wise coverage of the attribute-value pairs. For each execution of the testcases, for each attribute-value pair, a non-binary success rate (SAV) is computed based on the binary execution results. in response to a success rate of an attribute-value pair being below a predetermined threshold, a subset of testcases that use the attribute-value pair is identified. Further, sets of code paths for the subset of testcases are identified, each set of code path respectively corresponding to a testcase from the subset of testcases. Further, an intersection of the sets of code paths is determined. Code paths of the SUT that are in the intersection, are highlighted to represent a soft failure with the SUT.Type: GrantFiled: December 15, 2020Date of Patent: December 21, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Andrew C. M. Hicks, Kevin Minerley, Dale E. Blue, Ryan Thomas Rawlins, Daniel Nicolas Gisolfi
-
Patent number: 11188453Abstract: A system and related method comprise using a processor for executing a plurality of tests associated with a covering array of a test framework of the software test system on a first version of a system under test (SUT). For each of the plurality of tests, on a current test, the method comprises determining a current success rate value (SRV) for the current test that represents a success rate of the current test for the first version of the SUT. The method further comprises combining the current SRV of the first version of the SUT and current SRVs of the current test for prior versions of the SUT into a current test eigenvector associated with the current test. The method further comprises converting the current test eigenvector into a first eigenvalue that represents a health, accuracy, and quality of the first version of the SUT.Type: GrantFiled: December 15, 2020Date of Patent: November 30, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Andrew C. M. Hicks, Kevin Minerley, Dale E. Blue, Ryan Thomas Rawlins, Daniel Nicolas Gisolfi
-
Patent number: 11132273Abstract: Inputs to a system under test (SUT) are modeled as a collection of attribute-value pairs. A set of testcases is executed using an initial set of test vectors that provides complete n-wise coverage of the attribute-value pairs. For each execution of the testcases, for each attribute-value pair, a non-binary success rate (SAV) is computed based on the binary execution results. An attribute is selected in response to a set of success rates corresponding to a set of attribute-value pairs that includes said attribute are all below a predetermined threshold. The set of testcases is executed using another set of test vectors using additional values for the selected attribute. For each execution of the set of testcases, for each attribute-value pair, a second non-binary success rate (SAV?) is recorded. If the predetermined threshold is now satisfied, a user is notified of the additional values for the attribute that were detected.Type: GrantFiled: December 15, 2020Date of Patent: September 28, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Andrew C. M. Hicks, Kevin Minerley, Dale E. Blue, Ryan Thomas Rawlins, Daniel Nicolas Gisolfi
-
Publication number: 20210286711Abstract: A method for testing a system under test (SUT) in an active environment includes receiving, by a testing system, a code path of the SUT that causes a soft failure in the active environment. The soft failure occurs in the active environment during execution of the SUT based at least on a parameter of the active environment. The method further includes generating, by the testing system, multiple tests for testing the SUT, the tests generated based on a coverage model of the SUT, wherein the coverage model uses several attributes. The method further includes selecting, by the testing system, from the generated tests, a set of tests that are associated with the code path. The method further includes executing, by the testing system, only the set of tests that are selected on the SUT to analyze a cause of the soft failure.Type: ApplicationFiled: March 16, 2020Publication date: September 16, 2021Inventors: Andrew C. M. Hicks, RYAN THOMAS RAWLINS, Dale E. Blue, Kevin Minerley
-
Publication number: 20210286712Abstract: A method for testing a system under test (SUT) in an active environment includes executing, by the testing system, on the SUT, a test from a set of tests. The method further includes, monitoring a first execution time to complete the test on the SUT in the active environment. Based on the first execution time being different than a second execution time of the test, marking, by the testing system, a code path associated with the test. The second execution time is a duration to complete execution of the test on the SUT in a clean execution environment. The method further includes communicating, by the testing system, the code path for analyzing a soft failure of the SUT in the active environment, wherein the soft failure occurs in the active environment during execution of the SUT based at least on a parameter of the active environment.Type: ApplicationFiled: March 16, 2020Publication date: September 16, 2021Inventors: Andrew C. M. Hicks, RYAN THOMAS RAWLINS, Dale E. Blue, Kevin Minerley
-
Publication number: 20070106644Abstract: The present invention concerns methods and apparatus for analyzing product descriptions and comment databases, and for correlating product descriptions with comment databases. In methods and apparatus of the present invention general categories of product descriptions or user comments are identified. In instances where product descriptions or user comments are subject to highly differentiable grammatical expression, several or more possible grammatical expressions are identified, or formulated. Grammatical information derived from an expression, or multiple expressions, of a comment are then used to search a comment database or product description to locate similar comments reflected in the comment database, or concerns reflected in the product description. Once similar comments or concerns are identified, the methods and apparatus of the present invention can perform various correlations.Type: ApplicationFiled: November 8, 2005Publication date: May 10, 2007Inventor: Kevin Minerley
-
Publication number: 20070005535Abstract: An off-line knowledge acquisition process takes IT resource messages, in CBE format generated natively or using generic log adapter, and use a variety of mining techniques and technologies to automatically generate a set of rules used to provide situation categories for the resource messages/events. The off-line knowledge acquisition process also generates an event-to-situation mapping file for efficiently mapping situation to events in runtime. Rules are fed back into a knowledge repository and process for reuse. The off-line knowledge acquisition process also provides methods to reiterate the process of mining (autonomically and/or by human interaction) to improve the rules and confidence level assigning the situation categories. A runtime categorizer component uses the event-to-situation mapping file, when available from the off-line knowledge acquisition process, to add situation categories to the IT resource events.Type: ApplicationFiled: April 27, 2005Publication date: January 4, 2007Inventors: Abdolreza Salahshour, Ma Sheng, David Loewenstern, Kevin Minerley
-
Publication number: 20060085297Abstract: Customer interaction with inventory via radio frequency identification (RFID) are disclosed, where a unique RFID is combined into ID cards, credit, debit, and smartcards. The current inventory RFID technology and RFID reader are moved into a place convenient to the end-user or customer to remove the need for cashiers. Some applications include point-of-sale terminals, libraries, tool cribs, and places where customers or end-users remove items from inventories and inventories need to be monitored.Type: ApplicationFiled: October 14, 2004Publication date: April 20, 2006Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventor: Kevin Minerley
-
Publication number: 20030088858Abstract: A method for matching customer requirements communicated from a customer to a corresponding software design is disclosed. In an exemplary embodiment of the invention, the method includes gathering the customer requirements communicated from the customer and generating a machine-readable transcript of the customer requirements. A lexical analysis is run of the machine-readable transcript, thereby generating an output including one or more diagrammed sentences. The output of the lexical analysis is then mapped into object-oriented constructs. A high-level language design from an output of said mapping is then created.Type: ApplicationFiled: November 7, 2001Publication date: May 8, 2003Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventor: Kevin Minerley