Abstract: According to an aspect of the present inventive concept there is provided a method for identifying a cause for a failure of a computer-implemented test performed on a latest software code revision in a sequence of a plurality of software code revisions, the method comprising: identifying a first revision of said sequence of revisions for which said test passes and a second revision of said sequence of revisions which is subsequent to the first revision and for which said test fails, determining a first change between the software code of the first revision and the software code of the second revision, generating a first modified version of the software code of the latest revision using the determined first change, determining whether said test passes or fails when performed on the first modified version, in response to determining that said test fails when performed on the first modified version: identifying a third revision and a fourth revision of said sequence which are intermediate the latest revision
Abstract: One embodiment of the present invention provides a technique for automatic diagnosis of regression test failures. Initially, an automatic regression test system provides the test results per configuration for a revision of the device under test. Next, each failing test is analyzed in conjunction with the information in the version control system that is used to manage the device under test in order to conclude what additional revisions that needs to be tested for each test and configuration in order to find the earliest failing revision. Next, a request is issued to the automated regression test system which performs the requested tests and provides back a list of test results. Next, another analysis takes places and if the earliest failing revision cannot be concluded for each failing test and configuration then another request is issues to the automated regression test system. This continues until the earliest failing revision can be concluded for each failing test and configuration.
Abstract: One embodiment of the present invention provides a technique for automatic diagnosis of regression test failures. Initially, an automatic regression test system provides the test results per configuration for a revision of the device under test. Next, each failing test is analyzed in conjunction with the information in the version control system that is used to manage the device under test in order to conclude what additional revisions that needs to be tested for each test and configuration in order to find the earliest failing revision. Next, a request is issued to the automated regression test system which performs the requested tests and provides back a list of test results. Next, another analysis takes places and if the earliest failing revision cannot be concluded for each failing test and configuration then another request is issues to the automated regression test system. This continues until the earliest failing revision can be concluded for each failing test and configuration.