Abstract: A testing technique and apparatus are described for apply a test to a System Under Test (SUT) in one or more configurations of the SUT. The test can generate and store multiple output results that capture the behavior of the SUT in performing the test. Policy analysis logic applies a policy to the output results to generate an output verdict that reaches some conclusion regarding the outcome of the test. That is, the applied policy maps a subset of stored output results (and possibly input parameters) into the output verdict based on specified rules. A tester can apply different policies to investigate different aspects of the SUT's behavior.

Abstract: A method of testing an application program for multiple interfaces includes identifying one or more APIs that are common among the multiple interfaces. A test program for testing the application program at least with respect to the common API can be designed around the identified, common API. One or more values, such as a value and/or the value's isomorphisms, can be input into the test program so that a robust determination can be inferred from the output of the application program. The test program can be reconfigured easily for different APIs, thereby significantly minimizing the amount of testing that needs to be done, as well as the number of test programs that need to be written for an application program that can be accessed through multiple interfaces.

Abstract: Example embodiments provide methods, systems, and computer program products for controlling the amount of verification—i.e., the amount of checking or testing—done in determining the success or failure of software under test. Tunable test cases include software testing instructions organized as verification levels within a verification hierarchy. The verification levels define different amounts of checking to perform in determining if the software functions as intended. Each test case may be set to any verification level. Verification settings define the desired verification level and those software testing instructions which correspond to the desired verification levels are identified and run. The amount of testing that is external to the test case may be varied through test case groupings that are also set to desired verification levels.

Abstract: A testing technique and apparatus are described for apply a test to a System Under Test (SUT) in one or more configurations of the SUT. The test can generate and store multiple output results that capture the behavior of the SUT in performing the test. Policy analysis logic applies a policy to the output results to generate an output verdict that reaches some conclusion regarding the outcome of the test. That is, the applied policy maps a subset of stored output results (and possibly input parameters) into the output verdict based on specified rules. A tester can apply different policies to investigate different aspects of the SUT's behavior.