Abstract: In accordance with the present invention, the above and other problems are solved by an integrated test framework that can receive measurement commands from a test script, automatically configure and execute any performance metrics required to effectuate the measurements and further manage the operation of the software to be tested. The integrated test framework can interpret script commands directed at any testing tool in a testing tool library accessible to the framework. Furthermore, the integrated test framework can identify and utilize code markers during the testing of software applications that utilize embedded code markers as well as identifying script markers. Thus, the integrated framework allows testing scenarios to be created incorporating both code markers and script markers to control performance testing of the executing software application.

Abstract: A method, apparatus, and article of manufacture provide a mechanism for inserting performance code markers into programs to obtain and provide data regarding the run-time operation of the programs. The computing system has an init module, a performance code marker module for obtaining and storing the run-time internal state data for later retrieval, and an uninit module. The init module is executed before any run-time internal state data is collected. The performance code marker module is executed each time run-time internal state data is to be collected. The uninit module is executed after all run-time internal state data desired has been collected.

Abstract: A method, apparatus, and article of manufacture provide a mechanism for inserting performance markers into programs to obtain and provide data regarding the run-time benchmark timing of the programs. The computing system has an init module for determining if the benchmark timing data is to be collected during the operation of the application program, a performance marker module for obtaining and storing the benchmark timing data for later retrieval, and an uninit module for formatting and storing the obtained benchmark timing data into memory that permits retrieval after the termination of the application program. The init module is executed before any benchmark timing data is collected. The performance marker module is executed each time benchmark timing data is to be collected. The uninit module is executed after all benchmark timing data desired has been collected.

Abstract: A method, apparatus, and article of manufacture provide a mechanism for inserting performance markers into programs to obtain and provide data regarding the run-time benchmark timing of the programs. The computing system has an init module for determining if the benchmark timing data is to be collected during the operation of the application program, a performance marker module for obtaining and storing the benchmark timing data for later retrieval, and an uninit module for formatting and storing the obtained benchmark timing data into memory that permits retrieval after the termination of the application program. The init module is executed before any benchmark timing data is collected. The performance marker module is executed each time benchmark timing data is to be collected. The uninit module is executed after all benchmark timing data desired has been collected.