Abstract: A system and method for testing computing devices is provided. A method for testing computing devices includes providing a suite of test programs on a server for execution by a computing device that is coupled to the server. A test console coupled to the server is used to initiate execution of the tests on the computing device. The server facilitates and coordinates testing between the test console and the computing device. The server provides the test console with results of the tests.

Abstract: A mechanism has been developed for transforming different test suites, written for different test harnesses, into a common XML-type format that can be read by one test harness. Thus differences in the structure of the test suites is transparent to the test harness. To implement this mechanism, a component has been developed that parses XML descriptors and provides an API to the test harness.

Abstract: A test execution system has a central repository that contains a management unit, available test suites and a single test execution harness. Using the management unit, a system administrator establishes active versions of the various test suites, and their individual configurations. End users install clients of the central repository, using a system-provided installer program. In the client, an execution script is created, which downloads the harness and a local configuration file. Then, when the harness is executed at the client, it loads with all designated test suites already installed, configured and ready for execution. The client always has the most current versions of all test suites. All necessary information is obtained from a single central location.

Abstract: A system and method for testing computing devices is provided. A method for testing computing devices includes providing a suite of test programs on a server for execution by a computing device that is coupled to the server. A test console coupled to the server is used to initiate execution of the tests on the computing device. The server facilitates and coordinates testing between the test console and the computing device. The server provides the test console with results of the tests.

Abstract: In an arrangement for testing multiple low-end computing devices simultaneously, different tests are executed simultaneously on different platforms using a single instance of a test harness to which multiple devices are connected. A platform-specific API is provided for independent components of the tests and platform-specific components are implemented for each test according to the respective platform-specific API. At run-time the test harness deploys each test together with a platform-specific execution agent, configured according to the components of the test. The agents execute the test suites, and return test results to the test harness.

Abstract: Methods and systems for administratively qualifying and disqualifying test programs of a suite as excludable from performance by a client are disclosed in conjunction with a test framework. Using a graphical user interface that represents the suite as a hierarchy or tree, an administrator is able to select test programs or entire divisions of a tree in order to disqualify these elements from exclusion by clients. The results of the operation are compactly stored in a table of excludable records, as pointers to a node of the tree, rather than individual elements of the subtree headed by the node. Using the same graphical user interface, the client is allowed to see only those elements of the tree that have not been disqualified by the administrator. The client can select visible elements of the tree to prevent one or more test programs of the suite from being executed.

Abstract: In an arrangement for testing multiple low-end computing devices simultaneously, different tests are executed simultaneously on different platforms using a single instance of a test harness to which multiple devices are connected. A platform-specific API is provided for independent components of the tests and platform-specific components are implemented for each test according to the respective platform-specific API. At run-time the test harness deploys each test together with a platform-specific execution agent, configured according to the components of the test. The agents execute the test suites, and return test results to the test harness.

Abstract: A mechanism has been developed for transforming different test suites, written for different test harnesses, into a common XML-type format that can be read by one test harness. Thus differences in the structure of the test suites is transparent to the test harness. To implement this mechanism, a component has been developed that parses XML descriptors and provides an API to the test harness.

Abstract: A test execution system has a central repository that contains a management unit, available test suites and a single test execution harness. Using the management unit, a system administrator establishes active versions of the various test suites, and their individual configurations. End users install clients of the central repository, using a system-provided installer program. In the client, an execution script is created, which downloads the harness and a local configuration file. Then, when the harness is executed at the client, it loads with all designated test suites already installed, configured and ready for execution. The client always has the most current versions of all test suites. All necessary information is obtained from a single central location.