Abstract: Computing environments, each executing at least one software program, are monitored for failures occurring during execution of the software program. Information associated with the failure, such as an identification of the software program and a failure type describing the failure, is recorded. The failure information is quantified to report the number of times the software program has failed or the number of times a particular failure has occurred. The quantified data may provide help in prioritizing what program or what failures merit investigation and resolution. Reports may be received from failing computing systems stopped at a state following the occurrence of the failure. In response, hold information is checked to determine whether to instruct the failing computing system to hold a state existing upon the occurrence of the failure.

Abstract: Software automation testing and validation are provided according to a system that runs automation tests using multiple lab machines and allows the testing to be performed before checking in the code to a version control system. Code changes in a build of the software are provided on a computing device. Automation tests are selected from a list of available tests. When indicated by a job queue, the changed code of the build is forwarded to lab machines allocated by an automation system. An image of the build from the computing device is generated on the lab machines and the automation tests are run against the build. A report is generated and forwarded back to one or more recipients that notifies of the success or failure of the automation testing.

Abstract: Computing environments, each executing at least one software program, are monitored for failures occurring during execution of the software program. Information associated with the failure, such as an identification of the software program and a failure type describing the failure, is recorded. The failure information is quantified to report the number of times the software program has failed or the number of times a particular failure has occurred. The quantified data may provide help in prioritizing what program or what failures merit investigation and resolution. Reports may be received from failing computing systems stopped at a state following the occurrence of the failure. In response, hold information is checked to determine whether to instruct the failing computing system to hold a state existing upon the occurrence of the failure.