Abstract: A computer system and method may include a processor instantiating a test scenario that includes a description of a stem that defines a context and at least one task to be performed in accordance with the context and via interaction with at least one target application; providing an interface to an instance of the at least one target application for the interaction; executing one or more stored evaluation queries to check a status of the instance of the at least one target application and record one or more binary values based on the status; and executing one or more stored scoring expressions to generate and output a score, the scoring expression defining a function having input parameters that are based on the one or more binary values. The processor may further provide an authoring environment in which to define the test scenario, evaluation queries, and scoring expressions.