Abstract: A computerized method and system for creating test items by generating variants from a test item model, comprising the steps of creating a new test item model by identifying elements of an initial test item or test item model to be variabilized, variabilizing the elements thereby creating test item variables, indicating values the variables can assume, defining the variables, and generating test item variants utilizing a simultaneous constraint solver. The initial test item can be a pre-existing test item or test item model, a newly created test item or even a conceptual template in the mind of the test item creator. The generated test item variants are displayed to the test item creator. The test item creator can store and forward acceptable test item variants for later use as test items. Test item models can be stored for later use in generating new test item variants.

Abstract: Disclosed is a method and system for administering to a student a problem in computer science for testing, analysis and feedback. The student is provided with an item pool of predetermined test problems to be selected by the student. The student inputs a solution in response to the problem selected, and the solution program is converted, by lexing and parsing, into an abstract syntax tree representation. Predetermined knowledge base patterns are selected from a knowledge base and compared against portions of the abstract syntax tree. Messages and a score are provided to the student which indicate the correctness or incorrectness of the solution program, as determined by the knowledge base patterns which were matched against the portions of the abstract syntax tree. The present method and system is especially qualified to analyze free-response test items.