Abstract: A computerized method and system for creating test items by generating variants from a test item model, comprising the steps of creating a new test item model by identifying elements of an initial test item or test item model to be variabilized, variabilizing the elements thereby creating test item variables, indicating values the variables can assume, defining the variables, and generating test item variants utilizing a simultaneous constraint solver. The initial test item can be a pre-existing test item or test item model, a newly created test item or even a conceptual template in the mind of the test item creator. The generated test item variants are displayed to the test item creator. The test item creator can store and forward acceptable test item variants for later use as test items. Test item models can be stored for later use in generating new test item variants.

Abstract: The invention generally concerns a method of generating a real number score for a response, such as a written essay response. The method comprises providing a scoring model having one or more concepts; determining for each concept a probability that the concept is present in the response; creating a scoring rule or scoring rule function; determining an expected value function for the scoring rule; and generating a real number score for the response based on the scoring rule, the expected value function, and the probabilities that the concepts are present in the response (or a combination thereof). The real number score for the response may then be displayed or output, for instance, where the method is implemented as a computer system or application. Concept-based scoring provides improved scoring accuracy and individualized feedback for students and reports for teachers and parents.