Abstract: A metric, such as a cosine similarity coefficient, is used to determine the degree of similarity between two responses. The assumption is that similar responses contain similar words with similar frequency counts (i.e., word lists). Word lists of the responses are used as a vector to assess the similarity between the word list for each student response and the word lists of responses having known scores. An iterative modeling process called semantic content similarity scoring, implemented by a content scoring module, augments differences among the various score-point responses by extending word lists to include, for example, synonyms of key words, key phrases (two or more words), key rubric scoring rule components, likelihood that a response would be given a specific score by a human rater. The word lists are also augmented by removing stop words.

Abstract: A computerized system for efficiently transforming educational materials composed of questions and answers into an on-line computer interactive form is provided. Computer readable images of pages of textual and/or graphical material are created by, for example, optical scanning of paper and pencil test sheets. The captured images are modified by the application of answer formats, examples of which include underlining, highlighting, circling a correct answer, and the like. The modified captured images are stored on, for example, computer disks for distribution to users. When the disks are used, answer formats are automatically applied to the questions thus allowing them to be answered in a computer interactive form.

Abstract: Computerized systems for optically scanning "bubble" sheet responses to test questions and then electronically scoring and reporting test results are provided. The systems employ templates which contain (a) computer readable images of the test questions and (b) overlay records which contain (i) the coordinates of icons representing the possible answers to the questions and (ii) an identification of the correct answers. The templates are merged with the scanned "bubble" sheet responses and the results displayed on a video monitor as if the test had been administered on a computer, rather than through the use of a "bubble" sheet. The templates minimize the amount of computer storage space required to produce the video display of the test results.

Abstract: A system for making computer software consumable is provided. The software comprises a set of units, each of the units being an interactive activity between the program and the user which can be separately completed from the interactive activities of the other units in the set. The completion of units is monitored by means of a copy-protected region of a recording medium and when all units have been completed, further access to the software is denied. Among the applications for the system are academic tests composed of different subject categories, games having different levels of difficulty, and workbooks having different tasks to be performed.