Abstract: A system and method for automated assessment of constrained constructed responses provides for automatic, e.g., programmatic, assessing of a test subject response to a constrained constructed response item or question. In one embodiment, paper test materials with test subject markings thereon are converted to electronic form. Test subject markings are further isolated, for example, by registration, sizing and removal of markings other than a graphic response. The subject markings are further compared with a baseline response, correctness deviation criteria and incorrectness deviation criteria (e.g., correctness, incorrectness, substantial correctness, substantial incorrectness, and so on) from which one or more of a score, further learning or other assessment results may be determined. Cluster analysis or other post-evaluation or post-assessment processing may also be conducted, or re-evaluation or re-assessment may also be conducted.

Abstract: Aspects of the present invention provide a system that supports (1) the development and administration of instructional materials and/or programs, (2) the development, administration, scoring, and reporting of assessment materials and/or programs, and/or (3) the integration of instruction with assessment materials and/or programs. The system achieves this by organizing the content in these materials and programs into learning targets and ordering the learning targets to reflect the pre-cursor/post-cursor relationships among the learning targets.

Abstract: The methodology of the present invention is implemented by a system which defines concepts about which a respondent is required to demonstrate knowledge of a relationship. The concepts are represented by respondent-manipulable devices that are uniquely associated with the concepts, and the respondent is able to manipulate attributes of the devices to create an arrangement of the devices representative of the respondent's understanding of the relationship of the concepts with which the devices are associated. The attributes of the manipulated devices are recorded and converted into a response pattern based on the cognitive relationships of the devices as manipulated by the respondent. One or more predefined rubric patterns are associated with the constructed response item and define possible cognitive patterns of the concepts as represented by the devices. The response pattern is compared to the rubric pattern to identify matches between the response pattern and the rubric pattern.

Abstract: The present invention relates to, among other things, the interactive reporting of student progress using learning maps.

Abstract: An embodiment of the invention provides a system and method for creating a learning map, which is a device for expressing hypothesized learning target dependencies within any domain of knowledge of skill acquisition. The system and method are also able to utilize multiple data types and sources to assess whether the learning target dependencies expressed by a learning map are accurate and are configured to modify the learning map as necessary so that the learning map conforms to the reality of how students learn.

Abstract: A system and method for improved cumulative assessment provide for automatically, e.g., programmatically, determining an evaluation of two or more assessments including two or more related items in a cumulative manner. In one embodiment, an initial assessment including initial assessment items is administered at time T1 and scored to produce an ability estimate. At least one successive assessment is also administered and scored to produce an ability estimate. Selected ones of the administered assessments or included items are determined (“included assessments”), and the included assessments are scored to produce a simultaneous maximum likelihood ability estimate for the included assessments, for example, in view of all of the included assessments.

Abstract: A system and method for automated assessment of constrained constructed responses provides for automatic, e.g., programmatic, assessing of a test subject response to a constrained constructed response item or question. In one embodiment, paper test materials with test subject markings thereon are converted to electronic form. Test subject markings are further isolated, for example, by registration, sizing and removal of markings other than a graphic response. The subject markings are further compared with a baseline response, correctness deviation criteria and incorrectness deviation criteria (e.g., correctness, incorrectness, substantial correctness, substantial incorrectness, and so on) from which one or more of a score, further learning or other assessment results may be determined. Cluster analysis or other post-evaluation or post-assessment processing may also be conducted, or re-evaluation or re-assessment may also be conducted.

Abstract: The methodology of the present invention is implemented by a system which defines concepts about which a respondent is required to demonstrate knowledge of a relationship. The concepts are represented by respondent-manipulable devices that are uniquely associated with the concepts, and the respondent is able to manipulate attributes of the devices to create an arrangement of the devices representative of the respondent's understanding of the relationship of the concepts with which the devices are associated. The attributes of the manipulated devices are recorded and converted into a response pattern based on the cognitive relationships of the devices as manipulated by the respondent. One or more predefined rubric patterns are associated with the constructed response item and define possible cognitive patterns of the concepts as represented by the devices. The response pattern is compared to the rubric pattern to identify matches between the response pattern and the rubric pattern.

Abstract: In a method and system to extract data from handwritten information when the information is captured as sequences of strokes, vectors, or marks, temporal data is stored within the color or gray-scale encoding of pixel values within a bitmapped image. A bitmapped image is used to create a derived image suitable for data extraction and a method of analyzing the image, including the encoded temporal data, to yield an adjusted image that better reflects the intent of the person who created the handwriting. While the primary application of the invention is in processing handwritten responses to assessment items, the system and method can be advantageously used to extract data from or to improve the presentation of information from an electronic representation of temporal human marks in many applications. Additionally, the system and method can be advantageously used to store and process other types of data within a bitmapped image.

Abstract: The methodology of the present invention is implemented by a system which defines concepts about which a respondent is required to demonstrate knowledge of a relationship. The concepts are represented by respondent- manipulable devices that are uniquely associated with the concepts, and the respondent is able to manipulate attributes of the devices to create an arrangement of the devices representative of the respondent's understanding of the relationship of the concepts with which the devices are associated. The attributes of the manipulated devices are recorded and converted into a response pattern based on the cognitive relationships of the devices as manipulated by the respondent. One or more predefined rubric patterns are associated with the constructed response item and define possible cognitive patterns of the concepts as represented by the devices. The response pattern is compared to the rubric pattern to identify matches between the response pattern and the rubric pattern.

Abstract: The present invention provides a system and methodology for overcoming the shortcomings of traditional pen and paper assessment administration while taking advantage of the benefits offered by computer technology in a manner that is fair to all respondents, regardless of their individual computer proficiencies. Hand written item responses are made by a writing instrument that creates a digital electronic record of the hand written response. The digital electronic record can then be stored, transmitted electronically, and evaluated.

Abstract: A system and method for administering adaptive tests employs computer technology for item storage, response storage and scoring, and item selection, but permits examinees to write item responses on paper response sheets. The handwritten responses are electronically captured so as to create electronic data corresponding to the response. The electronic data can thereafter be electronically processed, e.g., stored, sorted, transmitted, displayed, scored, etc.