Abstract: The current invention is designed to improve the certainty of test-taker classifications in testing programs utilizing open-ended items. The current invention discloses methods to improve certainty in estimates of test-taker performance for all test-takers while using a minimum of scoring resources. The invention selectively allocates resources to scoring by ceasing to allocate scoring resources to test-takers whose performance has been determined with sufficient certainty, and by having an additional reader or readers score responses from test-takers whose scores are close to cutoff levels. The invention further increases precision of scores for test-takers near a cutoff by selectively allocating more reliable and accurate readers to score responses most likely to influence a test-taker's performance classification. Other scoring resources are also shown.

Abstract: In a method and computer-implemented system of modular instruction a body of knowledge is divided into cognitive constructs, with instructional materials and post-instruction assessments being associated with each of the cognitive constructs and comprising a learning packet. The instructional material associated with each learning packet is presented to a student, followed by the post-instruction assessment associated with each learning packet. A result of the post-instruction assessment is compared to a pre-defined standard for that learning packet to determine whether the instructional material associated with another learning packet should be presented to the student, or if the instructional material associated with the current learning packet should be presented again to the student. The learning packets can be presented in default sequence or they can be reordered and presented in a user-selected sequence, and all or only a portion of the learning packets can be presented to the student.

Abstract: The current invention is designed to improve the certainty of test-taker classifications in testing programs utilizing open-ended items. The current invention discloses methods to improve certainty in estimates of test-taker performance for all test-takers while using a minimum of scoring resources. The invention selectively allocates resources to scoring by ceasing to allocate scoring resources to test-takers whose performance has been determined with sufficient certainty, and by having an additional reader or readers score responses from test-takers whose scores are close to cutoff levels. The invention further increases precision of scores for test-takers near a cutoff by selectively allocating more reliable and accurate readers to score responses most likely to influence a test-taker's performance classification. Other scoring resources are also shown.

Abstract: In a method and computer-implemented system of modular instruction a body of knowledge is divided into cognitive constructs, with instructional materials and post-instruction assessments being associated with each of the cognitive constructs and comprising a learning packet. The instructional material associated with each learning packet is presented to a student, followed by the post-instruction assessment associated with each learning packet. A result of the post-instruction assessment is compared to a pre-defined standard for that learning packet to determine whether the instructional material associated with another learning packet should be presented to the student, or if the instructional material associated with the current learning packet should be presented again to the student. The learning packets can be presented in default sequence or they can be reordered and presented in a user-selected sequence, and all or only a portion of the learning packets can be presented to the student.

Abstract: The current invention is designed to improve the certainty of test-taker classifications in testing programs utilizing open-ended items. The current invention discloses methods to improve certainty in estimates of test-taker performance for all test-takers while using a minimum of scoring resources. The invention selectively allocates resources to scoring by ceasing to allocate scoring resources to test-takers whose performance has been determined with sufficient certainty, and by having an additional reader or readers score responses from test-takers whose scores are close to cutoff levels. The invention further increases precision of scores for test-takers near a cutoff by selectively allocating more reliable and accurate readers to score responses most likely to influence a test-taker's performance classification. Other scoring resources are also shown.

Abstract: A methodology and system for presenting an assessment includes forming short supplemental assessment forms including NRT items, field test items, and anchor equating items from large groups of such items. Different supplemental assessment are incorporated with a common operational form that is administered to all students of a group of students to form an administered form. The administered forms are presented to the group of students in such a manner that different subgroups of students will take an administered form having a different supplemental form embedded therein.

Abstract: A method and system of modular instruction is provided in which a body of knowledge is divided into N cognitive constructs, with instructional materials and post-instruction assessments associated with each of the N cognitive constructs and comprising a learning packet, and in which the N learning packets may be re-ordered by an administrator.