Abstract: Systems and methods are provided for assigning an examinee to one of a plurality of scoring levels based on an adaptive exam that generates one or more questions of the exam subsequent to the start of administration of the exam to the examinee. A first exam question is provided to the examinee and a first exam answer is received from the examinee. The first exam question requests a constructed response from the examinee. A score for the first exam answer is generated, and a second exam question is generated, where the difficulty of the second exam question is based on the score for the first exam answer. The examinee is assigned to one of a plurality of scoring levels, where the examinee is excluded from assignment to one or more of the plurality of scoring levels based on the first exam answer without consideration of the second exam answer.

Abstract: The present invention provides systems and methods for controlled presentation of constructed responses through a variety of computer applications to human evaluators for assessment. The systems and methods further provide for controlled presentation of the constructed responses to minimize the influences of psychometric factors on the accuracy of the human evaluators' assessments and to maximize the ability to efficiently generate data for use in analyzing the accuracy of the human evaluators' assessments and the difficulty of the constructed response categories or questions. The systems and methods of the present invention utilize a storage means which relationally stores data regarding the human evaluators, the constructed responses, the scores awarded and the computer applications to utilize.

Abstract: The present invention provides systems and methods for controlled presentation of constructed responses through a variety of computer applications to human evaluators for assessment. The systems and methods further provide for controlled presentation of the constructed responses to minimize the influences of psychometric factors on the accuracy of the human evaluators' assessments and to maximize the ability to efficiently generate data for use in analyzing the accuracy of the human evaluators' assessments and the difficulty of the constructed response categories or questions. The systems and methods of the present invention utilize a storage means which relationally stores data regarding the human evaluators, the constructed responses, the scores awarded and the computer applications to utilize.

Abstract: The present invention provide systems and methods for controlled presentation of constructed responses through a variety of computer applications to human evaluators for assessment. The systems and methods further provide for controlled presentation of the constructed responses to minimize the influences of psychometric factors on the accuracy of the human evaluators' assessments and to maximize the ability to efficiently generate data for use in analyzing the accuracy of the human evaluators' assessments and the difficulty of the constructed response categories or questions. The systems and methods of the present invention utilize a storage means which relationally stores data regarding the human evaluators, the constructed responses, the scores awarded and the computer applications to utilize.

Abstract: The present invention relates to computer-based technology in assessment particularly for the licensing and certification of professionals such as architects and engineers. For assessment of architects, the system includes tools and methods for item creation, computer programs for computerized item presentation, and programs for automatically scoring test responses by computer.