Abstract: A computer-implemented method of calibrating an assessment model for assessing responses includes accessing a plurality of training responses with a processing system for training an assessment model. The processing system analyzes the plurality of training responses to derive values of multiple features of the training responses. The processing system trains the assessment model based on the values of the multiple features of the training responses and a portfolio score for each individual associated with the plurality of training responses utilized in the training. The portfolio score for each individual corresponds to a measure of proficiency based on multiple writing samples constructed by the individual. The processing system determines, based on said training, a weight for each of the multiple features. The processing system calibrates the assessment model to include the weights for at least some of the features such that the assessment model is configured to generate scores for responses.

Abstract: Systems and methods are described for generating a scoring model for responses. A computer-implemented method of calibrating a scoring model using a processing system for scoring examinee responses includes accessing a plurality of training responses for training the scoring model. The plurality of training responses are analyzed to derive values of multiple features (variables) of the training responses. The scoring model is trained based on the values of the multiple features of the training responses and one or more external measures of proficiency for each individual associated with a training response utilized in the training. The one or more external measures are not derived from the training responses. Based on the training, a weight for each of the multiple features is determined. The scoring model is calibrated to include the weights for at least some of the features for scoring examinee responses.

Abstract: A computer-implemented method of calibrating an assessment model for assessing responses includes accessing a plurality of training responses with a processing system for training an assessment model. The processing system analyzes the plurality of training responses to derive values of multiple features of the training responses. The processing system trains the assessment model based on the values of the multiple features of the training responses and a portfolio score for each individual associated with the plurality of training responses utilized in the training. The portfolio score for each individual corresponds to a measure of proficiency based on multiple writing samples constructed by the individual. The processing system determines, based on said training, a weight for each of the multiple features. The processing system calibrates the assessment model to include the weights for at least some of the features such that the assessment model is configured to generate scores for responses.

Abstract: Systems and methods are provided for carrying out an examination with a client computer. A client computer is booted using a secondary operating system other than a primary operating system of the client computer that is accessed from a computer readable medium provided by an administrator of an examination only on the day of the examination. A broadcast message is sent from the client computer to check for the existence of a local server and to establish communication with the local server. A client application is received from the local server for presenting the examination at the client computer. Assessment content is received for the examination from the local server. The examination including the assessment content is presented to a user of the client computer with the client application, and user responses are received at the client computer and transmitted to the local server.

Abstract: Systems and methods are provided for carrying out an examination with a client computer. A client computer is booted using a secondary operating system other than a primary operating system of the client computer that is accessed from a computer readable medium provided by an administrator of an examination only on the day of the examination. A broadcast message is sent from the client computer to check for the existence of a local server and to establish communication with the local server. A client application is received from the local server for presenting the examination at the client computer. Assessment content is received for the examination from the local server. The examination including the assessment content is presented to a user of the client computer with the client application, and user responses are received at the client computer and transmitted to the local server.