Abstract: A method for adaptive scoring of responses to constructed response questions is disclosed. Adaptive scoring may be used to apply evaluator time in such a way that a predetermined reliability level is reached with the least possible use of evaluator time, including adjusting the number of response graded and/or the number of evaluators grading each response. A score may be calculated after grading a subset of a test taker's responses to the constructed response questions. A probability or an error estimate is calculated and compared to a threshold value. Grading may be discontinued based on the comparison. A score may be calculated based on a predetermined number of ratings for the test taker's response to a constructed response. A probability that the score is within a predetermined range of what the score would be if all the responses are graded is calculated. If the probability is less than a threshold value, the number of ratings is increased.

Abstract: Methods and systems are disclosed for test administration and management. A server or server system presents an interface to a client web browser over a network. A user of the client web browser selects a test taker, a test, and a destination identifier. The server or server system may then present the test to the test taker in a call to the destination identifier. After completion of the test, the server or server system may then score the test and display the score of the test in the interface. The interface may also allow the user to play back a recording of a completed test. The interface may support multiple test takers or multiple tests.

Abstract: A system and method for spoken language proficiency assessment by a computer is described. A user provides a spoken response to a constructed response question. A speech recognition system processes the spoken response into a sequence of linguistic units. At training time, features matching a linguistic template are extracted by identifying matches between a training sequence of linguistic units and pre-selected templates. Additionally, a generalized count of the extracted features is computed. At runtime, linguistic features are detected by comparing a runtime sequence of linguistic units to the feature set extracted at training time. This comparison results in a generalized count of linguistic features. The generalized count is then used to compute a score.

Abstract: A system for measuring an ability of a subject. The system includes a set of tasks that require the subject to provide one or more spoken responses. A speech recognition system, which is coupled to receive the spoken responses, provides an estimate of the spoken responses. The estimate may be an estimate of the linguistic content and/or other characteristics of the response. The speech recognition system has an associated operating characteristic relating to its ability to recognize and estimate the content of responses and elements of responses. A scoring device converts the response estimate into one or more item scores. A computation device provides a subject score using a scoring computation model that depends upon the expected item-dependent operating characteristics of the speech recognition system.

Abstract: A system and method for measuring reading skills is described. An individual whose reading skills are to be evaluated reads aloud from a text. As the person reads aloud from the text, a speech signal is captured. The speech signal is analyzed to provide an estimate of what the individual said and to measure a timing of the words said. The estimate and timing is combined with parameters assigned to each word said to form a measure of the individual's reading skill. The measure of the individual's reading skill is substantially independent of the text.

Abstract: A method for adaptive scoring of responses to constructed response questions is disclosed. Adaptive scoring may be used to apply evaluator time in such a way that a predetermined reliability level is reached with the least possible use of evaluator time, including adjusting the number of response graded and/or the number of evaluators grading each response. A score may be calculated after grading a subset of a test taker's responses to the constructed response questions. A probability or an error estimate is calculated and compared to a threshold value. Grading may be discontinued based on the comparison. A score may be calculated based on a predetermined number of ratings for the test taker's response to a constructed response. A probability that the score is within a predetermined range of what the score would be if all the responses are graded is calculated. If the probability is less than a threshold value, the number of ratings is increased.

Abstract: An automatic reading system provides a system and methods of evaluating a user's reading skills while the user is reading out loud. The automatic reading system adjusts text of an electronic book as the user is reading to increase or decrease a level profile of the electronic book. The automatic reading system also provides reading recommendations, feedback, and marketing data.

Abstract: An automatic reading system provides a system and methods of evaluating a user's reading skills while the user is reading out loud. The automatic reading system adjusts text of an electronic book as the user is reading to increase or decrease a level profile of the electronic book. The automatic reading system also provides reading recommendations, feedback, and marketing data.

Abstract: An intelligibility measuring system provides a system and method of evaluating intelligibility of a speaker. Intelligibility may be a function of the speaker's pronunciation of words, material being spoken, context in which words are spoken, and skill of a listener. The speaker repeats items. The items may be words or combination of words. The listener hears the speaker articulating items and a transcription is created to document what the listener heard. A measurement unit determines an error count based on a comparison of the items and the transcription. An intelligibility score is then determined using the error count, difficulty level of the items, and ability of the listener.

Abstract: A computer system with a speech recognition component provides a method and apparatus for instructing and evaluating the proficiency of human users in skills that can be exhibited through speaking. The computer system tracks linguistic, indexical and paralinguistic characteristics of the spoken input of users, and implements games, data access, instructional systems, and tests. The computer system combines characteristics of the spoken input automatically to select appropriate material and present it in a manner suitable for the user. In one embodiment, the computer system measures the response latency and speaking rate of the user and presents its next spoken display at an appropriate speaking rate. In other embodiments, the computer system identifies the gender and native language of the user, and combines that information with the relative accuracy of the linguistic content of the user's utterance to select and display material that may be easier or more challenging for speakers with these characteristics.