Abstract: A Portal Assessment Design System includes a system for designing assessment models and assessments (e.g., standardized tests). In assessment design, specifications are organized around three basic elements: 1) what knowledge, skill or abilities are important to measure; 2) what is necessary evidence of that knowledge, skill or ability; 3) what performance situations are needed to elicit the required evidence from students and other assessment users. The system includes three modules (i.e., Domain Analysis, Domain Modeling, Conceptual Assessment Framework), each of which targets a specific phase of the design process, for designing an assessment in accordance with the three basic elements. The sequence of modules represents the structure of a design process that helps assessment developers work through successive stages or phases of assessment design, from the gathering of raw information to the creation of a complete set of specifications for an assessment product.

Abstract: Exemplary data structures designed for log files of game/simulation-based educational assessments are described. An exemplary data structure may comprise at least one session element representing an assessee's participation in an educational assessment session; a session identification element identifying the educational assessment session represented by the session element; an assessee identification element identifying the assessee participating in the educational assessment session represented by the session element; an events element representing a collection of events occurring in the educational assessment session represented by the session element; an event element representing one event in the collection of events; an event time element indicting a time associated with the event; an event performer element indicating a performer of the event; an event target element indicating a target of the event; and an event result element representing a result of the event.

Abstract: A method and system for estimating uncalibrated task performance are disclosed.

Abstract: A Portal Assessment Design System includes a system for designing assessment models and assessments (e.g., standardized tests). In assessment design, specifications are organized around three basic elements: 1) what knowledge, skill or abilities are important to measure; 2) what is necessary evidence of that knowledge, skill or ability; 3) what performance situations are needed to elicit the required evidence from students and other assessment users. The system includes three modules (i.e., Domain Analysis, Domain Modeling, Conceptual Assessment Framework), each of which targets a specific phase of the design process, for designing an assessment in accordance with the three basic elements. The sequence of modules represents the structure of a design process that helps assessment developers work through successive stages or phases of assessment design, from the gathering of raw information to the creation of a complete set of specifications for an assessment product.

Abstract: A Portal Assessment Design System includes a system for designing assessment models and assessments (e.g., standardized tests). In assessment design, specifications are organized around three basic elements: 1) what knowledge, skill or abilities are important to measure; 2) what is necessary evidence of that knowledge, skill or ability; 3) what performance situations are needed to elicit the required evidence from students and other assessment users. The system includes three modules (i.e., Domain Analysis, Domain Modeling, Conceptual Assessment Framework), each of which targets a specific phase of the design process, for designing an assessment in accordance with the three basic elements. The sequence of modules represents the structure of a design process that helps assessment developers work through successive stages or phases of assessment design, from the gathering of raw information to the creation of a complete set of specifications for an assessment product.

Abstract: Methods for designing an assessment and providing accessibility features for a test taker profile are disclosed. A test taker profile, including multiple knowledge, skill and other attribute(s) (KSAs), is defined in which each KSA has a specific level. Each KSA is designated as either a focal KSA (an essential part of the targeted proficiency to be measured) or an ancillary KSA (not an essential part). For each focal KSA, a focal value (the value that the test taker must have to possess a high level in the targeted proficiency) is defined. For a particular test design alternative (which may include an accessibility feature), a requirement is determined for each KSA. An accessibility feature is selected which avoids indications of invalidity, including: a mismatch between the targeted proficiency and the expected proficiency; the test taker profile does not satisfy all ancillary requirements; and focal requirements are either excessive or insufficient.

Abstract: A Portal Assessment Design System includes a system for designing assessment models and assessments (e.g., standardized tests). In assessment design, specifications are organized around three basic elements: 1) what knowledge, skill or abilities are important to measure; 2) what is necessary evidence of that knowledge, skill or ability; 3) what performance situations are needed to elicit the required evidence from students and other assessment users. The system includes three modules (i.e., Domain Analysis, Domain Modeling, Conceptual Assessment Framework), each of which targets a specific phase of the design process, for designing an assessment in accordance with the three basic elements. The sequence of modules represents the structure of a design process that helps assessment developers work through successive stages or phases of assessment design, from the gathering of raw information to the creation of a complete set of specifications for an assessment product.