Abstract: A method for improving a scoring process includes displaying an original scanned image of a hard copy page of an answer to a scorer. If the scorer determines that the image is of insufficient quality to read, an electronic request for an improved image is received from the scorer and routed electronically to an archive containing the hard copy page, from which the page is retrieved. The retrieved page is rescanned to form a new image, which is then electronically transmitted to the scorer for scoring. A system includes hardware and software elements, including a processor and a database accessible by the processor containing original scanned images of answer pages. A scorer display and an input device are located at a scoring site, and an archive display and a scanner at an archive site. Software as described above is resident on the processor for implementing the method steps.

Abstract: A method for creating a test for administration to a student includes creating a plurality of test items using a unitary software application. Each test item has a plurality of elements, including an item stem (a question or problem), at least one option (such as a choice of answers, including one correct answer and at least one “distractor” or an open-ended question), and metadata related to the test item. Next, if desired, an image is added to the test item using the software. Each test item is then stored in an electronic database. Access to each test item in the database is provided, wherein the test items are searchable by at least one of the test item elements. The test creator then electronically selects at least one test item from the database and views at least a portion of the selected test item. If desired, the at least one selected test item is assembled into a test.

Abstract: A method for testing a working memory of a subject includes the steps of presenting to a subject a first representation of a plurality of items and asking the subject to select a first item from the first representation. Next the subject is presented with a second representation of the plurality of items and is asked to select a second item from the second representation, the second item different from the first item. These steps test a subject's ability to select a different item from a plurality thereof, a first type of information. As a next aspect of the test the subject is asked to recall an order of the selected items. This step requires the subject to track the order of selection, another type of information. This juxtaposition of testing aspects increases the working memory load on the subject.

Abstract: A tutorial method for teaching the scoring of open-ended questions holistically includes displaying a student response to a scorer and permitting the scorer to access a rubric containing the rules for scoring that response. The scorer can choose a display form from a handwritten form and a typed text form that retains and originally present errors. Following the scorer's having entered a score, a model score is displayed so that a scoring efficacy may be determined. Annotations prepared by expert scorers may be accessed to enhance the learning process. In addition, a running correlation between the model and entered scores is calculated and displayed for the scorer over a tutorial session that includes attempts at scoring different responses. The system includes a processor, a workstation, and software for performing the above-described method.

Abstract: An imaging system includes two sets of cameras: a first set for capturing optical mark or optical character recognition data and a second set for capturing visual images. Full visual images of pages containing answers to open-ended questions are retained and are retrievable by a reader such that an area of interest wherein the answer is expected is displayed, but the remaining area is also available for viewing. The system permits the alignment of a page based upon edge detection if the page contains only an open-ended answer, obviating the need for timing tracks. Hardware and software elements cooperate to store the image temporarily in a server having a response time commensurate with the scanner. The image is then processed with the use of high-performance index imaging for optical storage and retrieval, and then routed to a long-term storage device.

Abstract: A scoring system and method include a distribution application for delivering an answer image to a qualified reader. The distributor prefetches a batch of answer images from long-term storage and caches them for retrieval and scoring. The scoring process includes displaying an answer based upon an answer image form along with a scoring protocol. Geometric tools are also available for assisting in scoring geometry tests. A routing system permits a reader to electronically pose a query to a supervisor and to continue working on another answer while the query is being addressed. A reader's effectiveness and efficiency can be monitored by distributing a calibration answer to the reader in transparent fashion and comparing the resulting score with a target score.

Abstract: A tutorial method for teaching the scoring of open-ended questions holistically includes displaying a student response to a scorer and permitting the scorer to access a rubric containing the rules for scoring that response. The scorer can choose a display form from a handwritten form and a typed text form that retains and originally present errors. Following the scorer's having entered a score, a model score is displayed so that a scoring efficacy may be determined. Annotations prepared by expert scorers may be accessed to enhance the learning process. In addition, a running correlation between the model and entered scores is calculated and displayed for the scorer over a tutorial session that includes attempts at scoring different responses. The system includes a processor, a workstation, and software for performing the above-described method.

Abstract: An imaging system includes two sets of cameras: a first set for capturing optical mark or optical character recognition data and a second set for capturing visual images. Full visual images of pages containing answers to open-ended questions are retained and are retrievable by a reader such that an area of interest wherein the answer is expected is displayed, but the remaining area is also available for viewing. The system permits the alignment of a page based upon edge detection if the page contains only an open-ended answer, obviating the need for timing tracks. Hardware and software elements cooperate to store the image temporarily in a server having a response time commensurate with the scanner. The image is then processed with the use of high-performance index imaging for optical storage and retrieval, and then routed to a long-term storage device.

Abstract: A system and method for collecting behavioral health care data for a patient include a mechanism for creating an evaluation instrument from a database of questions having linked answers thereto. New questions can also be entered into the database, along with a user-defined branching logic dependent upon the patient's answer to the question. Patient answers that are numerically scaleable can be displayed graphically against time over a plurality of sessions and also against indicia labeled for values representing a predetermined goal and a value determined upon an initial evaluation, for tracking patient progress.

Abstract: The present invention relates to systems and methods for reporting behavioral health care data, and, more particularly, for creating displays and reports for aggregating data from patient treatment results. One feature permits the user to choose among patient progress indicators relative to a behavioral problem to be graphed versus time, along with one or more treatments, in order to gauge the effect of the treatment upon the behavioral problem. Another feature permits the generation of a narrative report that integrates fixed textual matter with data from the patient's electronic chart. An alternate embodiment of this feature also permits the composition of formats for a narrative report.

Abstract: The disclosure relates to an attachment for a scanner apparatus which electrically scans the markings on the upper face of test score sheets. The attachment stacks score sheets in either a main hopper or a reject hopper with the sheets being stacked in either hopper in the sequence in which the sheets were scanned. Thus, the first sheet after having its upper face scanned is inverted and placed on the bottom of a hopper with the face surface directed downwardly. Each subsequent test score sheet is inverted and placed on the prior score sheet. When removed from either hopper, a stack of sheets can be inverted as an entirety, thereby establishing the faces of the score sheets in their original order. The stack can then be conveniently run back through the scanner or other apparatus.

Abstract: The invention relates to a device for facilitating the handling of transparencies to be projected by an overhead projector. The device includes a support frame which can be secured by adhesive means to the light table of a projector. A transparency is placed on the support frame, and extends across an aperture in the frame through which light is projected upwardly. An aperture cover which encloses the support frame is mounted thereon for reciprocating movement between a position covering the aperture to a position exposing the aperture. Accordingly, the aperture cover enables the projected light to be interrupted when a transparency is being changed on the support frame.