Abstract: A method for execution by a computing entity includes obtaining first and second learning objects regarding a topic. The method further includes deriving a first set of knowledge test-points for the first learning object regarding the topic based on a first set of knowledge bullet-points. The method further includes deriving a second set of knowledge test-points for the second learning object regarding the topic based on the second set of knowledge bullet-points. The method further includes generating a first knowledge assessment asset for the first learning object regarding the topic based on the first set of knowledge test-points, an illustrative asset, and a first descriptive asset of the first learning object. The method further includes generating a second knowledge assessment asset for the second learning object regarding the topic based on the second set of knowledge test-points, the illustrative asset, and a second descriptive asset of the second learning object.

Abstract: Method for taking a test using a smartphone including placing the smartphone into connection with a device, placing the device on a head of a person with the smartphone in a position in which a display of the smartphone is visible to the person, coupling the smartphone to the device and displaying test questions on the display. Cheating is detected by, for example, monitoring presence of the device on the head of the person by periodically obtaining biometric data from the person and analyzing a change in the biometric data relative to previously obtained biometric data for the person, and when a change is present, stopping display of the test questions and generating and transmitting a communication to a test-providing institution derived from the change in biometric data.

Abstract: A method for operating a behavior modification software comprises identifying a user profile comprising a behavioral score; presenting an illustration associated with a scenario, the scenario associated with at least one question, each question associated with at least two answers, wherein each answer is associated with a behavior score modifier; receiving selection of a selected question within the scenario; presenting the selected question to a user in response to the selection and at least a subset of the answers associated with the selected question; receiving a selected answer from the user in response to presenting the question; evaluating input from the user based on the behavior score modifier associated with the received selected answer; adjusting the behavioral score based on the behavior score modifier; and determining a path based on the user's adjusted behavioral score, wherein the path identifies a next operation within the behavioral modification software.

Abstract: A form filling application is configured to minimize the form filling effort of a user. The configuration follows concepts from reinforcement learning, and includes optimizing a policy for selecting agent actions in a manner that maximizes a reward signal. In the context of the form filling application, an agent action may specify one or more slots of the form for the user to fill, and further specify one or more user interfaces for filling the specified one or more slots. The reward signal may be defined as an inverse function of the user effort, so that maximizing the reward signal has the desired effect of minimizing the user effort.

Abstract: The disclosure provides systems and methods for maintaining integrity of documents and activities associated with examinations. The systems and methods store such activities and documents in a distributed blockchain such that integrity is maintained through transparency and redundancy of the records and activities. The systems monitor for any anomalies and notify appropriate individuals when an anomaly is detected, as well as maintaining a log of such anomalies.

Abstract: The disclosure provides systems and methods for maintaining integrity of documents and activities associated with examinations. The systems and methods store such activities and documents in a distributed blockchain such that integrity is maintained through transparency and redundancy of the records and activities. The systems monitor for any anomalies and notify appropriate individuals when an anomaly is detected, as well as maintaining a log of such anomalies.

Abstract: A communications platform is provided which can be employed to implement a recognition and reward system that is simple to use, streamlined, and scalable thereby enabling such systems to be seamlessly implemented in many different environments. The communications platform can be implemented in a client-server environment in which a server or servers maintain a number of data structures which can be employed to facilitate the creation and display of a dashboard representing achievements that have been awarded to students, to facilitate the implementation of group competitions, and to facilitate the association of traits with students based on achievements that have been awarded to the students.

Abstract: A mobile device having an established multiplexed connection for optimizing communications is configured for communicating over the established multiplexed connection, predicting an activity session based on application access history, and fetching data for an application before the activity session based on the predicted activity session. A second connection is established that is other than the established multiplexed connection with the mobile device. The fetched data is transmitted over the second connection.

Abstract: A parent social network based on relationship of children, including of activities, needs, interests or combinations thereof, is described. The parent social network can identify at least two minors with a common activity, need, interest or combination thereof, identify an adult responsible for the identified minors; and propose to link the identified adults. The parent social network can also provide post and other data to a parent based on interests and activities of a child. The parent social network can also identify and subscribe the parent to relevant children related calendars. The parent social network can allow effective communication between relevant parents using messaging and other means.

Abstract: Methods and apparatuses are disclosed for computer-based evaluation of a test-taker's performance with respect to a reward threshold. A performance assessment of the test taker can be standardized or customized, as well as relative or absolute. The system allows a parentally-controlled reward system such that children who reach specified objectives can claim an award that parents are confident was fairly and honestly earned without the parent being required to proctor the testing.

Abstract: Techniques are disclosed for recognizing user personality in accordance with a speech recognition system. For example, a technique for recognizing a personality trait associated with a user interacting with a speech recognition system includes the following steps/operations. One or more decoded spoken utterances of the user are obtained. The one or more decoded spoken utterances are generated by the speech recognition system. The one or more decoded spoken utterances are analyzed to determine one or more linguistic attributes (morphological and syntactic filters) that are associated with the one or more decoded spoken utterances. The personality trait associated with the user is then determined based on the analyzing step/operation.

Abstract: A method and system provides arrangements creating a relationship between a real-world entity and a virtual world environment. A participant or player can participate in various virtual world experiences including activities, settings, events, purchases, sales and diverse transactions to acquire virtual products, virtual services, and/or virtual items of value. Feedback may be provided and records kept regarding the virtual world participation. In some circumstances, multiple persons can participate as a group or participate as individuals in the virtual world environment. Some embodiments provide an oversight procedure that enables a supervisory entity to exercise direct or indirect control over certain virtual world aspects of a participant or player. In some implementations the oversight procedure is at least partially based on an attribute related to the participant or player.

Abstract: Disclosed is a method and system for evaluating performance of at least one first-user on an online platform. A course-builder module enables a second-user to create at least one assignment and to define a set of assessment criteria for assessing the at least one assignment. After creating the at least one assignment, a course-attempting module is configured to enable a first-user to attempt and submit the at least one assignment. Once the at least one assignment is submitted by the first-user, a similarity-check module is configured to apply a similarity-check algorithm on the submitted assignment to automatically generate a report having a score quantifying similarity of the assignment with a content from an online source. Upon applying the similarity-check, a grading module is configured to evaluate the performance of the first-user by assigning a grade to the assignment on the basis of the predefined set of criteria.

Abstract: An Internet search engine is configured to provide information to a user of the service in ranked order according to demographic profile information about the user provided by the user. Such information might include advertising information and/or search results (e.g., rendered as hyperlinks) to search queries posed by the user. The information may be returned in a ranked order according to reward credits offered by advertisers and/or content providers associated with the advertising information and/or web sites represented by the search results. Such reward credits may be posted to an account maintained by the user upon selection by the user of cursor-selectable objects (e.g., icons, banner ads, hyperlinks, radio buttons, check boxes, etc.) associated with the advertising information and/or search results. Ultimately, the reward credits may be redeemed through the Internet service for cash, Internet content or other value. A process for verifying whether or not an Internet operation (e.g.

Abstract: Described is a method using a computer for grading student work on a problem when the student's own steps are shown in detail. A reference trace is created representing a best solution path to the problem.

Abstract: A system and method for generating a test and an answer key to identify correct answers is disclosed. A test can be created by entering a set of questions with answer choices and correct answers at the same time. The tests can be rendered via a rendering device that includes both the questions and the answer choices. A ticket can be generated that drives a CNC (computer numerically control) machine to create a punched answer key with holes that align over correct answers. The answer key can also be rendered on a transparency utilizing a solid color everywhere except an area where the correct answer should be marked. The test and the answer key can also be rendered and aligned side by side in order to identify correct answers.

Abstract: A method, apparatus and computer software for automatically analysing a filled in questionnaire, are provided. The method includes automatically analysing a filled in questionnaire, the method comprising the steps of: providing a questionnaire having answer locations; scanning at least two copies of the questionnaire with the answer locations filled in differently and complementarily in a predetermined way, to produce a first scan and a second scan; automatically determining answer locations by comparing the first and second scans; providing a filled in questionnaire having certain answers; scanning the provided filled in questionnaire as a third scan; and automatically judging the certain answers with the determined answer locations.

Abstract: A method and system for customizing an automated essay scoring system are disclosed. Relative weights may be assigned to a plurality of features for a plurality of benchmark essay responses. Based on the relative weights, automated scores may be determined for one or more first essay responses to a first prompt. The automated scores may be scaled based on one or more scoring standards for the first prompt. A scaled automated score may be assigned for a second essay response to the first prompt based on the scaled automated scores for the one or more first essay responses.

Abstract: Methods and apparatuses are disclosed for computer-based evaluation of a test-taker's performance with respect to a reward threshold. A performance assessment of the test taker can be standardized or customized, as well as relative or absolute. The system allows a parentally-controlled reward system such that children who reach specified objectives can claim an award that parents are confident was fairly and honestly earned without the parent being required to proctor the testing.

Abstract: The present invention provides a method of doing cognitive diagnosis of mental skills, medical and psychiatric diagnosis of diseases and disorders, and in general the diagnosing of latent properties of a set of objects, usually people, for which multiple pieces of binary (dichotomous) information about the objects are available, for example testing examinees using right/wrong scored test questions. Settings where the present invention can be applied but are not limited to include classrooms at all levels, web-based instruction, corporate in-house training, large scale standardized tests, and medical and psychiatric settings. Uses include but are not limited to individual learner feedback, learner remediation, group level educational assessment, and medical and psychiatric treatment.

Abstract: A computer program product for use with text transcribed from audio information, the computer program product residing on a computer-readable medium, includes computer-readable instructions for causing a computer to: enable defined keystroke combinations for use in editing the text transcribed from audio, the defined keystroke combinations corresponding to formatting functions identified as frequently-used functions during editing of a transcribed text; and respond to an activated keystroke combination by replacing a first format in the text document with a second format corresponding to the chosen keystroke combination.

Abstract: A material processing apparatus has a reader unit, an information extracting unit and a grade determination unit. The reader unit reads a material. The information extracting unit extracts information from the material, the information having information written by a user and information printed on the material in advance. The grade determination unit grades the information written by the user based on the information printed on the material in advance.

Abstract: A system and method for generating a test and an answer key to identify correct answers is disclosed. A test can be created by entering a set of questions with answer choices and correct answers at the same time. The tests can be rendered via a rendering device that includes both the questions and the answer choices. A ticket can be generated that drives a CNC (computer numerically control) machine to create a punched answer key with holes that align over correct answers. The answer key can also be rendered on a transparency utilizing a solid color everywhere except an area where the correct answer should be marked. The test and the answer key can also be rendered and aligned side by side in order to identify correct answers.

Abstract: The invented apparatus, system and method for examining a student's oral answer capability includes a presentation mechanism for presenting a program test including one or more questions and soliciting one or more answers as oral inputs; a voice recognition mechanism for receiving a voice stream from a student oral recitation and for converting the voice stream to text-based essay form and for recording the same as a first given answer; answer key data stored in memory, the answer key data representing an ideal answer; a correlation mechanism coupled with the first given answer and with the stored answer key data for comparing the given answer to the stored answer key; and a grading mechanism coupled with the correlation mechanism for assigning a point score representing the merit of the given answer relative to the stored answer key data, wherein the point score represents the level of correlation therebetween.

Abstract: A learning and training process that memorizes traces of a learner solving an exercise, attaches meta labels to the learner traces, and compares the learner traces to reference traces of a referent solving the exercise, meta labels being attached to the reference traces.

Abstract: A method and system for performing image mark recognition for a document is disclosed. A document is scanned into a digital image. Reference image marks are sensed from the digital image. The reference image marks may include trigger row marks and/or corner/crop marks. Coordinates denoting the location of cells within the digital image are determined base on the locations of the reference image marks. Response marks are evaluated for darkness, opacity, and/or grayness on a pixel-by-pixel basis. The response marks are each assigned a percentage value based on the ratio between a total color value for a cell and a maximum color value for a cell.

Abstract: A computer integrated assessment system for standards-based assessments wherein the assessments conform to recorded standards, the system includes algorithms for directing the generation of a plan of a series of customized assessments aligned to respective selected standards of the recorded standards wherein each of the customized assessments are set for different times within a period of time; and algorithms for enabling a user to generate a test in one of the customized assessments wherein one of the selected standards of the one customized assessment is displayed to the user during generation of questions for the test. During generation of tests, repeating of questions or questions on selected subject matter can be prevented. Individuals or groups can be selected to the customized assessments. Accuracy in grading of answer sheets by scanning is improved by an algorithm determining the lightest and darkest answer mark to determine the intended answer.

Abstract: A method for checking forms can include retrieving user responses to entries from a hardcopy of a form, comparing at least a portion of the retrieved responses to appropriate responses for the entries specified in a stored template for the form, generating indicia responsive to the comparing step locating inappropriate responses on the hardcopy, identifying a user associated with the hardcopy; and storing the results of the comparison in a location associated with the identified user.

Abstract: Methods and apparatuses are disclosed for computer-based evaluation of a test-taker's performance with respect to a reward threshold. A performance assessment of the test taker can be standardized or customized, as well as relative or absolute. The system allows a parentally-controlled reward system such that children who reach specified objectives can claim an award that parents are confident was fairly and honestly earned without the parent being required to proctor the testing.

Abstract: The present invention provides a method of doing cognitive diagnosis of mental skills, medical and psychiatric diagnosis of diseases and disorders, and in general the diagnosing of latent properties of a set of objects, usually people, for which multiple pieces of binary (dichotomous) information about the objects are available, for example testing examinees using right/wrong scored test questions. Settings where the present invention can be applied but are not limited to include classrooms at all levels, web-based instruction, corporate in-house training, large scale standardized tests, and medical and psychiatric settings. Uses include but are not limited to individual learner feedback, learner remediation, group level educational assessment, and medical and psychiatric treatment.

Abstract: Methods and systems for evaluating the fit of raw data to model data are disclosed. Relationships between an assessment item and a tested attribute, responses from examinees to an assessment item, mastery states for an examinee for a tested attribute, one or more parameters based on expected assessment item performance, estimates for non-tested attributes for each examinee, likelihoods that an examinee that has mastered attributes pertaining to an assessment item will answer the item correctly, likelihoods that an examinee that has not mastered an attribute for an assessment item will answer the item correctly, and/or other variables may be received. For each item and/or for each examinee, a determination of a class for the examinee and/or item may be determined. Statistics may also be generated for each examinee, each item, an examination and/or any other basis.

Abstract: A computer based method and related system, computer program product and device includes receiving audio input associated with a user reading a sequence of words and determining an approximate amount of time corresponding to an absence of input associated with an assessed word, after receiving audio input associated with a preceding word in the sequence of words, or since the start of the audio buffer or file. The method can also include displaying a visual indication or generating an audio intervention based on the determined amount of time corresponding to an absence of input.

Abstract: A method and system are disclosed for computerized training, monitoring, certification or re-certification of human raters in clinical trials. The invention provides an interactive computerized interview that can be compared scores obtained by human raters to monitor and train clinical raters on a continuing basis in order to reduce rater drift and variance during clinical trials. Remediation can be automatically flagged or provided to improve a deviating rater's performance. Computerized assessment of symptom severity is provided without the need for human clinical raters. The system and method enable screening of prospective patients for inclusion or exclusion from a clinical trial by automatically obtaining computerized ratings of symptom severity.

Abstract: A scannable form with a numeric value block, a plurality of response control marks, response receiving rows, and a zone for a bar code, optical character recognition (OCR) spaces and/or intelligence character recognition (ICR) spaces. The scannable form may be scanned by two different devices.

Abstract: A method and system for performing image mark recognition for a document is disclosed. A document is scanned into a digital image. Reference image marks are sensed from the digital image. The reference image marks may include trigger row marks and/or corner/crop marks. Coordinates denoting the location of cells within the digital image are determined based on the locations of the reference image marks. Response marks are evaluated for darkness, opacity, and/or grayness on a pixel-by-pixel basis. The response marks are each assigned a percentage value based on the ratio between a total color value for a cell and a maximum color value for a cell.

Abstract: A method, program and system for administering tests in a distributed data processing network are provided by the present invention. The invention includes combining predetermined test content and multimedia support material into a single encrypted test file. The multimedia support may include visual and audio files for presenting test questions. The invention then exports the encrypted test file to at least one remote test location. The test locations import and decrypt the encrypted test file and load the test content and multimedia support material into a local database. The test is administered on a plurality of client workstations at the testing location, wherein the test may include audio questions and verbal responses by participants. During the course of testing biometric data about test participants is recorded and associated with the test files and participant identification.

Abstract: Methods and systems for evaluating the fit of raw data to model data are disclosed. Relationships between an assessment item and a tested attribute, responses from examinees to an assessment item, mastery states for an examinee for a tested attribute, one or more parameters based on expected assessment item performance, estimates for non-tested attributes for each examinee, likelihoods that an examinee that has mastered attributes pertaining to an assessment item will answer the item correctly, likelihoods that an examinee that has not mastered an attribute for an assessment item will answer the item correctly, and/or other variables may be received. For each item and/or for each examinee, a determination of a class for the examinee and/or item may be determined. Statistics may also be generated for each examinee, each item, an examination and/or any other basis.

Abstract: A method for improving a scoring process includes displaying an original scanned image of a hard copy page of an answer to a scorer. If the scorer determines that the image is of insufficient quality to read, an electronic request for an improved image is received from the scorer and routed electronically to an archive containing the hard copy page, from which the page is retrieved. The retrieved page is rescanned to form a new image, which is then electronically transmitted to the scorer for scoring. A system includes hardware and software elements, including a processor and a database accessible by the processor containing original scanned images of answer pages. A scorer display and an input device are located at a scoring site, and an archive display and a scanner at an archive site. Software as described above is resident on the processor for implementing the method steps.

Abstract: A self-administered and self-scoring test kit and method for early self-screening of neurological disease, by detection of diminished olfactory function. The test kit is comprised of a plurality of pages; attached to each page (28) via adhesive is a microencapsulated strip (36) that, when scratched, releases a different, distinct odor. The test kit has instructions that provide for self-administration (33) and self-scoring (46) of the test, and identification of a threshold score (48) as a self-screening method for possible neurological disease and need to consult a physician.

Abstract: The present invention discloses a method and system for providing an education decision support library to enable user access to information, over a processor based network. The information assists the user in making an administrative decision. The method includes the steps of loading operational data from one or more sources into a database; providing one or more analytical tools that enable a user to manipulate the operational data; and accessing the one or more analytical tools over the processor based network to assist in an educational environment.

Abstract: A test form comprises a substrate, a chromogenic material applied to at least a top surface portion of the substrate, a removable opaque layer overlaying a portion of the chromogenic material, the chromogenic material being adapted to irreversibly generate a visible change in color to form a desired indicia, upon exposure of the area to an activating agent such as heat to predetermined areas on a bottom portion of the substrate, all without disturbing the opaque layer covering the indicia so produced. The present invention is further directed to a method and system for customizing a test form having a removable opaque layer, by permitting printing under the opaque layer to be concealed until the corresponding opaque layer covering the indicia is removed.

Abstract: The present invention provides a method of doing cognitive diagnosis of mental skills, medical and psychiatric diagnosis of diseases and disorders, and in general the diagnosing of latent properties of a set of objects, usually people, for which multiple pieces of binary (dichotomous) information about the objects are available, for example testing examinees using right/wrong scored test questions. Settings where the present invention can be applied but are not limited to include classrooms at all levels, web-based instruction, corporate in-house training, large scale standardized tests, and medical and psychiatric settings. Uses include but are not limited to individual learner feedback, learner remediation, group level educational assessment, and medical and psychiatric treatment.

Abstract: A method and system for providing on-line game competition are provided. Players select their favorite teams, join with other fans of the team, and compete against players on the opposite team. Teams compete against each other in matches, where matches are based on schedules of real-life events, such as sports schedules or entertainment schedules. Players are grouped with other players associated with their favorite teams, and matches are organized. Various trivia questions may be presented, and players have a predetermined period of time to answer the questions. Points may be awarded based on a player's success in competition and the overall teams success in matches. Further, prizes are awarded based on points received by a player.

Abstract: The present invention relates to a system and method for verifying and editing optically imaged responses received from a response provider.

Abstract: Methods and systems for skills-based testing and training of an application are provided. Example embodiments provide a Skills-Based Simulation and Measurement System “SBSMS”, which enables publishers and authors of tests and training programs to provide simulated application environments for testing and training students. In one embodiment, the SBSMS comprises a client portion and a server portion. The client portion includes a simulation engine that is run by a student and tracks the student's responses. The server portion comprises the components and data that are used to implement the client-side simulation engine and includes a skills-based testing and training engine, simulation components, non-simulation components, and a tests and training scenarios and student data repository. The server portion receives and satisfies requests for portions of a scenario with the simulation and non-simulation components.

Abstract: A computer-based apparatus for evaluating school readiness of a child, based on challenging the child to play a series of games and automatic comparison of performance data of the child in these games with a database of performance results of a population of children. The apparatus comprises a server; storing facility provided on said server with database that comprises personal identity data and game performance parameters of the population and a games library. The games library comprises a plurality of games.

Abstract: A system and method for assessing and monitoring student academic achievement levels for purposes of identifying students at risk for not meeting minimum academic standards as measured using standardized tests, and for tracking or monitoring student academic performance levels. The system and method of the present invention comprises producing a pool of curriculum-independent General Outcome Measures (GOMs) of substantially equal difficulty for a particular grade level, and further comprises a system and method of assessing and monitoring students in that grade level using the pool of GOMs for the purpose of identifying those students at risk for not meeting minimum standardized test target scores and for tracking or monitoring student academic performance levels.

Abstract: A self-administered and self-scoring test kit and method for early self-screening of neurological disease, by detection of diminished olfactory function. The test kit is comprised of a plurality of pages; attached to each page (28) via adhesive is a microencapsulated strip (36) that, when scratched, releases a different, distinct odor. The test kit has instructions that provide for self-administration (33) and self-scoring (46) of the test, and identification of a threshold score (48) as a self-screening method for possible neurological disease and need to consult a physician.

Abstract: Methods are disclosed for distributing digitized electronic representations of representative responses to non-objective assessment tasks and established scores for the responses to readers in order to train the readers to determine scores for responses in accordance with a scoring criteria, to qualify the readers to determine scores for responses in accordance with the scoring criteria, and to monitor how well a reader is determining scores for such responses in accordance with the scoring criteria. In disclosed embodiments, the methods provide such distribution for multiple scorers on a network located at a single site, for multiple scorers on a network remote from a central site; and scoring by individual scorers remote from the central site. Distribution may be accomplished by transferring data from electronic files using diverse techniques such as magnetic storage discs, CD-ROM, cable or high-speed public communications network, in accordance with the needs of the particular job and setting.

Abstract: A method and system are provided for quiz question game play. In order to check the correctness of answers to quiz questions or the like over the media and in events, the correctness of answers given by a participant to questions asked by the organizer is checked. This is done by converting answers into a question-related control data word by automatically allocating a confirmation data word verifying the correctness of the answer given by the participant to the organizer.