Abstract: There is disclosed a system of providing technical guidance and instruction by utilizing two zoom lens equipped auto focus CCD cameras placed directly in front of the instructor's left and right pupils and communication networks, such as internet. More specifically, a business system is disclosed which distributes technical guidance and instruction on medical surgeries and other highly precision oriented technical work performed in person, and/or an education guidance system which a specific client performs a medical surgery or other highly precise and technical work. In addition, the business system will have the capability of settling tuition/instruction fees which arise from providing the technical guidance and instructions, recruiting potential students, and settlement of payments to the instructors.

Abstract: Techniques for real-time observation assessment are provided. The techniques, which are designed for educators, take advantage of handheld computers, desktop/laptop computers and Internet access in order to reduce the paperwork associated with conventional educational assessments. An array of instructional assessment applications are designed to run on handheld computers. The instructional assessment applications may be based on existing and widely used paper methodologies. A common Web-based platform for assessment application distribution, selection, download, data management and reporting is also provided. Users can then periodically synchronize instructional data (assessments, diagnostic results, notes and/or schedules) to the Web site. At the Web site, browser-based reports and analysis can be viewed, administered and shared via electronic mail.

Abstract: Objects associated with eye fixations are used to support training tasks that are characterized by operation within a dynamic 3D environment, problem-solving that involves user multitasking, short decision time periods, heavy workloads, potential for unexpected events, and the need for high-performance skills. The invention is ideally suited to measure the nuances associated with maintaining situation awareness in such problems where dynamic 3D environments that support problem solving with high cognitive fidelity have already been developed. Potential training application areas include urban warfighting, night vision goggle use, aircraft piloting, helicopter operation, remote control of vehicles and robots, night driving, and air traffic control.

Abstract: A system and method for making use of formative assessment data collected is disclosed that identifies clusters of students and concurrently determines the characteristics of the student clusters. A decomposition of the data is performed with spectral theories of graphs and fuzzy logic algorithms to identify the clusters of students, clusters of assessment data and relationships between them. An actionable output is presented to teachers for the evaluation of educational progress.

Abstract: Techniques are disclosed for recognizing user personality in accordance with a speech recognition system. For example, a technique for recognizing a personality trait associated with a user interacting with a speech recognition system includes the following steps/operations. One or more decoded spoken utterances of the user are obtained. The one or more decoded spoken utterances are generated by the speech recognition system. The one or more decoded spoken utterances are analyzed to determine one or more linguistic attributes (morphological and syntactic filters) that are associated with the one or more decoded spoken utterances. The personality trait associated with the user is then determined based on the analyzing step/operation.

Abstract: A learning and training process that memorizes traces of a learner solving an exercise, attaches meta labels to the learner traces, and compares the learner traces to reference traces of a referent solving the exercise, meta labels being attached to the reference traces.

Abstract: Implementations feature scannable form techniques and systems. Some aspects feature a scannable form including at least one response column parallel to a first longitudinal edge of the scannable form, and a broken ladder having two substantially parallel lines with locations for multiple rungs corresponding to encoded information that identifies a person assigned to the scannable form. A top rung is positioned on the scannable form so that the top rung can be a first rung that is scanned by a test scoring machine for the broken ladder, and a bottom rung is positioned so that the bottom rung can be a last rung that is scanned by the test scoring machine for the broken ladder. Other aspects feature a method to determine correct scoring key data in the test scoring machine for a test, and a method of transmitting information between the test scoring machine and a portable memory device.

Abstract: A method for facilitating assessment of an answer to a coursework question and moderating the assessment, the method comprising the steps of displaying at least part of a representation of a coursework answer on a display of a computer, displaying a list of learning outcome statements, selecting a learning outcome statement from the list of learning outcome statements and placing the learning outcome statement on the representation of the coursework answer at a location evidencing fulfillment of the learning outcome statement.

Abstract: An on-line teaching and learning system with rapid change-by-change or real time reinforcement signals for students and simultaneous monitoring by the teacher of the actual responses as well as their correctness is disclosed. The system may include at least one teacher computer, a plurality of student computers operably connected to the at least one teacher computer by a communications network. The system may be used in a classroom setting or in a distance-learning environment.

Abstract: Student growth can be defined, tracked, and analyzed using a method that comprises PLAN, ASSESS and REFLECT steps, potentially in conjunction with related sub-steps. This type of method can be facilitated using computer software that can be deployed over a remote network, and that can present a number of screens relevant to defining, tracking and analyzing student growth to a user.

Abstract: A computer based system for composing an essay comprising at least one computer-readable medium having one or more executable instructions stored thereon, which when executed by at least one processing system, causes the at least one processing system to implement one or more essay generation tools for assisting a user in generating at least one essay.

Abstract: The system includes an evaluation server configured to receive an article from an author. The article is then distributed to one or more reviewers who are technically qualified to evaluate the article. Further, the reviewers are provided with a scorecard that provides for specific aspects to be evaluated. Each reviewer completes his or her evaluation and submits his or her scores to the evaluation server. The evaluation server compiles the scores from each of the reviewers and calculates an aggregate score for the article. The server may be further configured to match the submitted articles with various technical journals that may be interested in the article. The server may give journals the ability to monitor articles that come through the process and that match a set of journal-definable requirements. The system may also provide authors with a list of matching journals.

Abstract: The system includes an evaluation server configured to receive an article from an author. The article is then distributed to one or more reviewers who are technically qualified to evaluate the article. Further, the reviewers are provided with a scorecard that provides for specific aspects to be evaluated. Each reviewer completes his or her evaluation and submits his or her scores to the evaluation server. The evaluation server compiles the scores from each of the reviewers and calculates an aggregate score for the article. The server may be further configured to match the submitted articles with various technical journals that may be interested in the article. The server may give journals the ability to monitor articles that come through the process and that match a set of journal-definable requirements. The system may also provide authors with a list of matching journals.

Abstract: A method, a system, and a computer program product for creating an assessment model are disclosed. Marked regions in an electronic document are identified. Thereafter, mark-ups within the marked regions are identified. Based on the identified marked regions and mark-ups the assessment model is created.

Abstract: Disclosed herein, among other things, is an imaging system for processing educational assessments. According to one embodiment of the present subject matter, educational assessments are received in a paper format and processed from the paper format to an electronic format. A navigation console is provided and adapted to provide a portal and a login interface to a user. Educational assessment documents are scanned and images are generated. The images are passed through applications to derive data from the images, and the data is transferred to peripheral systems, according to various embodiments.

Abstract: A system and method for education including community-sourced data and community interactions. The method can include registering a plurality of users in a database, presenting educational material to a user of the plurality of users, recording the performance of the user in regards to the educational material, collecting personal statistics regarding the performance of the user, compiling the personal statistics for the plurality of users to generate community statistics regarding the performance of the plurality of users, comparing the personal statistics of a user to the community statistics or to a subset thereof, collecting personal information from each user of the plurality of users, subdividing the plurality of users into a plurality of communities based on the personal information of each user, facilitating interactions between the users within a community of the plurality of communities, and generating a credibility score for each user within the community.

Abstract: Evaluating candidate answers to questions in a target knowledge domain, including: identifying, by a question answering module, a plurality of evidence items in the target knowledge domain; identifying, by the question answering module, a plurality of answers to questions in the target knowledge domain; determining, by the question answering module, associations between each evidence item and one or more of the answers; receiving, by the question answering module, a question; receiving, by the question answering module, values for the one or more evidence items; and providing, by the question answering module, an answer to the question in dependence upon the associations between each evidence item and one or more of the answers and the values for the one or more evidence items.

Abstract: In general, in an aspect, embodiments of the invention can provide, a semi- or fully-automatic computer-implemented method for personalized electronic education of a student, the method including, performing a computerized assessment of the student, using a knowledge assessment module, to determine a knowledge deficit of the student associated with at least one concept, defining a learning profile for the student using a learning profile generation module, receiving, at a server module, a computerized explanation submission based on the learning profile, evaluating, using an explanation submission evaluation module of the server module, the received explanation submission based on an understanding of the concept by the student after presentation to the student of the explanation submission, and rating, using the explanation submission evaluation module, the explanation submission based on the evaluation.

Abstract: Disclosed are a method for providing a correction and teaching services over a network and a web server used in the method. The method of the present invention is implemented by the steps of: enabling a web server to receive information to be corrected including image information created by a student from a student terminal, storing the information to be corrected, transmitting the information to be corrected to a teacher terminal, receiving corrected information from the teacher terminal, and mapping the corrected information and the information to be corrected. According to the present invention, the cost of time required for correcting and teaching can be reduced, and the teacher can provide the student with both corrections on the student's answer sheet and with feedback in the teacher's voice.

Abstract: Methods and apparatus for assessing and promoting learning according to various aspects of the present technology generally comprise presenting a training system to a user that adapts to the user's progress by altering how a training assignment is presented to the user by monitoring the user's progression toward a desired completion criterion. The training system may determine a user's proficiency with the subject matter without a formal or standardized test.

Abstract: A system for providing computer-aided speech and language therapy is provided herein. The system includes: a user interface configured to provide a language or a speech exercise to a patient, over a computer terminal wherein the exercise comprises at least one non multiple choice question; an analyzer configured to analyze performance of the exercise as carried out by the client, to determined a type of error, in a case of an error by the patient; and a guidance generator configured to generate a guidance instructing the patient to a correct answer to the provided exercise, wherein the guidance is generated based, at least partially, on the type of error made by the patient, wherein analyzer and the guidance generator are further configured to repeatedly analyze and generate guidance in further attempts of the patient to perform the exercise.

Abstract: Embodiments described herein disclose methods and systems to automatically present a checklist element to be completed by the medical practitioner. In embodiments, the medical practitioner may indicate that the presented checklist element is completed without using their hands. Therefore, the medical practitioner may maintain a sterile environment while completing checklist elements reducing the amount of time that the medical practitioner uses to complete a medical procedure.

Abstract: Disclosed herein is a method of analyzing examinee item response data comprising constructing a diagnosis model for reporting skill profiles of examinees, wherein the diagnosis model comprises at least a variable representing unobserved subpopulations, creating an item design matrix, distributing examinees across the unobserved subpopulations, iteratively estimating values for a plurality of variables within the diagnosis model, and reporting the estimated values to a user.

Abstract: A method and system for customizing an automated essay scoring system are disclosed. Relative weights may be assigned to a plurality of features for a plurality of benchmark essay responses. Based on the relative weights, automated scores may be determined for one or more first essay responses to a first prompt. The automated scores may be scaled based on one or more scoring standards for the first prompt. A scaled automated score may be assigned for a second essay response to the first prompt based on the scaled automated scores for the one or more first essay responses.

Abstract: The examination support apparatus includes a question database, an answer status database, a question output unit, an answer acquisition unit, a correct/incorrect determination unit, a calculation unit, and a determination unit. The question output unit extracts and outputs examination questions from the question database. The answer acquisition unit acquires an answer to each of the above-described examination questions transmitted from an examinee terminal, and the correct/incorrect determination unit determines whether the answer is correct or incorrect. The calculation unit calculates for the examinee a correct-answer percentage to the examination questions in the same administering section based on a result of the correct/incorrect determination.

Abstract: Methods and systems for providing educational and instructional programs to users through wireless and cellular technology is disclosed. The method is designed to be highly flexible to allow the user a broad range of course selections, instruction difficulty level, and format of the instruction provided to the user. In a preferred embodiment of the method, the core steps comprise (a) authorizing the subscriber information; (b) identifying the selected curriculum, grade level, and format for the requested instruction; (c) selecting an appropriate question; (d) transmitting the selected question to the subscriber's cellular device; (e) receiving the subscriber's answer to the transmitted question; (f) determining whether the subscriber's answer is correct; (g) advising the subscriber whether the transmitted answer was correct; (h) recording and tracking the subscriber's answers in a database and then repeating the selecting process, and updating and analyzing the subscriber's progress.

Abstract: To automatically annotate an essay, a sentence of the essay is identified and a feature associated with the sentence is determined. In addition, a probability of the sentence being a discourse element is determined by mapping the feature to a model. The model having been generated by a machine learning application based on at least one annotated essay. Furthermore, the essay is annotated based on the probability.

Abstract: A method of capturing student performance can be provided that includes enabling a course creator to generate assessment data related to learning assessments for an online course and to generate learning outcomes for the online course, associating the assessment data with the learning outcomes, such that at least some of the learning assessments correspond to at least some of the learning outcomes, and generating an online classroom. The method may further include providing the learning assessments to students enrolled in the online course using the online classroom, wherein the students can generate completed learning assessments, and determining, for each of the completed learning assessments, whether one or more of the learning outcomes were met by each of the students.

Abstract: Creation of a standardized test, that includes a sub-pool of questions, involves assembling the sub-pool from a pool of questions. The sub-pool satisfies one or more constraints. Multiple mutually disjoint sub-pools of questions are assembled from the pool of questions.

Abstract: A method of gathering information from respondents, the method including posing a primary question to the respondents, receiving primary question answers from the respondents, posing a secondary question to at least a sub-portion of the respondents, the secondary question corresponding to the primary question, receiving secondary question answers from the respondents, and scoring a primary question answer received from a selected respondent as a function of i) the primary question answer received from the selected respondent and ii) answers to the primary and secondary questions received from the respondents.

Abstract: A computer-implemented method of overseeing and adjusting the instruction and evaluation of a student with respect to one or more topics of study within a classroom. The subject matter of an academic course is studied and broken down into a plurality of discretely defined behavioral performances designed to be readily and objectively recognized as being mastered or not by a student. One or more of the discretely defined behavioral performances are then selected, with the aid of a first computerized database system, as learning objectives for the week. At the end of the week, a student is subsequently evaluated on these objectives. Results of the evaluation are then transferred to a second computerized database system, which organizes the collected data into an interactive learning management report that can be configured by a reviewer in real time to display a variety of levels of detail.

Abstract: What is disclosed is a novel system and method to control an imaging device. A first collection of a plurality of two-dimensional image points in a first vector space for a source image and a second collection of a plurality of two-dimensional image points in a second vector space for a target image are received. The first collection of two-dimensional image points and the second collection of two-dimensional image points are converted into a homogenous form to apply affine matrix transformations. A matrix transformation is solved to map the first collection of the plurality of two-dimensional image points to the second collection of the plurality of two-dimensional image points. The matrix transformation is used to adjust distortion of the target image in an imaging device.

Abstract: A method and an apparatus to provide machine-assisted training have been disclosed. In one embodiment, the method includes monitoring action performed by a trainee during machine-assisted training and dynamically adjusting the machine-assisted training in response to the trainee's action. Other embodiments have been claimed and described.

Abstract: The invention relates to a method and means of grading students. This invention is a software application utilizing profiling techniques that when combined or imbedded with available knowledge on the human learning experience will individually evaluate each student based on their current ability and capacity to learn, by subject. Student's tests are graded electronically against their personal ability and capability profile for grade. The profile system software is applicable to many learning situations requiring a measured outcome.

Abstract: The present invention is a method for testing and developing Artificial Intelligence, more particularly intelligence of machines, based on prediction of elements in human-generated documents. Essentially, if Artificial Intelligence can predict elements as effectively as human subjects, it can be considered an intelligent as human beings.

Abstract: A method of testing and improving recall information using an automated device. An item of information is connected to an initial prompt by a relationship link. The device presents the initial prompt to the user who recalls information and links to the prompt. The device reviews the information and links and the user compares the reviewed intended information with the recalled information. The user provides inputs to the device indicating an ability to recall the information and links. The inputs provided by the user are used to calculate a re-testing interval for each item of information. The device automatically re-test the user after the interval calculated for each item of information has elapsed. A longer interval is used for items of information recalled exactly than the interval for items of information not recalled exactly. At re-testing information not yet done for re-testing is presented to the user.

Abstract: A system and method for testing labor resources is disclosed. The method includes defining core skill set requirements for a project and/or job and defining each according to expertise and experience requirements is disclosed. The defined skill set requirements and their corresponding expertise levels are provided into a tool via a web interface where they are used to compile an examination from questions selected from a database. The invention further administers the compiled examination to one or more candidates, scores the examination, transmits results and analysis to a hiring manager and accepts subjective input from the hiring manger following a personal interview. Subjective input is used to adjust future weighting values of the examination questions.

Abstract: Disclosed is a testing and learning method comprising a testing system that registers a student as having passed a test when the student completes a testing option chosen from the group consisting of (1) answering one hundred percent of the questions in a set of questions within a required time, (2) answering one hundred percent of the questions in a series of sets of questions, but failing to answer any individual set of questions within the required time, and (3) providing a cumulative percentage of correct answers over a series of sets of questions.

Abstract: A question item comprising: textual, visual or auditory subject matter; a query or instruction pertaining to the subject matter; and a representation of a response mechanism for receiving a user response to the query or instruction, may be retrieved from a data store. The subject matter, query or instruction and response mechanism may be presented in a presentation sequence, wherein a presentation duration of each of the subject matter, query or instruction and response mechanism is controlled by user input. Based on the user input, a presentation duration of each of the subject matter, query or instruction, and response mechanism may be determined. Each of the three presentation durations may be stored. A completion time may be determined based on one or more of the presentation durations and may be stored along with response accuracy, for use in calculating a user competency measure for the question item.

Abstract: The present subject matter discloses a method and system (100) for conducting examination for at least one candidate. In one implementation, the method includes enrolling the at least one candidate. The method further includes managing at least one examination resource based at least on enrolling of the at least one candidate. A plurality of question papers is generated to evaluate the at least one candidate based at least on an assessment type. Furthermore, the method includes evaluating the at least one candidate based at least on the assessment type. The assessment type can be at least one of an online assessment and an offline assessment.

Abstract: Methods and computer-based products are described for standardized, controlled, peer review of responses to defined material. A logic application for standardizing the defined material, a database for storing information, a program component, and a user interface are described. The user interface is adapted to display standardized material to a user and allow that user to construct a response to the material. The program component is adapted to select at random a pre-defined number of peer responses to the same standardized material to be simultaneously displayed to the user along with the user's response. The user is then allowed to judge all of the responses in reference to one another, and possibly an externally provided reference. The program component is adapted to determine the frequency of responses solicited, limit the display of peer responses, and quantify the user's evaluation to produce feedback related to the relative quality of responses reviewed.

Abstract: Described is a method using a computer for grading student work on a problem when the student's own steps are shown in detail. A reference trace is created representing a best solution path to the problem.

Abstract: Systems and methods for building a model for use in grading an essay are provided. A plurality of human graded essays are evaluated using a processor to generate a set of features. A score category is determined for each of the plurality of human graded essays. A weight is produced using a processor for each feature based on the score category for each of the plurality of human graded essays and the set of features. A model is generated using a processor based on the weights for the set of features for evaluating an essay. The set of features includes n features, where the first k features have optimized weights, and the last n?k features have fixed predetermined weights.

Abstract: Systems and methods for building a trait model for essay evaluation are provided. At least one evaluated essay is received. A plurality of features pertaining to one or more traits from the at least one evaluated essay are identified and extracted. The one or more traits comprise writing errors, discourse, or vocabulary usage. A plurality of vector files based upon the plurality of features are created. A trait model for essay evaluation based upon the plurality of vector files is built. The trait model is evaluated, where the evaluation includes mapping features of a new essay to the trait model by navigating a multi-branched decision tree. At each branch of the decision tree, a value associated with the features of the new essay is used to determine how to proceed through the trait model.

Abstract: The invention relates to a method and means of grading students. This invention is a software application utilizing profiling techniques that when combined or imbedded with available knowledge on the human learning experience will individually evaluate each student based on their current ability and capacity to learn, by subject. Student's tests are graded electronically against their personal ability and capability profile for grade. The profile system software is applicable to many learning situations requiring a measured outcome.

Abstract: Provided herein are methods and systems for training and/or assessing competency of an individual who is a medical student or medical professional. The methods comprise the steps of: (a) providing a first module of one or more graded slides; (b) testing an individual's knowledge of the slides; (c) scoring the individual's knowledge; and (d) comparing the score to a baseline score or a standard score. A score above the baseline score or standard score indicates the individual's competency. The steps can further comprise providing feedback regarding the individual's knowledge of the slides.

Abstract: Systems and methods for creating a mathematical model for use in identifying discourse elements are described. A plurality of first essays relating to a particular subject are received, where each first essay is in an electronic format. Annotations for each first essay are received, where each annotation identifies at least one discourse element. Features are identified with a processor, where each feature is exhibited by at least one identified discourse element. Empirical frequencies are computed with a processor, where each empirical frequency relates to the presence of a feature with respect to the identified discourse elements across the plurality of first essays. Each empirical frequency is associated with the related identified discourse element with a processor. The empirical frequencies are utilized to select discourse elements in at least one second essay.

Abstract: Systems and methods are provided for selecting a proposed test item for inclusion in an examination where a non-multiple choice response to the proposed test item will be automatically scored. A proposed test item is analyzed to generate a proposed test item metric, where the proposed test item is a non-multiple choice test item. The proposed test item metric is provided to a proposed test item scoring model, where the proposed test item scoring model outputs a likelihood score indicative of a likelihood that automated scoring of a response to the proposed test item would be at or above a quality level. The proposed test item is selected for inclusion in the examination based on the likelihood score.

Abstract: A natural interactions academic course designer system and method that allows an educator to integrate a natural interactions forum (such as discussion boards, blogs, and collaborative wikis) into a formal curriculum. Embodiments of the system and method include a natural interactions integration module, which allows an educator to select a type of natural interaction forum and attaches a rubric, and a natural interactions provisioning module that creates the forum, determines the participants, and the learners to be assessed. Embodiments of the system and method also include an assessment module that assesses a validated learner using one or more of three different metrics. These metrics include a participation metric, a tagging metric, and a natural language processing metric. The assessment module then creates a raw score from the metrics used. Embodiments of the system and method also include a learner tracking module that generates a single final score for the assignment.

Abstract: A portable storage apparatus is configured to interface with a computer having a processor. The portable storage apparatus comprises a wireless transceiver for transmitting and receiving data, an operating system, and a memory containing data representing a plurality of questions. The portable storage apparatus is configured to receive data representative of a question identification number, to communicate a question, from the plurality of questions, corresponding to the question identification number, to receive data representative of a response to the question, and to transmit the data representative of the response.