System, apparatus and method for maximizing effectiveness and efficiency of learning, retaining and retrieving knowledge and skills
A system, method and apparatus for maximizing the effectiveness and efficiency of learning, retaining and retrieving knowledge and skills includes a main engine having a Learn Module, a Review Module and a Test Module. Each of the Learn, Review and Test Modules are capable of operating independently but are preferably arranged to operate interactively such that operation of each of the Learn, Review and Test Modules are changed based on a user's past performance within one or more of the three modules. In addition, the main engine may also include a Schedule Module for flexibly scheduling learning, reviewing and retrieving knowledge and skills based on various factors and input information. The main engine also may include a Progress Module which monitors a user's performance on any of the Learn, Review and Test Modules and changes the future operation of each module based on the monitored performance. The main engine also may include a Help Module to provide assistance with any of the other modules.
1. Field of the Invention
The present invention relates to a system, apparatus and method for learning, and more specifically, relates to a system, apparatus and method for interactively and adaptively maximizing the effectiveness and efficiency of learning, retaining and retrieving knowledge and skills including flexibly scheduling learning, retaining and retrieving knowledge and skills based on various factors and input information.
2. Description of Background Art
Previous systems and methods for learning have focused on presenting an item or items to be learned in a paired-associate format, such as a cue and response system. These prior art systems and methods have relied heavily on the motivation and metacognitive skills of the student and therefore, have varying degrees of effectiveness and efficiency. More importantly, such prior art methods and systems have very limited success in terms of a student actually acquiring knowledge or skills rapidly, ensuring that the student maintains the knowledge and skills to a high degree of retention for an extended period of time, and enabling the student to retrieve knowledge and skills automatically at some future date.
In a well known prior art method, a paired-associate learning method is embodied in a group of flashcards which may be presented manually or electronically via a computer, for example. In a typical example of such a method, a student starts by separating flashcards into two groups: known and unknown. The student studies each unknown flashcard by first viewing the question on one side of the flashcard and then formulating a response to the question. The student then turns the card over and views the answer provided. The student judges the adequacy of his response by comparing his answer to the correct answer. If the student believes he has learned or “knows” the paired-associate, that flashcard is placed in the group of known items. When the student has studied all of the flashcards in the first unknown group, and all of the flashcards have been transferred to the group of known flashcards, the student may review the group of known items in the same manner as described above. In an alternative method, the cards can be shuffled for learning. Thus, in this method, the learning and review is performed by a student simply looking at flashcards to determine correct responses and reviewing the flashcards as desired, with no fixed schedule or sequence.
In another method invented by B. F. Skinner, a method of learning and reviewing is provided. More specifically, Skinner discloses a machine which presents a number of paired-associate questions and answers. The learning machine has an area for providing questions, and an area where the user writes in an answer to these questions. At the time the question is presented, the correct answer is not visible. A student reads a question and then writes in an answer in the area provided. The user turns a handle which causes a clear plastic shield to cover his answer while revealing the correct answer. The user judges the adequacy of his response. If the user judges that his answer is adequate, he slides a lever which punches a hole in the question and answer sheet and turns a handle revealing the next question. If the answer is judged to be inadequate, the user simply turns a handle revealing the next question. After all of the questions have been answered a first time, the user can make a second pass through the questions and answers. The machine operates such that only the questions which were answered incorrectly in the first pass are viewable during the second pass so as to provide a review of questions which were answered incorrectly. Thus, this conventional method provides a crude method of enabling review of missed questions.
A slightly more advanced method was invented by Sebastian Leitner and described in “So Lernt Man Lernen.” The method involves studying flashcards as in the method described above, but in addition, involves using a specially constructed box to calculate review schedules. More specifically, the box has five compartments increasing in depth from the first compartment to the fifth compartment. According to Leitner's method, a student takes enough “unknown” flashcards to fill the first compartment and places them in the first compartment. The student begins by taking the first card out of the box and reading the question. The student then constructs an answer and compares it to the correct answer on the back of the card. If the student is correct, the student places the flashcard in the second compartment. If the student cannot construct an answer, or if the student's answer is incorrect, the student places the flashcard at the back of the group of cards in the first compartment. This process continues until all of the cards have been moved to the second compartment and the student stops the learning session. The next learning session begins by placing new “unknown” cards into the first compartment. The process of studying and sorting is performed as described above until once again, no cards remain in the first compartment. At some future date, the second compartment will be full of cards placed there during previous learning sessions. At that time, the student begins to study the cards in the second compartment, except this time, known cards are placed into the third compartment and unknown cards are placed backed into the first compartment. New cards are continually introduced into the first compartment and are moved through the compartments as they are learned and reviewed Cards that are easily remembered or known are moved from the more shallow compartments to the deeper compartments and therefore are reviewed less and less frequently. Cards that are more difficult to learn are put back into the more shallow compartments for more frequent review. This method provides a crude form of scheduled review of learned items based on item difficulty.
A computer-based version of Leitner's method is provided in the German language computer software program entitled Lernkartei PC 7.0 and in the Spanish language computer software entitled ALICE (Automatic Learning In a Computerized Environment) 1.0. With ALICE 1.0, question and answer units are presented to a user and the number of cards and interval of time between study sessions are distributed to adapt to a user's work habits.
Other conventional methods have recognized the importance of developing a system to present items for review. For example, a computer program developed by Piotr Wozniak in Poland and referred to as “SuperMemo” uses a mathematical model of the decline of memory traces to determine spacing of repetitions to maintain long term retention of paired-associates.
In another prior art method described in U.S. Pat. Nos. 5,545,044, 5,437,553 and 5,577,919 issued to Collins et al., paired-associates are presented to a user for learning. However, unlike the conventional methods described above, in this invention, the user is first queried as to whether a particular item is perceived to be known or unknown, not whether the user actually knows the item, or knows the correct answer to a question. That is, a user is asked to determine whether they think they know the correct response to the cue, not what the correct response actually is. Then, a sequence of perceived known items and perceived unknown items is generated and presented to the user in the form of cue and response for learning. Similar to the first conventional method described above, the question of the perceived known or unknown items is presented to a user, the user constructs a response to the presented cue and then compares the constructed response to the correct response.
The prior art methods described above have generally proven to be only marginally effective for learning, retaining and retrieving knowledge and skills. The prior art methods often require a user to schedule and manage the learn, review and test processes which consequently consumes a portion of the cognitive workload of the user thereby reducing efficiency of learning, retaining and retrieving knowledge and skills. The cognitive workload is the amount of mental work that an organism, such as a human, can produce in a specified time period. By diverting some of the cognitive workload away from learning, the organism is distracted from learning and cannot devote all of the available cognitive resources to learning.
Furthermore, because the user is making subjective judgements of perceived knowledge, they provide feedback to the method that is distorted by certain cognitive illusions inherent in self-paced study. These subjective inputs result in less effective learning than would otherwise be possible. Furthermore, even though some of the prior art methods monitor progress of learning or reviewing or testing, future learning or reviewing or testing are not modified based on a student's actual performance results.
In addition, most prior art methods seek to train or teach knowledge or skills only to a level of recall in which a person or organism must expend significant cognitive effort to attempt to remember an item previously learned. Conventional methods have not been successful in training or teaching knowledge or skills to a level of automaticity in which performance is characterized by an extremely rapid response without conscious effort or attention.
Also, there are many different theories, scientific principles, and concepts relating to learning, memory and performance which seek to explain how humans and other organisms are able to encode, store and retrieve knowledge and skills. Although these theories, principles and concepts have been studied, they have not been quantitatively measure and applied in a synergistic and effective manner to improve learning, reviewing and retrieving knowledge and skills. Furthermore, the prior art methods do not train a student to become a better learner by monitoring and improving their metacognitive skills, but merely provide a marginal improvement in the ability to encode and recall learned items.
SUMMARY OF THE INVENTIONTo overcome the problems described above and to provide other significant and previously unattainable advantages, preferred embodiments of the present invention provide a system including various apparatuses and methods for maximizing the effectiveness and efficiency of learning, reviewing and retrieving knowledge and skills in an interactive and adaptive matter that minimizes the cognitive workload or mental effort of the user, while minimizing or eliminating forgetting of the knowledge or skills learned.
In addition, preferred embodiments of the present invention provide a system including apparatuses and methods for allowing a user to encode, store and retrieve knowledge and skills flexibly and efficiently in response to overt and covert inputs from the user or other sources of input information, such as a desired level of memory strength, the date when the knowledge or skills are needed, the schedule of availability to use the system and many other factors.
More specifically, preferred embodiments of the present invention provide a system including various apparatuses and methods for maximizing the ease of use of the system and maximizing the results of learning, retaining and retrieving of knowledge and skills by allowing a user, administrator or other input information source to interactively and flexibly input information to be learned, identify confusable items to be learned, select desired levels of initial learning and final retention of knowledge or skills, and input preferences regarding scheduling of learning, reviewing and testing and other input information relating to the learning, reviewing and testing of knowledge or skills. Based on these and other input information, the system schedules operation of the learn, review and test operations in the most efficient way to guarantee that the user achieves the desired degree of learning within the desired time period.
Furthermore, preferred embodiments of the present invention provide a system including apparatuses and methods which include a Learn Module for presenting new knowledge or skills to a user, a Review Module for presenting previously learned knowledge or skills to a user in order to maintain a desired level of retention of the knowledge or skills learned previously, and a Test Module for testing of previously learned knowledge or skills. Each of the three modules are preferably adapted to interact with the other two modules and the future operation of each of the Learn, Review and Test modules and scheduling thereof can be based on previous performance in the three modules to maximize effectiveness and efficiency of operation.
The advantages achieved by basing the interaction and scheduling of the Learn, Review, and Test Modules on previous performance in the three modules include achieving much more effective and efficient combined and overall operation of each of the three main modules so that a user encodes, stores and retrieves knowledge and skills much more effectively and efficiently, while also becoming a better learner.
Also, preferred embodiments of the present invention provide a system including various methods and apparatuses which provide an extremely effective method of encoding, storing and retrieving knowledge or skills which are quantitatively based and interactively modified according to a plurality of scientific disciplines such as neuroscience (the scientific study of the nervous system and the cellular and molecular mechanisms associated with learning and memory), cognitive psychology (an approach to psychology that emphasizes internal mental processes), and behavioral psychology (an approach to psychology that emphasizes the actions or reactions produced in response to external or internal stimuli), as well as scientific principles including: active recall (the process whereby a student constructs a response to a presented cue as opposed to passive recall in which a student simply observes a cue and response paired presented), the alternative forced-choice method (a test of memory strength sensitive to the level of recognition in which a cue is presented followed by the correct response randomly arranged among several alternative choices called distracters, and in which the student must discriminate the correct response from the distracters), arousal (the student's experience of feeling more or less energetic which feeling is accompanied by physiological changes in perspiration, pupil diameter, respiration and other physiological reactions, and which influences information processing, in particular, the encoding and retrieval of information), attention (the ability or power to concentrate mentally by focusing on certain aspects of current experience to the exclusion of all others), automaticity (performance characterized by rapid response without conscious attention or effort), the auditory rehearsal loop (the process of rehearsal, usually via subvocal speech, to maintain verbal information in memory, in which the loop is capable of holding approximately 1.5 to 2.0 seconds worth of information), classical conditioning (the procedure in which an organism comes to display a conditioned response to a neutral conditioned stimulus that has been paired with a biologically significant unconditioned stimulus that evoked an unconditioned response), cognitive workload (the amount of mental work that a student produces or can produce in a specified time period), confidence (a subjective judgement made regarding the degree of certainty of the correctness of a constructed response or of a subjective evaluation), consolidation (the initial period of time in memory formation when information in a relatively transient state is transformed to a more permanent, retrievable state), consolidation period (the interval during which the transformation to the more permanent retrievable state occurs), contiguity (two items occurring or being presented close together in time), contingency (two items being presented or occurring in a manner such that the occurrence of one item increases the probability that another item will occur, which is required to form a conditioned association), discrimination (the act of distinguishing between two or more items by noting the differences between the two or more items), ease of learning (a metacognitive judgement made in advance of knowledge acquisition in the form of a prediction about what will be easy or difficult to learn), encoding specificity (the theory that memory performance is better when tested in the presence of the same cues that were present when the memory was formed), encoding variability (the theory that memory performance is better when multiple cues are available to generate a desired response), feeling of knowing (a metacognitive judgement made during or after knowledge or skill acquisition as to whether a given, currently non-recallable item is known or will be remembered on a subsequent retention test), generalization (when a response is evoked by a cue other than the one it was conditioned to), habituation (a decrease in response as a result of repeated exposed to a stimulus), instrumental conditioning (a situation in which a particular stimulus occurs and if an organism generates a response, then a particular reinforcer will occur), interference (a negative relationship between the learning of two sets of material), judgement of learning (a metacognitive judgement during or soon after knowledge acquisition which is a prediction about future test performance on currently recallable items), the labor-in-vain effect (in self-paced study, students make metacognitive judgements that determine the allocation of effort and often study beyond the point where any benefit is derived), latency of recall (a measure of time required to construct a response to a presented cue), learned helplessness (when a negative reinforcement is provided independent of a student's performance, the student behaves as though they have no control over their situation), long term potentiation (when appropriate stimulation is provided to some areas of the brain, there is a long term increase in the magnitude of the response of the cells to further stimulation), memory activation (the availability of an item in memory such that items which have been recalled recently have relatively higher activation than those that have not), memory strength (a property of memory which increases with repeated practice and is the degree to which a cue can activate a memory record), metacognition (the process of monitoring and controlling mental processes, particularly those associated with the acts of learning and retrieving), overlearning (learning that continues past the point where the student is first able to construct the correct response to a presented cue), paired-associate learning (a memory procedure in which the student learns to give a response when presented with a cue), performance (the observable qualities of learning; sometimes measured by the ability to discriminate a signal from noise), probability of recall (a measure of the likelihood that a student will be able to construct the correct response to a presented cue), rapid serial visual presentation (the presentation of a passage of text, one word or phrase at a time, serially, each in the same position on a display, so as to increase reading speeds and eliminate saccades required in normal reading), rehearsal (the process of repeating information to oneself in order to remember it), reinforcement (following a behavior with an especially powerful event such as a reward or punishment), the retrieval practice effect (the act of retrieving an item from memory facilitates subsequent retrieval access of that item and the act of retrieval does not simply strengthen an item's representation in memory, it also enhances the retrieval process), savings in relearning (a measure of memory strength calculated by measuring the amount of time necessary to relearn an item to the same criteria as that attained in the initial learning session), sensitization (increase in response as a result of repeated exposure to a stimulus), the serial position effect (the observation that items at the beginning and end of a list that are learned in serial order are more easily remembered than items in the middle of the list), signal detection theory (a method used to measure the criterion an observer uses in making decisions about signal existence and to measure the observer's sensitivity that is independent of his decision criteria), the spacing effect (the finding that for a given amount of study time, spaced presentations yield substantially better learned than massed presentations), the time of day effect (differences in performance on learning tasks and other factors relating to circadian rhythms depending on the time of day), transfer appropriate processing (the concept that memory performance is better when a student processes an item in the same way in which the item was processed during learning or study), vigilance (the process of paying close and continuous attention), Von Restorff effect (the observation that an item from one category that is learned as a part of a serial list of items all from a different category will be more easily recalled than items from around it in the list) and many other important factors which are applied in novel and unique ways, both individually and in combination with other factors. For the first time, the above-listed factors or phenomena are measured in a quantifiable manner and the measurements of the effects of these factors are used to interactively and adaptively modify the processes of learning, reviewing and testing knowledge and skills to achieve results never before obtainable.
While the above-listed factors have been studied in the past, and the effects thereof sometimes even measured, the measurements have not been quantified and then used in a feedback system to continuously and interactively modify future encoding, storage and retrieval of knowledge and skills to achieve maximum effectiveness and efficiency.
The system, apparatuses and methods of preferred embodiments of the present invention may be used to perform learning, reviewing and testing of any type of knowledge and skills in any format. The information including knowledge or skills to be learned, reviewed and tested, referred to as “content,” can be obtained from any source including but not limited to a text source, an image source, an audible sound source, a computer, the Internet, a mechanical device, an electrical device, an optical device, the actual physical world, etc. Also, the content may already be included in the system or may be input by a user, an administrator or other source of information. While the knowledge or skills to be learned, reviewed and tested may be presented in the form of a cue and response or question and answer in preferred embodiments of the present invention, other methods and formats for presenting items to be learned, reviewed and tested may be used.
More specifically, the content is preferably arranged in paired-associate (cue and response) format for ease of learning. The paired-associates may be presented visually, auditorily, kinesthetically or in any other manner in which knowledge or skills can be conveyed. The content may be also arranged in a serial or non-serial procedural order for skill-based learning. Any other arrangements where there is any form of a cue with an explicit or implicit paired response or responses are appropriate for use in the systems, methods and apparatuses of preferred embodiments of the present invention.
In one specific preferred embodiment, a system includes a Learn Module, a Review Module and a Test Module, each of which is arranged to interact and adapt based on the performance and user results in the other two modules and the particular module itself. That is, operation and functioning of each of the Learn, Review and Test Modules are preferably changed in accordance with how a user performed in all modules. The Learn Module, the Review Module and the Test Module preferably define a main engine of the system which enables information to be encoded, stored and retrieved with maximum efficiency and effectiveness.
A Discriminator Module may be included in the main engine to assist with the learning, reviewing and testing of confusable items.
A Schedule Module may also be included in the main engine to schedule the timing of operation of each of the Learn, Review and Test Modules. The scheduling is preferably based on a user's performance on each of the Learn, Review and Test modules, in addition to input information. The Schedule Module completely eliminates all scheduling planning and tasks which are normally the responsibility of the user, and thereby greatly increases the cognitive workload and metacognitive skills that the user can devote completely to learning, reviewing and testing of knowledge or skills.
Further, a Progress Module may be included in the main engine for monitoring a user's performance on each of the Learn, Review and Test Modules so as to provide input to the system and feedback to the user whenever desired. The Progress Module presents critical information to the user about the processes of learning, reviewing and testing in such a manner as to enable the user to increase his metacognitive skills and become a much better learner both with the system of preferred embodiments of the present invention and also outside of the system.
Also, a Help Module may be provided to allow a user to obtain further instructions and information about how the system works and each of the modules and functions thereof. The Help Module may include a help assistant that interactively determines when a user is having problems and provides information and assistance to overcome such difficulty and make the system easier to use. The Help Module may provide visual, graphical, kinesthetic or other types of help information.
It should be noted that although in the preferred embodiment of the present invention described in the preceding paragraph, the system preferably includes an interactive combination of Learn, Review and Test Modules, each module can be operated independently, and each module has unique and novel features, described below, which are independent of the novel combination of elements and the interactive and adaptive operation of the main engine described above.
In addition, other modules may be provided and used with the system described above. These other modules are preferably not included as part of the main engine, but instead are preferably arranged to interact with the main engine or various modules therein. For example, a Create Module may be provided outside of but operatively connected to the main engine to allow for input of knowledge or skills to be learned, retained or retrieved. The Create Module thus enables a user, administrator or other party to input, organize, modify and manage items to be learned so as to create customized lessons.
An Input Module may also be included and arranged similar to the Create Module. The Input Module is preferably arranged to allow a user, administrator, or other party to input any information that may affect operation of the modules of the main engine. Such input information may include information about which of the main engine modules is desired to be activated, changes in scheduling of learning, reviewing or testing, real world feed back which affect the learning, reviewing and testing and any other information that is relevant to the overall operation of the system and the modules contained in the main engine.
Also, a Connect Module may be provided outside of but operatively connected to the main engine to all external systems such as computers, the Internet, personal digital assistants, cellular telephones, and other communication or information transmission apparatuses, to be connected to the main engine. In fact, the Connect Module may be used for a variety of purposes including allowing any source of information to be input to the main engine, allowing multiple users to use the system and main engine at the same time, allowing a plurality of systems or main engines to be connected to each other so that systems can communicate. Other suitable connections may also be achieved via the connect module.
Another preferred embodiment of the present invention provides a method of learning including the steps of presenting knowledge or skills to be learned so that the knowledge or skills to be learned become learned knowledge or skills; presenting the learned knowledge or skills for review in a way that is different from the way in which the knowledge or skills are presented during learning, and presenting knowledge or skills for reviewing or testing whether the learned knowledge or skills have actually been learned. The method includes a step of monitoring each of the above steps and changing scheduling of each step based on progress in each step without the user knowing that monitoring or scheduling changes are occurring.
As noted above, with respect to the Input Module, the main engine and the methods performed thereby, can communicate with the real world allowing for feedback, information exchange and modification of the operation of the modules of the main engine based on real world information. All of these modules are preferably interactive with the Schedule Module and scheduling process which determines sequence of operation of the three modules and responds to the input information from the various input sources and optimizes the schedule of operation of the learn, review, and test processes.
The system, including the various methods and apparatuses of preferred embodiments of the present invention, is constructed to have a highly adaptive interface that makes the system extremely streamlined and progressively easier to use each time a user operates any of the modules of the system. The system preferably prompts a new user for identification information such as a password or other textual, graphical, physiological or other identifying data that identifies each user. Then, the adaptive interface determines the pattern of usage, and with what level of skill that particular user has operated the system. Based on this information, the system adapts to the user's familiarity level with the system and changes the presentation of information to the user to make it easier and quicker to use the system. For example, cues, instructions, help messages and other steps may be skipped if a particular user has operated the system many times successfully. Preferably, the Help module is preferably available should an advanced user forget how to operate the system.
The various systems, methods and apparatuses of preferred embodiments of the present invention may take various forms including a signal carrier wave format to be used on an Internet-based system, computer software or machine-executable or computer-executable code for operation on a processor-based system such as a computer, a telephone, a personal digital assistant or other information transmission device. Also, the systems, methods and apparatuses of preferred embodiments of the present invention may be applied to non-processor based systems which include but are not limited audio tapes, video tapes, paper-based systems including calendars, books, and any other documents.
The items to be learned, reviewed and tested using the systems, methods and apparatuses of preferred embodiments of the present invention are not limited. That is, items to be learned, reviewed and tested can be any knowledge, skill, or other item of information or training element which is desired to be learned initially and retrieved at a later date, or used to improve or build a knowledge base or skill base, to change behavior or thought processes, and to increase the ability to learn, review and test other items. For example, the systems, methods and apparatuses of preferred embodiments of the present invention may be used for all types of educational teaching and instruction, test preparation for educational institutions and various certifications such as CPA, bar exams, etc., corporate training, military and armed forces training, training of police offices and fire/rescue personnel, advertising and creating consumer preferences and purchasing patterns, mastering languages, learning to play musical instruments, learning to type, and any other applications involving various knowledge or skills. That is, the real-world applications of the systems, methods and apparatuses of preferred embodiments of the present invention are not limited in any sense.
Other features, advantages, elements and modifications of preferred embodiments of the present invention will become more apparent from the detailed description of the present invention below.
BRIEF DESCRIPTION OF THE DRAWINGSA more complete appreciation of the present invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description of preferred embodiments when considered in connection with the accompanying drawings, wherein:
Hereinbelow, a plurality of preferred embodiments of the present invention are explained referring to the several drawings. Hereinafter, like reference numerals indicate identical or corresponding elements throughout several views.
The system 10 preferably includes a main engine 20. The main engine 20 preferably includes a Learn Module 21, a Review Module 22 and a Test Module 23. The Learn Module 21 is adapted to encode knowledge or skills via a process for creating a memory record. The Review Module 22 is adapted to store knowledge or skills via a process of maintaining a memory record over time through rehearsal. The Test Module 23 is adapted to retrieve knowledge or skills via a process of producing a response to a presented cue automatically or through active recall.
The Learn Module 21, the Review Module 22 and the Test Module 23 preferably operate together and interact with each other to improve the learning, memory and performance of a user of the system 10. To this end, the cooperation between the Learn Module 21, the Review Module 22 and the Test Module 23 allows a user to learn via a process by which relatively permanent changes occur in the behavioral potential as a result of interaction of these modules, to achieve memory for each item which is the relatively permanent record of the experience that underlies the learning, and to achieve high levels of performance including various observable qualities of learning.
As shown in
The system 10 and the methods thereof can be implemented on any platform and with any type of system including a paper-based system, a computer-based system, a human-based system, and on any system that presents information to a person or organism, for learning and future retrieval of that information. For example, the system 10 may be a non-processor based system including but not limited to audio tapes, video tapes, paper-based systems such as a word-a-day calendar described later with respect to
As will be described in more detail below, the main engine 20 may also include a Schedule Module 25, a Progress Module 26, a Help Module 27 and a Discriminator Module 28.
The system 10 may also be adapted to interact with various elements or modules external to the system, such as an Input Module 100, a Create Module 200 and a Connect Module 300 shown in
It should be noted that the modules 21, 22, 23, 25, 26, 27, 28, 100, 200, 300 and other modules described herein are preferably processes or algorithms including a sequential series of steps to be performed. The steps may be performed via a plurality of different devices, apparatuses or systems. For example, the steps to be performed by the main engine 20 including modules 21, 22, 23, 25, 26, 27, 28 may be performed by various devices including as a computer, any type of processor, a central processing unit (CPU), a personal digital assistant, a hand-held electronic device, a telephone including a cellular telephone, digital data/information transmission device or other device which performs the steps via processing of instructions embodied in machine readable code or computer executable code such as computer software.
Each of the modules external to the main engine 20 will be described and then each of the modules of the main engine 20 will be described.
The processes or steps to be performed by the Input Module 100, the Create Module 200 and the Connect Module 300 may be performed by various devices including a keyboard, microphone, mouse, touchscreen, musical keyboard or other musical instrument, telephone, Internet or other suitable information transmitting device.
The Input Module 100 may be adapted to receive information that is transmitted overtly or covertly from the user. The Input Module 100 can also be used by an administrator of the system such as a teacher. The Input Module 100 can also receive input information from objects or any other source of information existing in the real world. The Input Module 100 is configured to allow a user, administrator, or other party or source of information to input any information that may affect operation of the modules of the main engine 20 or other modules in the system 10. Such input information may include information about which of the main engine modules is desired to be operated, changes in scheduling of learning, reviewing or testing, user performance with the system 10, the type and difficulty of the items to be learned, reviewed and tested, real world feed back which affect the learning, reviewing and testing, and any other information that is relevant to the overall operation of the system 10 and the modules contained in the main engine 20 and outside of the main engine.
Furthermore, the Input Module 100 can be configured to receive information as to the performance of the user of the system 10 through quantitative measurements such as time required to input various responses requested, ability of user to meet and adhere to schedule set up by the system 10, and the user's level of interest and arousal in learning which can be measured by such physiological characteristics as perspiration, pupil diameter, respiration, and other physiological reactions.
As will be described in more detail below, the system 10 accepts and obtains various input information through the Input Module 100 and the future operation of the various modules of the system 10 modified based on this input information. In this way, the system is adaptive to the user's abilities and performance, and other input information so as to constantly and continuously adapt to provide maximum effectiveness and efficiency of learning, retaining and retrieving of knowledge or skills.
The manner in which the information is input to the system 10 via the Input Module 100 is not limited, and may include any information transmission methods, processes, apparatuses and systems. Examples of input devices and processes include electronic data transmission and interchange via computer processors, the Internet, optical scanning, auditory input, graphical input, kinesthetic input and other known information transmission methods and devices.
The Create Module 200 may be provided outside of, but operatively connected to, the main engine 20 to allow for input of knowledge or skills to be learned, retained, and retrieved. The Create Module 200 thus enables a user, administrator or other party to create new customized lessons by inputting items to be learned and by providing additional information about each item that will affect how each item or groups of items will be learned, reviewed and tested to maximize effectiveness and efficiency of the learning system 10.
The Connect Module 300 may be provided outside of, but operatively connected to, the main engine 20 so as to connect all types of external systems and devices such as computers, the Internet, personal digital assistants, telephones, and other communication or information transmission apparatuses, to be connected to the main engine 20. In fact, the Connect Module 300 may be used for a variety of purposes including allowing any source of information to be input to the main engine, allowing multiple users to connect to and use the system 10 and the main engine 20 at the same time, and allowing a plurality of systems 10 or main engines 20 to be connected to each other so that systems 10 and main engines 20 can communicate and share information such as lessons to be learned, performance by an individual in any of the modules, changes in schedule and many other factors, data and information pertaining to operation of the system 10. Other suitable connections may also be achieved via the Connect Module 300.
The Help Module 27 may be provided to allow a user to obtain further instructions and information about how the system 10 works and the operation of each of the modules and functions thereof. The Help Module 27 may include a help assistant that interactively determines when a user is having problems in operating the system 10 and provides information and assistance to overcome such difficulty and make the system 10 easier to use. The Help Module 27 may provide visual, graphical, kinesthetic or other types of help information to the user, either in response to a request from the user or when the system 10 has detected that the user is having difficulty using the system 10. The Help Module 27 may also provide feedback, preferably through the Connect Module 300, to an administrator such as a teacher or some of other third party so as to indicate problems that various users of the system 10 are having.
The Progress Module 26, the Schedule Module 25 and the Discriminator Module 28 will be described after the Learn Module 21, the Review Module 22 and the Test Module 23 are described.
The arrangement and operation of the system 10 of
Similar biological principles apply to operant conditioning or instrumental conditioning which is the procedure in which a particular stimulus condition occurs and if an organism voluntarily emits a response to the stimulus, then a particular reinforcer will occur. For example, a student wishes to learn that the Spanish word for dog is “perro.” The stimulus can be thought of as “dog” and the response “perro”, and the reinforcer may be the teacher's approval.
As seen in
While classical conditioning and operant conditioning have been used in the past for various training and teaching methods, these methods have not been quantitatively measured and then had the resulting quantitative measurements used to modify various timing parameters and steps of a learning process as in preferred embodiments of the present invention as will be described later with respect to
As will be described below in preferred embodiments of the present invention, the presentation of cues and responses in the Learn Module 21, the Review Module 22 and the Test Module 23 interactively adapts the CS-US interval shown in
Conventional methods of learning have recognized the effects of the decay of memory over time as shown in
In contrast to the conventional methods, preferred embodiments of the present invention quantitatively measure the memory strength for each item and for each user, since there are significant differences in memory strength over time for various types of knowledge or skills and for various users which have vast differences in how they encode, store and retrieve knowledge or skills, (i.e. dyslexic, learning disabled, low IQ, etc.). The memory strength over time is quantitatively measured using overt and covert information gathered during the user's operation and activity in the Learn Module 21, the Review Module 22 and the Test Module 23, as well as other modules. The information input to the system 10 to determine memory strength over time include, but are not limited to: rate of initial learning, degree of initial learning, probability of recall, latency of recall and savings in relearning. The quantitative measurement of the memory strength for each item is used to adaptively modify the operation of one or more of the Learn Module 21, the Review Module 22 and the Test Module 23, as well as other modules included in the system 10.
More specifically, the system 10 determines that the memory strength for a particular item has decreased to the minimum retention level by making calculated projections based on the mathematical characteristics of the decline of human memory, the type and difficulty of the item being learned, the recency, the frequency, the pattern of prior exposure, and the user's particular history of past use of the system 10. As can be seen in
Because all learners are not alike, and not all items are equally easy to learn, to maintain in memory and to retrieve, the system 10 preferably constantly monitors the memory strength for each item for each learner to determine the most effective and efficient schedule of Review.
In the system 10 of preferred embodiments of the present invention, there is no single review schedule in the Review Module 22 that is the most effective and efficient to maintain a desired level of retention for each user for each item. Accordingly, the system 10 monitors the users as he learns, reviews and tests himself on each item. Based on measured quantitative results gathered overtly and covertly as described above, the system 10 quantitatively determines when the next review session must occur to maintain the desired level of retention. Thus, the system 10 is adapted to the individual needs of each user.
Eventually, review sessions are scheduled so far apart in time, that the item can be considered to have entered a state of permastore. That is, the item will have been learned and reviewed such that the item is known for the lifetime of the learner. Although memory strength will not decay to a point where the item is lost due to storage failure, the item may be forgotten as a result of low memory activation and the user may experience a retrieval failure. This problem can be reduced or eliminated by scheduling review sessions for particularly important items to maintain a minimum desired level of activation.
In
The system 10 according to preferred embodiments of the present invention monitors not only the correctness of the user's response but also the user's performance, which is the ability to evaluate accurately whether they know the correct response and the incorrect responses. The system 10 according to preferred embodiments of the present invention also measures the time required for the user to make such evaluation about the correct response and incorrect responses.
Instead of using the measured performance to generate sequences of perceived known and unknown items which is not done in any of the preferred embodiments of the present invention, the quantitatively measured performance is fed back and presented, either graphically, auditorily, kinesthetically, or otherwise, to the user, preferably along with the score of accuracy of recall, to provide information to the user about his metacognitive skills in this learning environment and other learning environments, enabling the user to improve how he monitors and controls how he learns and to become a better learner. Because a significant part of learning and retrieval is the ability to discriminate between correct and incorrect answers, the system 10 according to preferred embodiments of the present invention not only teaches the user knowledge or skills, but also trains the user to become a more effective learner by improving the metacognitive skills required for self-paced learning. These are skills necessary to monitor performance during learning, reviewing, and testing. Metacognitive skills include subjective measurements of feeling of knowing, confidence, and judgement of learning, which are measured quantitatively in preferred embodiments of the present invention and then used to modify the future use of the system 10 and the future operation of the various modules therein, including especially the Learn Module 21, the Review Module 22 and the Test Module 23.
For example, the system 10 of preferred embodiments of the present invention preferably uses the measured probability of recall, latency of response, and savings in relearning in the future operation of the Learn Module, the Review Module and the Test Module to further increase the effectiveness and efficiency of learning and performance achieved by the system of the present invention.
Each of the modules including the Learn module 21, the Review Module 22 and the Test Module 23 are preferably arranged and adapted to function either together with the other two of these three modules or to function independently as a stand-alone module.
In addition, other modules such as the Schedule Module 25, the Progress Module 26 and the Help Module 27 may be added to any combination of the Learn Module 21, the Review Module 22 or the Test Module 23 in a system.
It should be noted that each of the Learn Module 21, the Review Module 22 and the Test Module 23 contain many novel aspects, processes, elements and features thereof and can be used independently of the system shown in
Now, each of the various modules will be described.
I. THE LEARN MODULE: The Learn or Encode Module 21 is used to present items to be learned to a user. Learning methods have been known such as the Skinner method described above. The method and system according to the preferred embodiments of the present invention is based on the Skinner method but is modified and greatly improved so as to be adaptive and interactive in response to various factors.
The Learn Module 21 uses the Skinner method of learning through presenting paired-associates of cues and responses. The timing, order of presentation and sequence of each cue and response for the Learn Module 21 is interactively determined based on covert and overt input from the user and may also may be based on information received from various other input sources. Such cover or overt input may relate to the content of knowledge or skills to be learned, timing of presentation of knowledge or skills to be learned including timing between each cue and response in each of the plurality of cue and response items, timing between presentation of groups of cue and response items (time between presentation of one cue and response pair and the next cue and response pair), sequence of presentation of knowledge or skills to be learned and the format of presentation of knowledge or skills to be learned and other factors.
The inputs upon which the presentation of the items in the Learn Module 21 may be from one or more of the user, the administrator, the system 10 including other modules included therein, and any other input source that is relevant to the learning process and operation of the Learn Module 21.
For example, other input sources could be sensed environmental conditions such as time of day. Time of day has an effect on learning for people of various ages and therefore may be input to change the presentation of items in the Learn Module 21. The inputs to the Learn Module 21 may further include various personal and physiological information such as age, gender, physiological activity such as galvanic skin response, information obtained through non-invasive monitoring of brain activity, and other personal factors.
The overt and covert inputs from the various input sources may include information concerning rate of presentation of items, format of presentation of items, sequence of presentation of items, and other information that would affect operation of the Learn Module 21. The method of inputting the overt information is based on a purposeful, conscious decision on the part of a user, administrator, or other source to input information to the system. In contrast, the covert information is input based on physiological information obtained by various sensors obtaining data regarding factors such as a galvanic skin response, pupil diameter, respiration, blood pressure, heart rate, brain activity, and other personal conditions. This information can be obtained by such known sensors including an electromyogram, electroencephalogram, thermometer, and electrocardiogram among others. The covert information is analyzed to determine many factors including a user's attention and vigilance so as to determine to what degree a user is attending to the presentation of information in the Learn Module 21.
The actual cue and response items may be modified in format according to the desires of a user, administrator or based on other input information. In addition, the cue and response items may be supplemented by information such as a facility for pronunciation hints, and other helpful facts or information related to the items being presented for learning in the Learn Module 21. Such additional related information is not part of the cue and response items but is presented with the cue and response items to assist in the learning process.
In addition, items to be learned in the Learn Module 21 may be confusable items and may be presented differently from other items to be learned. This process will be described in more detail in the description of the Discriminator Module 28 below.
The Learn Module 21 operates and is controlled based on many factors including desired degree of initial learning and desired degree of retention over time. A desired degree of initial learning may be input by a user, administrator, or other input source to indicate what degree of memory strength is desired for each item or group of items to be learned. The desired degree of retention is based on the rate of forgetting predicted (
As a general rule, the system, apparatus, and method of preferred embodiments of the present invention seek to provide a level of retrieval that is known as automaticity. Automaticity means that a person knows the knowledge or skills and does not have to expend great effort to remember it. Automaticity decreases the latency of response as well as the cognitive workload during retrieval.
Therefore, the preferred embodiments of the present invention perform encoding for automaticity to achieve “knowing rather remembering.” The prior art assumes mastery is achieved at the time that the first correct answer is provided on a test of recall. Recall, however, is not automaticity. Automaticity can be distinguished from recall because it allows extremely fast retrieval of knowledge or skills. The difference between automaticity and recall is latency of response or how long it takes to respond to a cue or perform a desired skill. Also, simple recall requires relatively more cognitive effort on the part of the person responding to the cue or performing the skill, but automaticity requires far less cognitive effort thereby reducing overall cognitive workload. The net result is that knowledge or skills encoded, retained and retrieved using the method are retrieved quickly and effortlessly.
In order to reduce cognitive workload during learning and thereby reduce fatigue, the pattern, sequence and timing of presentation of items is continuously adjusted in the Learn Module 21 based on quantitative inputs thereto. Items to be learned are preferably presented one item at a time to avoid requiring the user to retain multiple items in short term memory. In addition, the pattern, sequence and timing of items to be learned is determined by the system 10 and therefore, the cognitive effort required for monitoring and controlling the study session is reduced so that a person can learn for a longer period of time and is not distracted from the learning process.
The Learn Module 21 also operates to capture and maintain the user's attention based on psychological phenomenon of habituation and sensitization. One example of sensitization is a person becoming aware of something, such as the sound of a car alarm, which initially captures that person's attention. However, if that stimuli repeats itself over and over, the person becomes oblivious or habituated to it—their brain tunes it out. Accordingly, the presentation pattern, sequence, or timing of items to be learned may be preferably varied so as to vary stimulation in such a way as to avoid habituation or the disengagement from attending to this particular stimuli. The difficulty is that this variation in the above-identified factors should not be done overtly but should be done in a manner that is not so obvious that it becomes a distraction in and of itself, but rather should be done in a more subtle manner, using variations in the presentation pattern, sequence, and timing at the “just noticeable difference” threshold whereby a person notices unconsciously but not actually consciously. In a preferred embodiment of the Learn Module 21, attention that is declining is recaptured through various means such as the use of obligatory attention cues and then by varying the presentation pattern, sequence, and timing of the items presented.
Obligatory attention cues include such sensory events as a blinking light, a tone, object movement or other stimulation that attracts the attention of the user.
In addition, the serial position affect is preferably taken into consideration in the Learn Module 21 and the presentation of items to be learned in the Learn Module 21 is changed in order to eliminate the serial position effect. Providing a non-serial presentation to avoid the serial position effect may be-accomplished by reordering the presentation of the cue and response items. For example, the non-serial presentation of items in the Learn Module 21 can be achieved by spacing apart unknown items to be learned by inserting between the unknown items, a number of items which are randomly selected from a pool of previously learned items.
The Learn Module 21 takes advantage of the psychological phenomenon known as the spacing effect. The spacing effect states that for an equal number of presentations of an item to be learned, distributing the presentations over time yields significantly greater long-term retention than does massed presentations. Furthermore, the spacing of presentations in the Learn Module 21 preferably takes the form of an expanded rehearsal series where items are reviewed at increasingly longer intervals for the greatest effectiveness and efficiency of learning.
Also, the sequence in which the cue and response items are presented in the Learn Module 21 may be changed to present more difficult items more times than easier items allowing the user to concentrate their effort where it is most needed.
The Learn Module 21 is preferably designed to promote self-motivated learning. One factor in motivating learning is the rate of success and failure. Too much success or failure is not motivating to a person seeking to learn. Thus, the Learn Module 21 maintains a challenging learning environment by sequencing the presentation of paired-associate items to balance items that a user is successful at providing a correct response to with items the user is less successful at providing a correct response to.
The Learn Module 21 also takes into consideration a physiological phenomenon known as consolidation in the presentation of items to be learned. Consolidation is the period of time immediately following learning where memories are most vulnerable to loss due to decay and interference. In first stage of memory formation, process oriented changes take place at the cellular level of the brain resulting in short term memory. During consolidation, additional changes occur and result in actual structural modifications in the brain. This is prerequisite for long term memory formation. Taking this into consideration, the Learn Module 21 presents items as many times as is necessary to achieve the desired degree of overlearning. In contrast, in the prior art, learning is judged to be completed when the user is able to recall the correct response to a cue the first time.
Overlearning suggests that the user can derive additional benefit from continuing to study an item learned to this level. One measure of overlearning is latency of recall. An item that is overlearned will be recalled not only correctly, but also quickly, indicating automaticity. Overlearning, however, is subject to the law of diminishing returns, which means that at some point the effort expended does not provide a justifiable benefit. Overlearning in the Learn Module 21 reduces the likelihood that memories will be lost during consolidation and that if no review were to follow, the likelihood of successful retrieval at some future date would be higher than if the items were not overlearned, as shown in
As will be described in more detail below, all of the modules of the main engine 20 are preferably adapted to enable users to become better learners by training them to make more accurate metacognitive judgements. Judgment of learning, for instance, is a subjective evaluation made after a learning session in which a person judges whether an item was learned or not learned. In self-paced study, the decision as to whether to continue studying a particular item is often made based on the user's judgement of learning of that item. An inaccurate judgement will lead to either too much time, or too little time spent on an item resulting in less effective and efficient learning than would otherwise be possible if an accurate judgement were made.
In addition, in the Learn Module 21, it is preferable to provide a preview of knowledge or skills to be learned. In the preview, a background description or related information is provided before the actual cue and response items to be learned are presented. Such background information can include general information about a topic that is the subject of the cue and response items so as to provide some basis or context for learning, or what a user should keep in mind while learning, hints about the upcoming lesson itself or any other relevant information. The preview information can be text-based, graphics-based, auditory, or any other format. In addition, the preview can teach a user how to learn more effectively and efficiently before he learns, for example, by providing learning tools (pronunciation hints, study tips, what to pay attention to, etc.).
The Learn Module 21 preferably includes a Quick Review, which is presented at the end of lesson. Quick Review provides the user one or more opportunities to review difficult or unlearned items before that particular session of the Learn Module 21 is completed. Quick Review preferably reorders the presentation of items so as to eliminate the serial position effects of primary, recency, Von Restorff and other well known effects. In addition, it is possible in Quick Review to rearrange the cue and response items such that for each item, the cue becomes response and the response becomes the cue.
Preferably, items presented during Quick Review are sorted using the drop-out method. That is, if the user quickly indicates he is able to retrieve a correct response to presented cue, as measured by accuracy of recall and latency of response, the item is dropped out of the list of items being presented because the item is determined to be well known. The remaining items are then re-ordered and lesser known items are presented again. This continues until no items remain, or until some other criteria is met such as the completion of four rounds of Quick Review
The re-ordering done during Quick Review is preferably based on an inside-out ordering to reduce the serial position effect. Primacy and recency effects cause items presented first and last to be learned better than items in the middle of the sequence. By turning the sequence inside-out in terms of presentation, the effects of primacy and recency are minimized ensuring that items originally presented in the middle of the sequence are learned to the level of items originally presented at the beginning or end of the sequence.
In the Learn Module 21, the ease of initial learning of each item can be determined by analyzing the drop-out scores. This is done by measuring how many times an item was presented and determining from this the relative difficulty of learning each item. This information is then used to place the item on the appropriate review curve (described later) which determines the initial schedule of review.
The Learn Module 21 is preferably interactive with the Review Module 22 and Test Module 23. More specifically, the ease of initial learning in the Learn Module 21 as described above is used to determine how to present items in the Review Module 22.
More specifically, preferred embodiments of the present invention use hopping tables, prediction curves and other mathematical correlations to accurately control interaction between the modules of the main engine 20. For example, a Learn hopping table is preferably provided and used to determine the initial schedule of presentation of items in the Review Module 22. Using the Learn hopping table, if an item was presented once in Quick Review, it is placed on an easy curve—one which schedules the review relatively infrequently. If an item was presented twice in Quick Review, it is placed on a medium curve. If an item was presented three times in Quick Review, it is placed on a hard curve—one which schedules review frequently. As will be described below, as a user begins reviewing the learned items using the Review Module 22, items will hop from curve to curve; the curves determine the items to present during each review session of the Review Module 22. The Review Module 22 has a hopping detect function which feeds back into a rule set used to determine which review curve the item is on and is used to reconfigure the hopping table rules in the Learn Module 21 for improving the effectiveness and efficiency of learning, reviewing, and testing in the future.
Since human memory decays differently for words, pictures, sounds, smells, skills and other types of information and depends on degree of difficulty in learning, retaining, and retrieving items, it is preferable to modify the curves to reduce hopping to more efficiently predict the decline of memory strength as a result of decay and interference. A plurality of families of curves may be used and arranged according to the characteristics of the curves. Such hopping tables and families of curves for review are shown in
The function of the system 10 relating to the hopping rules and curves depends on the rate or level of retention chosen by the user or administrator. Different families of curves may be better at predicting items based on primary sensory modality or other factors. Also, the curves or families of curves may be chosen for use based on subject matter of content, gender, age, or each individual user since information about each user may be made available each time the system starts up. This information about how the user learns is then used by the system in each of the Learn Module 21, the Review Module 22, and Test Module 23.
With such data, it is possible to determine which items are more difficult to learn, retain and retrieve than other items based on data from many other users and to share that data with each specific user so as to affect how the Learn Module 21, the Review Module 22 and the Test Module 23 perform for that user.
II. THE REVIEW/STORE MODULE: The Review Module 22 preferably includes many different types of review formats including Normal Review, Ad Hoc Review, and Scheduled Review.
In a preferred method of the Normal Review of the Review Module 22, after a lesson has been presented by the Learn Module 21 and has been learned by a user, the system 10 prompts the user to indicate whether the lesson is to be reviewed in the future. If so, the system 10 places the lesson on a review schedule of the Review Module 22 for maintaining default retention rate for an indefinite period of time. If not, then no review schedule is created for that lesson. The user or administrator may change from “never reviewed” to “indefinite review,” or vice versa, at any time in the future. The user or administrator may also change the retention level from the default level to any other level at any time in the future for lessons or individual items.
The Schedule Module 25 schedules the appropriate time of learning, reviewing and testing of items based on a previously input desired date of completion as well as many other factors. The desired date of completion is the date by which the user desires all of the items to be known to a predetermined level of memory strength and activation, preferably to a level of automaticity. At the appropriate times, the system will indicate that the items scheduled for review are due to be reviewed and review proceeds as will be described below in more detail.
Scheduled Review of the Schedule Module 22 takes into account problems such as items learned later in the schedule have relatively higher activation and relatively lower strength than items learned early in the schedule which have relatively higher strength and relatively lower activation. Items that are more difficult to learn may be scheduled to be learned early in the overall schedule to provide them with the greatest number of review sessions to develop the desired degree of memory strength.
With Ad Hoc Review of the Review Module 22, a user can select a particular item or group of items to be reviewed at that moment. If the user conducts this review on an ad hoc basis instead of waiting for the review of the item or group of items scheduled for Normal Review, feedback based on Ad Hoc Review performance is used by the system 10 to reschedule future Normal Review, Scheduled Review and testing of this item in the Test Module 23.
Scheduled Review of the Review Module 22 arranges the presentation of items to be reviewed so as to increase memory strength of items learned later in the schedule and increase memory activation of items learned early in the schedule just prior to the date when the knowledge or skills are required.
Other factors which might be used by Scheduled Review of the Review Module 22 to arrange presentation of items for review may include degree of difficulty, degree of importance, strength, activation and how user has interacted with the system 10 in the past.
In addition, Scheduled Review and Normal Review of the Review Module 22 preferably take into account graceful degradation and workload smoothing when arranging the presentation of items to be reviewed. Graceful degradation and workload smoothing are used if a schedule originally set is altered, for example, by a user missing a review session or moving ahead of the schedule set forth by the Review Module 22.
Because learning, reviewing and testing will be less effective and less efficient if a user simply doubles up on items to be learned, reviewed or tested because the user has missed a scheduled session, the system re-schedules Normal and Scheduled Review by re-ranking all items which still must be reviewed according to item importance, strength, activation, and other factors. This re-ordering can be done preferably using an Nth degree polynomial smoothing function. This re-ordering can also be conducted if the user, administrator, or system determines that the workload of any particular session is significantly greater or less than the sessions before or after it. It is desirable that the workload from session to session be as equal and uniform as possible to maintain the user's motivation, and to ensure the most effective and efficient learning, review and retrieval of knowledge and skills.
In each of Normal Review, Ad Hoc Review and Scheduled Review of the Review Module 22, items are presented for review in a manner that is similar to the presentation of items in the Learn Module 21 to the extent that latency of recall is measured and calculated. Based on the measured latency of recall and the user's quantitative judgement of the adequacy of his response to the presented cue, an item to be reviewed will either be maintained in the presentation group or dropped out of the review group in the Review Module 22. The process of sorting items continues until all items are reviewed to a level that is desired.
The time between presentation of a cue and presentation of a response in the Review Module 22 is preferably controlled according to user input, position of item within sequence of items to be reviewed, primary sensory modality, and other factors such as covert data taken from user, such as galvanic skin response, pupil diameter, blink rate etc. and other measured characteristics. The system, method and apparatus of preferred embodiments of the present invention also control the time between the presentation of one cue and one response pair and the next cue and response pair.
In addition, the presentation of each cue and response pair in the Review Module 22 relative to other cue and response pairs is controlled according to timing, sequence, and format of material to be presented. All of these factors vary over time based on user input, both overt and covert, to determine which items will be presented, as well as the sequence, pattern and timing of presentation.
III. THE TEST MODULE: The Test Module 23 preferably includes several different types of tests of varying sensitivity including a test of familiarity, a test of recognition, a test of recall, and a test of automaticity. Through testing and the use of different types of tests in the Test Module 23, the system can determine whether an item is known to a user and to what degree an item is known (familiarity, recognition, recall, automaticity).
In the prior art, a typical test is a test of recall in which latency of response is not measured and is unimportant. In contrast, in the present preferred embodiment, latency of response is important and is measured and used to modify future operations of the various modules of the system 10.
The preferred test format is to use an alternative forced-choice test, preferably a five alternative forced-choice test in which a user must select one of the five alternatives presented in response to a presented cue. Although a five alternative forced-choice test is preferred, it is possible to change the number of forced-choice responses and type of test according to various factors such as what level of memory strength is being measured or for what purpose the test is being presented.
The Test Module 23 is important not only as a traditional measure of knowledge or measure of memory strength, but also because the testing in the Test Module 23 functions as another form of review. Test taking is another way for the user to learn, review, and to maintain motivation and interest in using the system 10.
In a preferred embodiment of the Test Module 23, an item to be tested is presented. First the cue is presented along with a question, “Do you know the answer?”. The user constructs a response, and then indicates his quantitative “feeling of knowing” by choosing one of a plurality of choices. In the preferred embodiment of the Test Module 23, a scale from 1 to 5 is presented, whereby 1 indicates that the user has no idea of the correct response and 5 indicates that the user is absolutely certain that he knows what the correct response is. Scores of 2, 3, and 4 are gradated between these two extremes. The time period from the presentation of the scale of 1 to 5 until the time that the user makes his choice is measured.
Then a plurality of forced-choice responses (preferably five) are presented for the user to choose from. Only one of the presented responses is the correct response. The time period from the presentation of the plurality of responses to the time when the user selects a response is measured.
This time period is referred to as a measurement of latency of response. However, absolute latency is not an accurate indicator of the cognitive functioning of the user. Instead, relative latency is measured for each user by taking into account many difference latency periods, the order of presentation of alternative responses, the primary sensor modality of the items and other factors.
After the user has selected one of the alternative choices as his response, the user is required to rate his response by choosing one of a plurality of choices in response to a question “How confident are you in your response?” The time between the presentation of this question and the user's response is measured. The incorrect responses are removed from the screen, leaving the correct response and the cue displayed. If the correct response was selected, the cue and response remain for a period of time which is shorter than the period of time in which the cue and response remain if the user chose the incorrect response.
In addition to knowing whether a response was correct or incorrect, the user is provided with information about their metacognitive judgements of “feeling of knowing” and “confidence of response.” This information about metacognitive performance is only used to assist the user in improving his metacognitive abilities thus improving self-paced study skills and thereby making the user a better learner.
According to preferred embodiments of the present invention, items to be learned, reviewed or tested are presented in a sequence which is not determined by the user's metacognitive performance and perceived knowledge of those items, as is done in some conventional methods. That is, the sequence of the items in each group are presented to the user in each of the Learn Module 21, the Review Module and the Test Module 23 without ever querying the user as to whether the user thinks or perceives he knows the correct response or answer. Thus, the items to be learned, reviewed and tested are presented based on the predetermined grouping and sequencing of those items and the grouping and sequencing is not based on the user's perception as to whether the items are known or unknown.
It is preferred that the conditions of retrieval in the Test Module 23 most closely model the actual real world test or retrieval situations which the user is preparing for. Thus, the Test Module 23 is preferably configured to the form of the actual anticipated test or retrieval situations to enhance the retrieval practice effect. The act of retrieving an item from memory facilitates subsequent retrieval access of that item. The act of retrieval does not simply strengthen an item's representation in memory, it also enhances the retrieval process.
In terms of the presentation or sequence of items in the Test Module 23, it is preferred that the presentation of test items is based so as to reduce the process of elimination effect. This effect describes a method used by students to “learn” information early in a test that assists them in responding to items later in the test. In order to reduce or eliminate this effect, the most difficult and confusable items, for instance, are presented early in the test in the Test Module 23. Ordering of items is preferably based on difficulty, confusability and other suitable factors in the Test Module 23.
The measurements of latency of response for the feeling of knowing judgements and the confidence in response judgements, not the actual scores of feeling of knowing and confidence of response, are used for scheduling future learn, review and test activities in the Learn Module 21 and the Review Module 22.
The Test Module 23 is preferably adapted to modify or normalize the feeling of knowing and confidence of response choices. If a user selects only 3s, 4s and 5s, for instance, the system 10 will normalize such responses into a 1, 2, 3, 4, 5 scale. The absolute judgement is important, however, and valuable information can be obtained by measuring and calculating the relative values of the judgements as well.
For the review of missed items presented in the Test Module 23, the sequence is determined by the relative degree of difficulty of items. Degree of difficulty is determined by the correctness of the user's response, the latency of response in providing feeling of knowing and confidence of response judgements and is not based on the actual scores of feeling of knowing and confidence of response. Ordering the sequence of missed items on this basis creates higher memory strengths of items missed in the testing.
The system 10 can determine the user's motivation by monitoring the user's performance data in the Learn Module 21, the Review Module 22 and the Test Module 23, as well as system usage including a user's ability to adhere to a set schedule, how many sessions or days a user has missed, and other factors.
Based on relative motivation, determined as described above, the Test Module 23 preferably selects an item to be tested so as to increase a user's motivation and confidence. The Test Module 23 is also arranged to allow for use of testing as a form of motivation, to break up monotony, and to use test as form of review.
The date of tests in the Test Module 23, including using testing as a form of review, can be determined by the user, the system 10, the administrator, or other input sources. For example, a teacher may want to use a test in the Test Module 23 as a form of review when an actual classroom test will occur soon.
Test as a form of review is preferably done when the strength of items is relatively high and the activation is relatively low. A test as a form of review breaks up monotony, maintains a review schedule, allows a different form of retrieval practice, closely mirrors the conditions of an actual test, and may have a motivational influence. In addition, the scheduling of testing in the Test Module 23 as a form of review may be influenced by a user's performance in the Learn Module 21 or the Review Module 22. For example, if the user's performance in the Learn Module 21 and the Review Module 22 are less than desired, a test may be scheduled as an alternative form of review and also to increase motivation.
In addition, in the Test Module 23, the user, the administrator or the system can determine when a test should be administered. The Test Module 23 preferably takes into account all testing factors like time of day, gender, age, other personal factors including physiological measures, measures of attentiveness or other brain states and other environmental conditions. The Test Module 23 also takes into account the material to be tested, its difficulty, and other factors such as recency, frequency and pattern of prior exposure to material in the past.
After testing in the Test Module 23 further review and testing may be scheduled based on the performance in the Test Module 23. For example, items that were determined to be well known are tested and reviewed less in the future. Further, the system changes hopping tables for items to be reviewed and tested in the future based on latency of response, actual knowledge and other factors observed during the test.
Many different forms of tests may be used in the Test Module 23 including a test of recall, an alternative forced-choice test, and other types of tests. Latency of response is preferably measured when using a test of recall or alternative forced-choice test.
Also, items can be tested backwards and forwards in the Test Module 23. That is, the cue becomes the response and the response becomes the cue. Further, a distracter, which is an alternative forced-choice that is incorrect, may be used to increase testing difficulty. A distracter should be chosen from a group of similar items although not necessarily from the same lesson.
Also, confusable items are tested consecutively and may be used as reciprocal distracters. The Test Module 23 determines whether users are still confusing these items by analyzing latency of response, confidence, and by the user choosing the incorrect confusable response, rather than the correct response itself. Other factors may also be considered in determining whether items are confusable.
IV. THE SCHEDULE MODULE: The Schedule Module 25 is preferably provided to interactively and flexibly schedule the operation of the Learn Module 21, the Review Module 22 and the Test Module 23. The preferred embodiments of the present invention are set up such that a user's performance in the Learn Module 21, the Review Module 22 and the Test Module 23 may affect operation of any of the others of the Learn Module 21, the Review Module 22 and the Test Module 23 to make learning, reviewing and testing more efficient and effective.
Furthermore, the Schedule Module 25 may schedule presentation of items in any of the Learn Module 21, the Review Module 22 and the Test Module 23 based on input information from the user, the administrator, the system or other input sources and other input information, including date of test or date that knowledge or skills are required, the current date, the start date, what knowledge or skills need to be learned between the start date and the test date, desired degree of initial learning and retention, days that study or learning cannot be done, how closely a person follows the schedule already created by the system, and many other factors.
That is, the system 10, and the Schedule Module 25 in particular, is responsive to user performance and user activity both within the system and in the real world.
The Schedule Module 25 schedules the presentation of items in the Learn Module 21, the Review Module 22 and the Test Module 23 by spreading the material out to reduce cognitive workload on a micro level and a macro level to maximize strength and activation of all items or skills on the predetermined date. In addition, the most significant way to drastically reduce the cognitive workload on the user or student is to eliminate the burden of scheduling, determining the pattern, sequencing, and timing of presentation, and presenting cues and monitoring responses in the Learn Module 21, the Review Module 22 and the Test Module 23, which the Schedule Module 25 does.
In one example of a preferred embodiment of the present invention, a user or administrator identifies content which is either already in the system or input thereto. The user or administrator, or system, may identify and input to the Schedule Module 25 the date of test or date that knowledge or skills are required, the desired level of retention, the starting date, dates where no activity will be done, time available during each study session, whether or not a Final Review is desired, how well the user can perform according to a schedule, how much time is required by the user to learn, review and test an item based on past performance, and other factors. The system and more particularly, the Schedule Module 25 generates a customized schedule based on inputs from the user or administrator as noted above and any of the following factors: the spacing effect, strength, activation, when a lesson was initially learned, the degree of difficulty of items, the confusability of items or other factors upon which the Learn Module 21, the Review Module 22 and the Test Module 23 are based.
The Schedule Module 25 also preferably determines whether items are being scheduled for presentation during a Normal Zone, a Compression Zone or a Final Review Zone. In the Normal Zone, an average or normal schedule of learn, review and test is conducted since there is enough time remaining before the test date or the date that the knowledge or skills are required to achieve the desired degree of strength and activation. However, during the Compression Zone, the Schedule Module 25 must provide more opportunities to review items than in the Normal Zone. That is, the Schedule Module 25 treats items learned in the Compression Zone as though they are more difficult, increasing the number and type of reviews, so as to increase the strength of those items before the Final Review.
In addition, the Schedule Module 25 preferably uses workload smoothing to avoid any relative busy or easy study sessions for learning, reviewing and testing items. Graceful degradation also takes into account the user's actual use of the system 10. For instance, if the user skips one or more study sessions, or gets ahead of the schedule, or changes the date of the test, or makes other modification to the input factors, the Schedule Module 25 will recalculate the learning, reviewing and testing that must be conducted in the future to ensure the most effective and efficient use of time to develop the desired degree of strength and activation of knowledge or skills by the predetermined date.
V. THE PROGRESS MODULE: The Progress Module 26 is preferably provided in the main engine to quantitatively monitor performance of other modules, most notably, the Learn Module 21, the Review Module 22 and the Test Module 23. As noted above, the progress in any one of the Learn Module 21, the Review Module 22 and the Test Module 23 may affect the scheduling and operations of any of the others of the Learn Module 21, the Review Module 22 and the Test Module 23.
In addition, it is important to give the user or student proper motivation and feedback regarding their metacognitive skills as described above, as well as their usage of the system. Thus, the Progress Module 26 evaluates in any of the Learn Module 21, the Review Module 23, the Test Module 23, and the Schedule Module 25 and other elements of the system such as the Discriminator Module 28.
VI. THE DISCRIMINATOR MODULE: The Discriminator Module 28 is preferably provided in the main engine 20 and interacts with at least one and possibly each of the Learn Module 21, the Review Module 22 and the Test Module 23. The Discriminator Module 28 is designed to teach confusable items. Confusable items are two or more items which are somehow similar or easily confused by the user, particularly in retrieval.
Confusable items may be previously determined by the system or may be identified by the user, the administrator or the system during use of the system.
According to a preferred method of the Discriminator Module 28, confusable items are arranged in the Learn Module 21 such that a user learns the first and second confusable items and practices the ability to discriminate between the two.
If two items are confusable or difficult to discriminate, an aspect or feature of that item or items which increases discriminability should be identified and used to practice discriminating between the confusable items. Preferably the user, the administrator or system identifies the aspect or feature that allows the confusable items to be differentiated from each other using the Discriminator Module 28.
The Discriminator Module 28 is preferably set up to make the discrimination between the two confusable items as easy as possible. For example, visually similar items may be differentiated using a blink comparator which overlays and alternatively displays two items in the same position using different colors, shades, or graphical information to show clear differences between the two confusable items.
It should be noted that confusable items can be a pair of items to be learned or an item to be learned and another item that is not scheduled to be learned but is confusable with the item to be learned. In addition, there may be more than two confusable items which are identified and controlled by the Discriminator Module 28. However, it is preferred that the number of confusable items to be learned, reviewed and tested is two.
It is also preferred that the confusable pair is presented always in the same lesson set, review set and test set.
In addition to its applications to the Learn Module 21, the Discriminator Module 28 also preferably interacts with the Review Module 22 and the Test Module 23. For example, in the Review Module 22, confusable items may be reviewed together using the blink comparator. This may also be true at the end of a test in the Test Module 23.
Confusable items to be learned, reviewed or tested can be presented using a blink comparator or other suitable ways. For example, if items are visually similar, the cues and responses are shown together allowing the user a period of time to compare the two items which are confusable. A “blink” button is provided to initiate the presentation. The presentation includes displaying the first response for a period of time, then replacing the first response with the second response for a period of time, and then repeating this process. In this way, the images seem to “blink,” highlighting the most significant difference between the two. Further, it is preferred to change the rate of presentation of overlays, order of overlays, or other aspects of the blink comparator.
In addition, to further develop and retain the ability to discriminate between the confusable items, tests may be also be provided. When testing, a single cue is selected from one of the confusable items. All of the confusable responses are then presented. The user must choose the correct response to the presented cue. The correct response is then highlighted while the wrong responses disappear. This testing of each of the cues individually with the entire set of responses continues until the latency of responses and accuracy of responses reaches the desired criteria as shown in
It is also possible in any of the Learn Module 21, the Review Module 22 or the Test Module 23 to change the presentation of confusable pairs by reversing the cue and response for each confusable pair until the user achieves a desired number of correct responses with a stable latency of response. Latency of response is preferably measured during use of the Discriminator Module 28 to determine relative latency and whether the actual relative latency is within desired limits. Also, alternative confusable pairs may randomly be dropped out of the sequence using criteria of performance and latency of response factors.
It is possible to use known confusable items as known items to take advantage of the spacing affect to schedule presentation of unknown confusable items. The unknown confusable items can be spaced out for presentation of these items for better learning of differences between the two confusable items and to practice how to discriminate between the two confusable items.
It is preferred that confusable items are presented together in each of the Learn Module 21, the Review Module 22 and the Test Module 23. That is, it is preferred that if the user, administrator or system identifies confusable items, the confusable items will always be learned, reviewed and tested together even if the confusable items are not part of the same lesson, review group, or test group. Confusable items are bound together until it has been determined by the user, the administrator or the system that the items are no longer confusable.
Now preferred embodiments of various applications and operation of the various modules of the system of
As seen in
After the sequence and timing of items to learned are generated at step 700, the display of items to be learned begins at step 702. First, an unknown cue and response are displayed or presented to the user at the same time, step 704. Then the display is cleared of the cue and response or nothing is presented to the user, step 706. A value of N is then set equal to 1, step 708. Then the cue of an unknown item UN to be learned is presented or displayed, step 710. The response corresponding to the cue of the unknown item UN is displayed or presented to the user, step 712. Then the cue and response of the unknown item UN remain on the screen or are continued to be presented to the user, step 714. After this step, the screen is then cleared or nothing is presented to the user, step 716. A value of M is then set to 0, step 718. Then, a cue of a known item KM is presented to the user or displayed, step 720, followed by the presentation of the corresponding response of the known item KM, step 722. Then the cue and response for the unknown item KM remain or are continued to be presented to the user, step 724. Then the screen is cleared or nothing is presented to the user, step 726.
As shown by the interrupts at steps 736 and 738, the user can interrupt the flow from steps 712 to 716 and from steps 722 to 726, at any time. More specifically, if the user interrupts the process at any time between steps 712 to 716 or interrupts the process at any time between steps 722 to 726, the flow proceeds to step 740 at which an item is designated as having been learned and therefore, that item is stored as a known item in a “known” register. After the known item is stored, at step 740, a determination is made as to whether the last item has been learned, step 742. If the last item has been learned, the process flows to Quick Review, step 744, which is described in more detail with respect to
If there is no user interrupt at steps 736 or 738, the process flows normally from step 726 where the display is cleared or nothing is presented to the user, to step 728 where the value of M is increased by 1. Then a determination is made whether M is equal to a value of N, step 730. If M is not equal to N, the flow returns to step 720 at which another known item KM is presented to the user. If M is equal to N, a determination is made whether N is equal to some predetermined number, such as, for example, 9, step 732. If N is not equal to the predetermined number, the value of N is increased by 1, step 734, and the flow returns to step 712 for presentation of another unknown item to be learned UN. If N is equal to this predetermined number, a user is asked whether he wants to see the next item, step 750. If a user chooses to see the next item to be learned, the flow returns to step 748 and 700 for presentation of more items to be learned. If a user chooses not to see the next item to be learned, the flow returns to step 702. If there is no response within a certain period of time, step 752, the process stops at step 754.
As seen in
After the sequence and timing of items to Quick Reviewed are generated at step 800, the display of items to be Quick Reviewed begins at step 802. First, an unreviewed cue and response are displayed or presented to the user at the same time, step 804. Then the display is cleared of the cue and response or nothing is presented to the user, step 806. A value of N is then set equal to 1, step 808. Then the cue of an unreviewed item UN to be learned is presented or displayed, step 810. The response corresponding to the cue of the unreviewed item UN is displayed or presented to the user, step 811. After this step, the cue and response remain on the screen or are continued to be presented to the user, step 816. A value of M is then set to 0, step 818. Then, a cue of a reviewed item RM is presented to the user or displayed, step 820, followed by the presentation of the corresponding response of the reviewed item RM, step 821. The cue and response remain on the screen or are continued to be presented to the user, step 822. Then the display is cleared or nothing is presented to the user, step 826.
As shown by the interrupts at steps 836 and 838, the user can interrupt the flow at any time between steps 811 to 816, and between steps 821 to 826. More specifically, if the user interrupts the process at any time between steps 811 to 816 or interrupts the process at any time between steps 821 to 826, the flow proceeds to step 840 at which a determination is made as to whether an item has been seen or reviewed only one or twice. If the item has only been reviewed one or two times, the flow proceeds to step 842, described later. If the item has been reviewed more than two times, the item is stored in the drop-out register, step 841, and then a determination is made whether the last item has been Quick Reviewed, step 842. If the last item has been Quick Reviewed, a determination is made whether four rounds of Quick Review have been completed, step 844. If four rounds of Quick Review have been completed, review curves, described later, are calculated, step 847 and the process stops at step 860. If four rounds of Quick Review have not been completed, a determination is made whether there are any items which have been stored in a “show again” register, step 845. If there are no items to be shown or reviewed again, the process flows to step 847 where review curves are calculated and then the process stops at step 860. If there are items to be shown or reviewed again, the process begins the next round of Quick Review, step 849, and the process flows to step 848 where the next item to be Quick Reviewed is selected. The sequence and timing of presentation for the next item to be Quick Reviewed is then generated, step 800.
If there is no user interrupt at steps 836 or 838, the process flows normally from step 826 where the display is cleared or nothing is presented to the user, to step 828 where the value of M is increased by 1. Then a determination is made if M is equal to a value of N, step 830. If M is not equal to N, the flow returns to step 820 at which another known item RM is presented to the user. If M is equal to N, a determination is made whether N is equal to some predetermined number, such as, for example, 9, step 832. If N is not equal to the predetermined number, the value of N is increased by 1, step 834, and the flow returns to step 811 for presentation of another unknown item to be learned UN. If N is equal to this predetermined number, a user is asked whether he wants to see the next item, step 850. If a user chooses to see the next item to be learned, the flow returns to step 848 and 800 for presentation of more items to be learned. If a user chooses not to see the next item to be learned, the flow returns to step 802. If there is no response within a certain period of time, step 852, the review curves are calculated for items in the “drop-out” register and other items are treated as if those items have been Quick Reviewed through all four rounds of Quick Review without dropping out and then the process stops at step 854.
If the user fails to interrupt the Review Module 21 before the time period STAn has lapsed by failing to request that the answer or response be shown, step 950, the cue is displayed with the paired response at step 952. Then the screen is made blank, the cue is again displayed by itself, a response is requested and a timer is started, step 954, which is similar to step 900. If the user does not interrupt before the time period STAn lapses, that is the user did not request that the answer be shown, at step 956, the flow returns to step 952 in which the response is shown with the cue. If the user does interrupt before the time period STAn lapses, step 958, the cue is displayed with the paired response, step 960, and the flow proceeds to step 962 at which point the screen is made blank, a response for rating the quality of response is requested and the timer for timing the time period RTQn is started. If a user interrupts before the time period RTQn lapses, that is before the user rates the quality of his response, step 964, the response is ignored and the screen is wiped blank at step 968. If the user does not interrupt before the question is repeated at step 966, the response is ignored and the flow proceeds to step 968. The response is ignored in both cases because it has already been determined that this particular item should be reviewed again. Then the item is placed in the register Sn+1 at step 970 and flow proceeds to step 920, and further processing occurs as described above.
At step 1208, if the user chooses to be tested on the confusable items, the flow proceeds to step 1210 and the process shown in
As shown in
The sequence of items to be learned in the Learn Module 21 generated in step 700 of
Information learned or remembered to the level of familiarity is information that the user has the feeling that they knew at one time, but can no longer remember.
Information learned or remembered to the level of recognition is information that the user can separate from other distracting choices or distracters. When presented with a cue, the user can choose the appropriate response from a number of alternatives. For example, the user may be asked select the correct answer on a multiple choice test.
Information learned or remembered to the level of recall is information that the user can retrieve when only a cue is presented. For example, the user may be asked o provide the correct response to a provided cue on a “fill in the blank” test.
Information learned or known to the level of automaticity is information that the user can retrieve instantly, with little or no cognitive effort, when only a cue is presented. The user “knows” the information as opposed to “remembers” the information. Automaticity can be measured by a test of recall where accuracy is required and latency of response is the key variable.
As shown in
Different types of tests have varying degrees of sensitivity. A student could answer a question correctly on a multiple choice test, but miss the same question on a test of recall. Therefore, a test of recognition is less sensitive test of memory strength than a test of recall. Similarly, a test of recall is a less sensitive measure of memory strength than a test of automaticity.
In preferred embodiments of the present invention, the items to be learned are presented in the sequence generated in step 700 of
In order to have a user learn to a level of automaticity as shown in
The parallel nature of the curves in
For generating the sequence of items to be learned at step 700 of
By creating a sequence of known and unknown items as shown in
At some point during the presentation of the sequence shown in
At the beginning of the sequence, the unknown item to be learned within the sequence is presented as U.. Both the cue and the response are presented at the same time (T1).
The cue and response disappear leaving a blank screen, or depending upon the modality of presentation of the information, a null event—one where nothing happens (T2).
Now the unknown item is displayed or presented by itself. At this time, the user absorbs the cue and attempts to actively recall the appropriate response (T3).
Whether the user is successful in retrieving the response or not, the correct response is presented using a method that may be the same as the method of presenting the known response, but preferably is unique to the presentation of the response to be learned. The method of presentation could involve color, sound, motion or any other method that differentiates it from the presentation of the randomly-chosen known response. The time that it takes to present the response using the defined method is called T4.
Both the cue and response continue to be presented. The user uses this time (T5) and the time available in T4 to compare the response that the user retrieved to the correct response. If their response is judged adequate, the user can interrupt the sequence and move on to the next unknown item to be learned.
Following T5, both the cue and response are eliminated leaving a blank screen or null event (T6).
Now a known item is selected from the group of previously learned items. It is presented by first displaying the cue for a short period of time (T7) allowing the user to attempt to actively recall the correct response, then the correct response is shown according to a method that may be the same as the method of showing the unknown response, but preferably is unique to the presentation of known responses (T8). Both the known cue and known response remain presented for a period of time (T9), and then both are eliminated for another period of time or a null event (T10).
The presentation pattern of showing unknown cues and responses and known cues and responses separated by null events preferably follows the sequence described with respect to
The purpose of varying the timing values is to maintain the user's attention and arousal. Timing sequences where there is little or no variation in the stimulation can become habituating. That is, the stimulus is no longer novel and the brain tunes it out.
Additionally, each user has a desired rate of learning determined by the rate of presentation of each item as well as the rate at which new items are presented. In the classroom, when the teacher is lecturing, all students are presented information at the same rate. Some students find this boring because the presentation is too slow, and others find it frustrating because the presentation is too fast—they are left behind.
In the system 10 described above, the pattern, sequence, and timing of items are varied to maintain the user's interest, and provide each individual user with a rate of learning that each user finds challenging. Thus, the system 10 adapts to each user.
Also related to the sequencing of the items to be learned is a phenomenon knows as the serial position effect.
Items appearing early in the list are more likely to be recalled because of the primacy effect. Items appearing early in the list are more likely to be rehearsed a greater number of times than items later in the list as shown in
More specifically,
Now preferred embodiments of the Review Module shall be discussed. As described with respect to
As shown in
The review of each item and scoring and scoring of quality of response occurs round after round until no items are remaining, or until the fourth round of the Review Module 22 is complete. If an item has been seen in four rounds and a quality rating is consistently given as 1, 2, or 3, the item is treated as “unlearned”, and the whole process of Learning, Review, and Testing begins all over again.
This example of determining the appropriate curve to model the rate of forgetting of an item over time based on scoring the quality response during a session of the Review Module 22 represents only one way to monitor and control the ever-changing rate of forgetting. The current system 10 also takes into account latency of response, scores on scheduled and ad hoc tests, the rate of initial learning, the degree of initial learning, and many other factors. Those with ordinary skill in the art can also create other systems based on the present invention that modify the model for the rate of forgetting of each item for each user based on overt and covert feedback taken based on performance in the Learning Module 21, the Review Module 22, and the Test Module 23 as well as data available from other sources such as the rate of forgetting of other users of the system or other factors.
The white areas in
In the Normal Zone, items are learned and reviewed in the normal manner. In the Compression Zone, items are learned in the normal manner but are reviewed as those items are particularly difficult. This creates more opportunities to build strength of the items when very little time remains prior to the end date. In the Final Review Zone, all items have been learned and reviewed to develop the maximum strength possible. One or more Final Review sessions are scheduled to maximize and equalize to the greatest possible extent activation for each item. This presents to the user all of the material just prior to the end date in one or more of the last reviews.
According to one preferred embodiment of the present invention, a system 10, as shown in
In this preferred embodiment of the present invention shown in
If the user chooses “Yes,” the next unknown item is presented. If the user chooses “No,” the presentation sequence for the item currently being learned is started over again.
The user enters the question and answer as shown in this figure by first tapping on one of the buttons on the right labeled from 1 to 12, and then entering the text in the appropriate window. Two additional input windows are available—one above the question and one above the answer. These windows allow the user to add pronunciation hints or any other information that the user would like to include with each item. The buttons on the right appear in different colors depending on the state of the question and answer fields. If the fields are blank, the button is blue. If the fields have data entered, the button is green. The button that is colored red is the question and answer field currently displayed.
The user can change the ordering of items by tapping on the button representing item he wishes to move, then tapping on the move button, then tapping on the position where he would like the item moved to. If there was an item already filled in the target location, it is moved to where the first item used to be.
In another preferred embodiment of the present invention, the system 10 is embodied in a paper based application in the form of a word-a-day calendar shown in
In this preferred embodiment of the present invention, responses (definitions of vocabulary words) are to be actively recalled based upon the presentation of cues (vocabulary words). This active recall can be accomplished by shielding the responses with paper or plastic until active recall is attempted, by making invisible responses visible with special pens and printed inks after recall is attempted, or any number of ways known to those skilled in the art.
Numerous additional modifications and variations of the present invention are possible in light of the above teachings. As noted above, the information to be learned, reviewed and tested and the platforms for learning, reviewing and testing items is not limited in any sense and can be modified as desired. Also, various modules of the various preferred embodiments described above can be combined in different combinations to define systems as desired. Further, the various modules can operate independently of each other or can be interactive and adaptive to each other. Many other modifications, combinations and changes may be made to the present invention without departing from the scope of the present invention. It is therefore to be understood that within the scope of the appended claims, the present invention may be practiced other than as specifically described herein.
Claims
1. A method of learning comprising the steps of:
- (a) presenting information to be learned so that the information to be learned becomes learned information;
- (b) presenting the learned information for review in a way that is different from the way in which information is presented during learning whether the learned information has actually been learned;
- (c) presenting information for testing whether the learned information has actually been learned; and
- (d) monitoring a user's performance in each of steps (a), (b) and (c) and changing scheduling of at least one of steps (a), (b) and (c) based on the monitored user's performance.
Type: Application
Filed: Apr 18, 2003
Publication Date: Dec 15, 2005
Inventors: Andrew Van Schaack (Cupertino, CA), Andrew Lewis (New York, NY)
Application Number: 10/418,652
