Abstract: By performing a comparison of words spoken by a speaker and defined material which is presented to the speaker, information can be determined which allows for the convenient control of the presentation of material and external devices. A comparison of a speaker's words with defined material can be beneficially used as an input for controlling the operation of an exercise apparatus, video games, material presented to an audience, and the presentation of the material itself. Similar feedback loops can also be used with measurement and stimulation of neurophysiologic states, to make the activity of reading more enjoyable and convenient, or for other purposes.

Abstract: According to an aspect of the present invention, a language processing device has a text input section and an anaphora analysis section. The text input section acquires text data. The anaphora analysis section analyzes whether a correct anaphora relation is included in the text data acquired by the text input section. The correct anaphora relation has an anaphor and an antecedent corresponding to the anaphor.

Abstract: The present invention is directed to interactive training, and in particular, to methods and systems for computerized interactive skill training. An example embodiment provides a method and system for providing skill training using a computerized system. The computerized system receives a selection of a first training subject. Several related training components can be invoked, such as reading, watching, performing, and/or reviewing components. In addition, a scored challenge session is provided, wherein a training challenge is provided to a user via a terminal, optionally in video form.

Abstract: An audio-intonation calibration method in which an audio signal emitted by a subject is reproduced to the auditory organs of the subject after real time processing, which comprises the following steps: acquisition of a model audio signal to be imitated; spectral analysis of the model audio signal; acquisition of an imitation audio signal emitted by the subject; spectral analysis of the imitation audio signal; comparison of the spectra of the model audio signal and the imitation audio signal; correction of the imitation audio signal as a function of the result of said comparison; and reproduction to the auditory organs of the subject of the corrected audio signal.

Abstract: A pronunciation diagnosis device according to the present invention diagnoses the pronunciation of a speaker using articulatory attribute data including articulatory attribute values corresponding to an articulatory attribute of a desirable pronunciation for each phoneme in each audio language system, the articulatory attribute including any one condition of the tongue in the oral cavity, the lips, the vocal cord, the uvula, the nasal cavity, the teeth, and the jaws, or a combination including at least one of the conditions of the articulatory organs; the way of applying force in the conditions of articulatory organs; and a combination of breathing conditions; extracting an acoustic feature from an audio signal generated by a speaker, the acoustic feature being a frequency feature quantity, a sound volume, and a duration time, a rate of change or change pattern thereof, and at least one combination thereof; estimating an attribute value associated with the articulatory attribute on the basis of the extracted

Abstract: We invented (a) a teaching method of European language pronunciation (the English language included), as well as (2) a system of representation of European language sounds. We discovered that European language speakers resonate sound primarily in the throat, while Asian speakers do so primarily in the mouth (THE THROAT LAW) and based on this discovery we invented a way to condition one's throat to pronounce like native speakers of European languages. We also invented a way to represent how to read syllables and how to connect syllables, capitalizing on our discovery of how native speakers read them (THE 3-BEAT LAW). Our system of representation can be used to build a reading assistance devise, such as electronic dictionary.

Abstract: Methods, Systems, And Computer Program Products For Speech Assessment are disclosed. According to an embodiment, a speech assessment method can be provided and include prompting a speaker to pronounce one or more words. The one or more words pronounced by the speaker can be recorded to generate one or more recorded pronunciations. The one or more recorded pronunciations can be presented to a listener. A listener can be prompted to enter a phonetic or orthographic representation of the one or more recorded pronunciations in response to presentation of the one or more recorded pronunciations. Further, the phonetic or orthographic representation entered can be automatically compared with a correct spelling of the one or more words.

Abstract: Portable devices for treating stuttering or communication disorders include a circuit configured to automatically electronically select sua sponte different signal parameters and/or sound effect algorithms used to generate varied altered auditory feedback signals to a user over time.

Abstract: Methods and computer programs for recording infant-directed speech, including: guiding a parent as to which sound to record; showing the parent an image of her infant, or asking the parent to look at an image of her infant, in order to encourage the parent to speak in an infant-directed manner; and recording the parent.

Abstract: A method and device for correcting mispronunciations of a user, the method comprising the following steps: providing a database comprising a plurality of records each of which comprising at least a textual and a vocal representation of a specific word; training a speech recognition module to recognize spoken utterances of said user comprising the words represented by said records; generating word models for each recognized spoken word; associating each word model with a respective database record; after training said speech recognition module with sufficient words receiving spoken utterance from said user; extracting a sequence of words from said spoken utterance and generating a word model for each extracted word; comparing said word models to the word models associated with said database records; constructing an audible output comprising vocal representations obtained from records which their word models matched word models generated for said extracted word, wherein said word models comprises features extra

Abstract: The present invention is directed to methods and devices for teaching the proper configuration of the oral articulators, particularly the tongue, corresponding to particular speech sounds by providing intraoral tactile feedback. Intraoral tactile feedback is achieved by placing nodes in the oral cavity of the patient in locations corresponding to the proper lingual position required to produce a target sound. These nodes facilitate identification of the appropriate lingual position corresponding to a target speech sound by providing tactile differentiation when the target sound is properly produced.

Abstract: Certain aspects and embodiments of the present invention are directed to systems and methods for monitoring and analyzing the language environment and the development of a key child. A key child's language environment and language development can be monitored without placing artificial limitations on the key child's activities or requiring a third party observer. The language environment can be analyzed to identify phones or speech sounds spoken by the key child, independent of content. The number and type of phones is analyzed to automatically assess the key child's expressive language development. The assessment can result in a standard score, an estimated developmental age, or an estimated mean length of utterance.

Abstract: The invention describes a computer-based system that asks (101) a patient to pronounce a word displayed on a monitor, automatically assesses (104, 105) the speech quality, and uses suitable means to feed back (106) any improvement or deterioration of speech quality.

Abstract: A method, system, and computer program product for spoken language grammar evaluation are provided. The method includes playing a recorded question to a candidate, recording a spoken answer from the candidate, and converting the spoken answer into text. The method further includes comparing the text to a grammar database, calculating a spoken language grammar evaluation score based on the comparison, and outputting the spoken language grammar evaluation score.

Abstract: Techniques for dynamic personalized reading fluency instruction and improvement are provided by determining a user reading fluency level based on one or more spoken responses provided by the user during one or more reading aloud session of a text that has been evaluated for discourse structure and information structure of sentences. One or more reading fluency improvement aids are provided to the user based on one or more of: determined user-specific reading fluency deficiencies, user-personalized information responses and user class-specific reading fluency deficiencies as determined by the reading fluency improvement system.

Abstract: Immersive imaging system for learning a language comprising at least a first level, this first level including: d) a first activity that introduces a user of the system to the meaning and sound of a piece of spoken language; e) a second activity that works the visual mapping of spoken language on a picture matrix; and f) a third activity that works the narrative mapping of spoken language.

Abstract: A language tutor system and method. The system comprising a client module and a server module coupled to the client module. The server module downloads an oral language assignment to the client module to enable a student learning a second language to login to the client module and perform the oral language assignment. The client module provides a benchmark audio sentence in the second language to the student, records a recitation of the sentence from the student, and evaluates the recitation of the sentence from the student by comparing the recitation of the sentence with the benchmark audio. The system provides feedback to the student on the pronunciation and intonation of each word in the sentence.

Abstract: A computerized system and method of teaching spelling interfaces with an application that captures a user's misspelled words and adds them to a word database. A teacher or instructor may also add words to the word database based on a user's curriculum, cross-curriculum or words of interest. The words in the word database are utilized to automatically create an individualized spelling teaching assignment and spelling Journal for a user. The user corrects any spelling mistakes that he or she has made and performs assignments with new words including hearing the words pronounced, spelling the words and writing sentences using the words. Spelling tests are also assigned. The teacher or instructor monitors the completion of the various assignments by the students and also monitors how well the assignments are performed.

Abstract: A method of treating a person for stuttering that comprises providing sensory stimulation that alternates between the right and left side of person's body. In one preferred embodiment this stimulation is performed by applying a stream of sound pulses, alternating between the ears, by an auditory stimulation device. Such a device would include a sound signal production unit and a pair of auditory ear-pieces designed so as to not entirely occlude the ear canals.

Abstract: Certain aspects and embodiments of the present invention are directed to systems and methods for monitoring and analyzing the language environment and the development of a key child. A key child's language environment and language development can be monitored without placing artificial limitations on the key child's activities or requiring a third party observer. The language environment can be analyzed to identify words, vocalizations, or other noises directed to or spoken by the key child, independent of content. The analysis can include the number of responses between the child and another, such as an adult and the number of words spoken by the child and/or another, independent of content of the speech. One or more metrics can be determined based on the analysis and provided to assist in improving the language environment and/or tracking language development of the key child.

Abstract: The present invention provides a diagnostic device that presents, to a patient, a Noise-Vocoded Speech Sound signal that is obtained by dividing at least one portion of a sound signal into a single or a plurality of frequency band signals and subjecting the frequency band signals to noise, and analyzing the content of a response recognized by the patient and the presented stimulus to diagnose a disease of the patient based on the analysis results, so that diagnosis including determining the disease of the patient and estimating a damaged site can be performed.

Abstract: A speech recognition unit (114) and a processor unit (116) of a foreign language learning device (100) receive sentence speech information corresponding to a sentence pronounced by a learner (2) to separate the information into word speech information on the basis of words included in the sentence. The processor unit (116) evaluates the degree of matching (likelihood) of each word speech information with a model speech, and a resultant evaluation is indicated on a display unit (120) on the basis of each word.

Abstract: This invention provides a method for automated training speech and communication, including, but not limited to, pronunciation, intonation, speech fluency, dialect, accents and non verbal social conduct. This invention deals with the following problems: How to train a user to communicate in a specific region's dialect, accent and conduct, in scenarios similar to the ones the user is expected to encounter. How to train a user in building sentences that convey his thoughts. How to train a user to correctly pronounce given sentences, in a given dialect and accent. How to increase a user's confidence in his/her ability to communicate in a taught language. The method offers a solution for training users to communicate fluently in a desired environment, in a way that is both effective and fun.

Abstract: The present invention is a method and apparatus for reading education. In one embodiment, a method for recognizing an utterance spoken by a reader, includes receiving text to be read by the reader, generating a grammar for speech recognition, in accordance with the text, receiving the utterance, interpreting the utterance in accordance with the grammar, and outputting feedback indicative of reader performance.

Abstract: A computer system provides a series of visual flash stimuli to a user and then requires that the user process the visual stimuli to produce a verbalization that corresponds to the visual stimuli and/or a fine motor activity that corresponds to the visual stimuli. The visual flash stimuli are presented to a user via a display device and include letters, words and phrases. The fine motor activity includes inputting letters or words via an input device, such as typing on a keyboard. The system includes eye movement activities, letter flash activities and word flash activities. The content or visual stimuli provided during these activities, as well as the progression through these activities can be determined in part by the diagnosis of the individual user. The system can be used to treat a variety of mental disabilities.

Abstract: A method and system for recording, cataloging, and analyzing infant speech in order to enhance speech development by producing lists of suggested future words. The invention utilizes voice recognition software to update a database table comprising words that the infant has spoken. Speech analysis software then compares the previously spoken words in the database table to a set of rules, which are used to analyze consonant/vowel patterns and thereby identify trends in word usage. After identifying trends in an infant's word usage, the speech analysis software may then generate reports comprising trends in an infant's word usage and also generate lists of suggested future words for the infant to learn. The computer system then outputs the reports to a display screen, electronic data file, network connection device, or printout.

Abstract: A multi-mail system and method is disclosed in which a sender may convey and a recipient can realize emotional aspects associated with substantive content of a multi-mail message by receiving a message that is more than textual in nature. Voice recognition technology and programmatic relation of sound and graphics may be used to produce a talking image. In one embodiment, the image may include the user's own visual and/or audio likeness. In an alternate embodiment, the image may comprise any available visual and/or audio display selected by the user. The multi-mail message may be inputted by a user in a text format and transposed into a format including the selected image and/or voice. In an alternate embodiment, a spoken message may be converted into a format including the selected image and/or voice. The formatted messages are then stored and/or transmitted via an email system or some other electronic network.

Abstract: Systems and methods for dynamically analyzing temporality in an individual's speech in order to selectively categorize the speech fluency of the individual and/or to selectively provide speech training based on the results of the dynamic analysis. Temporal variables in one or more speech samples are dynamically quantified. The temporal variables in combination with a dynamic process, which is derived from analyses of temporality in the speech of native speakers and language learners, are used to provide a fluency score that identifies a proficiency of the individual. In some implementations, temporal variables are measured instantaneously.

Abstract: An improved stuttering treatment program provides for a multi dimensional diagnostic procedure for identifying the problems associated with stuttering. A simultaneous attitude modification phase and a speech fluency enhancing techniques phase define a supervised, hands-on exercise portion of the program which is intended to advance the level of speech of a stutter afflicted person to speech fluency. Upon completion of attitude modification and speech fluency enhancing exercises, which raises the patient to speech fluency, a self-discipline phase of the program is provided where the patient supervises himself during speech exercising, monitors and analyzes exercise effect and reports his analysis to speech professionals. The self-supervised exercise is up-dated and communicated to the patient, for preventive maintenance of speech fluency.

Abstract: An auditory sense training device 1 to be used in an auditory sense training method for training auditory sense by listening to a sound formed by processing an original sound comprises a band attenuation processing method 20 for attenuating a predetermined frequency band of an original sound 10, a switching means 30 for selectively outputting either the original sound or the output from said band attenuation processing means, a panpot processing means 40 for performing a panpot process wherein a voice signal formed by attenuating an original sound of one channel is superposed to the original sound of another channel, and a phase reverse processing means 50 for performing a phase reverse process of reversing the phase of the original sound, wherein a trainee listens to the original sound and a band attenuation processed sound formed by attenuating a predetermined frequency band of the original sound alternately.

Abstract: The present invention is a speech cueing system that incorporates a multi modal (auditory, visual, tactile-kinesthetic) approach to teaching speech sounds and an accompanying apparatus. The system provides explicit instructions on how to utilize the apparatus in the method of multi modal teaching The apparatus is a planar surface equipped with fixed and moveable cue markers and vowel and consonant sound cards. The planar surface has securement locations at either end and along the fixed cue marker, for placement of the movable cue marker and sound cards in specific arrangements to teach various sound combinations, as set forth in the written instructions. The instructions also include designated tactile kinesthetic hand movement patterns that work in conjunction with the set up of the apparatus for the given sound combinations.

Abstract: A method and implement for use in speech therapy to assist with teaching a patient to correctly produce sounds, especially /r/ sounds, designed to be used in a human mouth to support tongue tip and made of a palatable, non-toxic substance such as wax or candy.

Abstract: A method and apparatus for videorealistic, speech animation is disclosed. A human subject is recorded using a video camera as he/she utters a predetermined speech corpus. After processing the corpus automatically, a visual speech module is learned from the data that is capable of synthesizing the human subject's mouth uttering entirely novel utterances that were not recorded in the original video. The synthesized utterance is re-composited onto a background sequence which contains natural head and eye movement. The final output is videorealistic in the sense that it looks like a video camera recording of the subject.

Abstract: A system and method for teaching a speaker of a primary language the basic tools necessary to communicate with a speaker of the a secondary language in an accelerated and concise manner, including a base set of phrase or word cards and a profession-specific set of phrase or word cards, each of the cards including: a phrase or word in a primary language; a translation of the phrase or word in a secondary language; and a pronunciation key written in the primary language to aid a speaker in pronouncing the phrase or word in the secondary language. The cards can also include a visual depiction of a scenario which can aid the speaker in remembering both the pronunciation and meaning of a particular word or phrase.

Abstract: A language learning system and method with a visualized pronunciation suggestion is disclosed. A sound wave corresponding to a sample voice output is used to suggest the user to make corrections with respect to tones and stresses. Through sectional evaluations and corrections, the invention can effectively improve the speaking ability of the user. The disclosed system includes a language database, a follow-reading module, a display control module, a sectional evaluation module, a correction module, and a suggestion-editing module. The disclosed method includes the steps of: extracting a full-sentence sample, outputting a full-sentence voice message and an associated message, prompting the user to imitate and recording the voice data, comparing the voice data with the full-sentence voice message and outputting the similarity, and evaluating the voice data.

Abstract: A method and system provides procedures/routines to teach certain repertoires, such as reading, to learners without a teacher present. The various routines can be provided or implemented via a computer network, such as the Internet, so that multiple learners can access and use the routines. Feedback features take into account that the Internet is a medium where it is difficult to directly monitor the learner's activities during the course of various lessons provided by the routines. The routines may be implemented in a sequence of episodes, with each episode systematically building on the particular skills learned in a prior episode. Some of these routines include establishing routines, adduction routines, potentiating routines, composite routines, sequential composite routines, fluency routines, motivation routines, application routines, and the overall sequencing of these routines.

Abstract: A method and apparatus for interactive language instruction is provided that displays text files for processing, provide key features and functions for interactive learning, displays facial animation, and provides a workspace for language building functions. The system includes a stored set of language rules as part of the text-to-speech sub-system, as well as another stored set of rules as applied to the process of learning a language. The method implemented by the system includes digitally converting text to audible speech, providing the audible speech to a user or student (with the aid of an animated image in selected circumstances), prompting the student to replicate the audible speech, comparing the student's replication with the audible speech provided by the system, and providing feedback and reinforcement to the student by, for example, selectively recording or playing back the audible speech and the student's replication.

Abstract: A stereotypical sentence is synthesized into a voice of an arbitrary speech style. A third party is able to prepare prosody data and a user of a terminal device having a voice synthesizing part can acquire the prosody data. The voice synthesizing method determines a voice-contents identifier to point to a type of voice contents of a stereotypical sentence, prepares a speech style dictionary including speech style and prosody data which correspond to the voice-contents identifier, selects prosody data of the synthesized voice to be generated from the speech style dictionary, and adds the selected prosody data to a voice synthesizer 13 as voice-synthesizer driving data to thereby perform voice synthesis with a specific speech style. Thus, a voice of a stereotypical sentence can be synthesized with an arbitrary speech style.

Abstract: An auditory sense training device 1 to be used in an auditory sense training method for training auditory sense by listening to a sound formed by processing an original sound comprises a band attenuation processing method 20 for attenuating a predetermined frequency band of an original sound 10, a switching means 30 for selectively outputting either the original sound or the output from said band attenuation processing means, a panpot processing means 40 for performing a panpot process wherein a voice signal formed by attenuating an original sound of one channel is superposed to the original sound of another channel, and a phase reverse processing means 50 for performing a phase reverse process of reversing the phase of the original sound, wherein a trainee listens to the original sound and a band attenuation processed sound formed by attenuating a predetermined frequency band of the original sound alternately.

Abstract: A system for providing customized audio content, based on a client-server communication network, includes a means for producing a plurality of audio content with different attributes; and a content-providing server for converting the plurality of audio content into digital audio files that are stored with and linked to the corresponding script. A contents file with specific attributes is provided via the communication network to a user after being requested.

Abstract: Methods, devices, and computer program products display visual choral speech to a patient who stutters or has a speech impediment or impairment as a visual stimulus for the patient to enhance the fluency of the patient. The visual choral speech is incongruous with the speech produced by the stutterer and is provided by a visual display of the articulatory movements of a person other than the patient (or a simulated representation thereof) of the person's lips and mouth as the person speaks. The visual speech gestures can be displayed to the patient in advance of a speaking event or speech production by the stutterer and/or concurrently with a speaking event (either intermittently or continuous during the speaking event). The visual choral speech gestures can be based on a string of coherent words to provide the visual speech gestures signal such that it is relayed to the user without the attendant auditory component allowing the user to speak at a substantially normal pace with enhanced fluency.

Abstract: Computer software and portable memory for an electronic educational toy designed to stimulate the development of a child's mind using audio feedback, the educational toy including an enclosure enclosing a processor, data storage medium and a speaker and having a substantially flat surface, at least a portion of which comprises a work platform on which a child manipulates and places an object.

Abstract: A manipulative tool for demonstrating the relative positions and configurations of articulators and other oral structures, when making phonetic sounds. The tool comprises a tongue, upper and lower palate, and upper and lower teeth, as well as, adjustable and positional lips, any one of which may be manipulated and posed so as to retain placement once released by a user. In this regard, the manipulative tool is used to demonstrate proper formation of certain phonetic sounds to assist in speech therapy or training of persons who are affected by speech impediments, or to assist in the training of future clinicians.

Abstract: A method for utilizing oral movements is used in speech assessment, speech therapy, language development, and controlling external devices. A device is used which includes a sensor plate having sensors to detect contact of the tongue with the sensor plate. One aspect of the invention allows viewing representations of contact of the tongue and palate during speech and comparing the representations with model representations displayed in a split screen fashion. The model representations may be generated by another speaker utilizing a sensor plate or by computer generated representations which have been electronically stored. The representations may be analyzed to assess speech proficiency and the model may be mimicked for speech enhancement.

Abstract: A learning system method for infants, toddlers and young children which uses selected visuals stored on an audiovisual storage and playback device in conjunction with unique flash cards to provide an enhanced learning experience.

Abstract: A language learning system is provided. The language learning system typically includes a set of fictional characters, each character being associated with a predetermined phoneme of a language, such as English. The character typically has a given name including the phoneme. The system may further include a learning device configured to display at least one of the characters along with an associated letter corresponding to the phoneme. The device may be a wheel, block, vessel, card, doll, disk, cone, or other suitable device.

Abstract: An audio-visual method of learning a foreign language, which can be practiced using a video projection screen with concomitant audio, or a television includes the steps of: showing the program (in a foreign language) in its original form; showing either a sequence of frozen scenes or a sequence of short program segments, each frozen scene or segment including a single statement by one of the program participants, along with a transcription and a translation of the statement; reshowing the program in its original form; reshowing the sequence of frozen scenes or short program segments, along with only a transcription of the associated statement; and reshowing the program in its original form. Statements by program participants may be shown as subtitles or as dialog balloons such as those used in comic books. Short program segments may end with a frozen frame, which includes the translation and/or transcription.

Abstract: A method of teaching pronunciation is provided which includes communicating by a voice portal server to a user a model word and detecting a response by the user to the voice portal server. The method also includes comparing the response word to the model word and determining a confidence level based on the comparison of the response word to the model word. The method further includes comparing an acceptance limit to the confidence level and confirming a correct pronunciation of the model word if the confidence level one of equals and exceeds the acceptance limit.

Abstract: A computer assisted learning system comprises a storage server to communicate with a contents server that controls voice data and text data of English conversation and a mobile phone through a network, and a terminal device to communicate with the storage server through a network. The storage server downloads voice data of English conversation in an information storage unit from the contents server according to a direction from the mobile phone, sends the downloaded voice data to a mobile phone, and when it is requested from the terminal device to obtain a text of an English conversation, downloads text data of an English conversation in the information storage unit and sends this downloaded text data to the terminal device. The terminal device makes the request to obtain a text of English conversation to the storage server and when the text data of English conversation is received from the storage server, prints and outputs this text data.

Abstract: The present invention is a method of associating visual symbols with verbal expression including the steps of preselecting a language having both verbal and written expressions, establishing an array of sounds employed in the verbal expression of the language, assembling an array of symbols correlating to the first array of sounds according to the language, associating a mechanical physiologic cue with each sound in the array of sounds, and animating the array of symbols according to the mechanical physiologic cues.