Speech Patents (Class 434/185)
  • Patent number: 6364666
    Abstract: A method for adaptively training a subject, using auditory processing of phonemes within command sentences, to improve the subject's listening comprehension, grammatical parsing, and serial memory is provided. The method utilizes a number of training installments, each designed for testing a particular aspect of the subject's language skills, all tied together by a common story. More specifically, installments are provided that narrate a story, test the subject's listening comprehension to the narrated story, test the subject's ability to grammatically parse increasingly difficult sentence structures, and test the subject's ability to select and manipulate graphical objects in response to auditory commands. Speech processing is used for the narration, as well as for commands within each test to allow the subject to more easily distinguish between similar sounding phonemes.
    Type: Grant
    Filed: June 30, 1998
    Date of Patent: April 2, 2002
    Assignee: Scientific Learnîng Corp.
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6358056
    Abstract: A method for adaptively training a human subject to process, and to distinguish between, similar acoustic events that are common in spoken language is provided. The method utilizes sequences of up/down frequency sweeps, of varying frequency and duration, and having varying inter stimulus intervals (ISI) between the frequency sweeps. A sequence is presented to the subject for order identification. The subject must listen to the up/down order of a sequence, and signal identification of the up/down order according to what s/he heard. Signal identification is provided utilizing a computer display, a mouse, and graphical buttons corresponding to the up/down frequency sweeps. Correct order identification causes the process to adaptively reduce the ISI separating the frequency sweeps, to reduce the duration of the frequency sweeps, to alter the frequency of the frequency sweeps, and to increase the number of frequency sweeps within a sequence.
    Type: Grant
    Filed: June 21, 2000
    Date of Patent: March 19, 2002
    Assignee: Scientific Learning Corporation
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6358054
    Abstract: A system and apparatus for teaching prosodic features of speech senses and extracts prosodic or suprasegmental variables of a user's speech segment. Prosodic features of speech include pitch and loudness variations, as opposed to articulatory or sequential features of speech which are the primary determinants of phoneme variations. Once prosodic variables have been extracted from a speech segment, the variables are used to modulate a quasiperiodic waveform such as a sinusoid, a pulse-train, or a synthesized vowel-like waveform, or the parameters can be used to modulate a random-noise-like waveform. A modulated waveform can be played acoustically, and the user can hear the variation of the prosodic parameters without interference from the articulatory parameters of a complete waveform. This auditory feedback can be combined with visual feedback of the speech segment to teach proper prosodic speech formation.
    Type: Grant
    Filed: June 6, 2000
    Date of Patent: March 19, 2002
    Assignee: Syracuse Language Systems
    Inventor: Martin Rothenberg
  • Patent number: 6358055
    Abstract: A system and apparatus for teaching prosodic features of speech senses and extracts prosodic or suprasegmental variables of a user's speech segment. Prosodic features of speech include pitch and loudness variations, as opposed to articulatory or sequential features of speech which are the primary determinants of phoneme variations. Once prosodic variables have been extracted from a speech segment, the variables are used to modulate a quasiperiodic waveform such as a sinusoid, a pulse-train, or a synthesized vowel-like waveform, or the parameters can be used to modulate a random-noise-like waveform. A modulated waveform can be played acoustically, and the user can hear the variation of the prosodic parameters without interference from the articulatory parameters of a complete waveform. This auditory feedback can be combined with visual feedback of the speech segment to teach proper prosodic speech formation.
    Type: Grant
    Filed: June 6, 2000
    Date of Patent: March 19, 2002
    Assignee: Syracuse Language System
    Inventor: Martin Rothenberg
  • Patent number: 6347993
    Abstract: A video game device of this invention comprises a speech/action storage device for storing contents of various speeches and actions of a leader character to be given to a main character as an ability growth object; an ability value updating device for successively updating an ability value of the main character according to the execution result of the content of the speech/action; a parameter storage device for storing an enthusiasm parameter which is set to be a positive value for each training-related speech/action and a negative value for any other speech/action; an enthusiasm parameter adding device for adding a set value to a present enthusiasm parameter given to the main character every time the speech/action is executed; a reliability degree calculating means for calculating a reliability degree between the main character and the leader character; and a judging device for judging a successful growth of the main character.
    Type: Grant
    Filed: May 12, 2000
    Date of Patent: February 19, 2002
    Assignee: Konami Co., Ltd.
    Inventors: Tetsuya Kondo, Eiji Nakagawa, Akinori Hiromi
  • Patent number: 6343935
    Abstract: A computer based interactive method and apparatus for teaching vocabulary words. In particular, a vocabulary game aimed at preparing children for the SAT. The invention is also applicable to other vocabulary words for children and adults of all ages and learning levels, as well as teaching subjects and concepts other than vocabulary. The vocabulary game comprises a synonym matching game which provides audio and visual reinforcement of words, their definitions, and dialogue that uses the word, and requires the user to physically interact (i.e. select words, approve word choices, and the like). Reinforcement of vocabulary words is enhanced through the use of various support materials, including support tests, index cards containing phrases using the vocabulary words, and mnemonic aids.
    Type: Grant
    Filed: March 1, 2000
    Date of Patent: February 5, 2002
    Assignee: Castle Hill Learning Company, LLC
    Inventor: Jeanne Clements
  • Publication number: 20020001792
    Abstract: A language learning system for native English speakers learning Spanish, concentrating primarily on vowel sounds pronunciation, allowing the learner to overcome the obstacles of pronunciation of unknown words.
    Type: Application
    Filed: June 4, 2001
    Publication date: January 3, 2002
    Inventor: Eleanor L. Chatman
  • Patent number: 6334776
    Abstract: An apparatus and method for training of auditory and graphical discrimination in humans is provided. The method and apparatus provides a number of stimulus sets, each stimulus set having a target phoneme, and associated grapheme, and a number of distractor phonemes, and associated graphemes. Upon initiation of a trial, a target phoneme is presented to a subject. A stimulus stream is then prepared that consists of a random sequence of distractor phonemes. Located within the sequence of distractor phonemes is the target phoneme. The stimulus sequence is presented to the subject for identification of the target phoneme within the sequence. Speech processing is used to provide multiple levels of emphasis for enhancing a subject's ability to discriminate between similarly sounding phonemes. The processing is applied to the presentation of the target phoneme and the stimulus stream.
    Type: Grant
    Filed: June 27, 2000
    Date of Patent: January 1, 2002
    Assignee: Scientific Learning Corporation
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6334777
    Abstract: A method for adaptively training a human subject to process, and to distinguish between, similar acoustic events that are common in spoken language is provided. The method utilizes sequences of up/down frequency sweeps, of varying frequency and duration, and having varying inter stimulus intervals (ISI) between the frequency sweeps. A sequence is presented to the subject for order identification. The subject must listen to the up/down order of a sequence, and signal identification of the up/down order according to what s/he heard. Signal identification is provided utilizing a computer display, a mouse, and graphical buttons corresponding to the up/down frequency sweeps. Correct order identification causes the process to adaptively reduce the ISI separating the frequency sweeps, to reduce the duration of the frequency sweeps, to alter the frequency of the frequency sweeps, and to increase the number of frequency sweeps within a sequence.
    Type: Grant
    Filed: June 24, 2000
    Date of Patent: January 1, 2002
    Assignee: Scientific Learning Corporation
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6336089
    Abstract: An interactive computer assisted pronunciation learning system which allows a student to compare his/her pronunciation with that of a model speaker. A model speaker's recorded reading of text is digitally linked to and aligned with each corresponding syllable of the text. Pitch, volume and duration parameters of each syllable are extracted digitally and displayed in a simplified notation above each word. The student's own speech is also recorded, analyzed, displayed, and/or replayed in the same manner. The student can choose the option of overlapping his/her own notation above those of the model speaker and determine whether, to what extent, and on which parameters his own speech varies from that of the model speaker. Scores may be provided in the margin denoting the percentage of correct correspondence to the model as well as the type and degree of each error.
    Type: Grant
    Filed: August 20, 1998
    Date of Patent: January 1, 2002
    Inventor: Michael Everding
  • Patent number: 6331115
    Abstract: A method for training of auditory and graphical discrimination in humans, and a human's short term memory, is provided within an animated game environment. The method provides a number of stimulus sets, each stimulus set having similar sounding phonemes associated with graphemes. Upon initiation of a trial, a grid of tiles is presented to a subject. The subject selects the tiles, one at a time. As the tiles are selected, an associated phoneme is presented to the subject. The subject clears away tiles by pairing them with identical tiles. When all the tiles in a trial are cleared, the subject is either promoted or demoted in skill level. Promotion/demotion varies the number of tiles presented, the phonemes used within each trial, and the amount of audio processing that is applied to the phonemes.
    Type: Grant
    Filed: June 30, 1998
    Date of Patent: December 18, 2001
    Assignee: Scientific Learning Corp.
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6328569
    Abstract: A method for training of auditory and graphical discrimination in humans is provided within an animated game environment. The method provides a number of stimulus sets, each stimulus set having a target phoneme and a plurality of associated foils (similar sounding phonemes). Upon initiation of a trial, a target phoneme is presented to a subject. Subsequently, the target phoneme is presented to the subject, along with one of the associated foils, in randomized order. As the target phoneme and associated foil is presented, a graphical animation associates the target and foil each with its own graphical image. The subject then designates identification of the target phoneme by selecting its associated image. Speech processing is used to provide multiple levels of emphasis for enhancing the subject's ability to discriminate between the target phoneme and the foils.
    Type: Grant
    Filed: June 26, 1998
    Date of Patent: December 11, 2001
    Assignee: Scientific Learning Corp.
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6319010
    Abstract: An interactive system for teaching, entertaining, and habituating a child utilizes an interactive entity such as a doll, the doll having input and output elements and control circuitry adapted for driving the I/O elements, and a bi-directional communication link to a personal computer (PC). Scripted data stored at the computer directs doll activity and verbal articulation, and utilizes response from the child through the doll to the PC in directing output to the doll. The communication between the doll and the PC treats the doll as a peripheral device. In specific embodiments the interactive doll has servo-mechanisms for providing doll motion, such as eye and mouth and limb movement, which may be coordinated with verbalization in different scripts by commands retrieved at the computer and sent to the doll. In a preferred embodiment environments and applications are provided on CD-ROM disks which may also provide the operating application for the interactive doll system.
    Type: Grant
    Filed: December 7, 1998
    Date of Patent: November 20, 2001
    Inventor: Dan Kikinis
  • Patent number: 6305942
    Abstract: The present invention provides a comprehensive English language learning system and methodology. An interactive procedure for learning English is provided that can be applied in both public and private schools and in adult education programs. It can be used, for example, to teach primary English, to teach English as a second language (ESL) and to improve the language skill of remedial and educationally handicapped students.
    Type: Grant
    Filed: November 12, 1998
    Date of Patent: October 23, 2001
    Assignee: MetaLearning Systems, Inc.
    Inventors: Robert S. Block, Robert D. Loye, Margot Swan
  • Patent number: 6302697
    Abstract: A method and a system is disclosed that provide means to enable individuals with speech, language and reading based communication disabilities, due to a temporal processing problem, to improve their temporal processing abilities as well as their communication abilities. The method and system include provisions to elongate portions of phonemes that have brief and/or rapidly changing acoustic spectra, such as occur in the stop consonants b and d in the phonemes /ba/ and /da/, as well as reduce the duration of the steady state portion of the syllable. In addition, some emphasis is added to the rapidly changing segments of these phonemes. Additionally, the disclosure includes method for and computer software to modify fluent speech to make the modified speech better recognizable by communicatively impaired individuals. Finally, the disclosure includes method for and computer software to train temporal processing abilities, specifically speed and precision of temporal integration, sequencing and serial memory.
    Type: Grant
    Filed: August 20, 1999
    Date of Patent: October 16, 2001
    Inventors: Paula Anne Tallal, Michael Mathias Merzenich, William Michael Jenkins, Steven Lamont Miller, Christoph E. Schreiner
  • Patent number: 6299452
    Abstract: A diagnostic system and method for evaluating one or more phonological awareness, phonological processing and reading skills of an individual to detect phonological awareness, phonological processing and reading skill deficiencies in the individual so that the risk of developing a reading deficiency is reduced and existing reading deficiencies are remediated. The system may use graphical games to test the individual's ability in a plurality of different phonological awareness, phonological processing and reading skills. The system may use speech recognition technology to interact with the tests.
    Type: Grant
    Filed: July 9, 1999
    Date of Patent: October 9, 2001
    Assignee: Cognitive Concepts, Inc.
    Inventors: Janet Marie Wasowicz, Art Carl Maerlender
  • Patent number: 6296489
    Abstract: The invention is a system for sound file recording, comparison, and archiving for network-based language and communications training, or other applications. The invention allows capture of multimedia data from a user, and allows the user to play back his or her self-created sound inputs and to view various comparisons of his or her sound inputs with model sounds. The invention displays a waveform or spectrogram of a model sound superimposed over a waveform (or spectrogram) of the user's sound input. It can display a failure/success indication for the user's sound input relative to a predetermined standard. Further, the invention allows a user to archive sound files for subsequent review and analysis.
    Type: Grant
    Filed: June 23, 1999
    Date of Patent: October 2, 2001
    Assignee: Heuristix
    Inventors: Laurie J. Blass, Pamela H. Elder
  • Patent number: 6296487
    Abstract: A method for operating a computer to teach a student communication skills. First a goal is displayed to the student. Then the student is presented with a prompting scene that is related to the goal that was presented to him. In the prompting scene there is a first character that represents the student. Also, there is at least one second character that represents at least one person to whom the student needs to communicate. Also displayed is a plurality of sentences the student may select. At least one of the sentences will help the student achieve his goal and at least one of the sentences will not help the student achieve his goal. The student's selection is then received. The student is then presented with a response scene. The response scene is positive if the student's selection from the plurality of sentences is such that it will help the student achieve his goal.
    Type: Grant
    Filed: June 14, 1999
    Date of Patent: October 2, 2001
    Inventor: Ernest L. Lotecka
  • Patent number: 6290504
    Abstract: An apparatus and method on a computing device for training of auditory and graphical discrimination in humans is provided. The method and apparatus provides a number of stimulus sets, each stimulus set having a number of different phonemes. Speech processing is used to provide multiple levels of emphasis and or stretching for enhancing a subject's ability to discriminate between similarly sounding phonemes. The processing is applied to phonemes and presented to the human as a trial. As a subject correctly identifies phonemes in the stimulus sets, the amount of processing applied to the phonemes is reduced, ultimately to the level of normal speech. A performance feedback mechanism is provided to allow the human to obtain a summary of his/her success over the stimulus sets, at the different processing levels. More detailed feedback is also provided indicating specific processing levels achieved for each of the stimulus sets.
    Type: Grant
    Filed: October 8, 1999
    Date of Patent: September 18, 2001
    Assignee: Scientific Learning Corp.
    Inventors: Angela Jane Benitz, Elizabeth H. Budra, William M. Jenkins, John J. Montgomery
  • Patent number: 6289310
    Abstract: An apparatus and method for screening an individual's ability to process acoustic events is provided. The invention provides sequences (or trials) of acoustically processed target and distractor phonemes to a subject for identification. The acoustic processing includes amplitude emphasis of selected frequency envelopes, stretching (in the time domain) of selected portions of phonemes, and phase adjustment of selection portions of phonemes relative to a base frequency. After a number of trials, the method of the present invention develops a profile for an individual that indicates whether the individual's ability to process acoustic events is within a normal range, and if not, what processing can provide the individual with optimal hearing. The individual's profile can then be used by a listening or processing device to particularly emphasize, stretch, or otherwise manipulate an audio stream to provide the individual with an optimal chance of distinguishing between similar acoustic events.
    Type: Grant
    Filed: October 7, 1998
    Date of Patent: September 11, 2001
    Assignee: Scientific Learning Corp.
    Inventors: Steven L. Miller, Bret E. Peterson, Athanassios Protopapas
  • Patent number: 6283760
    Abstract: A pronunciation practice system, device and method allows the user, while watching the television screen, to speak the part of the character which has been selectively turned off, and to check his pronunciation with the subtitle or voice playback simultaneously or successively, thus making it possible to learn a language enjoyably and effectively while at the same time watching attractive images and listening to music. The system, device and method allow pronunciation to be practiced effectively by selecting a first sound signal and a second sound signal from a first sound channel CH1 and a second sound channel CH2, turning at least one of the voices from one of the channels off, and processing this voice which has been turned off with the aid of mixers and a speaker with attached microphone.
    Type: Grant
    Filed: August 24, 1998
    Date of Patent: September 4, 2001
    Inventor: Carl Wakamoto
  • Patent number: 6250928
    Abstract: A method and apparatus of converting input text into an audio-visual speech stream resulting in a talking face image enunciating the text. This method of converting input text into an audio-visual speech stream comprises the steps of: recording a visual corpus of a human-subject, building a viseme interpolation database, and synchronizing the talking face image with the text stream. In a preferred embodiment, viseme transitions are automatically calculated using optical flow methods, and morphing techniques are employed to result in smooth viseme transitions. The viseme transitions are concatenated together and synchronized with the phonemes according to the timing information. The audio-visual speech stream is then displayed in real time, thereby displaying a photo-realistic talking face.
    Type: Grant
    Filed: December 31, 1998
    Date of Patent: June 26, 2001
    Assignee: Massachusetts Institute of Technology
    Inventors: Tomaso A. Poggio, Antoine F. Ezzat
  • Patent number: 6234802
    Abstract: A method and system for teaching a language and evaluating language comprehension in a digitally synthesized, interactive three-dimensional graphical representation of an environment. Within the environment, the user is given opportunities to practice language skills by interacting with digital videos of people. As the user walks through the environment and encounters various people therein, the people set forth challenges in the form of scripted questions and tasks that require the user to comprehend the language in order to correctly respond. A speech recognition engine interprets verbal responses of the user, thereby further simulating a real-world environment. A set of one or more scripts controls various aspects of the environment while testing and evaluating the user's comprehension of the language.
    Type: Grant
    Filed: January 26, 1999
    Date of Patent: May 22, 2001
    Assignee: Microsoft Corporation
    Inventors: John P. Pella, Quentin DeWolf, Peter C. Acker, Charles A. Hale, Renée Louise April, Jason T. Cortese, Victor J. Bondi
  • Patent number: 6224383
    Abstract: A method of computerized language instruction for a student. Based on data regarding past performance of the student, an adjustable speech recognizer is adjusted. An utterance is received from the student, and the utterance is processed using the adjusted adjustable speech recognizer. The adjustable speech recognizer may comprise an Automatic Speech Recognition (ASR) engine. A set of contexts is created. Each context includes a set of words and utterances selected to allow recognition of the words and utterances by a speech recognizer. For each context, a set of subcontexts is created. Each subcontext includes the words and utterances of the context and selected mispronunciations or misarticulations of the words and utterances of the context. Recursively passing a portion of a received utterance to an ASR engine is described.
    Type: Grant
    Filed: March 25, 1999
    Date of Patent: May 1, 2001
    Assignee: planetLingo, Inc.
    Inventor: Marvin Shannon
  • Patent number: 6226611
    Abstract: Pronunciation quality is automatically evaluated for an utterance of speech based on one or more pronunciation scores. One type of pronunciation score is based on duration of acoustic units. Examples of acoustic units include phones and syllables. Another type of pronunciation score is based on a posterior probability that a piece of input speech corresponds to a certain model such as an HMM, given the piece of input speech. Speech may be segmented into phones and syllables for evaluation with respect to the models. The utterance of speech may be an arbitrary utterance made up of a sequence of words which had not been encountered before. Pronunciation scores are converted into grades as would be assigned by human graders. Pronunciation quality may be evaluated in a client-server language instruction environment.
    Type: Grant
    Filed: January 26, 2000
    Date of Patent: May 1, 2001
    Assignee: SRI International
    Inventors: Leonardo Neumeyer, Horacio Franco, Mitchel Weintraub, Patti Price, Vassilios Digalakis
  • Patent number: 6224384
    Abstract: An apparatus and method for training of auditory and graphical discrimination in humans is provided. The method and apparatus provides a number of stimulus sets, each stimulus set having a target phoneme, and associated grapheme, and a number of distractor phonemes, and associated graphemes. Upon initiation of a trial, a target phoneme is presented to a subject. A stimulus stream is then prepared that consists of a random sequence of distractor phonemes. Located within the sequence of distractor phonemes is the target phoneme. The stimulus sequence is presented to the subject for identification of the target phoneme within the sequence. Speech processing is used to provide multiple levels of emphasis for enhancing a subject's ability to discriminate between similarly sounding phonemes. The processing is applied to the presentation of the target phoneme and the stimulus stream.
    Type: Grant
    Filed: June 27, 2000
    Date of Patent: May 1, 2001
    Assignee: Scientific Learning Corp.
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6210166
    Abstract: A method for adaptively training a human subject to process, and to distinguish between, similar acoustic events that are common in spoken language is provided. The method utilizes sequences of up/down frequency sweeps, of varying frequency and duration, and having varying inter stimulus intervals (ISI) between the frequency sweeps. A sequence is presented to the subject for order identification. The subject must listen to the up/down order of a sequence, and signal identification of the up/down order according to what s/he heard. Signal identification is provided utilizing a computer display, a mouse, and graphical buttons corresponding to the up/down frequency sweeps. Correct order identification causes the process to adaptively reduce the ISI separating the frequency sweeps, to reduce the duration of the frequency sweeps, to alter the frequency of the frequency sweeps, and to increase the number of frequency sweeps within a sequence.
    Type: Grant
    Filed: June 16, 1998
    Date of Patent: April 3, 2001
    Assignee: Scientific Learning Corp.
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6190173
    Abstract: An apparatus and method for training of auditory and graphical discrimination in humans is provided. The method and apparatus provides a number of stimulus sets, each stimulus set having a target phoneme, and associated grapheme, and a number of distractor phonemes, and associated graphemes. Upon initiation of a trial, a target phoneme is presented to a subject. A stimulus stream is then prepared that consists of a random sequence of distractor phonemes. Located within the sequence of distractor phonemes is the target phoneme. The stimulus sequence is presented to the subject for identification of the target phoneme within the sequence. Speech processing is used to provide multiple levels of emphasis for enhancing a subject's ability to discriminate between similarly sounding phonemes. The processing is applied to the presentation of the target phoneme and the stimulus stream.
    Type: Grant
    Filed: June 2, 1998
    Date of Patent: February 20, 2001
    Assignee: Scientific Learning Corp.
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven L. Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6148286
    Abstract: A method and apparatus which allows a user with minimal understanding of the orthography of a language to nevertheless use its orthography as the basis for performing a database search. Orthographic information is displayed. When a user indicates a possible selection of this information by, for example, placing a mouse cursor over the displayed information the selection is pronounced. When the user selects this information by, for example, clicking a mouse button, the input data associated with the information may be used for a database search, and the results presented to back the user aurally. According to another aspect of the invention, the results may also be presented orthographically. According to another aspect of the invention, the results may also be presented pictorially. According to another aspect of the invention, when the user indicates a possible selection of an orthographically presented result by, for example, placing a mouse cursor over ie result, the result is pronounced.
    Type: Grant
    Filed: October 27, 1999
    Date of Patent: November 14, 2000
    Inventor: Steven H. Siegel
  • Patent number: 6123548
    Abstract: A method and a system is disclosed that provide means to enable individuals with speech, language and reading based communication disabilities, due to a temporal processing problem, to improve their temporal processing abilities as well as their communication abilities. The method and system include provisions to elongate portions of phonemes that have brief and/or rapidly changing acoustic spectra, such as occur in the stop consonants b and d in the phonemes /ba/ and /da/, as well as reduce the duration of the steady state portion of the syllable. In addition, some emphasis is added to the rapidly changing segments of these phonemes. Additionally, the disclosure includes method for and computer software to modify fluent speech to make the modified speech better recognizable by communicatively impaired individuals. Finally, the disclosure includes method for and computer software to train temporal processing abilities, specifically speed and precision of temporal integration, sequencing and serial memory.
    Type: Grant
    Filed: April 9, 1997
    Date of Patent: September 26, 2000
    Assignees: The Regents of the University of California, Rutgers, The State University of New Jersey
    Inventors: Paula Anne Tallal, Steven Lamont Miller, Mathias Merzenich, William Michael Jenkins, Christoph E. Schreiner
  • Patent number: 6119089
    Abstract: A listener's ability to recognize and identify similar sounds is improved by forming exaggerated sounds which differ in spectral/temporal energy distribution from one another more than the similar sounds differ from one another and in generally the same way in which the similar sounds differ and testing the listener's ability to recognize and identify the exaggerated sounds. The exaggerated sounds are formed as follows: The similar sounds are spectrally transformed into a coordinate space and a linear function is projected between a pair of points representing the similar sounds in the coordinate space. Between the pair of points, the linear function represents a continuum of sounds between the similar sounds. To exaggerate the sounds, points are extrapolated outward from the pair of points along the linear function.
    Type: Grant
    Filed: July 1, 1998
    Date of Patent: September 12, 2000
    Assignee: Scientific Learning Corp.
    Inventor: Athanassios Protopapas
  • Patent number: 6116907
    Abstract: A method and system are disclosed for encoding signs in a given sign language. The sign typically uses a dominant hand for some signs and a second hand is used for other signs the dominant hand remaining dominant of the two hands. In order to encode the signs into a useful form, each hand has various articles defined. The first article is that of handshape for both hands. The next article is that of palm orientation, with location and movement being the next two articles. A parametric value is associated with each of these particular articles. A combination of the articles, such as an article's concatenation in a parametric value string, allows for the transcription of a particular sign. Using this parametric value or even parts of the parametric value for the combined sign, a desired sign or a group of signs may be identified that closely resembles the particular sign being encoded.
    Type: Grant
    Filed: January 13, 1998
    Date of Patent: September 12, 2000
    Assignee: Sorenson Vision, Inc.
    Inventors: David Baker, David Taylor
  • Patent number: 6109923
    Abstract: A system and apparatus for teaching prosodic features of speech senses and extracts prosodic or suprasegmental variables of a user's speech segment. Prosodic features of speech include pitch and loudness variations, as opposed to articulatory or sequential features of speech which are the primary determinants of phoneme variations. Once prosodic variables have been extracted from a speech segment, the variables are used to modulate a quasiperiodic waveform such as a sinusoid, a pulse-train, or a synthesized vowel-like waveform, or the parameters can be used to modulate a random-noise-like waveform. A modulated waveform can be played acoustically, and the user can hear the variation of the prosodic parameters without interference from the articulatory parameters of a complete waveform. This auditory feedback can be combined with visual feedback of the speech segment to teach proper prosodic speech formation.
    Type: Grant
    Filed: May 24, 1995
    Date of Patent: August 29, 2000
    Assignee: Syracuase Language Systems
    Inventor: Martin Rothenberg
  • Patent number: 6108515
    Abstract: An interactive conversational apparatus provides seamless uninterrupted conversational responsiveness to a variety of user inputs utilizing a storage media having a plurality of temporally related data storage tracks containing interactive conversational content. The conversational content and control code information are stored on tracks in a timed sequence for providing interactive pathways through the tracks dependent upon various user responses. A media player facilitates playback of the interactive conversational content. A control code reader reads the control code information and generates track selection information based upon the control codes. User-input buttons or keys receive responses from a user based upon the interactive conversational content.
    Type: Grant
    Filed: September 9, 1997
    Date of Patent: August 22, 2000
    Inventor: Michael J. Freeman
  • Toy
    Patent number: 6089943
    Abstract: An educational toy comprises a soft toy (10) carrying a barcode scanner (20) for scanning a number of barcodes each individually associated with a visual message in a book (12). A decoder and audio device in the toy generate an audio message corresponding to that visual message in the book associated with the scanned barcode.
    Type: Grant
    Filed: October 30, 1998
    Date of Patent: July 18, 2000
    Assignee: Tai Sun Plastic Novelties Ltd.
    Inventor: Wai Shing Lo
  • Patent number: 6081772
    Abstract: A method for proofreading text generated by a speech application can include the following steps beginning with the step of finding all closed-class vocabulary words in the text. Subsequently, the method can include the step of automatically highlighting at least some of the closed-class vocabulary words in the text during proofreading. Additionally, the highlighting of the closed-class vocabulary words can include either highlighting all of the closed-class vocabulary words, highlighting the closed-class vocabulary words based on a perplexity filter, or highlighting the closed-class vocabulary words based on a language model enhancement filter.
    Type: Grant
    Filed: March 26, 1998
    Date of Patent: June 27, 2000
    Assignee: International Business Machines Corporation
    Inventor: James R. Lewis
  • Patent number: 6077085
    Abstract: The systems, methods and apparatus of preferred embodiments of the present invention provide an integrated instructional system directed to learning a specific task or concept. Some embodiments are particularly suited for language instruction and some embodiments will accommodate a group of students with differing native languages. This is accomplished in the exemplary embodiment through the use of a template and database system wherein computer activity templates are programmed to perform a task or carry out an exercise. An activity template accesses data stored in a multilingual language database according to a student's needs or preferences. Embodiments of the present invention also provide a review method and system which optimize study efficiency by managing the content of review sessions according to each student's individual familiarity with those concepts.
    Type: Grant
    Filed: May 19, 1998
    Date of Patent: June 20, 2000
    Assignee: Intellectual Reserve, Inc.
    Inventors: Kent Parry, C. Bret Elzinga
  • Patent number: 6071123
    Abstract: A method and a system is disclosed that provide means to enable individuals with speech, language and reading based communication disabilities, due to a temporal processing problem, to improve their temporal processing abilities as well as their communication abilities. The method and system include provisions to elongate portions of phonemes that have brief and/or rapidly changing acoustic spectra, such as occur in the stop consonants b and d in the phonemes /ba/ and /da/, as well as reduce the duration of the steady state portion of the syllable. In addition, some emphasis is added to the rapidly changing segments of these phonemes. Additionally, the disclosure includes method for and computer software to modify fluent speech to make the modified speech better recognizable by communicatively impaired individuals. Finally, the disclosure includes method for and computer software to train temporal processing abilities, specifically speed and precision of temporal integration, sequencing and serial memory.
    Type: Grant
    Filed: July 30, 1998
    Date of Patent: June 6, 2000
    Assignees: The Regents of the University of California, Rutgers, The State University of New Jersey
    Inventors: Paula Anne Tallal, Mathias Merzenich, William Michael Jenkins, Steven Lamont Miller, Christopher E. Schreiner
  • Patent number: 6068485
    Abstract: A computer-operated system for assisting aphasics in communication includes user-controlled means for storing data representing the user's vocalizations during a time interval, means for associating the data stored in each of a plurality of such intervals with an icon, means for ordering a plurality of such icons in a group representing a speech message, and means for generating an audio output from the stored data represented by the icons in the group so as to provide a speech message.
    Type: Grant
    Filed: May 1, 1998
    Date of Patent: May 30, 2000
    Assignee: Unisys Corporation
    Inventors: Marcia C. Linebarger, John F. Romania
  • Patent number: 6068487
    Abstract: A method for having a reading machine spell a word includes retrieving a word to be spelled, displaying the first character of the word on a display while applying a highlighting indicia to the character, synthesizing speech for the character to have the reading machine pronounce the displayed letter of the word, unhighlighting the displayed letter of the word, and retrieving a subsequent letter of the word.
    Type: Grant
    Filed: October 20, 1998
    Date of Patent: May 30, 2000
    Assignee: Lernout & Hauspie Speech Products N.V.
    Inventor: Mark S. Dionne
  • Patent number: 6056552
    Abstract: The invention relates to an instrument for analysis of rhythmic measures of speech. One input device is operable to generate input signals representing the rhythm of a group of syllables and an output device responds to these signals and provides a representation of the input rhythm and an indication of the relationship of the input rhythm to a known or predetermined rhythm. The visual representation may be in the form of a numerical display such as comprising symbols representing different rhythmic measures of speech. The input device may be a push button to open and close a switch in a rhythm corresponding to that in which a group of syllables such as a line of verse would be spoken or read. The instrument allows information to be entered rapidly and simply and the different between spoken and written language presents no difficulty.
    Type: Grant
    Filed: May 29, 1996
    Date of Patent: May 2, 2000
    Inventor: Talal Al-Housseini
  • Patent number: 6055498
    Abstract: Pronunciation quality is automatically evaluated for an utterance of speech based on one or more pronunciation scores. One type of pronunciation score is based on duration of acoustic units. Examples of acoustic units include phones and syllables. Another type of pronunciation score is based on a posterior probability that a piece of input speech corresponds to a certain model, such as a hidden Markov model, given the piece of input speech. Speech may be segmented into phones and syllable for evaluation with respect to the models. The utterance of speech may be an arbitrary utterance made up of a sequence of words which had not been encountered before. Pronunciation scores are converted into grades as would be assigned by human graders. Pronunciation quality may be evaluated in a client-server language instruction environment.
    Type: Grant
    Filed: October 2, 1997
    Date of Patent: April 25, 2000
    Assignee: SRI International
    Inventors: Leonardo Neumeyer, Horacio Franco, Mitchel Weintraub, Patti Price, Vassilios Digalakis
  • Patent number: 6036496
    Abstract: An apparatus and method for screening an individual's ability to process acoustic events is provided. The invention provides sequences (or trials) of acoustically processed target and distractor phonemes to a subject for identification. The acoustic processing includes amplitude emphasis of selected frequency envelopes, stretching (in the time domain) of selected portions of phonemes, and phase adjustment of selection portions of phonemes relative to a base frequency. After a number of trials, the method of the present invention develops a profile for an individual that indicates whether the individual's ability to process acoustic events is within a normal range, and if not, what processing can provide the individual with optimal hearing. The individual's profile can then be used by a listening or processing device to particularly emphasize, stretch, or otherwise manipulate an audio stream to provide the individual with an optimal chance of distinguishing between similar acoustic events.
    Type: Grant
    Filed: October 7, 1998
    Date of Patent: March 14, 2000
    Assignee: Scientific Learning Corporation
    Inventors: Steven L. Miller, Bret E. Peterson, Athanassios Protopapas
  • Patent number: 6033224
    Abstract: A reading machine for a blind or visually impaired person includes a computer system that causes the computer to load a definition file in accordance with the current word whose definition a user desires the reading machine to read aloud, extract from said definition file text corresponding to at least a first definition contained in said file, and synthesize speech corresponding to the extracted text to permit the definition to be read aloud. The reading machine includes a user input device including a user activated button that produces a signal that causes the computer to enter a definition mode to read a definition of current word being spoken by the reading machine.
    Type: Grant
    Filed: June 27, 1997
    Date of Patent: March 7, 2000
    Assignee: Kurzweil Educational Systems
    Inventors: Raymond C. Kurzweil, Firdaus Bhathena, Stephen R. Baum
  • Patent number: 6022222
    Abstract: A computerized system and method for learning a natural language through the visual depiction of grammar is described. The system employs icons that are strung together in sentences that exactly parallel the word order of the natural language being studied. Icons are used to represent all parts of speech, and also to provide a pictorial representation of tense and number.
    Type: Grant
    Filed: September 30, 1997
    Date of Patent: February 8, 2000
    Assignee: Mary Beth Guinan
    Inventor: Mary Beth Guinan
  • Patent number: 6019607
    Abstract: An apparatus and method for training the sensory perceptual system in a language learning impaired (LLI) subject is provided. The apparatus and method incorporates a number of different programs to be played by the subject. The programs artificially process selected portions of language elements, called phonemes, so they will be more easily distinguished by an LLI subject, and gradually improves the subject's neurological processing of the elements through repetitive stimulation. The programs continually monitor a subject's ability to distinguish the processed language elements, and adaptively configures the programs to challenge and reward the subject by altering the degree of processing. Through adaptive control and repetition of processed speech elements, and presentation of the speech elements in a creative fashion, a subject's temporal processing of acoustic events common to speech are significantly improved.
    Type: Grant
    Filed: December 17, 1997
    Date of Patent: February 1, 2000
    Inventors: William M. Jenkins, Michael M. Merzenich, Steven Lamont Miller, Bret E. Peterson, Paula Tallal
  • Patent number: 6017219
    Abstract: A reading or language interactive system which utilizes a mechanism to permit a computer-based instruction program in reading or language instruction to implement a shared reading program, wherein portions of the text are read by the student and portions by the computer itself. The proportion of the text "read" by each participant and the pace at which the lesson progresses can each be automatically altered based upon the proficiency of the student. In addition, the system utilizes a computer instructor to share the task of reading or language learning by modeling the task for the learner, variably controlling the amount of material that the student reads aloud based upon a computer assessment of the student's ability, helping the learner navigate through the instructional application, and participating in a joint performance that demonstrates the student's reading.
    Type: Grant
    Filed: June 18, 1997
    Date of Patent: January 25, 2000
    Assignee: International Business Machines Corporation
    Inventors: Hugh Williams Adams, Jr., Subrata Kumar Das, Peter Gustav Fairweather, Don Holmes Nix
  • Patent number: 5991727
    Abstract: A voice reproducing apparatus for personal use is provided with a card serving as a memory-unit accommodating member incorporating therein a memory unit which stores voice as compressed codes; a player body for converting the codes to a voice signal and incorporating therein an interface, a decoding unit, and a circuit portion; and an earphone. The earphone is connected to said card, some of a plurality of contacts of a terminal portion provided in said card are formed as contacts of a terminal portion for an earphone, some of a plurality of contacts of a terminal portion provided in said interface of said player body are formed as contacts of an output terminal portion, and said terminal portion for an earphone is connectable to said output terminal portion when said card is loaded in said player body.
    Type: Grant
    Filed: December 5, 1997
    Date of Patent: November 23, 1999
    Inventors: Kazuhiro Ono, Hiroaki Kato
  • Patent number: 5991594
    Abstract: An electronic book is provided including a plurality of PCMIA cards each with read only memory having a unique text permanently stored therein. Further provided is a portable unit comprising at least one speaker for allowing the transmission of audio signals upon the receipt thereof, a PCMCIA interface slot formed in the housing for allowing the downloading of the text of the PCMCIA card, and a speech processor/synthesizer connected to the speaker for transmitting audio signals thereto upon the receipt of text stored in the PCMCIA card. Such audio signals are representative of speech corresponding with the text. Further provided is a control mechanism adapted to download the text located within the PCMCIA card via the PCMCIA interface and further transmit the same to the speakers and the display whereby the audio signals are continuously transmitted and a user may view the text via the display.
    Type: Grant
    Filed: July 21, 1997
    Date of Patent: November 23, 1999
    Inventors: Helmut Froeber, Hong Kim
  • Patent number: 5964593
    Abstract: A computer toy for infants that promotes normal speech development by facilitating the infant's experimentation with babbles and other elementary sounds. Additionally, the toy provides an enriched environment for language learning by prompting the infant with a repertoire of verbal sounds including phonemes, syllables, and simple spoken words. The toy includes a microphone input device for detecting vocalizations by an infant and an audiovisual output device for providing feedback to the infant including the immediate playback of the infant's own vocalizations, and a control means for transforming detected vocalizations into instructions for use by the audiovisual output device.
    Type: Grant
    Filed: June 25, 1998
    Date of Patent: October 12, 1999
    Inventor: Hannah R. Cohen