Abstract: A system for monitoring conditions associated with an individual in a region includes at least one speech input transducer and speech processing software coupled thereto. Results of the speech processing can initiate communications with a displaced communications device such as a telephone or a computer to provide a source of feedback.

Abstract: A hearing aid for improving diminished hearing caused by reduced temporal resolution includes: a speech input unit (201) which receives a speech signal from outside; a speech analysis unit (202) which detects a sound segment and a segment acoustically regarded as soundless from the speech signal received by the speech input unit and detects a consonant segment and a vowel segment within the detected sound segment; and a signal processing unit (204) which temporally increments the consonant segment detected by the speech analysis unit (204) and temporally decrements at least one of the vowel segment and the segment acoustically regarded as soundless detected by the speech analysis unit (204).

Abstract: Provided are an information processing apparatus and method so adapted that if a plurality of speech output units having a speech synthesizing function are present, a conversion is made to speech having mutually different feature quantitys so that a user can readily be informed of which unit is providing the user with information such as an alert information. Speech data that is output from another speech output unit is input from a communication unit (8) and stored in a RAM (7). A central processing unit (1) extracts a feature quantity relating to the input speech data. Further, the central processing unit (1) utilizes a speech synthesis dictionary (51) that has been stored in a storage device (5) and generates speech data having a feature quantity different from that of the extracted feature quantity. The generated speech data is output from a speech output unit (4).

Abstract: In a vehicle-mounted control apparatus, a control unit 2 displays guidance on an operation of the vehicle-mounted control apparatus by voice input on a display device 6, and makes the user get training so that the user can master the techniques for operating the vehicle-mounted control apparatus (in step ST4). At this time, by using a voice which the user tries to input in order to master the techniques for operating the vehicle-mounted control apparatus, the voice recognition unit 5 learns the features of the user's voice in the background, and computes recognition parameters. Thereby, the user can know how to operate the vehicle-mounted control apparatus and can also register the features of the voice in the vehicle-mounted control apparatus.

Abstract: A unit for providing an interactive, light-activated, voice recorder unit for a book wherein said interactive voice recorder unit automatically initiates a playback mode when the front cover of a book is opened and light enters the unit.

Abstract: Embodiments of the present invention comprises a system, method, and apparatus that provides for the utilization of a relatively real-time or near real-time interpretation or translation that may be utilized preferably for a relatively short duration of time on a network. A preferred embodiment of the present invention provides online, real-time, short-duration interpreting services in a network-based format. In preferred embodiments, the interpreting system comprises at least one provider computer, such as a server, wherein the provider computer is capable of communicating with user computers via a network. In one preferred embodiment, the provider computer provides a series of web pages that allow access to the interpreting system, including, but not limited to, a request for service page, wherein a user can access the system and input a request for interpreting services. Interpreting services are then provided to a user and a third party desiring to communicate with the user via the network.

Abstract: A mobile wireless communications device includes a housing and transceiver carried by the housing for transmitting and receiving radio frequency (RF) signals carrying communications data of speech. A processor is coupled to the transceiver for processing the communications data as speech that is transmitted and received to and from the transceiver. A keyboard and display is carried by the housing and connected to the processor. A speech-to-text and text-to-speech module converts communications data as speech received from the transceiver to text that is displayed on the display and converting text that is typed by a user on the keyboard in the communications data as speech to be transmitted from the transceiver as an RF signal.

Abstract: The present disclosure presents a useful metric for assessing the relative difficulty which non-native speakers face in pronouncing a given utterance and a method and systems for using such a metric in the evaluation and assessment of the utterances of non-native speakers. In an embodiment, the metric may be based on both known sources of difficulty for language learners and a corpus-based measure of cross-language sound differences. The method may be applied to speakers who primarily speak a first language speaking utterances in any non-native second language.

Abstract: Nothing exists like this Verbal Command Laptop Computer and Software worldwide to transfer electronic information data of EDI. It can be used for the elderly when they need to scan something. Just set the item on a scanner and say, “scan, please.” The Verbal Command Laptop Computer and Software can be used to store names and addresses. Also, used as a fax machine. Just say, “fax, please” or “email please.” When user wishes to use email say, “check email please” or “send email please.” When wanting to use the Internet say, “Internet please” or for search engine say, “search engine.” The Verbal Command Laptop Computer and Software can handle all phases of a standard computer. The Verbal Command Laptop Computer and Software also has its own search engine. One can also use verbal command hands free with the Cordless Microphone or Verbal Head Set.

Abstract: Techniques are described for automatically measuring fluency of a patient's speech based on prosodic characteristics thereof. The prosodic characteristics may include statistics regarding silent pauses, filled pauses, repetitions, or fundamental frequency of the patient's speech. The statistics may include a count, average number of occurrences, duration, average duration, frequency of occurrence, standard deviation, or other statistics. In one embodiment, a method includes receiving an audio sample that includes speech of a patient, analyzing the audio sample to identify prosodic characteristics of the speech of the patient, and automatically measuring fluency of the speech of the patient based on the prosodic characteristics. These techniques may present several advantages, such as objectively measuring fluency of a patient's speech without requiring a manual transcription or other manual intervention in the analysis process.

Abstract: Systems and methods for displaying visual content to a user corresponding to sound captured at a user terminal are disclosed. After receiving over a network from a user terminal a request to convert sound into a visual content representing the sound, wherein the sound comprises one or more words, a translation server may retrieve text corresponding to the one or more words from a database. The translation server may then convert the text into one or more content phrases, wherein the content phrases represent the meaning of the one or more words, and convert each of the one or more content phrases into a new language. Finally, the translation server may send visual content to the user terminal representing the new language.

Abstract: Preparing for the full-fledged aged society, measures to prevent senility are required. Senility is prevented by extracting signals of prescribed bands from a speech signal using a first bandpass filter section having a plurality of bandpass filters, extracting the envelopes of each frequency band signal using an envelope extraction section having envelope extractors, applying a noise source signal to a second bandpass filter section having a plurality of bandpass filters and extracting noise signals corresponding to the prescribed bands, multiplying the outputs from the first bandpass filter section and the second bandpass filter section in a multiplication section, summing up the outputs from the multiplication section in an addition section to produce a Noise-Vocoded Speech Sound signal, and presenting the Noise-Vocoded Speech Sound signal for listening.

Abstract: A device for use by a deafblind person is disclosed. The device comprises a first key for manually inputting a series of words in the form of a code, a second key for manually inputting an action to be performed by the device, a third key for manually inputting a user preference, and a fourth key for manually inputting communication instructions. The device further has an internal processor programmed to carry out communication functions and search and guide functions. The device has various safety and security functions for pedestrians or persons in transit. In a preferred embodiment, the device comprises an electronic cane known as an eCane. Also disclosed is a system for allowing a deafblind person to enjoy television programs.

Abstract: A speech aid for persons with hypokinetic dysarthria, a speech disorder associated with Parkinson's disease. The speech aid alters the pitch at which the user hears his or her voice and/or provides multitalker babble noise to the speaker's ears. The speech aid induces increased speech motor activity and improves the intelligibility of the user's speech. The speech aid may be used with a variety of microphones, headphones, in one or both ears, with a voice amplifier, or connected to telephones.

Abstract: An object of the present invention is to provide a conversation support apparatus and a conversation support method that allow users to effectively and smoothly onverse with each other. According to the present invention, since a first display section 22 and a second display section 32 can be placed at different angles, while a first user is watching the second display section 32 and a second user is watching the first display section 22, they can smoothly converse with each other. Since the first display section 22 and the second display section 32 are disposed, for example the second user and the first user can face-to-face converse with each other.

Abstract: A sign language recognition apparatus and method is provided for translating hand gestures into speech or written text. The apparatus includes a number of sensors on the hand, arm and shoulder to measure dynamic and static gestures. The sensors are connected to a microprocessor to search a library of gestures and generate output signals that can then be used to produce a synthesized voice or written text. The apparatus includes sensors such as accelerometers on the fingers and thumb and two accelerometers on the back of the hand to detect motion and orientation of the hand. Sensors are also provided on the back of the hand or wrist to detect forearm rotation, an angle sensor to detect flexing of the elbow, two sensors on the upper arm to detect arm elevation and rotation, and a sensor on the upper arm to detect arm twist. The sensors transmit the data to the microprocessor to determine the shape, position and orientation of the hand relative to the body of the user.

Abstract: A communication system that is specifically designed for the needs of speech impaired individuals, particularly aphasia victims, makes use of a speech generating mobile terminal communication device (SGMTD) (12) that is designed to be hand held and operated by a speech disabled individual. The SGMTD includes a database of audio files that are accessed to generate full sentences in response to single word or short phrase entries selected from a plurality of menus by the disabled user. A second, companion mobile terminal device (COMTD) (14) enables a caregiver to communicate with the speech disabled individual's SGMTD to assist the individual in communicating with the caregiver by causing the SGMTD to switch to a particular menu or list from which the caregiver wants the disabled individual to make a selection. The SGMTD also includes software that enables the device to communicate with other SGMTDs via wireless communications and thereby simulate a verbal conversation between speech impaired individuals.

Abstract: A speech transformation apparatus comprises a microphone 21 for detecting speech and generating a speech signal; a signal processor 22 for performing a speech recognition process using the speech signal; a speech information generator for transforming the recognition result responsive to the physical state of the user, the operating conditions, and/or the purpose for using the apparatus; and a display unit 26 and loudspeaker 25 for generating a control signal for outputting a raw recognition result and/or a transformed recognition result. In a speech transformation apparatus thus constituted, speech enunciated by a spoken-language-impaired individual can be transformed and presented to the user, and sounds from outside sources can also be transformed and presented to the user.

Abstract: The present invention is intended to perform text-to-speech conversion by replacing URLs and electronic mail addresses included in the text data of electronic mail by registered predetermined words. A mail watcher application control section executes the processing for converting electronic mail received by a MAPI mailer into speech data. The mail watcher application control section outputs URLs and electronic mail addresses included in the text data of electronic mail supplied from the MAPI mailer to a URL and mail address filter to replace them by registered predetermined names. Of the entered texts, the URL and mail address filter compares the URL or mail address included in the entered text with those registered in the URL and mail address table. If a the URL or mail address of the entered text is found matching, the URL and mail address filter replace it by the registered name and outputs it to the mail watcher application control section.

Abstract: The invention provides a system and method for indexing and organizing voice mail message by the speaker of the message. One or more speaker models are created from voice mail messages received. As additional messages are left, each of the new messages are compared with existing speaker models to determine the identity of the callers of each of the new messages. The voice mail messages are organized within a user's mailbox by caller. Unknown callers may be identified and tagged by the user and then used to create new speaker models and/or update existing speaker models.

Abstract: The present invention is directed toward a method, device, and system for providing a high quality communication session. The system provides a way of determining speech characteristics of participants in the communication session and adjusting, if necessary, signals from a speaker to a listener such that the listener can more intelligibly understand what the speaker is saying.

Abstract: The present invention relates to a handheld analysis instrument for assaying a medically significant sample. The instrument comprises a measuring device for measuring the concentration of an analyte in the sample, an output device for outputting measurement results. The output device has both an acoustic signal output device for outputting the measurement results through nonverbal acoustic signals and also a wireless interface for communicating with an external speech output unit.

Abstract: An on-vehicle acoustic control system determines which one of sounds of an audio device and a navigation device should be generated with priority, when both devices are requested to generate respective sounds. The control system further detects a user's physical condition based on an interaction with the user, a picture of the user and biometric information of the user. The control system generates sound in the order of determined priority, and varies the manner of sound generation based on the user's physical condition.

Abstract: Embodiments of the invention may be used to enhance the presentation of a virtual environment for certain users, e.g., a visually impaired user. Because users may visit, and revisit, locations within the virtual environment, the state of elements in the virtual environment may change. Accordingly, audible descriptions of an object, person or environment, may be adjusted to prevent redundant or unnecessary descriptions. For example, when the user encounters a given element a second time, rather than describe each characteristic of the element, only changes to the characteristics of the element are described.

Abstract: A method and system for presenting lip-synchronized speech corresponding to the text received in real time is provided. A lip synchronization system provides an image of a character that is to be portrayed as speaking text received in real time. The lip synchronization system receives a sequence of text corresponding to the speech of the character. It may modify the received text in various ways before synchronizing the lips. It may generate phonemes for the modified text that are adapted to certain idioms. The lip synchronization system then generates the lip-synchronized images based on the phonemes generated from the modified texts and based on the identified expressions.

Abstract: A set of therapy parameter values is selected based on a patient state, where the patient state comprises a speech state or a mixed patient state including the speech state and at least one of a movement state or a sleep state. In this way, therapy delivery is tailored to the patient state, which may include one or more patient symptoms specific to the patient state. In some examples, a medical device determines whether the patient is in the speech state or a mixed patient state including the speech state based on a signal generated by a voice activity sensor. The voice activity sensor detects the use of the patient's voice, and may include a microphone, a vibration detector or an accelerometer.

Abstract: A way of delivering recipe preparation instruction to disabled individuals is provided using an interactive cooking preparation device. The device retrieves an instruction delivery preference that corresponds to a user with a disability, such as a hearing or sight disability. The user then selects a recipe from list of recipes. Preparation steps that correspond to the selected recipe are retrieved from a data store, such as a database. The retrieved preparation steps are provided to the user using the interactive cooking preparation device that provides the preparation steps in an alternative delivery mode based on the user's delivery preference.

Abstract: Methods and apparatus to present a video program to a visually impaired person are disclosed. An example method comprises receiving a video stream and an associated audio stream of a video program, detecting a portion of the video program that is not readily consumable by a visually impaired person, obtaining text associated with the portion of the video program, converting the text to a second audio stream, and combining the second audio stream with the associated audio stream.

Abstract: Stuttering treatment methods and apparatus which utilize removable oral-based appliances having actuators which are attached, adhered, or otherwise embedded into or upon a dental or oral appliance are described. Such oral appliances may receive the user's voice and process the voice to introduce a time delay and/or a frequency shift. The altered audio feedback signal is then transmitted back to the user through a tooth, teeth, or other bone via a vibrating actuator element. The actuator element may utilize electromagnetic or piezoelectric actuator mechanisms and may be positioned directly along the dentition or along an oral appliance housing in various configurations.

Abstract: A sign language recognition apparatus and method is provided for translating hand gestures into speech or written text. The apparatus includes a number of sensors on the hand, arm and shoulder to measure dynamic and static gestures. The sensors are connected to a microprocessor to search a library of gestures and generate output signals that can then be used to produce a synthesized voice or written text. The apparatus includes sensors such as accelerometers on the fingers and thumb and two accelerometers on the back of the hand to detect motion and orientation of the hand. Sensors are also provided on the back of the hand or wrist to detect forearm rotation, an angle sensor to detect flexing of the elbow, two sensors on the upper arm to detect arm elevation and rotation, and a sensor on the upper arm to detect arm twist. The sensors transmit the data to the microprocessor to determine the shape, position and orientation of the hand relative to the body of the user.

Abstract: The present invention informs a recipient of a holding non-voice call and allows the recipient to participate in real time text communication. A voice/text server is capable of communicating with a text device across a network or the Internet. The text device transmits the non-voice call to the voice/text server where the non-voice call is stored in a memory. The voice/text server generates a placeholder call and transmits the placeholder call to a voice telephone. The recipient receives the placeholder call by use of a voice telephone. A local text device generates a text link that is transmitted to the voice/text server. The voice/text server matches the text link to the holding text call. Text communication may then proceed between the users in any number of formats.

Abstract: The provision of speech therapy to a learner (76) entails receiving a speech signal (156) from the learner (76) at a computing system (24). The speech signal (156) corresponds to an utterance (116) made by the learner (76). A set of parameters (166) is ascertained from the speech signal (156). The parameters (166) represent a contact pattern (52) between a tongue and palate of the learner (156) during the utterance (116). For each parameter in the set of parameters (166), a deviation measure (188) is calculated relative to a corresponding parameter from a set of normative parameters (138) characterizing an ideal pronunciation of the utterance (116). An accuracy score (56) for the utterance (116), relative to its ideal pronunciation, is generated from the deviation measure (188). The accuracy score (56) is provided to the learner (76) to visualize accuracy of the utterance (116) relative to its ideal pronunciation.

Abstract: The invention describes a computer-based system that asks (101) a patient to pronounce a word displayed on a monitor, automatically assesses (104, 105) the speech quality, and uses suitable means to feed back (106) any improvement or deterioration of speech quality.

Abstract: A human interface device for assisting the verbally challenged to record custom messages and play back the custom and pre-recorded messages through a sequence of simple finger movements. A data glove containing Hall Effect and Bend Resistor is warn by the user and connected to the Voice Module. The data glove is designed to capture and translate the sequence of finger movements into actions, then transmits the actions to the Voice Module. When a pause is sensed in the actions, the Voice Module links these actions to the custom or pre-recorded messages. These messages are then played on the Voice Module allowing people in close proximity to hear. A Remote Voice Monitor may also be wirelessly connected to the Voice Module to allow remote monitoring.

Abstract: The present invention is an innovative system and method for passive diagnosis of dementias. The disclosed invention enables early diagnosis of and assessments of the efficacy of medications for neural disorders which are characterized by progressive linguistic decline and circadian speech-rhythm disturbances. Clinical and psychometric indicators of dementias are automatically identified by longitudinal statistical measurements and track the nature of language change and/or patient audio features change using mathematical methods. According to embodiments of the present invention the disclosed system and method include multi-layer processing units wherein initial processing of the recorded audio data is processed in a local unit. Processed and required raw data is also transferred to a central unit which performs in-depth analysis of the audio data.

Abstract: The present invention provides an assistive technology screen reader in a distributed network computer system. The screen reader, on a server computer system, receives display information output from one or more applications. The screen reader converts the text and symbolic content of the display information into a performant format for transmission across a network. The screen reader, on a client computer system, receives the performant format. The received performant format is converted to a device type file, by the screen reader. The screen reader then presents the device type file to a device driver, for output to a speaker, braille reader, or the like.

Abstract: An interface system including a manipulandum adapted to be moveable according to a manual gesture imparted by the user; a sensor adapted to detect a characteristic of the manual gesture imparted to the manipulandum and to generate a sensor signal representing the detected characteristic of the manual gesture; a microphone adapted to detect a characteristic of an utterance spoken by the user and to generate an audio signal representing the detected characteristic of the spoken utterance; and a control system adapted receive the generated sensor and audio signals and to transmit a command signal to an electronic device via a communication link, the command signal being based on the generated sensor and audio signals and the time synchronization between them.

Abstract: An apparatus for processing a speech signal includes a receiver, a speech signal decoder, a speech rate conversion information detector, and a speech rate converting processor. The receiver receives multiplexed signal of information concerning controls and programs, including speech packets through a transmission line. The decoder decodes the speech signal of packets out of the received signals. The detector detects speech rate conversion execution information in the received signals. The processor subjects the decoded speech signal to a speech rate conversion process if the speech rate conversion execution information indicates that the speech signal has not been subjected to the speech rate conversion process on the transmitting end, and which does not subject the decoded speech signal to the speech rate conversion process if the speech rate conversion execution information indicates that the speech signal has been subjected to the speech rate conversion process on the transmitting end.

Abstract: A portable assistive listening system for enhancing sound for hearing impaired individuals includes a fully functional hearing aid and a separate handheld digital signal processing (DSP) device. The focus of the present invention is directed to the handheld DSP device and a unique method of processing incoming audio signals. The DSP device includes a programmable digital signal processor, a UWB transceiver for communicating with the hearing aid and/or other wireless audio sources, an LCD display, and a user input device (keypad). The handheld device is user programmable to apply different sound enhancement algorithms for enhancing sound signals received from the hearing aid and/or other audio source. The handheld device is capable of receiving audio signals from multiple sources, and gives the user control over selection of incoming sound sources and selective enhancement of sound.

Abstract: A device for use by a deafblind person is disclosed. The device comprises a first key for manually inputting a series of words in the form of a code, a second key for manually inputting an action to be performed by the device, a third key for manually inputting a user preference, and a fourth key for manually inputting communication instructions. The device further has an internal processor programmed to carry out communication functions and search and guide functions. The device has various safety and security functions for pedestrians or persons in transit. In a preferred embodiment, the device comprises an electronic cane known as an eCane. Also disclosed is a system for allowing a deafblind person to enjoy television programs.

Abstract: The invention includes an apparatus and method of providing information using an information appliance coupled to a network. The method includes storing text files in a database at a remote location and converting, at the remote location, the text files into speech files. A portion of the speech files requested are downloaded to the information appliance and presented through an audio speaker. The speech files may include audio of electronic program guide (EPG) information, weather information, news information or other information. The method also includes converting the text files into speech files at the remote location using an English text-to-speech (TTS) synthesizer, a Spanish TTS synthesizer, or another language synthesizer. A voice personality may be selected to announce the speech files.

Abstract: Methods and devices (620, 1220, 1410) to deliver a tactile speech analog to a person's skin (404, 604, 1082, 1440) providing a silent, invisible, hands-free, eyes-free, and ears-free way to receive and directly comprehend electronic communications (1600b). Embodiments include an alternative to hearing aids that will enable people with hearing loss to better understand speech. A device (1410), worn like watch or bracelet, supplements a person's remaining hearing to help identify and disambiguate those sounds he or she can not hear properly. Embodiments for hearing aids (620) and hearing prosthetics (1220) are also described.

Abstract: An auxiliary operation interface of a digital recording/reproducing apparatus includes a targeting item, a switching button set and an audio prompt generator. The targeting item is optionally triggered to have the digital recording/reproducing apparatus execute a selected function. The audio prompt generator is enabled to generate an audio prompt when the targeting item is triggered. The audio prompt generator is optionally enabled or disabled by an operation of the switching button set.

Abstract: Information relating to an amount of muscle activity is extracted from a myo-electrical signal by activity amount information extraction means, and information recognition is performed by activity amount information recognition means using the information relating to the amount of muscle activity of a speaker. There is a prescribed correspondence relationship between the amount of muscle activity of a speaker and a phoneme uttered by a speaker, so the content of an utterance can be recognized with a high recognition rate by information recognition using information relating to an amount of muscle activity.

Abstract: A speech communication system for patients having difficulty in speaking or writing comprises a display screen, a controller, a host having a storage unit for storing specific software and connected with the display screen, and a speaker connected with the host. A plurality of choices is presented on the display screen in a nine-square form or an English keyboard form for patients to select according to their needs. The controller is used for patients having difficulty in speaking or writing to move a cursor on the display screen to select any choice they need. The speaker is designed to output speech sounds of words or simple sentences in different languages corresponding to the choices patients select via the controller and thus make it possible for patients to communicate with others.

Abstract: A device for use by a deafblind person is disclosed. The device comprises a first key for manually inputting a series of words in the form of a code, a second key for manually inputting an action to be performed by the device, a third key for manually inputting a user preference, and a fourth key for manually inputting communication instructions. The device further has an internal processor programmed to carry out communication functions and search and guide functions. The device has various safety and security functions for pedestrians or persons in transit. In a preferred embodiment, the device comprises an electronic cane known as an eCane. Also disclosed is a system for allowing a deafblind person to enjoy television programs.

Abstract: A subscriber terminal is provided for speech-to-text translation. Speech packets are received at a broadband telephony interface and stored in a buffer. The speech packets are processed and textual representations thereof are displayed as words on a display device. Speech processing is activated and deactivated in response to a command from a subscriber.

Abstract: Cochlear implant performance is improved by extracting pitch information and encoding such pitch information into the processor of a cochlear implant. One embodiment of the invention is to explicitly extract the pitch and deliver it to the cochlear implant by co-varying the stimulate site and rate. Another embodiment of the invention is to implicitly encode the pitch information via a code book that serves as the carrier of stimulation in the cochlear implant.

Abstract: The present invention provides a diagnostic device that presents, to a patient, a Noise-Vocoded Speech Sound signal that is obtained by dividing at least one portion of a sound signal into a single or a plurality of frequency band signals and subjecting the frequency band signals to noise, and analyzing the content of a response recognized by the patient and the presented stimulus to diagnose a disease of the patient based on the analysis results, so that diagnosis including determining the disease of the patient and estimating a damaged site can be performed.

Abstract: An electronic communications system for the deaf includes a video apparatus for observing and digitizing the facial, body and hand and finger signing motions of a deaf person, an electronic translator for translating the digitized signing motions into words and phrases, and an electronic output for the words and phrases. The video apparatus desirably includes both a video camera and a video display which will display signing motions provided by translating spoken words of a hearing person into digitized images. The system may function as a translator by outputting the translated words and phrases as synthetic speech at the deaf person's location for another person at that location, and that person's speech may be picked up, translated, and displayed as signing motions on a display in the video apparatus.