Abstract: This voice detection device is composed of a myoelectric signal acquisition part for acquiring, from a plurality of regions, myoelectric signals generated at the time of a vocalization operation, a parameter calculation part for calculating, as parameters, the fluctuations of the acquired myoelectric signals relative to a predetermined value in every channel corresponding to one of the plurality of regions, a vowel vocalization recognition part for specifying the vowel vocalization operation timing at the time of the vocalization operation, based on the fluctuations of the calculated parameters, and a vowel specification part for specifying a vowel corresponding to the vocalization operation, based on the fluctuation condition of the parameters before and after the specified vocalization operation timing in every channel.

Abstract: A portable device enables a text to be constructed by an input interface, then to be sent on a voice synthesis engine. The synthesized voice is rendered audible through a loudspeaker. The synthesized voice can also be sent over a telephone network addressed to another telephone. The device thus enables a person with a speech handicap to communicate with a party who is not used to communication by sign language.

Abstract: A method, system, and computer program product for assisting individuals with vision impairment in their selection of items that are typically displayed in a list.

Abstract: A control system receiving an input signal, comprising speech with ambient noise, determines the ambient noise power spectrum, retrieves control information corresponding to the closest-matching ambient noise power spectrum, and outputs the input signal along with display of a predetermined effect or image corresponding to the ambient noise power spectrum.

Abstract: A device, computer program and method for outputting linguistic information. The voice output device, for example, includes an output information acquisition unit acquiring linguistic information and attribute information. Attribute information includes an attribute added to each linguistic element included in the linguistic information. A tactile pattern storage unit stores a predetermined tactile pattern corresponding to each linguistic element. A tactile pattern acquisition unit acquires the tactile pattern from the tactile pattern storage unit. A voice output unit reads aloud the linguistic elements and a tactile pattern output unit outputs, in parallel with reading aloud each linguistic element, the tactile pattern corresponding to the attribute added to the linguistic element, thereby allowing a user to sense the tactile pattern by the sense of touch.

Abstract: A method for assisting a visually impaired person with a document job. The method includes scanning a document that includes at least one sheet, detecting at least one characteristic of the scanned document, and providing a signal identifying the at least one characteristic.

Abstract: The present invention relates to a method and system for diagnosing pathological phenomenon using a voice signal. In one embodiment, the existence of at least one pathological phenomena is determined based at least in part upon a calculated average intensity function associated with speech from the patient. In another embodiment, the existence of at least one pathological phenomena is determined based at least in part upon the a calculated maximum intensity function associated with speech from the patient.

Abstract: A method of representing information to a person comprising displaying an image viewable by a person, the image comprising visual markers representative of portions of a human body minimally necessary to communicate with the person, the visual markers, when viewed by the person, causing the person to extrapolate the human body, a remainder of the image being visually silent with respect to the person. The method is particularly applicable to represent information so as to be perceivable by a hearing-impaired person (e.g. deaf person) wherein a plurality of images, when displayed, one after another on a display device, represent information perceivable by the hearing-impaired person via sign language.

Abstract: A system for rehabilitation of a hearing disorder which comprises at least one acoustic sensor for picking up an acoustic signal and converting it into an electrical audio signal, an electronic signal processing unit for audio signal processing and amplification, an electrical power supply unit which supplies individual components of the system with current, and an actuator arrangement which is provided with one or more electroacoustic, electromechanical or purely electrical output-side actuators or any combination of these actuators for stimulation of damaged hearing, wherein the signal processing unit has a speech analysis and recognition module and a speech synthesis module.

Abstract: The VT-2000 is a portable communication device, that enables hearing and speaking impaired persons, to communicate to anyone who wants to talk to them. The VT-2000, uses “voice recognition” and “text to speech” technology, in a “portable” hand carried unit, with dual view screens, email and text messaging capabilities.

Abstract: A computer system provides a series of visual flash stimuli to a user and then requires that the user process the visual stimuli to produce a verbalization that corresponds to the visual stimuli and/or a fine motor activity that corresponds to the visual stimuli. The visual flash stimuli are presented to a user via a display device and include letters, words and phrases. The fine motor activity includes inputting letters or words via an input device, such as typing on a keyboard. The system includes eye movement activities, letter flash activities and word flash activities. The content or visual stimuli provided during these activities, as well as the progression through these activities can be determined in part by the diagnosis of the individual user. The system can be used to treat a variety of mental disabilities.

Abstract: A system for interfacing a user with an electronic device. An accessor device provides a user interface matched to the needs, abilities and intentions of the user and translates the user input commands and data into commands for the electronic device. An intelligent access port translates commands from the accessor into an input format required by the electronic device. A communication link connects the accessor device with the intelligent access port to send the translated user input commands and data from the accessor to the intelligent access port. The accessor device contains an intelligent access module and an interactive display. The intelligent access module contains a driver device for routing message packets, an interaction processor for processing incoming message packets and generating a message packet for the electronic device, and a communications channel. Communications between system components take place over a universal serial bus or over a wireless fidelity or ZigBee device.

Abstract: A computer-aided communication and assistance system that uses a signal processing and other algorithms in a processor in wireless communication with a microphone system to aid a deaf person. An instrumented communication module receives information from one or more microphones and provides textual and, optionally, stimulatory information to the deaf person. In one embodiment, a microphone is provided in a piece of jewelry or clothing. In one embodiment, a wireless (or wired) earpiece is provided to provide microphones and vibration stimulators.

Abstract: A method and apparatus for legal intercept monitoring of a cellular telephone modem (CTM) device. More particularly, a system incorporating a CTM-to-TTY/TDD converter and a Call Content Delivery Unit (CCDU) to facilitate the monitoring of calls made to or from a CTM device is implemented.

Abstract: The invention discloses a portable device that allows users to deal with objects that require intervention to operate. The portable device can detect and identify the object and execute an action desired by the user on the object. A compatible system in the object allows the object to interactively communicate with the portable device. The invention can be easily integrated with public areas, schools, traffic lights, public transportation, elevators, security doors and the like.

Abstract: A system that includes a speech synthesizer and a computer system that includes a basic input output system (BIOS). The BIOS is configured to cause the computer system to translate pre-boot display information, in response to detecting the speech synthesizer, so as to provide one or more serial data signals associated with the information to the speech synthesizer. The speech synthesizer is configured to generate one or more audible outputs associated with the information in response to receiving the one or more signals.

Abstract: The present invention is directed to a wearable stutter reducing device incorporating novel methods that make extensive use of digital signal processing (DSP) technology. The wearable stutter reducing device of the present invention has an audio signal receiver for receiving speech signals corresponding to a wearer's voice. An input conversion means for converting the speech signals and noise mixed with the speech signals into frequency domain components is in communication with the audio signal receiver. A channelization means in communication with the conversion means separates the frequency domain components into a plurality of channels. An identifying means in communication with the plurality of channels identifies which channels of the plurality of channels contain substantially more speech corresponding frequency domain components than noise corresponding frequency components. An amplification means for amplifying signals identified as speech is in communication with the identifying means.

Abstract: A method and system is provided for communicating a interpreted sign-language communication in a communication system having a plurality of nodes including at least a source node, a destination node, and a network node. To facilitate communicating the interpreted sign-language communication, the network node receives from the source node non-sign-language content. The network node stores sign-language-interpreted content in a network queue for retrieval by the destination node. The sign-language-interpreted content defines at least one sign-language translation of the non-sign-language content. When the destination node retrieves and displays the sign-language-interpreted content, a user of the destination node, such as a hearing-impaired individual, can receive communications from the source node that originate in a form other than sign-language format.

Abstract: In a method of assisting a subject to generate speech, at least one first neural impulse is sensed from a first preselected location in the subject's brain. A first preselected sound is associated with the first neural impulse. The first preselected sound is generated in an audible format. In an apparatus for assisting the subject to generate speech, at least one sensor senses a neural impulse in the subject's brain and generates a signal representative thereof. An electronic speech generator generates a phoneme in response to the generation of the signal. An audio system generates audible sounds corresponding to the phoneme based upon the signal received from the speech generator.

Abstract: A speech to touch translator assembly and method for converting spoken words directed to an operator into tactile sensations caused by combinations of pressure point exertions on the body of the operator, each combination of pressure points exerted signifying a phoneme of one of the spoken words, permitting comprehension of spoken words by persons that are deaf and blind.

Abstract: A portable device increases user access to equipment utilizing a communications interface providing communication with the equipment in accordance with various, combinable embodiments. In one embodiment, a speech generator generates speech based on commands relating to equipment operation, which may be received from the equipment via the communications interface. A selection mechanism allows the user to select commands and thereby operate the equipment. In another embodiment, a command navigator navigates commands based on user input by shifting focus between commands, communicates a command having the focus to the speech generator, and allows the user to select a command. In a further embodiment, a phoneticizer converts the commands and/or predetermined navigation and selection options into a dynamic speech lexicon, and a speech recognizer uses the lexicon to recognize a user navigation input and/or user selection of a command.

Abstract: A method of tuning a digital hearing device can include playing portions of test audio, wherein each portion of test audio represents one or more distinctive features of speech. The method also can include receiving user responses to played portions of test audio heard through the digital hearing device and comparing the user responses with the portions of test audio. An operational parameter of the digital hearing device can be adjusted according to the comparing step, wherein the operational parameter is associated with one or more of the distinctive features of speech.

Abstract: A computer-operated speech therapy system is provided that includes speech input, speech recognition and natural language understanding, and audio and visual outputs to enable an aphasic patient to conduct self-paced speech therapy autonomously. The system of the invention conducts a therapy exercise by displaying a picture; generating a speech prompt asking the patient for information about the picture; receiving the patient's speech response and processing it to determine its semantic content; determining whether the patient's response was correct; and outputting feedback to the patient. Preferably the system includes a touch screen as a graphical input/output device by which the patient controls the therapy exercise.

Abstract: Methods, systems, and products for radio frequency identification aiding the visually impaired, storing a recording of a sound, including timing information for synchronous playback, representing at least one attribute of an object having associated with the object a radio frequency identification (“RFID”) tag; activating the RFID tag with an electronic travel aid (“ETA”) for the visually impaired; retrieving the recording from storage; and playing the recording synchronously through an audio interface of the ETA. Storage of sound recording may be local or remote, and sound recordings may be sorted or indexed and retrieved from storage according to an RFID tag identification code, a classification code for the object, and a type code (a sound skin identifier) for the recording.

Abstract: A hand held device that captures information with the capability to read only the captured information, display only the captured information, or simultaneously read and display the captured information. The device includes text-to-voice technology, a flat-panel display, a computer processor, a headphone for private receipt of transmitted information, microphone to receive dictated information, and storage. The device enables blind and/or visual impaired persons to read information anytime and anywhere.

Abstract: A visual simulation technique is provided to facilitate visual activities, such as reading and movement of a subject through surroundings, for sight-impaired persons. The technique obtains digital images of the surroundings via an image retrieval and sending device, and then provides a real-time audio interpretation of the images via an automated image identification and narration system. The automated system may have communication and computing circuitry, remote human interaction circuitry, and other components for either computer-based or human-based identification and narration of the acquired images.

Abstract: Web pages and other text documents displayed on a computer are reformatted to allow a a user who has difficulty reading to navigate between and among such documents and to have such documents, or portions of them, read aloud by the computer using a text-to-speech engine in their original or translated form while preserving the original layout of the document. A “point-and-read” paradigm allows a user to cause the text to be read solely by moving a pointing device over graphical icons or text without requiring the user to click on anything in the document. Hyperlink navigation and other program functions are accomplished in a similar manner.

Abstract: In a key-input voice assistant apparatus of the present invention, a mode switching key is used to switch the operation mode between a normal mode in which a function assigned to a key is executed when key input is detected and a voice guide mode in which a voice is used for a guide. The apparatus determines whether or not key information indicative of the detection of the key is stored when it detects the key input in the voice guide mode, stores the key information and outputs voice information assigned to the key if it concludes that the key information is not stored, and executes the function assigned to the key if it concludes that the key information is stored.

Abstract: Changing a mode of operation of a destination communication device by establishing a voice service option communication channel over a network between an initiating device and a destination device. Using the voice service option communication channel, a predetermined sequence of data is transmitted from the initiating device to the destination device. The predetermined sequence of data specifies a different operation mode of the destination device. The destination device receives the data packet and determines if it is a predetermined sequence of data. If the data packet is a predetermined sequence of data then the destination device examines the sequence of data and changes its operational mode in response to the predetermined sequence of data. The predetermined sequence of data may be transmitted in compliance with a TTY standard for data communication.

Abstract: A terminal is designed so that a user who employs numerical keys, allocated for the entry of dots, can enter Braille dot combinations that are used for the input of characters. The input characters may be output as speech for feedback. Further, when a terminal accesses a server, Braille dot combinations can be entered in the above described manner, and speech can be fed back from the server. Furthermore, the server can provide a service for the user in accordance with a character string input at the terminal.

Abstract: A described computer network includes a first computer system and a second computer system. The first computer system transmits screen image information and corresponding speech information to the second computer system. The screen image information includes information corresponding to a screen image intended for display within the first computer system. The speech information conveys a verbal description of the screen image. When the screen image includes one or more objects (e.g., menus, dialog boxes, icons, and the like) having corresponding semantic information, the speech information includes the corresponding semantic information. The second computer system responds to the speech information by producing an output (e.g., human speech via an audio output device, a tactile output via a Braille output device, and the like). The semantic information conveyed by the output allows a visually-impaired user of the second computer system to know intended purposes of the objects.

Abstract: Apparatus for presenting images representative of one or more words in an utterance with corresponding decoded speech includes, in one aspect, a visual detector for capturing images of body movements (e.g., lip and/or mouth movements) corresponding to the one or more words in the utterance coupled to a visual feature extractor. The visual feature extractor receives time information from an automatic speech recognition (ASR) system and operatively processes the captured images from the visual detector to generate one or more image segments based on the time information relating to one or more decoded words in the utterance, each image segment corresponding to a decoded word in the utterance. An image player coupled to the visual feature extractor presents an image segment with a corresponding decoded word.

Abstract: A system and method for detection and analysis of audio recording is disclosed. The method comprises receiving an audio recording, calculating complexity values of audio recording received, comparing the complexity values within an audio recording, and displaying analysis of audio recording on a user interface. The system comprises an input device an input device for receiving audio recording, a computing device for calculating complex values of received audio recording, a comparator device for comparing complex values of audio recording, and a storage device for storing internal data.

Abstract: A system for and method of providing feedback information relating to characteristics of the oral presentation to a speaker while giving a real-time oral presentation by analyzing representations of the audio signal corresponding to the oral presentation. The feedback information can then be provided to the speaker during the real-time presentation to assist the speaker and improve the oral presentation.

Abstract: The present invention relates to systems and methods for audio processing. For example, the present invention provides systems and methods for creating standardized text for streaming text application from a variety of different speech-to-text software formats and systems and methods for interfacing a stenographic computer with an electronic communications network.

Abstract: Methods, devices, and computer program products display visual choral speech to a patient who stutters or has a speech impediment or impairment as a visual stimulus for the patient to enhance the fluency of the patient. The visual choral speech is incongruous with the speech produced by the stutterer and is provided by a visual display of the articulatory movements of a person other than the patient (or a simulated representation thereof) of the person's lips and mouth as the person speaks. The visual speech gestures can be displayed to the patient in advance of a speaking event or speech production by the stutterer and/or concurrently with a speaking event (either intermittently or continuous during the speaking event). The visual choral speech gestures can be based on a string of coherent words to provide the visual speech gestures signal such that it is relayed to the user without the attendant auditory component allowing the user to speak at a substantially normal pace with enhanced fluency.

Abstract: A method and an apparatus for providing automated speech-to-text encoding and decoding for hearing-impaired persons. A broadband subscriber terminal interfaces to: (a) a network to convey speech packets thereover, (b) a telephone to convey speech information, and (c) a display device to display textual information of spoken words. A speech buffer in the subscriber terminal receives speech data and a processor decodes and displays textual representations of speech on the display device. A database stores voice and/or speech patterns that are used by a speech analyzer to recognize an incoming caller and to associate a name or characteristic (e.g., male or female) with the incoming call. A tonal and inflection analyzer analyzes speech to add punctuation to the displayed text. A detector, such as a DTMF detector, responds to subscriber inputs to activate/deactivate speech recognition or other functions.

Abstract: A apparatus and method are provided which assist the use of electronic documents in both a word processor (17) and Braille environment (16). The apparatus and methods facilitate conversion of electronic documents between various formats for subsequent use on word processor equipment (15) and Braille equipment (10) as required. The translation utilizes a temporary file (90, 91) in an intermediary format which retains formatting information relating the manner in which the document should be rendered in each environment (16,17). The transfer of electronic documents is transparent to the user in a manner that it appears only one document is being worked with.

Abstract: Methods and systems for creating a comfortable, user-friendly environment that allows a hearing impaired user to identify who is speaking and preferably what is being said during interactions with other individuals, e.g., at any form of meeting. In accordance with the invention, it is determined whether or not someone is speaking. If yes, then the speaker's position is identified. It is also determined whether the speaker is in the range of view for the user's display. If yes, an illuminated dot is projected above the speaker on a wearable display to show the user where the speaker is located. If no, a directional arrow is projected on the display to indicate to the user which way he should look to see the current speaker.

Abstract: A technique for separating an acoustic signal into a voiced (V) component corresponding to an electrolaryngeal source and an unvoiced (U) component corresponding to a turbulence source. The technique can be used to improve the quality of electrolaryngeal speech, and may be adapted for use in a special purpose telephone. A method according to the invention extracts a segment of consecutive values from the original stream of numerical values, and performs a discrete Fourier transform on the this first group of values. Next, a second group of values is extracted from components of the discrete Fourier transform result which correspond to an electrolaryngeal fixed repetition rate, F0, and harmonics thereof. An inverse-Fourier transform is applied to the second group of values, to produce a representation of a segment of the V component. Multiple V component segments are then concatenated to form a V component sample stream.

Abstract: A speech-driven control device for a media system includes a housing; a controller; a first communication port to enable communication of instructions between a data processing system and the controller; and a second communication port to enable communication of instructions between a media device and the controller. The controller includes a speech recognition system to recognize human speech and to convert the human speech into a first set of commands and into a second set of commands. The first set of commands provides instructions to the data-processing system to enable speech driven control of a media presentation. The second set of commands provides instructions to the media device to enable speech driven control of a functionality of the media device.

Abstract: A method and apparatus for examining a three dimensional image in a data processing system. An object is presented, wherein the object includes a set of views for different angles of view for the object. In response to a user input to traverse a view from the set of views, a depth map is transcoded for the view into a non-visual output. In response to other user inputs to present other views from the set of views, depth maps from those views are transcoded into non-visual outputs. In this manner, a visually impaired user is able to perceive a 3-dimensional object.

Abstract: A mobile phone or other personal communication device includes resources applying measures of an individual's hearing profile, personal choice profile, and induced hearing loss profile, separately or in combination, to build the basis of sound enhancement. A personal communication device thus comprises a transmitter/receiver coupled to a communication medium for transmitted receiving audio signals, control circuitry that controls transmission, reception and processing of call and audio signals, a speaker, and a microphone. The control circuitry includes logic applying one or more of a hearing profile of the user, a user preference related hearing, and environmental noise factors in processing the audio signals. The control circuitry may includes instruction memory and an instruction execution processor such as a digital signal processor.

Abstract: The invention relates first of all to a method for identifying a transient acoustic scene, said method including the extraction, during an extraction phase, of characteristic features from an acoustic signal captured by at least one microphone (2a, 2b), and the identification, during an identification phase, of the transient acoustic scene on the basis of the extracted characteristics. According to the invention, at least auditory-based characteristics are identified in the extraction phase. Also specified are an application of the method per this invention and a hearing device.

Abstract: A system and a method for operating and monitoring, in particular, an automation system and/or a production machine or machine tool. The visual field (9) of a user (1) directed onto at least one display (2) is recorded. Speech information (8) from the user (1) is at least intermittently determined and a visual feedback signal is generated in response to a processing status regarding the determined speech information (8). An improved speech interaction is thus obtained, in particular, in the field of augmented-reality applications and in complex technical plants.

Abstract: A method for repeatable application testing on a computer system for audible output generated by the application in conjunction with a screen reader or similar assistive technology. The method includes recording user inputs to a user application using a test input component. The user inputs are also accessed by a screen reader input component. Outputs of the user application are recorded using a test output component. The outputs of the user application are also accessed by a screen reader output component. The resulting screen reader outputs are recorded and are analyzed with respect to the recorded user inputs and the recorded outputs of the user application. The user inputs to the user application can be keyboard inputs or mouse inputs, and inputs of other input devices. The outputs of the user application can be graphical outputs or alphanumeric outputs for a display of the computer system.

Abstract: A training method and apparatus to train a call assistant to operate a telephone relay system for the hearing impaired that uses a re-voicing technique to produce near real-time transcription of a telephone conversation for display on a caption telephone or other device. The invention simulates an actual relay call as realistically as possible and produces a report on the skill of the particular call assistant being trained.

Abstract: A method of and device for the diagnosis and treatment of speech dynamically measures the functioning of the velum in the control of nasality during speech. Various components of oral and nasal airflow are separated and selectively analyzed including (i) the fundamental frequency component of each airflow during voiced speech, (ii) a plurality of voice components that cover a frequency range encompassing at least the lowest vocal tract resonance (the first formant), and (iii) the subsonic and infrasonic components of at least the nasal airflow. By comparing the nasal and oral airflow components at the voice fundamental frequency, a nasalization measure for voiced speech sounds is formed which emulates methods that compare low frequency nasal and oral airflow during voiced speech, while eliminating or greatly reducing the problems associated with comparing these low frequency airflows, and which improves upon previous methods based on measuring and comparing nasal and oral radiated sound pressure.

Abstract: A portable communication apparatus allowing increased flexibility and convenience is disclosed. A switch is provided to select one of a voice-character conversion communication mode and a character-voice conversion communication mode depending on a setting instruction. A voice-character converter performs a selected one of a first conversion from voice to character data and a second conversion from character to voice data according to the selected communication mode.

Abstract: Several different embodiments of an electronic document delivery system are described including a client machine (e.g., a palmtop/handheld computer or wireless communication device) coupled to a transcoder proxy. The system allows a client machine with limited resources to provide interactive aspects of electronic documents such as Web pages and/or an assistive technology solution for a physically challenged user. The transcoder proxy receives an electronic document including one or more elements and expressed in a first digital format (e.g., HTML or XML). The transcoder proxy assigns a unique identifier to each element, produces an “original” script including at least a portion of the document expressed in a second digital format (e.g., a scripting language), and provides the original script to the client machine. The transcoder proxy may form a model of the document (e.g., a document object model or DOM), and may use the model to produce the original script.