Abstract: The present invention has an architecture capable of eliminating a necessity for previously designating in a document, when reading aloud the document, attributes for reading aloud. Focusing on utilizing the document with attributes, a document reading system analyzes contents of the attributes and reads aloud texts in the document with a voice synthesizing module. The attributes are set irrespective of reading aloud conditions. A basic reading condition setting module sets the reading aloud conditions for the entire document. An individual reading condition setting module sets the reading aloud condition for every attribute. A selective reading module, when reading aloud the document, in principle, reads aloud the text with reference to the basic reading aloud condition set by the basic reading condition setting module, and selectively reads aloud the text having the individual reading aloud condition given a higher priority than the basic reading aloud condition.

Abstract: An electronic translator translates input speech into multiple streams of data that are simultaneously delivered to the user, such as a hearing impaired individual. Preferably, the data is delivered in audible, visual and text formats. These multiple data streams are delivered to the hearing-impaired individual in a synchronized fashion, thereby creating a cognitive response. Preferably, the system of the present invention converts the input speech to a text format, and then translates the text to any of three other forms, including sign language, animation and computer generated speech. The sign language and animation translations are preferably implemented by using the medium of digital movies in which videos of a person signing words, phrase and finger spelled words, and of animations corresponding to the words, are selectively accessed from databases and displayed.

Abstract: A method of and apparatus for Internet voice mail messaging allows for automatic retrieval of information from the Internet, text to digital speech conversion of the information, if necessary, conversion of the digital speech information from digital format to a proprietary digital voice signal, if necessary and transfer of such information to various users through conventional telephonic voice messaging systems. The method and apparatus automatically accesses the Internet, downloads the information to be retrieved, converts the information from a digital format to a proprietary digital voice signal, transmits the converted information to a dedicated telephonic voice messaging system, and instructs the dedicated telephonic voice messaging system to transmit the information to the voice mail boxes of various selected users.

Abstract: A method for accessing and browsing the internet through the use of a telephone and the associated DTMF signals is disclosed. The preferred embodiment provides a system that converts the information content of a web page from text to speech (voice signals), signals the hyperlink selections of a web page in an audio manner, and allows selection of the hyperlinks through the use of DTMF signals generated from a telephone keypad. Upon receiving a DTMF signal corresponding to a hyperlink, the corresponding web page is fetched and again delivered to the user via one of the available delivery methods such as voice, fax-on-demand, electronic mail, or regular mail.

Abstract: A system for controlling the automatic scrolling of information on a computer display. The system includes a computer display, a computer gimbaled sensor for tracking the position of the user's head and user's eye, and a scroll activating interface algorithm using a neural network to find screen gaze coordinates implemented by the computer. A scrolling function is performed based upon the screen gaze coordinates of the user's eye relative t activation area(s) on the display. The gimbaled sensor system contains a platform mounted at the top of the display. The gimbaled sensor system tracks the user's head and eye allowing the user to be free from attachments while the gimbaled sensor system is tracking, still allowing the user to freely move his head.

Abstract: An improved recognition system for translating Braille into multi-byte languages is provided that resolves ambiguities in the translation. By resolving ambiguities in the translation, the improved recognition system helps integrate visually-impaired users into the workforce. Such integration is achieved by providing visually-impaired users with both the means to input Braille for translation into a multi-byte language and the means to disambiguate the translation so that it reflects what the user intended. In this manner, the translation accurately reflects the intentions of the user. Furthermore, the translation is actually stored in the computer in the multi-byte language so that both sighted and nonsighted users alike can utilize the translation.

Abstract: A method and system for intelligent text entry on a keypad. First, a user selects a key on a keypad. Then, an application predicts which character of those corresponding to that key is intended by the user. The predicted character is then presented to the user for confirmation. If the user confirms the selection, the character is stored. If the user rejects the character, the application presents a new character to the user until a character is finally confirmed. It is only when the predicted character is not the intended character that the user is required to iterate through character choices.

Abstract: Apparatus for correcting speech including one or more words of a predetermined language comprises candidate word correlating means for correlating each of one or more speech data items of words to one or more candidate words obtained by recognizing said speech data items indicating the words. Analogous word correlating means correlates each of the candidate words correlated to the speech data items to null or more analogous words which may correspond to a pronunciation of each of the candidate words. The speech correcting apparatus further comprises pronunciation correcting data output means for outputting pronunciation correcting data corresponding to the analogous word indicated by the speech data item and correcting the pronunciation of the word indicated by the speech data item when the word indicated by the speech data item matches the analogous word correlated to each of the candidate words which are correlated to the speech data item.

Abstract: The present invention provides speech and audio user-computer interface mechanisms for accessing and editing information in electronic records. A mechanism is provided by which the user can direct inputs to any of a variety of fields without following a predetermined order of input. This allows the user to be proactive in making entries rather than simply reacting to requirements set by computer-generated prompts. Audio is provided as feedback to the user, not as a fixed path prompt for the user. This feedback can be in the form of non-verbal auditory signals or synthesized speech. The invention uses audio to inform the user of whether or not the system understood the spoken words or phrases as valid inputs to the electronic record, what the system recognized as the input, and to identify the contents of various fields in the electronic record.

Abstract: A digital camera that recognizes printed or written words, and converts those words into recognizable speech in either native or foreign tongue. The user points the camera at a printed/text object and the camera will speak (or optionally display) the words. Using this device, a blind or visually disabled person can point at an object, press the shutter button to “take a picture” of the words before him/her, and the camera will speak those words in his/her native language. In a second and more advanced configuration, a person can point this camera at a worded object, press the shutter button to “take a picture” of the words before him/her and the camera will speak those words in a foreign language. Alternatively, he/she may point at text in a foreign language and have those words translated and spoken in his/her native language.

Abstract: Speech recognition and natural language parsing components are used to extract the meaning of the user's spoken input. The system stores a semantic representation of an electronic program guide, and the contents of the program guide can be mapped into the grammars used by the natural language parser. Thus, when the user wishes to navigate through the complex menu structure of the electronic program guide, he or she only needs to speak in natural language sentences. The system automatically filters the contents of the program guide and supplies the user with on-screen display or synthesized speech responses to the user's request.

Abstract: A method of providing language assistance to a computer user with dyslexia, reading disabilities or visual impairment by presenting text-based information via multiple media channels.

Abstract: A voice reproduction apparatus and voice reproduction system for providing guide voice corresponding to a moving direction of a user, for example a visually handicapped person, in a theme park or the like. The voice reproduction apparatus comprises: a receiving part for receiving an identifying signal; an identifying signal discriminating part that discriminates the identifying signal received in the receiving part and discriminates a combination of an identifying signal received and an identifying signal received subsequently; a voice data storage part for storing voice data, relating the voice data to the combination of the received identifying signals; a voice reproduction part reproducing the voice data stored in the voice data storage part; and a reproduction control part that reads out, from the voice data storage part, voice data corresponding to the combination discriminated by the identifying signal discriminating part, and causes the voice reproduction part to reproduce the voice data.

Abstract: An apparatus and method for screening an individual's ability to process acoustic events is provided. The invention provides sequences (or trials) of acoustically processed target and distractor phonemes to a subject for identification. The acoustic processing includes amplitude emphasis of selected frequency envelopes, stretching (in the time domain) of selected portions of phonemes, and phase adjustment of selection portions of phonemes relative to a base frequency. After a number of trials, the method of the present invention develops a profile for an individual that indicates whether the individual's ability to process acoustic events is within a normal range, and if not, what processing can provide the individual with optimal hearing. The individual's profile can then be used by a listening or processing device to particularly emphasize, stretch, or otherwise manipulate an audio stream to provide the individual with an optimal chance of distinguishing between similar acoustic events.

Abstract: Phoneme analysis is carried out in real time by detecting a voiced component in the range of 200 Hz to 1 KHz and simultaneously detecting voiceless components having frequencies greater than about 2.4 KHz and greater than about 3.4 KHz, respectively, to produce respective outputs which are logically combined to produce two-bit logic signals which can be used to control a speech processing device.

Abstract: As a speaker produces a sound, the positions and angles of specular reflection plates put on the skin of the vocal organs and periphery thereof change. Resultantly, a ray of light applied from a light source section is reflected by the specular reflection plates uniquely in accordance with a law of reflection and the direction of the ray of light changes. Specularly reflected light spots moving on the face of a position detection sensor are detected by the position detection sensor, thereby detecting the positions of the specularly reflected light spots corresponding to the shape of the vocal organs and periphery thereof produced as the speaker produces the sound. Time characteristic and position change features are extracted based on the specularly reflected light spot positions detected. The features are compared with standard features patterns, thereby classifying input voice.

Abstract: A relay is described to facilitate communication through the telephone system between hearing users and users who need or desire assistance in understanding voice communications. To overcome the speed limitations inherent in typing, the call assistant at the relay does not type most words but, instead, re-voices the words spoken by the hearing user into a computer operating a voice recognition software package trained to the voice of that call assistant. The text stream created by the computer and the voice of the hearing user are both sent to the assisted user so that the assisted user can be supplied with a visual text stream to supplement the voice communications. A time delay in the transmission of the voice of the hearing user through the relay is of assistance in the assisted user comprehending the communications session.

Abstract: This invention is a system that enables handicapped and disabled individuals to control and use office photocopiers. The foregoing is accomplished by coupling a interface to a diagnostic communication port on the photocopier. The diagnostic port may be used to simulate the pressing of keys on the photocopier control panel. A software program running on a personal computer is coupled to the interface so that the interface may duplicate the actions of the photocopier control panel. A voice, keyboard and touch screen interface is added to the software program to permit several keys to be issued with a single phrase or touch. The user may use voice or the keyboard or the touch screen or any combination of the above to operate the photocopier. The addition of wireless audio may also be utilized to allow hands-free operation of the photocopier. An audio voice feedback provides information about what command was exactly executed. The system audibly reports the status of the photocopier.

Abstract: A method retrieves a multi-media segment from a signal stream having an audio component and a closed caption component. This includes separating the audio component and the closed caption text component from the signal stream, generating an audio pattern representative of the start of the multi-media segment, locating the audio pattern in the audio component, and temporally aligning the text from the closed caption text component with the audio pattern in the audio component. Locating the audio pattern in the audio component includes retrieving text from the closed caption text component; and comparing the text against one or more keywords delimiting the multi-media segment. Once located, the multi-media segment may be played on-demand. In addition, an apparatus retrieves a multi-media segment from a signal stream, the signal stream having an audio component and a closed caption text component.

Abstract: A communication device for deaf, hearing impaired, or mute persons comprises a processor control system which makes use of a microphone and a speech recognizer to receive and process audio data (speech or non-speech) to determine whether or not a dangerous situation exits within the environment surrounding the user. The system comprises a key pad and/or stylus and tablet information input system to accommodate communication from the user to the persons in the surrounding environments and a visual display capability to transmit the information so acquired by way of a projection apparatus in the form of characters and in the language to which the user is accustomed. Indicator signals which correspond to dangerous or cautionary situations relating to abnormally loud noises, or readily recognized sound patterns, such as a siren may also be displayed to the user, as may be information related geographic location, distance to a preset destination, or other personally useful information.

Abstract: A speech-rate converter slowing down input speech regularly monitors the data length of the input speech and the previously estimated extended output data length for the current rate scaling factor, computing new output data length estimates. The conversion rate is adaptively modified depending on the time lag between input and output speech so as to make input and output data lengths consistent without skipping any spoken input portions. Input signal power is monitored to discriminate speech and non-speech intervals, and the portions of input non-speech intervals exceeding a conversion-rate-dependent duration are deleted.

Abstract: Improvements to a biofeedback device for treating stuttering are disclosed. The device monitors aspects of speech production. When stuttering phenomena are detected, the device provides fluency-enhancing auditory feedback to reduce stuttering. As the user develops speech motor skills (typically taught by a speech pathologist), the device senses reduced stuttering phenomena and reduces auditory feedback. When the user can talk fluently without feedback, he discontinues using the device and continues to talk fluently. The improvements disclosed in this continuation-in-part are a biofeedback feature that monitors the user's vocal pitch; micropower impulse radar to monitor the user's muscle activity; and a fluency-enhancing auditory feedback feature that provides the sound of the user's vocal chords without the sounds added by nasal and oral cavities.

Abstract: The invention is a tactile communication system which provides a method and apparatus for presenting tactile communications in real time to people who lack the senses of sight, hearing, or both, but who have a functional tactile sense. To facilitate real-time communications, a new Phonetic Braille Code is provided which replaces the existing alphabet-based braille codes. The Phonetic Braille Code uses braille symbols which represent word sounds or phonemes, rather than letters. There is also provided an apparatus which enables the user to change from one-finger braille reading to two-finger or multiple-finger braille reading. The two-finger braille reading method facilitates the simultaneous perception of two-letter phonemes. By reading phonemes using a two finger method, rather than reading letter-by-letter with a single finger, communication speed can be increased to the point of real time. The apparatus of the invention includes several embodiments of portable tactile communication devices.

Abstract: A household appliance, in particular an electrically operated household appliance, can be controlled using voice signals. In order to avoid malfunction, e.g. as a result of voice signals coming from a radio set and not from a user, a control program is configured in such a way that successive voice signals can only form a control command when the successive voice signals are input within a given time period.

Abstract: Making use of a digital acoustic signal processing apparatus arranged by employing memory device for storing a digital acoustic signal, acoustic frequency feature enhancing device for enhancing an acoustic frequency feature, and low-speed sound reproducing device for changing a speed of the stored voice to reproduce this voice as a low speed into a hearing aid and an appliance with an acoustic output, a hearing function difficulty due to an age is aided in utilization of audio output appliances such as a hearing aid, television receiver, and a telephone receiver. After the voice has been stored in the memory device, a process for enhancing the frequency characteristic in order to fit the frequency characteristic to the individual hearing characteristic and the voice reproducing environment is carried out and thereafter represented to the user. The user can repeatedly listen the voice stored in the memory device with employment of control device for controlling the voice reproducing operation.

Abstract: Methods and apparatus implementing a technique for producing an audio output customized to a listener's hearing impairment through a digital telephone. A user initially sets user parameters to represent the user's hearing spectrum. In receiving a call, the digital telephone receives an input signal. The digital telephone adjusts the input signal according to the user parameters and generates an output signal based upon the adjusted input signal.

Abstract: An interactive adaptive learning system. A collection of core stimuli consisting of at least auditory and visual symbols and information, are stored on a computer. A number of different relationships between the core stimuli are created which can then be presented as discrimination or identification tasks to the user. Different sets of stimuli are then presented succeedingly to the user and the user is requested to respond. The form of response can either be to investigate and analyze the stimuli, or attributes of the stimuli, or answer of the quarry regarding the discrimination or identification task. The system has a built in strategy for progressing the user through learning tasks. The users actions and responses in reaction to the stimuli are all recorded and analyzed. Based not only on the success rate of the user responses, but also on other characteristics of the users reaction to the stimuli, the users learning strategy is classified.

Abstract: A data processing system and method for customizing a user output of a data processing system are disclosed. According to the method, a user preference for an audio or visual user output of a data processing system is determined. In response to determination of a user output having a first audio or visual frequency, the user output is mapped to a second audio or visual frequency in accordance with the user preference to obtain a customized user output. Thereafter, the customized user output is presented by the data processing system. In accordance with one embodiment, the user preference is determined by administering a test of the user's visual or aural acuity.

Abstract: An interactive adaptive learning system. A collection of core stimuli consisting of at least auditory and visual symbols and information, are stored on a computer. A number of different relationships between the core stimuli are created which can then be presented as discrimination or identification tasks to the user. Different sets of stimuli are then presented succeedingly to the user and the user is requested to respond. The form of response can either be to investigate and analyze the stimuli, or attributes of the stimuli, or answer of the quarry regarding the discrimination or identification task. The system has a built in strategy for progressing the user through learning tasks. The users actions and responses in reaction to the stimuli are all recorded and analyzed. Based not only on the success rate of the user responses, but also on other characteristics of the users reaction to the stimuli, the users learning strategy is classified.

Abstract: A reading system includes a computer and a mass storage device including software comprising instructions for causing a computer to accept an image file generated from optically scanning an image of a document. The software convert the image file into a converted text file that includes text information, and positional information associating the text with the position of its representation in the image file. The reading system has the ability therefore to display the image representation of the scanned image on a computer monitor and permit a user to control operation of the reader by with respect to the displayed image representation of the document by using the locational information associated with the converted text file. Also described are techniques for dual highlighting spoken text and a technique for determining the nearest word to a position selected by use of mouse or other pointing device operating on the image representation as displayed on the monitor.

Abstract: Image data and natural language data indicating a visual impression of an image prepared based on the image data are correlated to each other and stored in the correlated form in the image database, and when retrieving an image using the retrieving section, natural language data indicating a text for retrieval is inputted from a natural language input section, and image data relating to natural language data having a common visual impression is extracted from the image database by collating the inputted natural language data to natural language data on the image database.

Abstract: A radio communication system includes a voice recognition system (218), a transmitter (202) and a processing system (210). The voice recognition system is utilized for receiving caller initiated messages, and the transmitter is used for transmitting messages to a plurality of SCRs (selective call radios) (122) of the radio communication system. The processing system, which is coupled to the voice recognition system, and the transmitter, is adapted to cause the voice recognition system to convert a voice signal representative of a voice message originated by a caller of the radio communication system to a text message (401, 417), wherein the text message is intended for a SCR, to then generate a likelihood of success that the voice signal has been flawlessly converted to a text message, to have a human listen to an audible representation of the voice signal, and to cause the transmitter to transmit the text message to the SCR (432).

Abstract: A data input glove including a gloved body at least some of whose fingertip portions have conductive fingertip pad elements thereon, operatively connected to an output connector, and at least one conductive palm pad positioned on a palm portion of the gloved body and operatively connected to an output connector, wherein contact between a finger pad and a palm pad generates a signal. The signal may be processed by computer processor to provide a desired output, e.g., synthesized speech or other analogue or digital output in a suitable medium. The data glove is useful for inputting data in a covert manner, as well as communicationally enabling disabled persons with the aid of a computer, such as a handheld, wearable, or desktop computer.

Abstract: A viewpoint of a user is detected in a viewpoint detecting process, and how long the detected viewpoint has stayed in an area is determined. The obtained viewpoint and its trace is displayed on a display unit. In a recognition information controlling process, the relationship between the viewpoint (in an area) and/or its movement, and recognition information (words, sentences, grammar, etc.) is obtained as weight P(). When the user pronounces a word (or sentence), the speech is inputted and A/D converted via a speech input unit. Next, in a speech recognition process, a speech recognition probability PS() is obtained. Finally, speech recognition is performed on the basis of a product of the weight P() and the speech recognition probability PS(). Accordingly, classes of the recognition information are controlled in accordance with the movement of the user's viewpoint, thereby improving the speech recognition probability and the speed of recognition.

Abstract: A method and a system is disclosed that provide means to enable individuals with speech, language and reading based communication disabilities, due to a temporal processing problem, to improve their temporal processing abilities as well as their communication abilities. The method and system include provisions to elongate portions of phonemes that have brief and/or rapidly changing acoustic spectra, such as occur in the stop consonants b and d in the phonemes /ba/ and /da/, as well as reduce the duration of the steady state portion of the syllable. In addition, some emphasis is added to the rapidly changing segments of these phonemes. Additionally, the disclosure includes method for and computer software to modify fluent speech to make the modified speech better recognizable by communicatively impaired individuals. Finally, the disclosure includes method for and computer software to train temporal processing abilities, specifically speed and precision of temporal integration, sequencing and serial memory.

Abstract: A method for having a reading machine spell a word includes retrieving a word to be spelled, displaying the first character of the word on a display while applying a highlighting indicia to the character, synthesizing speech for the character to have the reading machine pronounce the displayed letter of the word, unhighlighting the displayed letter of the word, and retrieving a subsequent letter of the word.

Abstract: A computer-operated system for assisting aphasics in communication includes user-controlled means for storing data representing the user's vocalizations during a time interval, means for associating the data stored in each of a plurality of such intervals with an icon, means for ordering a plurality of such icons in a group representing a speech message, and means for generating an audio output from the stored data represented by the icons in the group so as to provide a speech message.

Abstract: An apparatus and method for screening an individual's ability to process acoustic events is provided. The invention provides sequences (or trials) of acoustically processed target and distractor phonemes to a subject for identification. The acoustic processing includes amplitude emphasis of selected frequency envelopes, stretching (in the time domain) of selected portions of phonemes, and phase adjustment of selection portions of phonemes relative to a base frequency. After a number of trials, the method of the present invention develops a profile for an individual that indicates whether the individual's ability to process acoustic events is within a normal range, and if not, what processing can provide the individual with optimal hearing. The individual's profile can then be used by a listening or processing device to particularly emphasize, stretch, or otherwise manipulate an audio stream to provide the individual with an optimal chance of distinguishing between similar acoustic events.

Abstract: Goniometers are provided having internal compensation employing two opposing variable resistance strain sensing elements separated by a flexible film. The goniometers may be used in sets for detecting complex hinge or joint movements, where patterns of hinge or joint positions may be used to define symbols. Algorithms are provided for parsing values from a system of goniometers in motion having information content.

Abstract: The present invention, according to one embodiment, comprises a speech intelligibility testing system and method. The invention comprises a sound device for producing a plurality of stimulus words to be heard by a test subject and a display means configured to display a set of word pairs corresponding to a set of contrasting speech sounds. Each word pair comprises two words which are real words with a high degree of familiarity to the test subject, and are displayed whenever a stimulus word is transmitted to the test subject. The first word of the word pair corresponds to the stimulus word, while the second word differs from the first word by at least one of the set of contrasting speech sounds. The invention also comprises a means for the test subject to select one word of the word pair after deciding which of the two words was heard. In accordance with one embodiment, the present invention employs a set of rules to generate vowel and consonant contrasts to be tested.

Abstract: A listener's ability to recognize and identify similar sounds is improved by testing the listener's ability to recognize and identify exaggerated sounds that are formed from pairs of similar sounds. The exaggerated sounds differ from one another in spectral/temporal energy distribution more that the similar sounds differ from one another and in generally the same way in which the similar sounds differ. The exaggerated sounds are formed as follows: the similar sounds are spectrally transformed into a coordinate space and a linear function is projected between a pair of points. To exaggerate the sounds, points are extrapolated outward from the pair of points along a linear function. The listener is challenged to repeatedly identify each of the exaggerated sounds. When the listener has demonstrated proficiency, the degree to which the exaggerated sounds differ from the similar sounds is reduced and the listener is again challenged.

Abstract: A patient monitoring system. A patient has access to a telephone. The telephone is operated by a patient. A central monitoring system is coupled to the telephone. The central monitoring system generates questions concerning a health condition of the patient for the patient to answer using the keys of the telephone or by speaking the correct response. The central monitoring system stores answers to the questions for later retrieval. The central monitoring system can include a DTMF modem decoder for receiving and decoding DTMF tones generated by the patient using the touch-tone telephone and transmitted to the central monitoring system. The DTMF tones represent the health condition of the patient. A computer processor is coupled to the DTMF modem decoder. A voice generator is also coupled to the computer processor and generates voice output under the control of the computer processor. The voice output is transmitted to the touch-tone telephone.

Abstract: A reading machine includes computer program residing on a computer readable medium operable with an operating system that permits the production of windows on a display. The program has instructions for causing a computer to provide a first user selected call a first user selected routine in response to a user selecting a first word that the user seeks assistance in understanding and produce a text file for the first selected word comprised of data that assists the user call. An operating system routine commands the operating system to create a new window on the display and fill the new window on the display with the information contained in the text file. A second user selected call to a user selected routine can be provided for word that the user seeks assistance in understanding to provide a recursive enrichment feature.

Abstract: A training system used while a person is speaking uses a feedback modification technique to reduce accents. As the speaker is speaking, the system feeds back to the speaker the speaker's speech in "real-time" so that the speaker, in effect, hears what he or she is saying while saying it. The system includes a detector configured to monitor a speaker's speech to detect a preselected target vowel sound that the speaker wishes to produce accurately. In response to the detector detecting a "target" vowel sound, a cue generator generates a sensory cue (e.g., an amplification of the "target" vowel sound) that is perceived by the speaker. As the speaker is speaking, the generator feeds back to the speaker the sensory cue along with the speech so that the cue is coincident with the "target" vowel sound.

Abstract: An electronic communications system for the deaf includes a video apparatus for observing and digitizing the facial, body and hand and finger signing motions of a deaf person, an electronic translator for translating the digitized signing motions into words and phrases, and an electronic output for the words and phrases. The video apparatus desirably includes both a video camera and a video display which will display signing motions provided by translating spoken words of a hearing person into digitized images. The system may function as a translator by outputting the translated words and phrases as synthetic speech at the deaf person's location for another person at that location, and that person's speech may be picked up, translated, and displayed as signing motions on a display in the video apparatus.

Abstract: A sign language interpretation apparatus for performing sign language recognition and sign language generation generates easily read sign language computer graphics (CG) animation by preparing sign language word CG patterns on the basis of actual motion of the hand through the use of a glove type sensor to generate natural sign language CG animation, and by applying correction to the sign language word CG patterns. Further, in the sign language interpretation apparatus, results of translation of inputted sign language or voice language are confirmed and modified easily by the individual input persons, whereby results of translation of the inputted sign language or voice language are displayed in a combined form desired by the user to realize smooth communication. Also, candidates obtained as a result of translation are all displayed and can be selected easily by the input person with a device such as a mouse.

Abstract: A method for accessing and browsing the internet through the use of a telephone and the associated DTMF signals is disclosed. The preferred embodiment provides a system that converts the information content of a web page from text to speech (voice signals), signals the hyperlink selections of a web page in an audio manner, and allows selection of the hyperlinks through the use of DTMF signals generated from a telephone keypad. Upon receiving a DTMF signal corresponding to a hyperlink, the corresponding web page is fetched and again delivered to the user via one of the available delivery methods such as voice, fax-on-demand, electronic mail, or regular mail.

Abstract: A treatment system for reducing stuttering uses an auditory feedback modification technique to train the stutterer's speech motor control system to be more stable. The auditory feedback modification is based on a model of speech motor control in the human brain that incorporates a variation of observer-based control and Smith prediction. In addition, the Kalman gain of the model is set by comparing the speech muscular control signals sent to the person's vocal tract to the corresponding auditory speech sounds the person actually hears. It is believed that the speech motor control system of a stutterer has set the Kalman gain too high, thereby creating an unstable control system that in turn causes stuttering. A feedback modifier feeds back the stutterer's speech to the stutterer with a perturbation that is small enough to pass a validator function that is believed to be part of the speech motor control system.

Abstract: An audible-output system disambiguates the phonetic sounds of multi-byte characters so that a visually-impaired user can uniquely identify which characters are associated with the output. The audible-output system provides this disambiguation through the use of a secondary audio channel that simultaneously outputs one or more sounds that distinguishes a character being output on a primary audio channel. That is, the phonetics of a character are audibly output on the primary channel, and the distinguishing sound is simultaneously output on a secondary channel. The combination of the two sounds on the two channels unambiguously identifies the character being output to the listener. In effect, this system brings the distinctness of shape to a visually-impaired listener and reinforces the differences in meaning between similar-sounding characters to the listener.

Abstract: A synthesized signing image is generated which includes an original image of a subject and a sign image superimposed on the original subject image. The sign image is selected from a sign language database based on the speech (i.e., a letter or word) spoken by the subject. Based on the size and tone (intensity) of the subject's face in the original image, the database sign image is modified to match the intensity and have a proportional size to the subject's face. The modified database sign image is then superimposed on the original image of the subject to create a synthesized image in which the subject appears to be signing.