Abstract: The present invention provides a method and system for providing improved understandability of received speech characterized in that it includes input interface adapted to capture received speech signals connected to a speech recognition means for identifying the contents of the received speech connected to one input of a data processor adapted to perform improvement in understandability, a user profile storage connected to another input of said data processor for providing user specific improvement data, and an output generator connected to the output of said data processor to produce personalized output based on an individual's needs. The instant invention also provides a configured computer program product for carrying out the above method.

Abstract: A device and a method to be used by laryngeally impaired people to improve the naturalness of their speech. An artificial sound creating mechanism which forms a simulated glottal pulse in the vocal tract is utilized. An artificial glottal pulse is compared with the natural spectrum and an inverse filter is generated to provide an output signal which would better reproduce natural sound. A digital signal processor introduces a variation of pitch based on an algorithm developed for this purpose; i.e. creating prosody. The algorithm uses primarily the relative amplitude of the speech signal and the rise and fall rates of the amplitude as a basis for setting the frequency of the speech. The invention also clarifies speech of laryngectomees by sensing the presence of consonants in the speech and appropriately amplifying them with respect to the vowel sounds.

Abstract: Scheme for processing an input signal A(t) by N resonators (17), each having parameters characterizing it, to generate N individual output signals. Then each of the N individual output signals is weighted using a corresponding weight to generate N individual weighted output signals which are superposed to obtain M output signals C(t). One of the parameters or the weight depend on a time signal P(t).

Abstract: An interface protocol for the functional manipulation of complex devices such as personal telecommunication devices without the necessity of the visual feedback via textual or graphic data, wherein the sensor functions change with time rather than placement, so that a user action biases a binary state switch, which is correlated to a timed audible audio data stream, the correlation indicating the desired action selected by the user. The device can be embedded in a product such as a plush toy without altering the external aesthetics of the product.

Abstract: A wireless ad hoc pico network is formed by eyewear and other devices such as a computer, a bracelet and a telephone having similar transceivers mounted on them. Master slave relationships are configurable. Other devices, such as a radio, a CD player, a hand held global positioning satellite system and a heart rate monitor, having similar transceivers, can also be connected with the transceiver of the eyewear. The transceivers operate on globally available, unlicensed radio band, 2.45 gigahertz (GHz) and conforms to the Bluetooth standard. The power consumption of Bluetooth enabled devices is less than three percent of the power consumption of a mobile phone. The eyewear includes a frame and connected to the frame are two temples. Temples are connected to frame via hinges. Temples have a male portion of a connector incorporated in them. Female portion of the connector is made integral with the hinges. When the male portion is inserted in the female portion the temple is attached to the frame.

Abstract: A system and method for enabling telephone network subscribers using a telecommunications device for the deaf (TDD) to communicate with other network subscribers lacking such a device. The TDD user dials a number that connects them with an automatic relay switch (ARS). The ARS determines the intended recipient of the call and establishes a connection to them. The TDD user then transmits a message in TDD format to the ARS, which converts it into an ASCII text file that is in turn provided to a text-to-speech (TTS) engine that synthesizes a voice message from the text file. The voice message is then sent to the non-TDD-enabled subscriber. The ARS then preferably prompts the non-TDD-enabled subscriber to enter a response. The response may be made by voice communication or by using the telephone keypad to send dual-tone multi-frequency tones back to the ARS according to instructions that were provided to the called party for this purpose.

Abstract: A system for activating a microphone based on visual speech cues, in accordance with the invention, includes a feature tracker coupled to an image acquisition device. The feature tracker tracks features in an image of a user. A region of interest extractor is coupled to the feature tracker. The region of interest extractor extracts a region of interest from the image of the user. A visual speech activity detector is coupled to the region of interest extractor and measures changes in the region of interest to determine if a visual speech cue has been generated by the user. A microphone is turned on by the visual speech activity detector when a visual speech cue has been determined by the visual speech activity detector. Methods for activating a microphone based on visual speech cues are also included.

Abstract: Methods and devices generate an exogenous natural second speech signal as an auditory stimulus to a user to enhance the fluency of persons who stutter. The natural speech signal is independent of the contemporaneous speech production of the stutterer and is provided by a voice gesture and can be a prolonged or sustained voice gesture sound such as a simple vowel, or consonant, or vowel trains and the like. The second speech signal can be transmitted in advance of a speaking event or speech production of the stutterer and/or concurrently with a speaking event, either intermittently or continuous during the speaking event. The devices of the instant invention are configured to provide the voice based speech signal such that it is audible to the user and does not require feedback of the user's own speech allowing the user to speak at a substantially normal pace with enhanced fluency.

Abstract: A method and a system that will allow a hearing impaired person to access a TRS (Telecommunications Relay Service) center via an Internet terminal on the World Wide Web instead of using a TTY device on the telephone network. The present invention represents a modification or add-on to the methodology and systems currently employed by TRS centers throughout the country. Therefore, a TRS center will be able to handle operator assisted relayed telephone calls both using the present POTS (Plain Old Telephone Service) and the World Wide Web. Additional equipment will be required for a center to implement the present invention, said equipment comprising a TRS Packet Server and a router connected to the internet. When a hearing impaired customer wishes to place a call, secured communication is first established over the internet with a Nationwide TRS Routing Server. The Nationwide Routing server then finds a TRS center to handle the call.

Abstract: A system and method for analyzing a speech problem includes the steps of presenting to a student/user a symbol representative of a word and prompting the user to pronounce the word represented by the symbol into a microphone in signal communication with a processor. Next the therapist enters a phonetic representation of the user pronunciation into the processor. It is then automatically determined whether an error exists in the user pronunciation. If an error exists, the error is automatically categorized. The system and method may be adapted for presentation of a single word, a plurality of words having a predetermined feature desired to be tested, a pretest for screening for potential articulation disorders, and an analysis of connected speech with the use of a moving picture to elicit a narrative from the student.

Abstract: A data processing system collects video and audio samples of acceptable speech production. A video camera focuses on a speaker's face and, particularly, articulation visible in the area of the mouth or other body movements associated with speech production. Video files are used to archive acceptable and unacceptable productions. These files may then be used to provide feedback about acceptable and unacceptable ways to produce speech. A speech professional or language teacher may play a model speech production and a subject speech attempt simultaneously to compare articulation, audio analysis, and appearance of articulators. A subject may play a model speech production and record a speech attempt simultaneously to attempt to mimic the appearance of articulators. Image processing may be used to create a mirror image of a video model or a current attempt or both to avoid left-right confusion.

Abstract: A system and method for analyzing a speech problem includes the steps of presenting a symbol representative of a word and prompting the user to pronounce the word represented by the symbol into an audio input device such as a microphone in signal communication with a processor. Next the therapist enters a phonetic representation of the user pronunciation into an operator input and storage device, the phonetic representation subsequently downloaded into the processor. It is then automatically determined whether an error exists in the user pronunciation. If an error exists, the error is automatically categorized.

Abstract: Several embodiments of an electronic document delivery system are described including a client machine (e.g., a palmtop/handheld computer or wireless communication device) coupled to a transcoder proxy. The system allows a client machine with limited resources to provide an assistive technology solution for a physically challenged user. In one embodiment, the client machine includes an assistive technology which functions as an interface for a device (e.g., a Braille display or a speech engine). The transcoder proxy receives an electronic document expressed in a first digital format (e.g., HTML or XML). The transcoder proxy assigns a unique identifier to the element, and forms a model of a logical structure of the document (e.g., a document object model or DOM). The transcoder proxy uses the model to produce an “original” script including a portion of the document expressed in a second digital format (e.g., a scripting language).

Abstract: A transcription method uses a computerized process to prompt a student to produce at least one phoneme orally. Next a correct and at least one incorrect production of the phoneme are displayed. The therapist selects from among the displayed productions based upon the student-produced phoneme. The system includes a processor and display to prompt a student to produce at least one phoneme orally, display a correct and at least one incorrect production of the phoneme. The therapist then uses an input device in signal communication with the processor to select from among the displayed correct and incorrect productions based upon the student-produced phoneme, thus obviating the need for the therapist to enter the incorrect production symbol by symbol, unless it is desired to do so, or unless the actual production is not found among the displayed production selections.

Abstract: A method for providing speech therapy includes the steps of selecting a problem speech sound and searching a database that houses a plurality of records. Each record contains a picture and a word associated with the word. Next a set of records is automatically generated from the plurality of records. Each record contains a word specific to the problem speech's sound. At least a portion of each record in the set of records is next automatically presented to a user sequentially on a display device, and the user is prompted to pronounce the displayed word. Finally, the pronunciation of each word is scored. The system includes hardware for carrying out the method, including a processor, display device, input device, and software resident on the processor adapted to access a database of records, present records to the user, and receive a score entered into the input device.

Abstract: A hearing aid includes an image sensing device, a sound input transducer, a sound output transducer, and a processor. The image sensing device detects an image from a selected region of a user of the hearing aid while the sound input transducer receives sound and produces an audio signal representative of the sound. The sound output transducer receives the audio signal and converts the audio signal to a sound wave that is provided to the user. The processor receives the image, analyzes the image to determine an existence of human-generated sound, and provides the audio signal from the sound input transducer to the sound output transducer when human-generated sound is detected. The audio signal is provided at a first level when human-generated sound is detected and is provided at a second level in an absence of human-generated sound.

Abstract: Techniques for dynamic personalized reading fluency proficiency assessment are provided by determining a user reading fluency level based on one or more spoken responses provided by the user during one or more reading aloud sessions of a text that has been evaluated for discourse structure and information structure of sentences.

Abstract: A system and method for remote audio caption visualizations is presented. A user uses a personal device during an event to display an enhanced captioning stream corresponding to the event. A media-playing device provides a media stream corresponding to the enhanced captioning stream. The media-playing device provides a synchronization signal to the personal device which instructs the personal device to start playing the enhanced captioning stream on the personal device's display. The user views text on the personal display while the media stream plays. The user is able to adjust the timing of the enhanced captioning stream in order to fine-tune the synchronization between the enhanced captioning stream and the media stream.

Abstract: Goniometers are provided having internal compensation employing two opposing variable resistance strain sensing elements separated by a flexible film. The goniometers may be used in sets for detecting complex hinge or joint movements, where patterns of hinge or joint positions may be used to define symbols. Algorithms are provided for parsing values from a system of goniometers in motion having information content.

Abstract: This invention includes a portable electronic device having telecommunication capabilities for use by a hearing-impaired user. The device includes a computer platform having storage for one or more programs, a display for displaying at least alphanumeric text, and at least a speech recognition program that is resident and selectively executable on the computer platform. When a communication connection is established with a communicating party, the speech recognition program translates the words of the calling party into equivalent text and displays the text on the display. The device can also include a text-to-speech program that translates text input by the user of the device into synthetic speech for transmission from the device to the communicating party. A preferred electronic device is a cellular telephone with an electronic organizer being the computer platform.

Abstract: A speech-generating computer apparatus for generating speech from electronic forms, a method of controlling a computer and a computer-readable media containing program code embodying an application program for performing a method of generating speech. The computer has a speech-generating function and at least one screen reader program. The at least one screen reader program generates human perceptible speech with the speech-generating function. The computer determines if a particular screen reader program is active and initializes an object in a format of a particular screen reader program that is active.

Abstract: An apparatus and method for converting the speed of reproducing an input acoustic signal. The apparatus and method can efficiently delay the output signal without using an output-data storage section of a large storage capacity even if the input acoustic signal has a high sampling frequency. In the apparatus, the speech-speed converting section generates an acoustic frame signal s6 which has been converted in speech speed and which has a predetermined length. The frame-signal encoding section encodes the acoustic frame signal s6 generated by the speech-speed converting section, thereby generating coded data s10 that is smaller than the data represented by the acoustic frame signal s6. The coded data storage section stores the coded data s10. The frame-signal decoding section decodes the coded data s11 read from the storage section, generating an output acoustic signal s9 having a particular length.

Abstract: A system and method for providing transformed web pages to users with special needs is presented. In one aspect of the system and method, a Translator/Mediator Server is located between the user and the web site. The Translator/Mediator Server translates and transforms the web pages that the user requests from the web site. The translation and transformation of the web pages is directed towards the particular needs of the user.

Abstract: The present method provides an acoustic signature with correlation to neurological degeneration for the speech disturbances. Acoustic measures of speech disturbance can be compared to or rated against neurological measures or indicators such as magnetic resonance imaging to diagnose a neurological condition or to rate the severity or progression of a condition.

Abstract: A pair of sensors are used for detecting an air pressure change signal within an ear of a person caused by the person's initiating action (thought, movement, biological function and/or speech). One of the microphones is placed at least partially within an ear of the person and the other is placed adjacent to and external to the ear, to produce two electrical signals, respectively corresponding to internally detected and to externally detected changes in air pressure. Comparison of the unmodified signal strength difference between these two signals is used to distinguish an initiating action component of each signal from an external source component of each signal. The electrical signals are processed to produce an output signal corresponding to the initiating action, which signal is then recognized by a neural network or speech recognizer, and used for control or communication.

Abstract: A real time visual display which enables a speaker to compare values of parameters in his own speech with measured values of acoustic information in the listener's environment. The speaker is thus able to use the display as feedback to adjust and modulate his own speech patterns to increase the listener's understanding. In a preferred embodiment of the invention, the visual display is presented to the speaker via a special set of eyeglasses.

Abstract: Information transmitted through radio is recorded in telephone communications using radio.

Abstract: A system and method is provided for real time teleconferencing, where one of the participants is deaf or hearing-impaired. In one aspect of the system and method, each participant has an Automatic Speech Recognition (ASR) system and a chat service system, such as AOL Instant Messenger™. Each participant may have a different type of ASR system, as well as a different type of chat service system. It is not necessary that the deaf or hearing-impaired participant have an ASR system. For each participant, the participant's ASR system transcribes the speech of the participant and provides it to the participant's chat service system, which translates the transcribed text into the chat service message in the format of the participant's chat service system.

Abstract: A method for speech enabling labeless controls in an existing graphical user interface can comprise the steps of: identifying controls in a window contained in the graphical user interface; testing each identified control for an associated label; for each identified control having an associated label, adding the associated label to an active grammar of a speech recognition system; for each identified control not having an associated label, creating a label based upon an object property of a contextually relevant user interface object; and, further adding each created label to the active grammar. In testing each identified control for an associated label, an accessibility interface query can be applied to each identified control in the window. In addition, in creating the label, each contextually relevant object can be searched for an object property descriptive of the identified control not having an associated label.

Abstract: The small-sized braille letter reading apparatus of the present invention is capable of reducing a manufacturing cost and increasing reliability and durability of apparatus. The apparatus comprises: a pressure sensor being capable of simultaneously contacting all braille points included in at least one of two braille lines constituting one braille letter, the pressure sensor generating output signals corresponding to the detected braille points; and an analyzing section for analyzing data of the output signals and converting the braille letter into an ordinary letter when the pressure sensor scans the two braille lines of the braille letter.

Abstract: A new modem standard provides reliable in-band transmission of TTY/TDD signals via the speech channel of all digital cellular phone systems. The standard includes error correction such as Forward Error Correction (FEC), and also performs interleaving to spread each TTY/TDD character over several adjacent speech frames. The modem standard can be applied to all speech coding standards and all mobile phone systems. The standard can be implemented using a special interface cable or box between a conventional TTY/TDD device and a mobile phone. The interface can also be integrated directly into new mobile phones, and necessary signal processing can be performed by the mobile's DSP. A new Universal TTY/TDD device can also be provided that supports both modem standards: conventional Baudot code as well as the new modem signals, and implemented using specialized hardware, or using conventional hardware such as a laptop computer with specialized software.

Abstract: A method and system for testing the speech intelligibility of a child comprises providing a set of target sounds as words in the presence and absence of competing sound(s) of a variety of types so as to enable an analysis of the aspects of competing sounds and their respective effects on the speech intelligibility of a child. Locations at which competing sound(s) is provided is varied to enable an evaluation of its effect on the spatial release from masking. The target words used in the test are first determined to be within the vocabulary of the child. The child is required to respond to the target word by selecting a picture representation of the target word from among several picture choices, thus providing an interactive aspect to the test. There may optionally be provided a positive or a negative reinforcement. The sound level at which the target words are presented may vary adaptively according to the child's responses, the change in sound level being determined by a set of rules.

Abstract: A method of providing language assistance to a computer user with dyslexia, reading disabilities or visual impairment by presenting text-based information via multiple channels is provided. This technique effectively provides multiple channels of information to a user. Moreover, this method is useful for displaying text-based information to users having disabilities such as dyslexia, or for increasing the entertainment value of viewing a text document. This technique may be used for assisting users in editing documents and in retrieving information from the World Wide Web.

Abstract: Inputted sign language word labels and editing items such as speeds and positions of moving portions for specifying manual signs and/or sign gestures corresponding to the respective sign language word labels are displayed on an editing screen. These editing items are modified by the user to add non-language information such as emphasis/feeling information to the contents of communication, thereby generating modified sign language animation information data including the inputted sign language word label string having the added non-language information. For communication or interaction, the non-language information is extracted from the modified sign language animation information data and stored into a memory with the inputted sign language word label string. When a hearing impaired person communicates or interacts with another person through text, the user can emphasize the contents of communication or show the user's feeling for the contents of communication to the other person.

Abstract: A method and system for assisting the visually impaired to identify the contents of an object or container and any important information related thereto is provided. When a container, such as, for example, a bottle or envelope, for an article is prepared, a barcode that includes data related to the contents of the container is generated. The generated barcode is printed on the container, or printed on a label secured to the container. A reading device is utilized to scan the barcode. The information included in the barcode is converted into an audible format, and provided by the reading device in an audible speech format thereby allowing a visually impaired person to hear the information regarding the container and/or its contents. Additionally, the reading device can obtain and audibly present additional detailed information related to the article via an on-line service.

Abstract: A device used with a conventional television set that permits both hearing impaired and non hearing impaired individuals to view television audio voice signals in a text format on the television screen without the requirement of a closed/open caption broadcast signal or a closed/open caption enabled television. The device also can utilize an FM audio input, an audio line input, and a microphone or impedance input for conversion into a text format. The system may use on-board or remote displays, wireless or wired, for also providing the text format representative of human speech. The system includes audio filters for filtering a television audio signal and filtering out human speech audio signals for processing and conversion by a speech-to-text converter.

Abstract: A dyslexia detection system displays a test word, either alone, or within a sentence. The test subject is asked to pronounce the test word, and to write it on a handwriting input device, such as a tablet. The system analyzes the spoken words, comparing them to sound records in a library of properly pronounced phonemes which make up the test word. The system also analyzes the characters written by the subject, and detects whether any of the characters correspond to a member of a distorted character set containing distortions commonly produced by dyslexics. A summary of errors in pronunciation shows errors in pronunciation as mispronounced phonemes, and errors in writing are displayed as erroneously written characters.

Abstract: A visual simulation technique is provided to facilitate visual activities, such as reading and movement of a subject through surroundings, for sight-impaired persons. The technique obtains digital images of the surroundings via an image retrieval and sending device, and then provides a real-time audio interpretation of the images via an automated image identification and narration system. The automated system may have communication and computing circuitry, remote human interaction circuitry, and other components for either computer-based or human-based identification and narration of the acquired images.

Abstract: The present invention provides a method for establishing fixation during computerized visual field perimetry, requiring the subject to verbally identify the symbol employed as fixation targets as they each appear. Speech recognition techniques are then employed to evaluate the subject's response, and, upon correctly identifying the fixation symbol, a visual test stimulus is displayed at a predetermined location within the subject's field of vision. Fixation is established by displaying to the subject fixation targets represented by varying symbols, which may be displayed at one or more locations on a display monitor. These so-called fixation symbols, include geometrical shapes, letters, numbers, pictures or other symbols readily identifiable by the subject. When a fixation symbol appears, the subject verbally identifies the symbol by saying the name of the symbol into a microphone.

Abstract: A method of producing a control signal. The method includes the steps of sensing an air pressure pattern in or near an ear of a person, the air pressure pattern resulting from voluntary physical action of the person; and converting the air pressure pattern into an output signal. Also described is a control system. The control system includes an air pressure sensor for detecting an air pressure pattern adjacent an ear of a person while the person makes a voluntary physical action and for producing an output signal corresponding to the detected air pressure pattern; and processing circuitry for discerning a pattern from the output signal.

Abstract: A voice recognition device and method allows position-stabilized capture of spoken sounds with great repeatability and accuracy. The voice recognition device may additionally provide two channels of lip movement information to supplement the usual audible speech component recognition system in selecting the proper pairing of data input to text output. The voice recognition device may provide a further channel of information about the speech generating motions via an ultrasonic injection of sound into the vocal cavity and subsequent decoding of the emitted sound after injection. The ultrasonic injection and decoding may also used to provide audible clues as to the unvoiced sound formed by speaking when the vocal cords are not energized. The ensemble of electronic equipment upon the bail band may be in microcircuit form, including placing the components on a copper layer polyimide flexible strip.

Abstract: A sign language telephone device is offered which enables an aurally handicapped person who uses the sign language to converse with a normal person at a distant place who does not know the sign language. The sign language telephone device is placed on the side of the aurally handicapped person, and hand gestures of the sign language inputted from a sign language input means are recognized as the sign language, and the recognized sign language is translated to Japanese. The translated Japanese word train is converted to synthesized voices and it is transmitted to a videophone on the side of a normal person. The voices from the videophone are recognized, and the recognized Japanese is translated to the sign language to generate sign language animations and they are displayed on the screen of a TV set on the side of the aurally handicapped person.

Abstract: A method and apparatus for translation of hand positions into symbols. A glove for wearing on an operator's hand includes bend sensors disposed along the operator's thumb and each finger. Additional bend sensors are located between selected fingers and along the wrist. A processor generates a hand position signal using bend sensor signals read from the bend sensors and transmits the hand position signal to an output device. The output device receives the hand position signal and generates a symbol representative of the hand position signal using the received hand position signal and a lookup table of hand position signals associated with a set of symbols. The output device then produces either a visual or audio output using the symbol.

Abstract: An electrotactile vocoder includes a handset (3) carrying stimulating electrodes (9) positioned adjacent openings (8) in the handset and electrically contacting the fingers when the handset is worn to cause stimulation of the digital nerves of the fingers, a speech processor/stimulator unit (2) for producing electrical stimuli at the electrodes (9) based on incoming speech and other information received by a microphone (1), the stimulator unit including circuit means for applying stimulating currents to the electrodes (9), the speech processor unit including means for encoding the presence of unvoiced speech components or for encoding information to a first formant F1 in addition to information relating to a second formant F2 and for applying the stimulating currents to selected pairs of electrodes.

Abstract: In order to provide an image display method and apparatus capable of displaying images corresponding to document data or speech data, image data (such as sign language images) are stored in an image dictionary in motion picture form. Document data is read out from a character information storage device (or speech data is received), and a sign language image corresponding to a character string of the document data (or the speech) is selected from the image dictionary and displayed on a display.

Abstract: A method and apparatus are provided for refining time alignments of closed captions. The method automatically aligns closed caption data with associated audio data such that the closed caption data can be more precisely indexed to a requested keyword by a search engine. Further, with such a structure, the closed captions can be made to appear and disappear on a display screen in direct relation to the associated spoken words and phrases. Accordingly, hearing impaired viewers can more easily understand the program that is being displayed.

Abstract: A method for providing speech therapy includes the steps of selecting a problem speech sound and searching a database that houses a plurality of records. Each record contains a picture and a word associated with the word. Next a set of records is automatically generated from the plurality of records. Each record contains a word specific to the problem speech's sound. At least a portion of each record in the set of records is next automatically presented to a user sequentially on a display device, and the user is prompted to pronounce the displayed word. Finally, the pronunciation of each word is scored. The system includes hardware for carrying out the method, including a processor, display device, input device, and software resident on the processor adapted to access a database of records, present records to the user, and receive a score entered into the input device.

Abstract: A method for providing auditory correction for a hearing-impaired individual, including extracting pitch, voicing, energy and spectrum characteristics of an input speech signal. The method also includes modifying the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic, modifying the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic, modifying the extracted energy characteristic by applying a compression function to the extracted energy characteristic, and modifying the extracted spectrum characteristic by applying a homothetical compression function to the extracted spectrum characteristic. Further, a speech signal is reconstituted perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics.

Abstract: A system and method is provided for real time teleconferencing, where one of the participants is deaf or hearing-impaired. In one aspect of the system and method, each participant has an Automatic Speech Recognition (ASR) system and a chat service system, such as AOL Instant Messenger™. Each participant may have a different type of ASR system, as well as a different type of chat service system. It is not necessary that the deaf or hearing-impaired participant have an ASR system. For each participant, the participant's ASR system transcribes the speech of the participant and provides it to the participant's chat service system, which translates the transcribed text into the chat service message in the format of the participant's chat service system.

Abstract: A terminal is designed so that a user who employs numerical keys, allocated for the entry of dots, can enter Braille dot combinations that are used for the input of characters. The input characters may be output as speech for feedback. Further, when a terminal accesses a server, Braille dot combinations can be entered in the above described manner, and speech can be fed back from the server. Furthermore, the server can provide a service for the user in accordance with a character string input at the terminal.