Abstract: A technique is disclosed for disambiguating speech input for multimodal systems by using a combination of speech and visual I/O interfaces. When the user's speech input is not recognized with sufficiently high confidence, a the user is presented with a set of possible matches using a visual display and/or speech output. The user then selects the intended input from the list of matches via one or more available input mechanisms (e.g., stylus, buttons, keyboard, mouse, or speech input). These techniques involve the combined use of speech and visual interfaces to correctly identify user's speech input. The techniques disclosed herein may be utilized in computer devices such as PDAs, cellphones, desktop and laptop computers, tablet PCs, etc.

Abstract: A technique for enabling a browser to update its state upon a change between voice and visual mode. A deck of visual content cards is loaded into a visual browser, wherein one card contains a link to change from visual to voice mode. Selecting the link directs the visual browser to an update card, which has a first event handler which enters voice mode by placing a voice call to a telephone number in response to forward entry into the update card. The update card also includes a second event handler which contacts an update site to determine what content to point the visual browser to when visual mode resumes. In a first embodiment, the second event handler is actuated by backward entry into the update card upon completion of the voice call. In a second embodiment, the second event handler is actuated by expiration of a timer.

Abstract: A technique is disclosed for disambiguating speech input for multimodal systems by using a combination of speech and visual I/O interfaces. When the user's speech input is not recognized with sufficiently high confidence, a the user is presented with a set of possible matches using a visual display and/or speech output. The user then selects the intended input from the list of matches via one or more available input mechanisms (e.g., stylus, buttons, keyboard, mouse, or speech input). These techniques involve the combined use of speech and visual interfaces to correctly identify user's speech input. The techniques disclosed herein may be utilized in computer devices such as PDAs, cellphones, desktop and laptop computers, tablet PCs, etc.

Abstract: A technique for enabling a browser to update its state upon a change between voice and visual mode. A deck of visual content cards is loaded into a visual browser, wherein one card contains a link to change from visual to voice mode. Selecting the link directs the visual browser to an update card, which has a first event handler which enters voice mode by placing a voice call to a telephone number in response to forward entry into the update card. The update card also includes a second event handler which contacts an update site to determine what content to point the visual browser to when visual mode resumes. In a first embodiment, the second event handler is actuated by backward entry into the update card upon completion of the voice call. In a second embodiment, the second event handler is actuated by expiration of a timer.

Abstract: A technique is disclosed for disambiguating speech input for multimodal systems by using a combination of speech and visual I/O interfaces. When the user's speech input is not recognized with sufficiently high confidence, a the user is presented with a set of possible matches using a visual display and/or speech output. The user then selects the intended input from the list of matches via one or more available input mechanisms (e.g., stylus, buttons, keyboard, mouse, or speech input). These techniques involve the combined use of speech and visual interfaces to correctly identify user's speech input. The techniques disclosed herein may be utilized in computer devices such as PDAs, cellphones, desktop and laptop computers, tablet PCs, etc.