Abstract: A method and system is provided to enable a recipient to interact with an interactive multimodal message triggered on the recipient's mobile device. A sender creates the interactive multimodal message using a client application. A server stores the created interactive multimodal message. The server sends a notification to the recipient's mobile device. The notification comprises a pointer to the stored interactive multimodal message. The stored interactive multimodal message is triggered on the recipient's mobile device when the pointer in the notification is accessed. Service information is transmitted to the recipient's mobile device through the triggered interactive multimodal message. The interactive multimodal message triggered on the recipient's mobile device enables the recipient interaction. The interactive multimodal message may be forwarded to one or more second recipients simultaneously.

Abstract: A technique for synchronizing a visual browser and a voice browser. A visual browser is used to navigate through visual content, such as WML pages. During the navigation, the visual browser creates a historical record of events that have occurred during the navigation. The voice browser uses this historical record to navigate the content in the same manner as occurred on the visual browser, thereby synchronizing to a state equivalent to that of the visual browser. The creation of the historical record may be performed by using a script to trap events, where the script contains code that records the trapped events. The synchronization technique may be used with a multi-modal application that permits the mode of input/output (I/O) to be changed between visual and voice browsers. When the mode is changed from visual to voice, the record of events captured by the visual browser is provided to the voice browser, thereby allowing the I/O mode to change seamlessly from visual to voice.

Abstract: A method and system are disclosed herein for accepting multimodal inputs and deriving synchronized and processed information. A reusable multimodal application is provided on the mobile device. A user transmits a multimodal command to the multimodal platform via the mobile network. The one or more modes of communication that are inputted are transmitted to the multimodal platform(s) via the mobile network(s) and thereafter synchronized and processed at the multimodal platform. The synchronized and processed information is transmitted to the multimodal application. If required, the user verifies and appropriately modifies the synchronized and processed information. The verified and modified information are transferred from the multimodal application to the visual application. The final result(s) are derived by inputting the verified and modified results into the visual application.

Abstract: A system and method for interacting with content, such as web-based markup content, using visual and voice browsers. A first browser facilitates communication in a first mode (e.g., an HTML browser that facilitates visual/tactile interaction with HTML content), and a second browser facilitates communication in a second mode (e.g., a VXML browser that facilitates audio interaction with VXML content). HTML and VXML content is created that: (1) indicates a correspondence between HTML and VXML pages that represent the same underlying content; and (2) contains specialized tags that indicate information to be send from one browser to the other to synchronize each browser to equivalent parts of the content. The HTML browser is adapted to use relative links as signals that information is to be sent to the VXML browser, and the platform on which the VXML browser runs is adapted to recognize a “hit” on its own port 80 as a signal that information is to be sent to the HTML browser.

Abstract: Combining speech with existing text wireless Short Message Service (SMS), to create a multimodal SMS service. A user of standard SMS text service is provided with a link within each message that allows adding or retrieval of a voice message associated with an SMS text message. A speech server in the wireless network may be used for recognition of voice commands, rendering of text into speech, and recording or playing back voice recordings. The messages may be retrieved or sent using any wireless handset. Additional services that may be used include message lists, prerecorded messages, integration with voicemail systems, image and video messages, cross-functional applications with Multimedia Messaging Services (MMS) and Enhanced Message Services (EMS), and extensions of the combination of voice with text SMS to other computing devices such as PDAs and PCs.

Abstract: A technique for synchronizing a visual browser and a voice browser. A visual browser is used to navigate through visual content, such as WML pages. During the navigation, the visual browser creates a historical record of events that have occurred during the navigation. The voice browser uses this historical record to navigate the content in the same manner as occurred on the visual browser, thereby synchronizing to a state equivalent to that of the visual browser. The creation of the historical record may be performed by using a script to trap events, where the script contains code that records the trapped events. The synchronization technique may be used with a multi-modal application that permits the mode of input/output (I/O) to be changed between visual and voice browsers. When the mode is changed from visual to voice, the record of events captured by the visual browser is provided to the voice browser, thereby allowing the I/O mode to change seamlessly from visual to voice.

Abstract: A technique for synchronizing a visual browser and a voice browser. A visual browser is used to navigate through visual content, such as WML pages. During the navigation, the visual browser creates a historical record of events that have occurred during the navigation. The voice browser uses this historical record to navigate the content in the same manner as occurred on the visual browser, thereby synchronizing to a state equivalent to that of the visual browser. The creation of the historical record may be performed by using a script to trap events, where the script contains code that records the trapped events. The synchronization technique may be used with a multi-modal application that permits the mode of input/output (I/O) to be changed between visual and voice browsers. When the mode is changed from visual to voice, the record of events captured by the visual browser is provided to the voice browser, thereby allowing the I/O mode to change seamlessly from visual to voice.

Abstract: A technique for synchronizing a visual browser and a voice browser. A visual browser is used to navigate through visual content, such as WML pages. During the navigation, the visual browser creates a historical record of events that have occurred during the navigation. The voice browser uses this historical record to navigate the content in the same manner as occurred-on the visual browser, thereby synchronizing to a state equivalent to that of the visual browser. The creation of the historical record may be performed by using a script to trap events, where the script contains code that records the trapped events. The synchronization technique may be used with a multi-modal application that permits the mode of input/output (I/O) to be changed between visual and voice browsers. When the mode is changed from visual to voice, the record of events captured by the visual browser is provided to the voice browser, thereby allowing the I/O mode to change seamlessly from visual to voice.

Abstract: A technique for providing multi-modal interaction with a directory. A user of a telephone set connects to a directory service, such as a directory assistance service that provides telephone numbers. The user interacts with the system, either by engaging in voice communications with a human operator, or by interacting with an automated system that employs voice recognition. The directory service then provides the requested information (e.g., a requested telephone number) to the user in the form of data that can be captured and used by the telephone—e.g., if the requested information is a telephone number, the telephone may store the data representation of that number in a contacts list, or place a call to the number without the user having to enter the number with a keypad.

Abstract: A system for enabling multi-modal bookmarks comprises a bookmark repository coupled to two browsers. A user bookmarks content using a first browser, and a bookmark is stored in the bookmark repository. The user subsequently uses a second browser and requests that the bookmark be de-referenced to point the second browser to the bookmarked content. The second browser accesses the bookmark in the content repository and is directed to the bookmarked content. The first and second browsers may be visual and voice browsers that render Wireless Markup Language (WML) and Voice Extensible Markup Language (VXML) content, respectively, wherein a mapping is provided that links a given piece of visual content to an equivalent piece of voice content.