Abstract: A system for synchronizing multiple modalities is described. A user may use multiple modalities, such as voice and browser, to interact with data on a network, such as the World Wide Web. All of the modalities may be synchronized so that all are updated when the user enters information in just one. A method of communicating between devices includes receiving a request for first-modality data that includes first content, and sending a message in response to receiving the request, the message including information allowing the request of second-modality data that includes second content overlapping the first content. Another method includes requesting first data for a first modality, the first data including first content, and automatically requesting second data for a second modality, wherein the second data includes second content that overlaps the first content.

Abstract: A particular logging framework provides empirical data on the use of a multi-modal system. The system receives user input in one of multiple modalities, and responds to the received single-modality input by updating a user interface in each of the multiple modalities. The user may respond, using an appropriate modality, to any of the multiple updated user interfaces. User inputs in each of the multiple modalities are logged and time-stamped to create an event log across all modalities for the user. Event logs may be analyzed or used to provide, for example, system improvements, technical support, replay of events, or monitoring of a user. Another logging framework logs events at a field-level from a user of a system. Another logging framework logs events from a user of a system and modifies a presentation parameter based on the logged user events, wherein content is presented to the user according to the presentation parameter.

Abstract: A system for synchronizing multiple modalities is described. A user may use multiple modalities, such as voice and browser, to interact with data on a network, such as the World Wide Web. All of the modalities may be synchronized so that all are updated when the user enters information in just one. A method of communicating between devices includes receiving a request for first-modality data that includes first content, and sending a message in response to receiving the request, the message including information allowing the request of second-modality data that includes second content overlapping the first content. Another method includes requesting first data for a first modality, the first data including first content, and automatically requesting second data for a second modality, wherein the second data includes second content that overlaps the first content.