Abstract: To integrate telephony with Web-based information services, and develop multi-modal telephony applications that combine graphical input and output with traditional speech-based user interfaces, a Web server for handling information which is in these different modal forms, has an internet interface for supporting connections on the internet, and a terminal interface for supporting connections from the server to user terminals, and for passing information in at least one of the modal forms. A service controller controls input or output of the information on the interfaces, and processes the information received from or sent to either interface, according to its modal form.

Abstract: Management of speech and audio prompts, and interface presence, in multimodal user interfaces is provided. A communications device having a multimodal user interface including a speech interface, and a non-speech interface, e.g. a graphical or tactile user interface, comprises means for dynamically switching between a background state of the speech interface and a foreground state of the speech interface in accordance with a users input modality choice. Preferably, in the foreground state speech prompts and speech based error recovery are fully implemented and in a background state speech prompts are replaced by earcons, and no speech based error recovery is implemented. Thus there is provided a device which automatically subdue the speech prompts when a user selects a non-speech input/output mechanism.