Abstract: According to one general aspect, a method for supplementing input content with related content includes receiving the input content and identifying concepts from the input content. The method also includes identifying a taxonomy associated with the concepts, and analyzing the concepts using the taxonomy to generate a set of categorized concepts. The method also includes submitting the categorized concepts to a database to identify the related content and to supplement the input content with the related content.

Abstract: A system for multimodal information services includes a multimodal information service mechanism for providing the multimodal information services. An information user connects to a first network through at least one communication device, the first network connecting to the multimodal information service mechanism, the information user requesting and receiving the multimodal information services from the multimodal information service mechanism through the device. An information source connects to the multimodal information service mechanism via a second network, the information source providing multimodal information to the multimodal information service mechanism to facilitate the multimodal information services.