Abstract: One or more processor can automatically identify, structure and retrieve spatial and/or temporal sequences of digital media content according to semantic specification. Digital media content can be received and information from digital media content can be extracted. Based on the information, a knowledge graph can be constructed or structured to include at least one of spatial and temporal representation of the digital media content. A search query can be received associated with the digital media content. Based on traversing the knowledge graph structure according to at least one of spatial and temporal criterion mapped from the search query, new digital media content can be composed which meets the search query.

Abstract: A hybrid knowledge representation is searched for a machine learning component corresponding to a search query. The hybrid knowledge representation may be structured as nodes representing machine learning workflow components and edges (e.g., links) connecting the nodes based on relationships between the nodes. Responsive to finding the machine learning component in the hybrid knowledge representation, the machine learning component is returned. Responsive to not finding the machine learning component in the hybrid knowledge representation, the hybrid knowledge representation is searched for machine learning model fragments associated with building the machine learning component, generating a new machine learning component by combining the machine learning model fragments and returning the new machine learning component.

Abstract: Embodiments of the invention are directed to a computer-implemented method of generating a pathway recommendation. The computer-implemented method includes using a processor system to generate an intermediate three-dimensional (3D) virtual reality (VR) environment of a target environment. A machine learning algorithm is used to perform a machine learning task on the intermediate 3D VR environment to generate machine learning task results including predicted features of interest (FOI) and FOI annotations for the intermediate 3D VR environment. The processor system is used to generate, based at least in part on the machine learning task results, the pathway recommendation configured to assist a user with navigating and interpreting a 3D VR environment including the intermediate 3D VR environment having the pathway recommendation.

Abstract: Entities and temporal information associated with the entities can be extracted from the documents using natural language processing. A graph structure can be created representing the document's temporal semantics, nodes of the graph structure including the entities and edges of the graph structure representing temporal relationships between the nodes. The graph structure can be linked with the document. Multiple documents can be received and a knowledgebase can be created including multiple graph structures representing the multiple documents according to the multiple documents' temporal semantics. An input document for query can be received and transformed into a graph structure for query, the graph structure for query representing the input document's temporal semantics. The knowledgebase can be searched for a matching document having a graph structure similar to the graph structure for query based on a similarity threshold. The matching document can be output.

Abstract: Document retrieval through assertion analysis on entities and document fragments is disclosed. A document is received. Logical structures and entities are extracted from the document by parsing the document. For an entity in the extracted entities, an object representing the entity is created, an assertion made in the document associated with the entity is determined, and the assertion is linked to the object representing the entity. A logical structure from the extracted logical structures and content of the logical structure containing the assertion are identified and linked to the object representing the entity.

Abstract: Automatically mapping and combining the application of machine learning models to answer queries according to semantic specification. A query is parsed to extract keywords from the query and to contextualize the query. Based on the keywords, machine learning models are selected that process concepts associated with the keywords. The machine learning models are sorted according to the contextualization of the query. The machine learning models are run on multimodal data according to a sorted order, where data resulting from an output of one of the machine learning models is used as input to another one of the machine learning models. A query result is output based on a result from running the machine learning models.

Abstract: A method and system of creating a knowledge graph includes capturing information of a user interacting with given data, as user interaction data. The user interaction data is structured as a trail of actions over time. An ontology for a domain related to the user interaction data is received. Each action of the trail of actions is matched onto entities of the ontology. The knowledge graph is created based on the ontology having the matched actions.

Abstract: A computer-implemented method of performing an incremental specification of a query includes extracting text from each of a plurality of participants in a dialog. A contextual information is determined of the extracted text of one or more of the plurality of participants. A dialog understanding operation is performed by processing at least the contextual information of the extracted text in a knowledge graph to identify in the dialog at least one or more of a structural gap, an information about entities, relationships, and actions. Query information is provided responsive to the dialog for at least one of filling the identified structural gap, or for providing additional information about one or more of the identified entities, relationships or actions in the dialog.

Abstract: One or more processor can automatically identify, structure and retrieve spatial and/or temporal sequences of digital media content according to semantic specification. Digital media content can be received and information from digital media content can be extracted. Based on the information, a knowledge graph can be constructed or structured to include at least one of spatial and temporal representation of the digital media content. A search query can be received associated with the digital media content. Based on traversing the knowledge graph structure according to at least one of spatial and temporal criterion mapped from the search query, new digital media content can be composed which meets the search query.

Abstract: Embodiments of the invention are directed to a computer-implemented method of generating a pathway recommendation. The computer-implemented method includes using a processor system to generate an intermediate three-dimensional (3D) virtual reality (VR) environment of a target environment. A machine learning algorithm is used to perform a machine learning task on the intermediate 3D VR environment to generate machine learning task results including predicted features of interest (FOI) and FOI annotations for the intermediate 3D VR environment. The processor system is used to generate, based at least in part on the machine learning task results, the pathway recommendation configured to assist a user with navigating and interpreting a 3D VR environment including the intermediate 3D VR environment having the pathway recommendation.

Abstract: A system, product, and method including automatically performing extraction of slides from multimodal content, performing object extraction from each of the slides, allowing object substitution through semantics and concepts of the objects extracted, processing audio synchronized with the slides enriched with cognitive computing, search engine, and knowledge base, to provide annotations of the slides, processing the audio synchronized with the object being presented in each slide to enhance semantics and understanding, and curating for each step with human-machine interaction to provide a learning process by the system.

Abstract: A document may be received. An ontology associated with a domain may be identified or retrieved. A set of concepts in the document may be extracted, the set represented in the ontology. A set of concepts selected from the ontology may be received. A search may be performed based on the set of selected concepts.

Abstract: A system and associated processes may generate new modalities by receiving content associated with an original modality. An appropriateness of an alternative modality may be determined based on at least one of a device available to present the content, a user profile, and a contextual factor regarding an environment of a user intended to receive the content. Source content semantics associated with the content may be automatically determined, and an alternative modality based on the determined source content semantics may be generated and used to present the content to the user.

Abstract: Method and apparatus for monitoring collaboration parameters and maintaining user profiles using cognitive computing techniques are provided. The method includes receiving a domain for a first collaborative session, and retrieving a plurality of trait profiles associated with potential participants. The method further includes determining a subset of trait profiles based in part on comparing each respective trait profile with the rest of the trait profiles, and providing the subset of trait profiles. Additionally, the method includes receiving an indication that the subset of trait profiles is acceptable, and a request to initiate the first collaborative session with participants corresponding to the subset of trait profiles.

Abstract: A system and a method of generating and using a multimodal knowledge representation within an artificial intelligence computing system may include prompting a selection of nodes in a graphical visualization; defining an adaptation strategy based; integrating an adaptation strategy representation with the selection of nodes to generate a multimodal knowledge representation; traversing the selection of nodes in response to a user query; performing an adaptation on the selection of nodes; and updating the knowledge representation based on user feedback to a result generated in response to the user query.

Abstract: A system and associated processes may generate new modalities by receiving content associated with an original modality. An appropriateness of an alternative modality may be determined based on at least one of a device available to present the content, a user profile, and a contextual factor regarding an environment of a user intended to receive the content. Source content semantics associated with the content may be automatically determined, and an alternative modality based on the determined source content semantics may be generated and used to present the content to the user.

Abstract: A method and system of dynamically adapting a streaming media content are provided. A user device determines a class of each member of its audience. Streaming media content is received. The streaming media content is monitored to dynamically determine a rating of each segment of the streaming media content. For each segment of the streaming media content, upon determining that a rating of a segment is above a class of a most restricted member of the audience, one or more portions of the segment are adapted to alter the rating of the segment to the class of the most restricted member of the audience. The segment of the media content is then presented on a user interface of the user device.

Abstract: Systems and methods are described for mapping input devices in real time. The method may include controlling a camera to capture a plurality of images, performing object recognition on the images to identify a plurality of objects, determining properties for each identified object that enable the corresponding object to provide spatial data and interaction data of a preferred input device, ranking the objects according to the determined properties, presenting the identified objects in an order corresponding to the rank that enables a user to select one of the presented objects, tracking the selected object and a human being, generating spatial data and interaction data from a result of the tracking, and providing the generated spatial data and interaction data to a computer to emulate the events of the preferred input device.

Abstract: A document may be received. An ontology associated with a domain may be identified or retrieved. A set of concepts in the document may be extracted, the set represented in the ontology. A set of concepts selected from the ontology may be received. A search may be performed based on the set of selected concepts.

Abstract: Automatically identifying speakers in real-time through media processing with dialog understanding. A plurality of audio streams may be received, an audio stream representing a speech of a participant speaking during an online meeting. A voice characteristic of a voice corresponding to the speech of the participant in the audio stream may be determined. The plurality of audio streams may be converted into text and a natural language processing may be performed to determine content context of the dialog. The natural language processing infers a name to associate with the voice in the audio stream based on the determined content context. A data structure linking the name with the voice may be created and stored in a knowledge base. A user interface associated with the online meeting application is triggered to present the name or identity of the speaker.