Abstract: Techniques for generating a gallery view of tiles for in-area participants who are participating in an online meeting are disclosed. A video stream is accessed, where this stream includes an area view of an area in which an in-area participant is located. This area view comprises pixels representative of the area and pixels representative of the in-area participant. The pixels representative of the in-area participant are identified. A field of view of the in-area participant is generated. A tile of the in-area participant is generated based on the field of view. This tile is then displayed while the area view is not displayed.

Abstract: A method for facilitating a remote conference includes receiving a digital video and a computer-readable audio signal. A face recognition machine is operated to recognize a face of a first conference participant in the digital video, and a speech recognition machine is operated to translate the computer-readable audio signal into a first text. An attribution machine attributes the text to the first conference participant. A second computer-readable audio signal is processed similarly, to obtain a second text attributed to a second conference participant. A transcription machine automatically creates a transcript including the first text attributed to the first conference participant and the second text attributed to the second conference participant.

Abstract: The disclosure herein describes providing responses to natural language queries associated with transcripts at least by searching multiple indexes. A transcript associated with a communication among a plurality of speakers is obtained, wherein sets of artifact sections are identified in the transcript. A set of section indexes is generated from the transcript based on artifact type definitions. A natural language query associated with the transcript is analyzed using a natural language model and query metadata of the analyzed natural language query is obtained. At least one section index of the set of section indexes is selected based on the obtained query metadata and that selected at least one section index is searched. A response to the natural language query is provided including result data from the searched at least one search index, wherein the result data includes a reference to an artifact section referenced by the searched section index(es).

Abstract: A method for facilitating a remote conference includes receiving a digital video and a computer-readable audio signal. A face recognition machine is operated to recognize a face of a first conference participant in the digital video, and a speech recognition machine is operated to translate the computer-readable audio signal into a first text. An attribution machine attributes the text to the first conference participant. A second computer-readable audio signal is processed similarly, to obtain a second text attributed to a second conference participant. A transcription machine automatically creates a transcript including the first text attributed to the first conference participant and the second text attributed to the second conference participant.

Abstract: The disclosure herein describes providing responses to natural language queries associated with transcripts at least by searching multiple indexes. A transcript associated with a communication among a plurality of speakers is obtained, wherein sets of artifact sections are identified in the transcript. A set of section indexes is generated from the transcript based on artifact type definitions. A natural language query associated with the transcript is analyzed using a natural language model and query metadata of the analyzed natural language query is obtained. At least one section index of the set of section indexes is selected based on the obtained query metadata and that selected section index is searched. A response to the natural language query is provided including result data from the searched at least one search index, wherein the result data includes a reference to an artifact section referenced by the searched section index(es).

Abstract: Systems and methods are provided for configuring and utilizing botcasts, which comprise audio content with transitions corresponding to the audio content, to facilitate accessibility and presentation of the media content within the botcasts according to contextual relevance for different individual users. The systems identify, access, filter, augment, customize, personalize, create and/or otherwise configure the media content, as well as the content transitions in the botcasts, according to the individual preferences and profiles of each user, as well as the contextual circumstances for each user.

Abstract: The disclosure herein describes providing responses to natural language queries associated with transcripts at least by searching multiple indexes. A transcript associated with a communication among a plurality of speakers is obtained, wherein sets of artifact sections are identified in the transcript. A set of section indexes is generated from the transcript based on artifact type definitions. A natural language query associated with the transcript is analyzed using a natural language model and query metadata of the analyzed natural language query is obtained. At least one section index of the set of section indexes is selected based on the obtained query metadata and that selected at least one section index is searched. A response to the natural language query is provided including result data from the searched at least one search index, wherein the result data includes a reference to an artifact section referenced by the searched section index(es).

Abstract: A method for facilitating a remote conference includes receiving a digital video and a computer-readable audio signal. A face recognition machine is operated to recognize a face of a first conference participant in the digital video, and a speech recognition machine is operated to translate the computer-readable audio signal into a first text. An attribution machine attributes the text to the first conference participant. A second computer-readable audio signal is processed similarly, to obtain a second text attributed to a second conference participant. A transcription machine automatically creates a transcript including the first text attributed to the first conference participant and the second text attributed to the second conference participant.

Abstract: Automatically alternating between input modes on a computing device based on a usage pattern is provided. A first input mode is initiated for interacting with content displayed on the computing device. An input corresponding to a second input mode on the computing is then detected. A transition is then made from the first input mode to the second input mode on the computing device. Upon the detecting a termination of the input on the displayed content the second input mode, a gradual transition is made from the second input mode to the first input mode based on a current sensor state of the computing device and a threshold.

Abstract: Computer interfaces are provided for accessing and displaying content from disparate and remotely connected computer systems and that can be used for facilitating collaboration and visualization of physical and cloud resources for distributed event management. Systems are provided for generating, modifying, deploying, accessing, and otherwise managing the computer interfaces. Templates are used to build canvas interfaces that are contextually relevant for different entities based on the context of associated events and assigned roles of the entities with respect to the different events. The canvas interfaces can be used to access and orchestrate resources associated with the different events.

Abstract: A method for facilitating a remote conference includes receiving a digital video and a computer-readable audio signal. A face recognition machine is operated to recognize a face of a first conference participant in the digital video, and a speech recognition machine is operated to translate the computer-readable audio signal into a first text. An attribution machine attributes the text to the first conference participant. A second computer-readable audio signal is processed similarly, to obtain a second text attributed to a second conference participant. A transcription machine automatically creates a transcript including the first text attributed to the first conference participant and the second text attributed to the second conference participant.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for executing a command by a digital assistant in a group device environment are presented. A plurality of devices with digital assistants may be clustered for the duration of an event. One of the devices of the cluster may be assigned as an arbitrator device for the cluster. A user may issue a verbal command executable by a digital assistant of the cluster. The user that issued the verbal command may be identified via voice analysis. A determination may be made as to whether the verbal command corresponds to an intent to share content with a plurality of members of the cluster, or a specific member of the cluster, and a device of the cluster may be selected for executing a reply to the verbal command based on the determined intent and the executing device's presentation capabilities.

Abstract: A method for facilitating a remote conference includes receiving a digital video and a computer-readable audio signal. A face recognition machine is operated to recognize a face of a first conference participant in the digital video, and a speech recognition machine is operated to translate the computer-readable audio signal into a first text. An attribution machine attributes the text to the first conference participant. A second computer-readable audio signal is processed similarly, to obtain a second text attributed to a second conference participant. A transcription machine automatically creates a transcript including the first text attributed to the first conference participant and the second text attributed to the second conference participant.

Abstract: Computer interfaces are provided for accessing and displaying content from disparate and remotely connected computer systems and that can be used for facilitating collaboration and visualization of physical and cloud resources for distributed event management. Systems are provided for generating, modifying, deploying, accessing, and otherwise managing the computer interfaces. Templates are used to build canvas interfaces that are contextually relevant for different entities based on the context of associated events and assigned roles of the entities with respect to the different events. The canvas interfaces can be used to access and orchestrate resources associated with the different events.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for executing a command by a digital assistant in a group device environment are presented. A plurality of devices with digital assistants may be clustered for the duration of an event. One of the devices of the cluster may be assigned as an arbitrator device for the cluster. A user may issue a verbal command executable by a digital assistant of the cluster. The user that issued the verbal command may be identified via voice analysis. A determination may be made as to whether the verbal command corresponds to an intent to share content with a plurality of members of the cluster, or a specific member of the cluster, and a device of the cluster may be selected for executing a reply to the verbal command based on the determined intent and the executing device's presentation capabilities.

Abstract: Query understanding using integrated image capture and recognition is provided. A user is enabled to speak an utterance which is received by a digital assistant executing on a computing device. The utterance includes a spoken trigger, which is detected by the digital assistant and activates a camera integrated in or communicatively attached to the computing device. The camera captures an image of an object or person of interest. The utterance, the image, and temporally relevant context information are provided to an image integrated query system, which performs speech recognition and image processing on the utterance and the image for understanding the user intent. The understood intent is provided to the digital assistant, which operates to complete perform a search query or complete a task indicated in the integrated utterance and image data.

Abstract: A system for associating between a computerized model of multimodal human interaction and application functions, comprising: (a) An interface for receiving instructions from a programmer defining one or more application functions. (b) A memory storing hand gestures each defined by a dataset of discrete pose values and discrete motion values. (c) A code store storing a code. (d) One or more processors coupled to the interface, the memory and the code store for executing the stored code which comprises: (1) Code instructions to define a logical sequence of user input per instructions of the programmer. The logical sequence combines hand gestures with non-gesture user input. (2) Code instructions to associate the logical sequence with the application function(s) for initiating an execution of the application function(s) during runtime of the application in response to detection of the logical sequence by analyzing a captured data depicting a user during runtime.

Abstract: Automatically alternating between input modes on a computing device based on a usage pattern is provided. A first input mode is initiated for interacting with content displayed on the computing device. An input corresponding to a second input mode on the computing is then detected. A transition is then made from the first input mode to the second input mode on the computing device. Upon the detecting a termination of the input on the displayed content the second input mode, a gradual transition is made from the second input mode to the first input mode based on a current sensor state of the computing device and a threshold.

Abstract: Automatically alternating between input modes on a computing device based on a usage pattern is provided. A first input mode is initiated for interacting with content displayed on the computing device. An input corresponding to a second input mode on the computing is then detected. A transition is then made from the first input mode to the second input mode on the computing device. Upon the detecting a termination of the input on the displayed content the second input mode, a gradual transition is made from the second input mode to the first input mode based on a current sensor state of the computing device and a threshold.

Abstract: A system for associating between a computerized model of multimodal human interaction and application functions, comprising: (a) An interface for receiving instructions from a programmer defining one or more application functions. (b) A memory storing hand gestures each defined by a dataset of discrete pose values and discrete motion values. (c) A code store storing a code. (d) One or more processors coupled to the interface, the memory and the code store for executing the stored code which comprises: (1) Code instructions to define a logical sequence of user input per instructions of the programmer. The logical sequence combines hand gestures with non-gesture user input. (2) Code instructions to associate the logical sequence with the application function(s) for initiating an execution of the application function(s) during runtime of the application in response to detection of the logical sequence by analyzing a captured data depicting a user during runtime.