Abstract: Multi-modal search systems with improved search request routing are provided. A device can include a module that identifies, based on content of a search request, provider criterion that indicates factors to be considered in making a routing decision, a criterion processor that determines, based on the provider criterion, a routing decision indicating whether to route the search request to a search engine or a chat engine based, at least in part, respective compute costs of servicing the search request using the search engine and the chat engine, respectively, and respective accuracies of responses provided responsive to the search request using the search engine and the chat engine, respectively, and an output port coupled to receive the search request and to provide the search request to the search engine or the chat engine in accord with the routing decision.

Abstract: Multi-modal search systems with improved search request routing are provided. A device can include a module that identifies, based on content of a search request, provider criterion that indicates factors to be considered in making a routing decision, a criterion processor that determines, based on the provider criterion, a routing decision indicating whether to route the search request to a search engine or a chat engine based, at least in part, respective compute costs of servicing the search request using the search engine and the chat engine, respectively, and respective accuracies of responses provided responsive to the search request using the search engine and the chat engine, respectively, and an output port coupled to receive the search request and to provide the search request to the search engine or the chat engine in accord with the routing decision.

Abstract: Methods, computer systems, computer-storage media, and graphical user interfaces are provided for efficiently generating and using intent taxonomies. In embodiments, training data, including data requests for information, is obtained. Thereafter, a model prompt to be input into a large language model is generated. The model prompt includes an instruction to generate an intent taxonomy, an indication of the training data to use for generating the intent taxonomy, and a taxonomy attribute desired to be used as criteria to generate a quality intent taxonomy. An intent taxonomy that includes user intent classes is obtained as output from the large language model. The intent taxonomy is analyzed to determine whether the intent taxonomy is valid. When the intent taxonomy is determined as valid, the intent taxonomy is provided for use in identifying user intent, and when the intent taxonomy is determined as invalid, the intent taxonomy is refined.

Abstract: The present disclosure relates to systems and methods for an interactive, intelligent hub built around the completion of a task. This hub brings together resources, information, suggested steps, and other automated assistance to facilitate the completion of the task. AI-based assistance may indicate which steps can be completed by automated processes, and dispatch those processes, or suggest resources to assist in the completion of other steps. The hub displays the current status of the task, and lives until the completion of the task, or abandonment by the user.

Abstract: The present disclosure relates to systems and methods for an interactive, intelligent hub built around the completion of a task. This hub brings together resources, information, suggested steps, and other automated assistance to facilitate the completion of the task. AI-based assistance may indicate which steps can be completed by automated processes, and dispatch those processes, or suggest resources to assist in the completion of other steps. The hub displays the current status of the task, and lives until the completion of the task, or abandonment by the user.

Abstract: A system and method to provide computer support for a meeting of invitees comprises accessing one or more sensory data streams providing digitized sensory data responsive to an activity of one or more of the invitees during the meeting, the one or more sensory data streams including at least one audio stream. The method also comprises subjecting the at least one audio stream to phonetic and situational computer modeling to recognize a sequence of words in the audio stream and to assign each word to an invitee, subjecting the sequence of words to semantic computer modeling to recognize a sequence of directives in the sequence of words, and releasing one or more output data streams based on the sequence of directives, the one or more output data streams including one or more notifications.

Abstract: Recommending one or more relevant skills to a user that are appropriate for the user's current context is provided. A machine learning contextual skills model is trained on data associated with skills that are invoked by the particular user and by various users and context data that defines characteristics of the context of the users, the users' computing devices, and the users' environments in association with the invoked skills. Responsive to a trigger event associated with the user and a computing device, current context data and user data is collected and passed to the contextual skills system. The contextual skills model is applied to the collected data and generates a ranked list of skills. One or more top-ranking skills are selected and provided to the user as one or more skill recommendations that are determined to be relevant to the user and relevant to the user's current context.

Abstract: A system and method to provide computer support for a meeting of invitees comprises accessing one or more sensory data streams providing digitized sensory data responsive to an activity of one or more of the invitees during the meeting, the one or more sensory data streams including at least one audio stream. The method also comprises subjecting the at least one audio stream to phonetic and situational computer modeling to recognize a sequence of words in the audio stream and to assign each word to an invitee, subjecting the sequence of words to semantic computer modeling to recognize a sequence of directives in the sequence of words, and releasing one or more output data streams based on the sequence of directives, the one or more output data streams including one or more notifications.

Abstract: Biases in search and retrieval (i.e., situations where searchers seek or are presented with information that significantly deviates from the truth) may be detected by comparison to one or more authoritative sources. Once bias or potential bias is detected, techniques may be applied to indicate and/or compensate for the bias. Such techniques may allow users to more easily assess the veracity of search results, and increase the chances that users will locate accurate answers to their questions.

Abstract: The present disclosure provides systems and methods for user interaction and task completion using multiple devices. A set of devices may be used to perform a task, such that different devices may perform different steps of the task. A device management service may update state information at each device of the set, thereby enabling a user to interact with any of the computing devices to perform the task. A device management service may also automatically determine which device should be used by the user, based on task or step requirements, device characteristics, and device capabilities, among other examples. Thus, rather than being required to continue a task on the same device (even when the device is not well-suited for the current step or task), the user is provided with the option to use and, in some instances, is automatically transitioned to use, different devices within the set.

Abstract: A method for monitoring quality of a conferencing session between a plurality of participant devices is described. One or more data streams of the conferencing session are monitored. Presenter contextual information is determined for media transmitted over the one or more data streams by a presenter device of the plurality of participant devices. A mismatch is identified between the presenter contextual information and a first participant contextual information for a first participant device of the plurality of participant devices. A mismatch notification is provided to the presenter device for an identified mismatch.

Abstract: Generally discussed herein are devices, systems, and methods for contextual messaging in a conference. A method can include receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference, while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied, responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data, and providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

Abstract: Generally discussed herein are devices, systems, and methods for eye contact assistance in a video conference. A method can include determining a location of the web camera relative to a display, providing a user interface of the video conference on the display, and providing, on the user interface, a graphic display of information at pixels of the display that are most proximate the location.

Abstract: The present disclosure provides systems and methods for user interaction and task completion using multiple devices. A set of devices may be used to perform a task, such that different devices may perform different steps of the task. A device management service may update state information at each device of the set, thereby enabling a user to interact with any of the computing devices to perform the task. A device management service may also automatically determine which device should be used by the user, based on task or step requirements, device characteristics, and device capabilities, among other examples. Thus, rather than being required to continue a task on the same device (even when the device is not well-suited for the current step or task), the user is provided with the option to use and, in some instances, is automatically transitioned to use, different devices within the set.

Abstract: Generally discussed herein are devices, systems, and methods for contextual messaging in a conference. A method can include receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference, while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied, responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data, and providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

Abstract: Generally discussed herein are devices, systems, and methods for eye contact assistance in a video conference. A method can include determining a location of the web camera relative to a display, providing a user interface of the video conference on the display, and providing, on the user interface, a graphic display of information at pixels of the display that are most proximate the location.

Abstract: Generally discussed herein are devices, systems, and methods for eye contact assistance in a video conference. A method can include determining a location of the web camera relative to a display, providing a user interface of the video conference on the display, and providing, on the user interface, a graphic display of information at pixels of the display that are most proximate the location.

Abstract: Methods and systems are disclosed for scheduling a task of a user based on a cyber-physical-social (CPS) context of activities. The present disclosure is directed to increasing the efficiency of performing tasks by grouping tasks with the same or similar task CPS contexts so that they are performed in conjunction with one another. A stream of user activities is received that encompasses the CPS context, tasks are identified and classified based on a CPS context model. The CPS model is trained using CPS context and annotations for identified tasks as input to create classes of tasks. The classes of tasks from the model are used to group similar tasks. The present disclosure enables users to receive recommendations on clustering tasks with the same or similar contexts based on an online tool, a location, and collaborators to be performed together to improve productivity.

Abstract: A device includes a memory that stores a prefetching model. A control module receives a content page including one or more links each associated with selectable content and collects data associated with the content page. The collected data includes at least one of first data indicative of respective relationships between each of the links and a viewport of the device and second data indicative of characteristics of the viewport. The control module further assigns, using the prefetching model, respective scores to each of the links based on the collected data, and selectively generates, based on the assigned scores, a request to prefetch the selectable content associated with at least one of the links.

Abstract: Generally discussed herein are devices, systems, and methods for contextual messaging in a conference. A method can include receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference, while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied, responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data, and providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.