Abstract: The techniques disclosed herein improve the efficiency of a system by providing intelligent agents for managing data associated with objects that are displayed within mixed-reality and virtual-reality collaboration environments. Individual agents are configured to collect, analyze, and store data associated with individual objects in a shared view. The agents can identify real-world objects and virtual objects discussed in a meeting, collect information about each object and store the collected information in an associated database for access across multiple collaboration environments or communication sessions. The data can be shared between different communication sessions without requiring users to manually store and present a collection of content for each object. The intelligent agents and their associated databases can also persist through different communication sessions to enhance user engagement and improve productivity.

Abstract: A system can minimize the use of a central computing resource while detecting and correcting visual anomalies that may result from a compilation of video streams from a variety of sources. The central resource can receive device specification data defining parameters on how remote computers measure image properties and generate video data, e.g., camera sensitivity levels, image generation capabilities, etc. The central resource then uses the device specification data to generate calibration metadata that allows each client device to analyze light levels and generate image data according to a normalized standard. This allows each of the clients to generate more consistent video images to be shared in a video communication session. In some configurations, the calibration metadata causes each client device to make the adjustments automatically, and in some instances, video streams can be corrected according to a ranked list of adjustments.

Abstract: The disclosed techniques improve user engagement and promote efficient use of computing resources by providing dynamically controlled aspect ratios for communication session renderings based on a physical orientation of a device. In some configurations, a system can select a first aspect ratio for individual video streams of a communication session when a device is in a first orientation, e.g., a portrait orientation. In addition, the system can select a second aspect ratio for the individual video streams when the device is in a second orientation, e.g., a landscape orientation. In some configurations, the first aspect ratio can be greater than the second aspect ratio, or the aspect ratios can be selected based on a target aspect ratio, which can be adjusted over time. By dynamically selecting an aspect ratio for individual stream renderings, screen space of a device can be optimized while the device is held in various physical orientations.

Abstract: A system provides automated transitions between presenters of a communication session. During a meeting, a system can provide a user interface that includes a primary presenter region configured to display a rendering of a presenter and the presenter's shared content. The user interface can also provide an audience region, which may include a number of individual video streams of audience members arranged in virtual environment. When the system determines that an individual audience member raises their hand, the system generates a graphical notification indicating that the person raised their hand. The system can also automatically add that individual audience member to a presenter queue. When the first presenter completes their presentation, the system can automatically transition the user listed in the presenter queue to the primary presenter region or a secondary presenter region. The system can also automatically change permissions for users that initiate a transition to a presenter role.

Abstract: The techniques disclosed herein improve existing systems by providing a system that automatically generates a scalable summary with adaptable graphical associations between people and content. The system can select a level of detail that can be applied to a process for generating a summary of content. The level of detail can be based on a user's engagement with respect to one or more events. The system can improve the usability of the summary by selecting a level of detail that is optimized for the user's contextual status. The system also improves the user's interaction with a computer by providing an adaptable layout of information indicating a source of content. The adaptable layout allows users to readily identify topics, content sources, and high-priority summary sections regardless of the level of detail that is selected for the summary.

Abstract: The techniques disclosed herein improve the efficiency of a system by providing intelligent agents for managing data associated with objects that are displayed within mixed-reality and virtual-reality collaboration environments and facilitating communication between the agents and computing devices associated with the collaboration environments. Individual agents are configured to collect, analyze, and store data associated with individual objects in a database associated with the agent . The agents are further configured to receive queries from the computing devices regarding an individual object. Agents can respond to queries by presenting relevant information collected by the agent with a view of the queried object of interest In addition, the data stored by the agents can be shared between different collaboration environments without requiring users to manually store and present a collection of content for each object.

Abstract: The disclosed techniques optimize the use of computing resources and user engagement by dynamically displaying a group of users of a communication session within a designated display area where each user of the group each share a common activity factor. For example, participants can be part of a group displayed in a certain section of a user interface or on a particular display screen if they each share a location, a role, a set of permissions, a team, a contribution level, etc. A system can also allow users of a group to exclusively control content that is displayed within a designated display area associated with the group. By dynamically displaying a group of users and content they control within designated display area by the use of a common activity factor, a system can improve user engagement by enabling users to readily identify people of interest.

Abstract: The present disclosure provides a number of techniques for enhancing a user's experience when joining teleconference sessions with multiple devices. When a user attempts to join a teleconference session using the same user identity for multiple devices, a system differentiates the devices as a primary device and at least one companion device. The primary device has a first control set for controlling a teleconference session and the at least one companion device has a companion control set for sharing content. In some embodiments, the primary device also has one set of selected streams, e.g., a stage view, and the companion device has a subset of those streams or other streams based on an activity level. In addition, the present disclosure provides a number of techniques for enabling users to share content using the companion devices.

Abstract: The techniques disclosed herein improve existing systems by providing a system that receives a settings profile associated with a first application. The settings profile is stored. When it is determined that a second application has unconfigured settings, the stored settings profile is accessed and based on the stored settings profile, the unconfigured settings are automatically configured.

Abstract: The techniques disclosed herein provide automatic escalation and de-escalation of roles and permissions based on user activity of a communication system. Initial event parameters, such as an event attendee list and a meeting type, can be established by a user input. The system can then determine an initial set of roles and permissions for each attendee. A system can then monitor user activity associated with the event to generate a queue of activities. When the system detects that one or more activities satisfies given criteria, the system can escalate or de-escalate the roles and permissions for specific attendees. By dynamically controlling granular levels of permissions in a timely manner based on the detection of specific activities, a system can improve the security of stored data as well as improve the efficiency of detected collaborative event scenarios.

Abstract: The techniques disclosed herein improve existing systems by automatically identifying tasks from a number of different types of user activity and providing suggestions for the tasks to one or more selected delivery mechanisms. A system compiles the tasks and pushes each task to a personalized task list of a user. The delivery of each task may be based on any suitable user activity, which may include communication between one or more users or a user's interaction with a particular file or a system. The system can identify timelines, performance parameters, and other related contextual data associated with the task. The system can identify a delivery schedule for the task to optimize the effectiveness of the delivery of the task. The system can also provide smart notifications. When a task conflicts with a person's calendar, the system can resolve scheduling conflicts based on priorities of a calendar event.

Abstract: The disclosed techniques optimize the use of computing resources by dynamically positioning content views based on a location of a camera relative to a display screen. The dynamically positioned content views are positioned in proximity to a camera to guide an eye gaze direction of a presenter toward a camera generating video data for transmission to remote devices participating in a communication session. The described systems improve a presenter's ability to direct eye contact toward a camera to allow for effective communication of gestures with an audience receiving a stream from the camera. A position, size and/or shape of a content view can be based on a camera position relative to a display screen to improve the accessibility and efficiencies of computing resources.

Abstract: The present disclosure provides a number of techniques for enhancing a user's experience when joining teleconference sessions. When multiple users join a teleconference session using separate devices, a system identifies devices that are co-located. The co-located devices are identified by the use of a combination of data including, but not limited to social signals, audio signal and other location data. At least one device of the co-located devices, has a first control set for controlling a teleconference session and other devices of the co-located devices have a second control set for sharing content. The at least one device also has one set of streams and the other devices see a subset of those streams or other streams based on an activity level. In addition, the present disclosure provides a number of techniques for enabling users to use multiple devices to share content.

Abstract: A system and method directed to determining one or more polls that a user may have missed during a period of inactivity is provided. Initially, a polling system may determine that a user is now active and may determine one or more polls that were created for or assigned to a user, or a group to which the user belongs, during the period of inactivity. The polling system may then surface a notification and/or an input window such that a user may provide polling input. In some instances, a user may have missed multiple polls; the polls presented to the user may be based on recent user activity and/or whether such missed polls are still live, or open.

Abstract: The techniques provided herein improve existing systems by automatically generating summaries of a document in response to a user input that defines selected segments of a document. The document can include any type of content such as, but not limited to, channel conversations, chat threads, transcripts, word processing documents, spreadsheets, etc. As the user indicates a selection of segments, a system can dynamically update a summary of the segments to inform a user of salient information that is shared in the selected segments. A summary can include a text description of the information having a threshold priority level. A system can analyze documents that are referenced within the selected segments and provide summaries of the documents. The techniques disclosed herein also provide a number of graphical elements that communicate additional context of each part of the summary.

Abstract: The techniques disclosed herein improve existing systems by automatically identifying tasks from a number of different types of user activity and providing suggestions for the tasks to one or more selected delivery mechanisms. A system compiles the tasks and pushes each task to a personalized task list of a user. The delivery of each task may be based on any suitable user activity, which may include communication between one or more users or a user's interaction with a particular file or a system. The system can identify timelines, performance parameters, and other related contextual data associated with the task. The system can identify a delivery schedule for the task to optimize the effectiveness of the delivery of the task. The system can also provide smart notifications. When a task conflicts with a person's calendar, the system can resolve scheduling conflicts based on priorities of a calendar event.

Abstract: The disclosed techniques improve user engagement and promote efficient use of computing resources by providing dynamically controlled aspect ratios for communication session renderings based on a physical orientation of a device. In some configurations, a system can select a first aspect ratio for individual video streams of a communication session when a device is in a first orientation, e.g., a portrait orientation. In addition, the system can select a second aspect ratio for the individual video streams when the device is in a second orientation, e.g., a landscape orientation. In some configurations, the first aspect ratio can be greater than the second aspect ratio, or the aspect ratios can be selected based on a target aspect ratio, which can be adjusted over time. By dynamically selecting an aspect ratio for individual stream renderings, screen space of a device can be optimized while the device is held in various physical orientations.

Abstract: The techniques disclosed herein improve the efficiency of a system by providing intelligent management of content that is associated with objects displayed within communication sessions. The participants can generate a content object associated with a 3D object. The content object may be in the form of 3D virtual object such as an arrow pointing to the table, a text box of an annotation, etc. The content object may also include functional features that collect and display information voting agent. The system can generate a data structure that associates the object with the content object. The data structure enables a system to maintain an association between the object and the content object when various operations are applied to either object. Thus, if a remote computer sends a request for the content object, the associated object is delivered with the content object.

Abstract: The provided techniques improve user engagement and more efficient use of computing resources by dynamically configuring video stream arrangements based on an aspect ratio of an available display area and a target aspect ratio. Such techniques provide dynamically optimized user interface arrangements that accommodate any given shape of an available display area. The techniques can also help viewers maintain focus on the salient content of a multi-stream display when users resize a display window, move a window to a random shape, rotate a device, join a communication session, leave a communication session, present content streams, remove content streams, etc. A target aspect ratio can be utilized in a process to recursively divide a display area horizontally or vertically to accommodate any number of stream renderings. An adjustment of the target aspect can allow for an optimal display any number of video stream renderings for any shape of a display screen.

Abstract: The provided techniques improve user engagement and more efficient use of computing resources by dynamically configuring video stream arrangements based on an aspect ratio of an available display area and a target aspect ratio. Such techniques provide dynamically optimized user interface arrangements that accommodate any given shape of an available display area. The techniques can also help viewers maintain focus on the salient content of a multi-stream display when users resize a display window, move a window to a random shape, rotate a device, join a communication session, leave a communication session, present content streams, remove content streams, etc. A target aspect ratio can be utilized in a process to recursively divide a display area horizontally or vertically to accommodate any number of stream renderings. An adjustment of the target aspect can allow for an optimal display any number of video stream renderings for any shape of a display screen.