Abstract: The techniques disclosed herein improve the efficiency of a system by providing intelligent agents for managing data associated with objects that are displayed within mixed-reality and virtual-reality collaboration environments. Individual agents are configured to collect, analyze, and store data associated with individual objects in a shared view. The agents can identify real-world objects and virtual objects discussed in a meeting, collect information about each object and store the collected information in an associated database for access across multiple collaboration environments or communication sessions. The data can be shared between different communication sessions without requiring users to manually store and present a collection of content for each object. The intelligent agents and their associated databases can also persist through different communication sessions to enhance user engagement and improve productivity.

Abstract: The disclosed techniques improve user engagement and promote efficient use of computing resources by providing dynamically controlled aspect ratios for communication session renderings based on a physical orientation of a device. In some configurations, a system can select a first aspect ratio for individual video streams of a communication session when a device is in a first orientation, e.g., a portrait orientation. In addition, the system can select a second aspect ratio for the individual video streams when the device is in a second orientation, e.g., a landscape orientation. In some configurations, the first aspect ratio can be greater than the second aspect ratio, or the aspect ratios can be selected based on a target aspect ratio, which can be adjusted over time. By dynamically selecting an aspect ratio for individual stream renderings, screen space of a device can be optimized while the device is held in various physical orientations.

Abstract: The disclosed techniques improve user engagement and promote efficient use of computing resources by providing dynamically controlled aspect ratios for communication session renderings based on a physical orientation of a device. In some configurations, a system can select a first aspect ratio for individual video streams of a communication session when a device is in a first orientation, e.g., a portrait orientation. In addition, the system can select a second aspect ratio for the individual video streams when the device is in a second orientation, e.g., a landscape orientation. In some configurations, the first aspect ratio can be greater than the second aspect ratio, or the aspect ratios can be selected based on a target aspect ratio, which can be adjusted over time. By dynamically selecting an aspect ratio for individual stream renderings, screen space of a device can be optimized while the device is held in various physical orientations.

Abstract: An improved human-computer interface for placing and sizing virtual objects in a three-dimensional (“3D”) representation of a real-world environment is disclosed herein. The disclosed HCI can determine a location, size, and orientation of virtual objects in a 3D representation of a real-world environment based on simplified user gestures. In some embodiments, based on the timing and direction of an input gesture, a computing device can utilize (1) an automated mode that determines a position and orientation of a virtual object or utilize (2) a manual mode that determines position, orientation, and size of the virtual object. A computing device capable of 3D spatial mapping generates mesh data defining a 3D representation of a real-world environment and images of the real-world environment. The size of the virtual object can be based on a computed depth of real-world objects related to the virtual object.

Abstract: Described herein is a system that enables a user to filter notable events, representations for which are presented on an interactive timeline associated with a teleconference session or a collaboration environment. The filtering can be implemented based on a type of a notable event and/or based on a specific notable event. The system is also configured to enable a user to search for instances of a type of event and instances of a specific notable event. The system is configured to provide results to the search request that list the teleconference sessions that include the located instances. The user can then select a teleconference session from the results to view an interactive timeline that includes representations of the located instances. Consequently, the system provides a tool that enables a user to efficiently and effectively locate events on an interactive timeline that are desirable (e.g., activity the user wants to view).

Abstract: The techniques disclosed herein improve existing computing systems by providing consistent interaction models during communication sessions. A system configured according to the disclosure presented herein can improve user engagement during communication sessions and conserve computing resources by enabling users to define arrangements of display areas in a user interface (UI) for presenting content during a communication session and to utilize the same pre-defined arrangement during multiple communication sessions. The arrangement can be presented to all or some of the participants in a communication session. By providing a consistent arrangement of display areas that render content to participants in communication sessions, the participants can be more engaged and productive, thereby improving human-computer interaction and conserving computing resources.

Abstract: A system and method directed to determining one or more polls that a user may have missed during a period of inactivity is provided. Initially, a polling system may determine that a user is now active and may determine one or more polls that were created for or assigned to a user, or a group to which the user belongs, during the period of inactivity. The polling system may then surface a notification and/or an input window such that a user may provide polling input. In some instances, a user may have missed multiple polls; the polls presented to the user may be based on recent user activity and/or whether such missed polls are still live, or open.

Abstract: A system and method of displaying a graphical element associated with a poll in a calendar view is provided. Initially, a polling system may determine that a response from a user has not been provided to a poll event. Accordingly, poll information associated with the poll event may be received, where the poll information may indicate a start and end time of a poll. A time slot based on the poll information may be determined which may cause a graphical element for the poll event to be displayed in the calendar view of the user at the determined time slot. In some instances, the graphical element may be provided when a user has missed or otherwise has not provided input into a poll event.

Abstract: A system and method for displaying a dashboard interface associated with a plurality of polls is provided. The system and method may receive a user identifier uniquely identifying a user of a system, determine one or more organizational units associated with the user identifier, and cause a dashboard interface associated with a plurality of polls to be rendered at a display, wherein information of a first poll associated with a first organizational unit of the one or more organizational units is provided in a first portion of the dashboard interface and information of a second poll associated with a second organizational unit of the one or more organizational units is provided in a second portion of the dashboard interface.

Abstract: The techniques disclosed herein improve the efficiency of a system by providing intelligent agents for managing data associated with objects that are displayed within mixed-reality and virtual-reality collaboration environments. Individual agents are configured to collect, analyze, and store data associated with individual objects in a shared view. The agents can identify real-world objects and virtual objects discussed in a meeting, collect information about each object and generate recommendations for each object based on the collected information. The recommendations can suggest modifications to the objects, provide resources for obtaining or modifying the objects, and provide actionable information allowing users to reach a consensus regarding an object. The data can be shared between different communication sessions without requiring users to manually store and present a collection of content for each object.

Abstract: The disclosed system implements techniques to identify activity in which attendees to a communication session likely have a greater interest. Prior to commencement of a communication session or during the communication session, the techniques enable a list of attendees to a communication session to be designated as a group for which detected activity has a priority with respect to being displayed. The designated list of attendees is a subset of a total number of attendees to the communication session. The system monitors streams associated with individual attendees on the list to detect an occurrence of a preset target event. The system configures a portion of a graphical user interface of the communication session to accentuate the stream that includes the occurrence of the preset target event.

Abstract: A tool for interacting with a rendered environment is configured to render a representation of a real-world environment. Input data is received that is indicative of a position for a zoom window to be placed within the representation. The zoom window is rendered at the position within the representation and has a size that is determined based on one or more criteria. Within the zoom window, a magnified view of a portion of the representation is rendered that is proximate to the position of the zoom window. Input data is received that is indicative of a first gesture applied to the zoom window and is indicative of a resizing of the zoom window. The zoom window is resized on the UI in accordance with the first gesture, and a scale of the magnified view within the zoom window is maintained as the zoom window is resized. Input data is received that is indicative of a second gesture applied to the zoom window and indicative of a change to a zoom scale for content within the zoom window.

Abstract: Techniques for providing intelligent notifications including detecting an event associated with a user. User data is analyzed to determine whether a notification is to be generated for the event. The user data relates to the activities, preferences, and learned behaviors of a user with respect to one or more applications and/or past notifications. When a notification is to be generated, an emphasis level can be determined for the notification. The notification can include one or more selectable options that enable a user to respond to the notification and/or perform an action in response to the notification.

Abstract: In a device including a processor and a computer-readable medium, the computer-readable medium includes executable instructions causing the processor to control the device to perform functions of (i) displaying, via a display, a GUI for a first communication application, the GUI including a first portion displaying content of a first communication session associated with the first communication application, wherein participants of the first communication session includes a user of the device, and a second portion including a plurality of graphical elements, each graphical element associated with one of a plurality of functionalities related to a second communication application different from the first communication application; (ii) detecting an activity related to a second communication session associated with the second communication application; and (iii) in response to detecting the activity, displaying, via the second portion of the GUI, an indication of the detected activity related to the second commu

Abstract: The techniques disclosed herein improve user engagement and more efficient use of computing resources by providing dynamically controlled view states for communication sessions based on a number of people depicted in shared video streams. In some configurations, a system can control the size and position of a video rendering based on the number of individuals depicted in a video stream. In some configurations, a stream depicting a threshold number of people can be rendered in the primary display area and other streams can be rendered in a secondary section. The primary area can be sized to scale a video depicting multiple people video to equalize the size of the people with renderings of single-person video streams. This helps a system provide a more granular level of control to equalize the representation of each person displayed within different video streams.

Abstract: The disclosed techniques improve user engagement and more efficient use of computing resources by providing dynamically controlled aspect ratios for communication session renderings based on a number of people depicted in shared video streams. A system can identify select streams depicting at least a threshold number of individuals. A first aspect ratio can be selected from a number of preset aspect ratios for the display of select streams depicting at least the threshold number of individuals. A second aspect ratio can be selected for the display of other individual streams having video components depicting less than the threshold number of individuals. In some embodiments, the first aspect ratio is greater than the second aspect ratio. By switching between aspect ratios depending on a number of individuals depicted in each video stream, a system can improve user engagement by equalizing the display each person participating in a communication session.

Abstract: System and techniques to implement a control bar on a display device for a communication session are described herein. A user interface is provided for the communication session to display on the display device. Here, the user interface includes a control bar and a session display area that provides a view of the communication session. In response to the number of users participating in the communication session increasing beyond a predefined criterion, the displayed user interface is updated by applying a modification to the control bar that includes moving the control bar from a current location to one of several pre-defined locations on the display device or reducing a size of the control bar. The session display area can then be expanded to occupy a space on the display device that was previously occupied by the control bar before the modification was applied to the control bar.

Abstract: The techniques disclosed herein improve existing systems by providing a system that automatically generates a scalable summary with adaptable graphical associations between people and content. The system can select a level of detail that can be applied to a process for generating a summary of content. The level of detail can be based on a user's engagement with respect to one or more events. The system can improve the usability of the summary by selecting a level of detail that is optimized for the user's contextual status. The system also improves the user's interaction with a computer by providing an adaptable layout of information indicating a source of content. The adaptable layout allows users to readily identify topics, content sources, and high-priority summary sections regardless of the level of detail that is selected for the summary.

Abstract: In a device including a processor and a memory, the memory includes executable instructions causing the processor to control the device to perform functions of displaying, via a GUI of a first communication application, content of a first communication session associated with a first communication application; detecting an activity related to a second communication session associated with a second communication application; displaying, as a part of the GUI of the first communication application, an indication of the detected activity and a first control element that, when activated, causes a user of the device to join the second communication session; receiving a first user input to activate the first control element; responsive to the received first user input, causing the user of the device to join and participate, via the GUI of the first communication application, the second communication session concurrently with the first communication session.

Abstract: Systems and methods for displaying a teleconference session are described. Teleconference data including display streams is transmitted to a number of client computers. Each of the streams may include at least a video and an audio component. A user interface includes a first display area rendering a first stream and a second display area rendering a second stream. An event may occur that removes a video component from the first stream. In response to the event, the rendering of the first stream may be removed from the first display area, and one or more streams of the plurality of streams may be displayed in at least a portion of the first display area. Such techniques for modifying user interface displays based on the actions of select users that have transitioned to an audio-only mode can optimize the use of a display area.