Abstract: The techniques disclosed herein provide a contextual toolset for use in canvases of collaboration applications. The techniques also provide smart hooks for pinning tools to specific locations on content opened in a canvas. The contextual toolset may include tools specific to an application opened in a canvas and/or tools for implementing the functionality of external applications. The smart hooks maintain linkages between an instance of tool usage and an object in a file or other content. The linkages maintain the tool in the same location relative to the object even if the object is moved. Instances of external applications opened in a canvas may be presented in a dedicated user interface region that passes data to and from the external application.

Abstract: The techniques disclosed herein provide a contextual toolset for use in canvases of collaboration applications. The techniques also provide smart hooks for pinning tools to specific locations on content opened in a canvas. The contextual toolset may include tools specific to an application opened in a canvas and/or tools for implementing the functionality of external applications. The smart hooks maintain linkages between an instance of tool usage and an object in a file or other content. The linkages maintain the tool in the same location relative to the object even if the object is moved. Instances of external applications opened in a canvas may be presented in a dedicated user interface region that passes data to and from the external application.

Abstract: In a device including a processor and a memory in communication with the processor is described, the memory includes executable instructions that, when executed by the processor, cause the processor to control the device to perform functions of: generating, based on a plurality of local 3D models, a global 3D model representing a portion of a real-world environment; determining a location of a 3D virtual object in the global 3D model; and generating augmentation data for rendering the 3D virtual object to be seen at a location of the real-world environment corresponding to the location of the 3D virtual object in the global 3D model.

Abstract: Disclosed techniques provide for the management of immersion levels and notifications of conference activities that are of interest to a user. In some embodiments, a system can monitor a conference session, that a user is not attending, on the user's behalf to determine when activity that is of interest to the user occurs during the conference session. The system can then send a notification to the user to inform her of the identified activity. In some embodiments, the notification may enable the user to control her immersion level with respect to the conference session. For example, the notification may include user interface element(s) that the user may select to observe or even join the conference session. In some embodiments, the notification may enable the user to directly share content with attendees of the conference session without having to observe or join the conference session.

Abstract: In a device including a processor and a memory in communication with the processor is described, the memory includes executable instructions that, when executed by the processor, cause the processor to control the device to perform functions of: generating, based on a plurality of local 3D models, a global 3D model representing a portion of a real-world environment; determining a location of a 3D virtual object in the global 3D model; and generating augmentation data for rendering the 3D virtual object to be seen at a location of the real-world environment corresponding to the location of the 3D virtual object in the global 3D model.

Abstract: A user device comprises a network interface, a rendering module, and a scene modification module. The network interface is configured to receive a video signal from another device via a network. The rendering module is configured to control display apparatus of the user device to display a virtual element to a user of the user device, the virtual element comprising a video image derived from the video signal. The modification module is configured to generate rendering data for displaying a modified version of the virtual element at the other device. The modified version does not include said video image. The network interface is configured to transmit the rendering data to the other device via the network. Alternatively or in addition, the rendering data can be modified at the other device to the same end.

Abstract: An augmented reality (AR) system receives a plurality of local 3D models of a part of a real-world environment, each having been generated by a different AR device when located in the real-world environment. The local 3D models are combined to generate a global 3D model, at least part of which is transmitted to a device remote from the real-world environment. The global 3D model represents a greater portion of the real-environment than any of the local 3D models individually. The AR system receives rendering data from the remote device, and transmits it to an AR device when the AR device is located in the real-world environment. Alternatively, the rendering data may be transmitted from the remote device to the AR device via a network directly. The rendering data is for use in rendering a virtual object at the AR device in the real-world environment.

Abstract: Disclosed techniques provide for the management of immersion levels and notifications of conference activities that are of interest to a user. In some embodiments, a system can monitor a conference session, that a user is not attending, on the user's behalf to determine when activity that is of interest to the user occurs during the conference session. The system can then send a notification to the user to inform her of the identified activity. In some embodiments, the notification may enable the user to control her immersion level with respect to the conference session. For example, the notification may include user interface element(s) that the user may select to observe or even join the conference session. In some embodiments, the notification may enable the user to directly share content with attendees of the conference session without having to observe or join the conference session.

Abstract: Techniques for presenting a message in a communication session are described. In at least some embodiments, a message is sent by a participant in a communication session. The message is presented in a graphical user interface (GUI) for the communication session and visually linked to a visual representation of the participant. According to one or more implementations, a number of messages that are presented in a GUI for a communication session is throttled.

Abstract: A method of monitoring shared user event at a user terminal, including identifying one or more shared user events of which the user of the terminal is not a participant and obtaining information about the content and/or participants of said shared user event without becoming a participant of the shared user event. Based on said obtained information a display is caused to render at least one portal object representing said shared experience, the portal object providing a view of the content and/or participants of said shared experience.

Abstract: Embodiments obtain a content item representing graphic content suitable for display as part of a shared media event, determine an activity metric for said content item, determine an activity metric for a participant of said shared media event, comparing the activity metric of the content item and the activity metric the participant, cause a display to render the graphic content associated with said content item, and render a representation of said participant. In at least some implementations, the relative displayed positions of said graphic content and said representation of the participant are based on the result of the comparison of the activity metric of the content item and the activity metric the participant.

Abstract: An augmented reality (AR) system receives a plurality of local 3D models of a part of a real-world environment, each having been generated by a different AR device when located in the real-world environment. The local 3D models are combined to generate a global 3D model, at least part of which is transmitted to a device remote from the real-world environment. The global 3D model represents a greater portion of the real-environment than any of the local 3D models individually. The AR system receives rendering data from the remote device, and transmits it to an AR device when the AR device is located in the real-world environment. Alternatively, the rendering data may be transmitted from the remote device to the AR device via a network directly. The rendering data is for use in rendering a virtual object at the AR device in the real-world environment.

Abstract: A user device within a communication architecture, the user device comprising a session viewer configured to: receive at least one annotation object associated with a mixed reality/virtual reality session; determine a field of view position; and generate an image overlay based on the determined field of view position and at least one annotation object to display an indicator to guide a user of the user device to a representation of the annotation object.

Abstract: Augmented reality apparatus comprises stereoscopic display apparatus, a computer interface, and a rendering module. The stereoscopic display apparatus is arranged to provide to a user of the augmented reality apparatus a view of a real-world environment in which the user is located. The display apparatus is configured to generate a stereoscopic image that is visible to the user simultaneously with the real-world view. The computer interface is configured to receive from a network externally generated 3D model data of the real-world environment in which the user is located. The rendering module is configured to use the externally generated 3D model data to control the display apparatus to render a virtual element in a manner such that it is perceived by the user as a 3D element located at a desired location in the real-world environment.

Abstract: A user device comprises a network interface, a rendering module, and a scene modification module. The network interface is configured to receive a video signal from another device via a network. The rendering module is configured to control display apparatus of the user device to display a virtual element to a user of the user device, the virtual element comprising a video image derived from the video signal. The modification module is configured to generate rendering data for displaying a modified version of the virtual element at the other device. The modified version does not include said video image. The network interface is configured to transmit the rendering data to the other device via the network. Alternatively or in addition, the rendering data can be modified at the other device to the same end.

Abstract: A user device within a communication architecture, the user device comprising an asynchronous session viewer configured to: receive asynchronous session data, the asynchronous session data comprising at least one image, camera pose data associated with the at least one image, and surface reconstruction data associated with the camera pose data; select a field of view position; and edit the asynchronous session data by adding/amending/deleting at least one annotation object based on the selected field of view.

Abstract: A user device within a communication architecture, the user device comprising an asynchronous session generator configured to: capture at least one image; determine camera pose data associated with the at least one image; capture surface reconstruction data, the surface reconstruction data being associated with the camera pose data; generate an asynchronous session comprising asynchronous session data, the asynchronous session data comprising the at least one image, the camera pose data, surface reconstruction data, and at least one annotation object wherein the asynchronous data is configured to be stored and retrieved at a later time.

Abstract: A user device has a display, a user interface and a network interface. The network interface receive a video data stream from another user interface. A user of the user device is able to pause the video stream. The paused image of the video stream and the video stream are both displayed on the display. The user is able to annotate the paused image.

Abstract: Techniques for visual configuration for communication session participants are described. According to various embodiments, a communication session is established that includes a video feed that is streamed between devices involved in the communication session. The video feed, for example, includes video images of participants in the communication session. A number of participants present at a particular device involved in the communication session is determined and used to generate instructions to other devices for visually representing video of the participants. According to various embodiments, user activity for participants in a communication session is detected and used to determine how the participants are visually represented for the communication session. For instance, users that are determined to be active in the communication session are presented visually more prominently than users that are less active.

Abstract: Techniques for presenting a message in a communication session are described. In at least some embodiments, a message is sent by a participant in a communication session. The message is presented in a graphical user interface (GUI) for the communication session and visually linked to a visual representation of the participant. According to one or more implementations, a number of messages that are presented in a GUI for a communication session is throttled.