Abstract: The present disclosure relates to providing a multi-user computer generated reality (“CGR”) session. In some embodiments, a first electronic device displays a CGR environment, wherein the CGR environment is responsive to input from the first electronic device and a second electronic device, wherein the second device is external to the first device. While displaying the CGR environment, the device obtains a first scene graph from a process executing on the first device, wherein the first scene graph includes information for rendering a first entity, and obtains a second scene graph from a process executing on the second device, wherein the second scene graph includes information for rendering a second entity. The first electronic device updates the displayed CGR environment based on the first scene graph and the second scene graph, wherein the displayed CGR environment includes a visual representation of the first and a visual representation of the second entity.

Abstract: A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for displaying in a three-dimensional display mode. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device in the three-dimensional display mode.

Abstract: The present disclosure relates to techniques for providing an interactive computer-generated reality environment for creating a virtual drawing using one or more electronic devices. Specifically, the described techniques provide a user with a computer-generated reality environment, which can be based on different types of realities including virtual reality and mixed reality, for creating a virtual drawing on a drawing surface within the computer-generated reality environment. The computer-generated reality environment provides the user with a realistic and immersive experience while creating the virtual drawing.

Abstract: A method of sharing content rendered on a device, including executing an application which generates audiovisual content, retrieving the application's audiovisual content from a graphics memory, and transmitting the retrieved content to a destination device via a network.

Abstract: The present disclosure relates to providing a computer-generated reality (CGR) platform for generating CGR environments including virtual and augmented reality environments. In some embodiments, the platform includes an operating-system-level (OS-level) process that simulates and renders content in the CGR environment, and one or more application-level processes that provide information related to the content to be simulated and rendered to the OS-level process.

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a CGR environment in which virtual objects from one or more apps are included. User interactions with the virtual objects are detected and interpreted by a system that is separate from the apps that provide the virtual objects. The system detects user interactions received via one or more input modalities and interprets those user interactions as events. These events provide a higher-level, input modality-independent, abstractions of the lower-level input-modality dependent user interactions that are detected. The system uses UI capability data provided by the apps to interpret user interactions with respect to the virtual object provided by the apps. For example, the UI capability data can identify whether a virtual object is moveable, actionable, hover-able, etc. and the system interprets user interactions at or near the virtual object accordingly.

Abstract: Methods, devices, and system for providing anonymous guest players for multiplayer applications are described. In one embodiment, a computer-implemented method includes initiating a game service for playing a multiplayer gaming application on a system, providing with a multiplayer API functionality for defining and adding an anonymous guest player to the system, generating data including a gaming invite that provides an ability to invite one or more friends that are registered with the game service and one or more anonymous guest players that are not registered with the game service. The method further includes receiving an input that identifies or selects an anonymous guest player to invite to play the multi-player gaming application on the system. The computer-implemented method further includes receiving data intended for the anonymous guest player from a different system of the multiplayer gaming application for peer to peer gaming applications.