Abstract: In one embodiment, a method includes, by an operating system of a first artificial-reality device, receiving a notification that virtual objects are shared with the first artificial-reality device by a second artificial-reality device, where the virtual objects are shared by being placed inside a sender-side shared space anchored to a physical object. The method further includes the first artificial-reality device accessing descriptors of a physical object and a spatial-relationship definition between the physical object and a receiver-side shared space, detecting physical objects based on the descriptors, determining pose of the receiver-side shared space, detecting physical constraints within the receiver-side shares space, receiving display instructions for the virtual objects, and rendering the virtual objects on the first artificial-reality device in the receiver-side shared space.

Abstract: Aspects of the present disclosure are directed to an artificial reality (XR) application system controlling applications in an artificial reality environment. In various cases, these controls include automatically suggesting XR applications by determining an XR context and identifying applications that match the XR context. These applications can be suggested to a user, who can authorize their execution, setting permissions for the application. In some cases, applications can be divided into components which can be progressively downloaded. By providing application suggestions relevant to the current context and progressively downloading application components, applications can appear ambient, rather than relying on users to constantly download, install, or activate applications. Permissions for applications may be revoked permanently or for certain situations—either through user permissions selections or automatically in response to determined user intents.

Abstract: Aspects of the present disclosure are directed to an artificial reality system orchestrating interactions between virtual object “augments.” The orchestration can include linking, which can be forming two or more augments into a combination, embedding an augment within an existing combination, or triggering an action mapped to the linking of those augments. Another type of orchestration can include extracting, which can refer to taking an augment out of an existing combination, either by removing it from the combination or copying the augment to leave a version in the combination and having another version outside the combination.

Abstract: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. In one example, an artificial reality system comprises an image capture device configured to capture image data representative of a physical environment; a head-mounted display (HMD) configured to output artificial reality content; a gesture detector configured to identify, from the image data, a gesture comprising a motion of two fingers from a hand to form a pinching configuration and a subsequent pulling motion while in the pinching configuration; a user interface (UI) engine configured to generate a UI input element in response to identifying the gesture; and a rendering engine configured to render the UI input element as an overlay to at least some of the artificial reality content.

Abstract: In one embodiment, a method includes, by an operating system of a first artificial-reality device, receiving a notification that virtual objects are shared with the first artificial-reality device by a second artificial-reality device, where the virtual objects are shared by being placed inside a sender-side shared space anchored to a physical object. The method further includes the first artificial-reality device accessing descriptors of a physical object and a spatial-relationship definition between the physical object and a receiver-side shared space, detecting physical objects based on the descriptors, determining pose of the receiver-side shared space, detecting physical constraints within the receiver-side shares space, receiving display instructions for the virtual objects, and rendering the virtual objects on the first artificial-reality device in the receiver-side shared space.

Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.

Abstract: Aspects of the present disclosure are directed to an artificial reality system orchestrating interactions between virtual object “augments.” The orchestration can include linking, which can be forming two or more augments into a combination, embedding an augment within an existing combination, or triggering an action mapped to the linking of those augments. Another type of orchestration can include extracting, which can refer to taking an augment out of an existing combination, either by removing it from the combination or copying the augment to leave a version in the combination and having another version outside the combination.

Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.

Abstract: In one embodiment, a method includes, by an operating system of a first artificial-reality device, receiving a notification that virtual objects are shared with the first artificial-reality device by a second artificial-reality device, where the virtual objects are shared by being placed inside a sender-side shared space anchored to a physical object. The method further includes the first artificial-reality device accessing descriptors of a physical object and a spatial-relationship definition between the physical object and a receiver-side shared space, detecting physical objects based on the descriptors, determining pose of the receiver-side shared space, detecting physical constraints within the receiver-side shares space, receiving display instructions for the virtual objects, and rendering the virtual objects on the first artificial-reality device in the receiver-side shared space.

Abstract: Aspects of the present disclosure are directed to an artificial reality system orchestrating interactions between virtual object “augments.” The orchestration can include linking, which can be forming two or more augments into a combination, embedding an augment within an existing combination, or triggering an action mapped to the linking of those augments. Another type of orchestration can include extracting, which can refer to taking an augment out of an existing combination, either by removing it from the combination or copying the augment to leave a version in the combination and having another version outside the combination.

Abstract: Aspects of the present disclosure are directed to an artificial reality (XR) application system controlling applications in an artificial reality environment. In various cases, these controls include automatically suggesting XR applications by determining an XR context and identifying applications that match the XR context. These applications can be suggested to a user, who can authorize their execution, setting permissions for the application. In some cases, applications can be divided into components which can be progressively downloaded. By providing application suggestions relevant to the current context and progressively downloading application components, applications can appear ambient, rather than relying on users to constantly download, install, or activate applications. Permissions for applications may be revoked permanently or for certain situations—either through user permissions selections or automatically in response to determined user intents.

Abstract: Aspects of the present disclosure are directed to an artificial reality (XR) application system controlling applications in an artificial reality environment. In various cases, these controls include automatically suggesting XR applications by determining an XR context and identifying applications that match the XR context. These applications can be suggested to a user, who can authorize their execution, setting permissions for the application. In some cases, applications can be divided into components which can be progressively downloaded. By providing application suggestions relevant to the current context and progressively downloading application components, applications can appear ambient, rather than relying on users to constantly download, install, or activate applications. Permissions for applications may be revoked permanently or for certain situations—either through user permissions selections or automatically in response to determined user intents.

Abstract: In one embodiment, a method includes, by an operating system of a first artificial-reality device, receiving a notification that virtual objects are shared with the first artificial-reality device by a second artificial-reality device, where the virtual objects are shared by being placed inside a sender-side shared space anchored to a physical object. The method further includes the first artificial-reality device accessing descriptors of a physical object and a spatial-relationship definition between the physical object and a receiver-side shared space, detecting physical objects based on the descriptors, determining pose of the receiver-side shared space, detecting physical constraints within the receiver-side shares space, receiving display instructions for the virtual objects, and rendering the virtual objects on the first artificial-reality device in the receiver-side shared space.

Abstract: Methods and systems described herein are directed to viewpoint coordination of multiple users on artificial reality collaboration models. Multiple users can collaborate on 3D models in an artificial reality environment. Attention indicators can indicate to the other users where a user is looking or where the user is pointing. In some implementations, there is a central model that each user sees from her own perspective (e.g., in the center of a virtual table all users are seated around) and/or instances of the model that only an individual user sees or can manipulate. The user's attention indicators can be based on where the user is looking or pointing on the model instances. Additionally, attention indicators can be translated from a controlling user's perspective to a coordinate system defined by the model, which allows the indicators to be then presented in that model coordinate system for all users.

Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.

Abstract: Aspects of the present disclosure are directed to an artificial reality (XR) application system controlling applications in an artificial reality environment. In various cases, these controls include automatically suggesting XR applications by determining an XR context and identifying applications that match the XR context. These applications can be suggested to a user, who can authorize their execution, setting permissions for the application. In some cases, applications can be divided into components which can be progressively downloaded. By providing application suggestions relevant to the current context and progressively downloading application components, applications can appear ambient, rather than relying on users to constantly download, install, or activate applications. Permissions for applications may be revoked permanently or for certain situations—either through user permissions selections or automatically in response to determined user intents.

Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.

Abstract: Methods and systems for integrating functionality of XR devices and non-XR devices are disclosed herein. An XR device can identify and obtain one or more content items being displayed on non-XR devices and create virtual objects associated with the content item in an artificial reality environment of the XR device. A user of the XR device can interact with the virtual objects, such as by moving the virtual objects to new locations within the artificial reality environment or interact with the virtual objects to view the content items. The user of the XR device can also provide one or more gestures or commands to send content items or identifiers of content items associated with the virtual objects to non-XR devices for display at the non-XR devices.

Abstract: Aspects of the present disclosure are directed to an artificial reality system orchestrating interactions between virtual object “augments.” The orchestration can include linking, which can be forming two or more augments into a combination, embedding an augment within an existing combination, or triggering an action mapped to the linking of those augments. Another type of orchestration can include extracting, which can refer to taking an augment out of an existing combination, either by removing it from the combination or copying the augment to leave a version in the combination and having another version outside the combination.

Abstract: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. The artificial reality system can include a menu that can be activated and interacted with using one hand. In response to detecting a menu activation gesture performed using one hand, the artificial reality system can cause a menu to be rendered. A menu sliding gesture (e.g., horizontal motion) of the hand can be used to cause a slidably engageable user interface (UI) element to move along a horizontal dimension of the menu while horizontal positioning of the UI menu is held constant. Motion of the hand orthogonal to the menu sliding gesture (e.g., non-horizontal motion) can cause the menu to be repositioned. The implementation of the artificial reality system does require use of both hands or use of other input devices in order to interact with the artificial reality system.