Abstract: In one embodiment, a method includes receiving an instruction to transition to a first virtual reality (VR) environment of a first VR application, accessing attribute information of one or more real-world objects in a real-world environment proximate to a VR display device, determining, for each of the one or more real-world objects, one or more first mixed reality (MR) functionalities applicable to the real-world object based on its attribute information, and rendering, for one or more displays of the VR display device, the first VR environment with one or more MR objects corresponding to the one or more real-world objects, wherein each MR object comprises one of the first MR functionalities applicable to the corresponding real-world object.

Abstract: In one embodiment, a method includes receiving an instruction to transition to a first virtual reality (VR) environment of a first VR application, accessing attribute information of one or more real-world objects in a real-world environment proximate to a VR display device, determining, for each of the one or more real-world objects, one or more first mixed reality (MR) functionalities applicable to the real-world object based on its attribute information, and rendering, for one or more displays of the VR display device, the first VR environment with one or more MR objects corresponding to the one or more real-world objects, wherein each MR object comprises one of the first MR functionalities applicable to the corresponding real-world object.

Abstract: In one embodiment, a method includes rendering, for a virtual reality (VR) display device, a first output image of a VR environment. The VR environment includes a personal user interface (UI) associated with a first user. The personal UI has a first form factor and a first pose with respect to the first user. The personal UI is a virtual object. The method includes detecting a change in context of the first user with respect to a real-world object. The method includes determining whether to adapt the personal UI based on a detected change in the context of the first user with respect to the real-world object. The method includes rendering, for the VR display device, a second output image of the VR environment. The personal UI is adapted to have a second form factor and a second pose with respect to the first user responsive to determining to adapt the personal UI. The second form factor and the second pose of the personal UI is based on the real-world object.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for linking artificial reality content to a shared artificial reality environment. Various aspects may include receiving a selection of a user representation and a virtual area, such as from a user device. Aspects may include providing the user representation for display in the virtual area. Aspects may also include determining a selected artificial reality application from a plurality of artificial reality applications for use by the user representation in the virtual area. Aspects may also include embedding visual content from the selected artificial reality application into the virtual area, which may be associated with a deep link to the selected artificial reality application. Aspects may include transitioning the user representation between virtual areas while providing an audio element to the user device indicative of other user devices associated with another virtual area.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for providing and activating a link to artificial reality content in a shared artificial reality environment. Various aspects may include receiving a request to generate a visual navigation element for an artificial reality application configured to operate in the shared artificial reality environment, such as via a user representation. Aspects may include generating the visual navigation element and generating an audio element indicative of another user representation engaged in the artificial reality application for the user representation. Aspects may also include receiving an indication of activation of the visual navigation element and loading the artificial reality application for the user representation upon activation and while providing the audio element. Aspects may also include providing instructions to display the user representation in the artificial reality application upon completion of the loading.

Abstract: In one embodiment, a method includes receiving an instruction to transition to a first virtual reality (VR) environment of a first VR application, accessing attribute information of one or more real-world objects in a real-world environment proximate to a VR display device, determining, for each of the one or more real-world objects, one or more first mixed reality (MR) functionalities applicable to the real-world object based on its attribute information, and rendering, for one or more displays of the VR display device, the first VR environment with one or more MR objects corresponding to the one or more real-world objects, wherein each MR object comprises one of the first MR functionalities applicable to the corresponding real-world object.

Abstract: In one embodiment, a method includes rendering, for one or more displays of a VR display device, a first output image of a VR environment. The VR environment includes a personal UI associated with a first user. The personal UI has a first form factor and a first pose with respect to the first user, is a virtual object comprising one or more 2D virtual displays, and is operable to execute a plurality of applications. The method includes determining whether to adapt the personal UI based on a detected change in a context of the first user with respect to the VR environment. The method includes rendering a second output image of the VR environment, where the personal UI is adapted to have a second form factor and a second pose with respect to the first user responsive to determining to adapt the personal UI based on the detected change in the context of the first user.

Abstract: In one embodiment, a method includes displaying, for one or more displays of a virtual VR device, a first output image comprising a passthrough view of a real-world environment. The method includes identifying, using one or more images captured by one or more cameras of the VR display device, a real-world object in the real-world environment. The method includes receiving a user input indicating a first dimension corresponding to the real-world object. The method includes automatically determining, based on the first dimension, a second and third dimension corresponding to the real-world object. The method includes rendering, for the one or more displays of the VR display device, a second output image of a VR environment. The VR environment includes a MR object that corresponds to the real-world object. The MR object is defined by the determined first, second, and third dimensions.

Abstract: In one embodiment, a method includes displaying, for one or more displays of a virtual VR device, a first output image comprising a passthrough view of a real-world environment. The method includes identifying, using one or more images captured by one or more cameras of the VR display device, a real-world object in the real-world environment. The method includes receiving a user input indicating a first dimension corresponding to the real-world object. The method includes automatically determining, based on the first dimension, a second and third dimension corresponding to the real-world object. The method includes rendering, for the one or more displays of the VR display device, a second output image of a VR environment. The VR environment includes a MR object that corresponds to the real-world object. The MR object is defined by the determined first, second, and third dimensions.

Abstract: In one embodiment, a method includes rendering, for one or more displays of a VR display device, a first output image of a VR environment. The VR environment includes a personal UI associated with a first user. The personal UI has a first form factor and a first pose with respect to the first user, is a virtual object comprising one or more 2D virtual displays, and is operable to execute a plurality of applications. The method includes determining whether to adapt the personal UI based on a detected change in a context of the first user with respect to the VR environment. The method includes rendering a second output image of the VR environment, where the personal UI is adapted to have a second form factor and a second pose with respect to the first user responsive to determining to adapt the personal UI based on the detected change in the context of the first user.

Abstract: Techniques are disclosed for providing a swipe-based confirmation mode in electronic touch sensitive devices. The user can engage the confirmation mode by performing a command (e.g., delete or power down command), which causes the device to display a confirmation swipe gesture prompt. The confirmation prompt may be included within a confirmation graphic or a confirmation pop-up window. By performing the confirmation swipe gesture on the touch sensitive surface, the user may confirm the command. By not properly performing the confirmation gesture, closing a confirmation pop-up window, tapping an area of the screen not associated with the confirmation prompt, or otherwise not performing the confirmation swipe gesture, the device may cause the function to be cancelled.

Abstract: In one embodiment, a method includes retrieving a media content item for display on a projectable surface. The method includes sending, to an interaction device including a projector and a camera, instructions causing the camera to capture one or more images of the projectable surface, receiving the one or more images from the interaction device, and determining one or more attributes of the surface based on the one or more images. The method also includes modifying the media content item based at least in part on the one or more attributes of the projectable surface and sending, to the interaction device, the modified media content item and instructions causing the projector to project the modified media content on the projectable surface.

Abstract: In one embodiment, a method includes sending, to an interaction device including a projector and a camera, a media content item and instructions causing the projector to project the media content item on a projectable surface and receiving, from the interaction device, one or more media objects captured by the camera, where one or more of the media objects include images of a user in proximity to the projectable surface. The method includes determining one or more movements of the user based on the one or more of the media objects and updating the media content item based on the determined movements. The method also includes sending, to the interaction device, the updated media content item and instructions causing the projector to project the updated media content item on the projectable surface.

Abstract: Techniques are disclosed for providing a digital flash card function in electronic devices. In an embodiment, a digital flash card includes a word or phrase along with the definition of the word or phrase pulled automatically from a glossary or dictionary. The digital flash card may be created through an options menu after selecting a word or phrase, automatically whenever a word or phrase is highlighted by the user, or whenever a word or phrase is looked up. Once the flash cards have been created, they may be organized into various folders or stacks, and in some cases the flash cards may automatically be organized based on the source of the selected word or phrase. Once one or more flash cards have been created, the user may view flash cards, flip them over to view the opposite side, and scroll through the flash cards using various touch screen gestures.

Abstract: Features and techniques are disclosed for interacting with paginated digital content, including a multi-purpose tool and an annotation mode. The multi-purpose tool, which may be represented by a graphic (e.g., a movable interactive graphic), can provide access to multiple modes (e.g., copy, define, note, and/or highlight modes) that a user can invoke. The mode invoked determines the functions performed by the tool when interacting with the paginated digital content. The annotation mode, which may be invoked using the multi-purpose tool or independently thereof, can allow a user to create and edit annotations, such as highlights and notes (e.g., sticky notes, margin notes, and/or highlight notes), for paginated digital content. Editing the annotations may include selecting a desired color for the annotation, for example. The annotation mode may also allow a user to intuitively merge and delete annotations previously added to paginated digital content.

Abstract: Techniques are disclosed for providing a swipe-based confirmation mode in electronic touch sensitive devices. The user can engage the confirmation mode by performing a command (e.g., delete or power down command), which causes the device to display a confirmation swipe gesture prompt. The confirmation prompt may be included within a confirmation graphic or a confirmation pop-up window. By performing the confirmation swipe gesture on the touch sensitive surface, the user may confirm the command. By not properly performing the confirmation gesture, closing a confirmation pop-up window, tapping an area of the screen not associated with the confirmation prompt, or otherwise not performing the confirmation swipe gesture, the device may cause the function to be cancelled.

Abstract: A method includes retrieving a media content item for display to a user in an environment. The method includes receiving, from one or more interaction devices each including a projector and a camera, one or more media objects captured by one or more cameras, where one or more of the media objects include images of the user, and determining a location of the user in the environment based on an analysis of the one or more of the media objects. The method also includes identifying one of the interaction devices based on the determined location of the user and sending, to the identified interaction device, the media content item and instructions causing the projector associated with the identified interaction device to project the media content item.

Abstract: A method includes sending, to an interaction device including a projector and a camera, instructions causing the projector to project a light pattern to each of one or more specified directions and receiving, from the interaction device, one or more images each including illumination patterns associated with one or more surfaces of a specified direction. The method also includes constructing, based on the projected light patterns and the received illumination patterns, a model describing an environment of the interaction device, where the model includes one or more characteristics of each of one or more objects in the environment and one or more characteristics of each of one or more surfaces in the environment.

Abstract: Techniques are disclosed for providing a swipe-based confirmation mode in electronic touch sensitive devices. The user can engage the confirmation mode by performing a command (e.g., delete or power down command), which causes the device to display a confirmation swipe gesture prompt. The confirmation prompt may be included within a confirmation graphic or a confirmation pop-up window. By performing the confirmation swipe gesture on the touch sensitive surface, the user may confirm the command. By not properly performing the confirmation gesture, closing a confirmation pop-up window, tapping an area of the screen not associated with the confirmation prompt, or otherwise not performing the confirmation swipe gesture, the device may cause the function to be cancelled.

Abstract: Features and techniques are disclosed for interacting with paginated digital content, including a multi-purpose tool and an annotation mode. The multi-purpose tool, which may be represented by a graphic (e.g., a movable interactive graphic), can provide access to multiple modes (e.g., copy, define, note, and/or highlight modes) that a user can invoke. The mode invoked determines the functions performed by the tool when interacting with the paginated digital content. The annotation mode, which may be invoked using the multi-purpose tool or independently thereof, can allow a user to create and edit annotations, such as highlights and notes (e.g., sticky notes, margin notes, and/or highlight notes), for paginated digital content. Editing the annotations may include selecting a desired color for the annotation, for example. The annotation mode may also allow a user to intuitively merge and delete annotations previously added to paginated digital content.