Abstract: Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in the multiple modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.

Abstract: A non-transitory computer-readable storage medium including instructions for distributing tasks between a handheld intermediary processing device (HIPD) and communicatively coupled devices is disclosed. The instructions cause one or more processors to, while a HIPD and a head-wearable device are communicatively coupled and share operational data for performing one or more computational tasks, identify one or more back-end tasks and one or more front-end tasks associated with performing the one or more computational tasks. The instructions further cause performance of the one or more back-end tasks at the HIPD including updating the operational data to create updated operational data. The instructions further cause performance of the one or more front-end tasks at the head-wearable device using the updated operational data such that a representation based on the one or more computational tasks is presented to the user by the head-wearable device.

Abstract: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the fist subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

Abstract: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

Abstract: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

Abstract: In some implementations, the disclosed systems and methods can automatically generate seller listing titles and descriptions for products; set a follow-me mode for various virtual objects, causing the virtual objects to be displayed as word-locked or body-locked in response to a current mode for the virtual objects and the location of the user of the XR device in relation to various anchor points for the virtual objects; create and/or apply XR profiles that specify one or more triggers for one or more effects that are applied to a user when the triggers are satisfied; and/or enable addition of external content in 3D applications.

Abstract: Embodiments described herein disclose methods and systems directed to input mode selection in artificial reality. In some implementations, various input modes enable a user to perform precise interactions with a target object without occluding the target object. Some input modes can include rays that extend along a line that intersects an origin point, a control point, and an interaction point. An interaction model can specify when the system switches between input modes, such as modes based solely on gaze, using long or short ray input, or with direct interaction between the user's hand(s) and objects. These transitions can be performed by evaluating rules that take context factors such as whether a user's hands are in view of the user, what posture the hands are in, whether a target object is selected, and whether a target object is within a threshold distance from the user.

Abstract: In embodiments, apparatuses, methods and storage media for human-computer interaction are described. In embodiments, an apparatus may include one or more light sources and a camera. Through capture of images by the camera, the computing device may detect positions of objects of a user, within a three-dimensional (3-D) interaction region within which to track positions of the objects of the user. The apparatus may utilize multiple light sources, which may be disposed at different distances to the display and may illuminate the objects in a direction other than the image capture direction. The apparatus may selectively illuminate individual light sources to facilitate detection of the objects in the direction toward the display. The camera may also capture images in synchronization with the selective illumination. Other embodiments may be described and claimed.

Abstract: In embodiments, apparatuses, methods and storage media for human-computer interaction are described. In embodiments, an apparatus may include one or more light sources and a camera. Through capture of images by the camera, the computing device may detect positions of objects of a user, within a three-dimensional (3-D) interaction region within which to track positions of the objects of the user. The apparatus may utilize multiple light sources, which may be disposed at different distances to the display and may illuminate the objects in a direction other than the image capture direction. The apparatus may selectively illuminate individual light sources to facilitate detection of the objects in the direction toward the display. The camera may also capture images in synchronization with the selective illumination. Other embodiments may be described and claimed.