Abstract: A source-camera assembly with an isolated light path for a reference pixel is described. The assembly may include a projector, a camera assembly, a reference waveguide, and an overmold. The projector may include a source array configured to emit light and a lens assembly configured to direct the light into a local area. The camera assembly may include a sensor and a reference pixel. The sensor may be configured to detect the emitted light reflected from an object within the local area. The reference waveguide is configured to guide a portion of the light emitted by the projector from the source array to the reference pixel. The light detected by the sensor and the light detected by the reference pixel may be used to determine depth information for the object. The overmold is opaque to the emitted light and covers portions of the projector, the camera assembly, and the reference waveguide.

Abstract: Mixed reality (MR) user interactions are enabled through a combination of eye tracking (user gaze determination) and secondary inputs such as finger gestures, hand gestures, eye gestures, wrist band device input, handheld controller input, and similar ones. A location of interest in displayed content may be identified through the user's gaze, fixation, and/or saccades, or other actions, such as zoom, rotate, pan, move, open actionable menus, etc., may be performed on the location of interest based on the secondary inputs.

Abstract: In one embodiment, a method includes capturing images of a first user wearing a VR display device in a real-world environment. The method includes receiving a VR rendering of a VR environment. The VR rendering is from the perspective of the mobile computing device with respect to the VR display device. The method includes generating a first MR rendering of the first user in the VR environment. The first MR rendering of the first user is based on a compositing of the images of the first user and the VR rendering. The method includes receiving an indication of a user interaction with one or more elements of the VR environment in the first MR rendering. The method includes generating, in real-time responsive to the indication of the user interaction with the one or more elements, a second MR rendering of the first user in the VR environment. The one or more elements are modified according to the interaction.

Abstract: A method includes receiving a source shape that is to be blended with a destination shape stored in a color buffer for an image; in response to determining that the source shape is associated with a blending mode that requires updates to pixels in the color buffer uncovered by the source shape: identifying empty tiles in the color buffer uncovered by the source shape and non-empty tiles in the color buffer covered by the source shape; for each of the empty tiles, sending instructions to clear pixel values associated with the empty tile in the color buffer; and for each of the non-empty tiles: identifying pixels of the non-empty tile that are covered by the destination shape but not the source shape; and sending instructions to clear pixel values associated with the pixels.

Abstract: Methods and systems described herein are directed to a virtual personal interface (herein “personal interface”) for controlling an artificial reality (XR) environment, such as by providing user interfaces for interactions with a current XR application, providing detail views for selected items, navigating between multiple virtual worlds without having to transition in and out of a home lobby for those worlds, executing aspects of a second XR application while within a world controlled by a first XR application, and providing 3D content that is separate from the current world. While in at least one of those worlds, the personal interface can itself present content in a runtime separate from the current virtual world, corresponding to an item, action, or application for that world. XR applications can be defined for use with the personal interface to create both a 3D world portion and 2D interface portions that are displayed via the personal interface.

Abstract: A virtual trackpad engine is configured to perform a technique for accessing and manipulating distant virtual objects in an XR environment. The technique includes generating, in an extended reality (XR) environment, a virtual model corresponding to a hand of a user. The technique also includes generating a virtual trackpad in the XR environment, where a surface of the virtual trackpad is mapped to a surface of a distant virtual object in the XR environment. Further, the technique includes determining if the virtual trackpad is activated and responsive to a determination that the virtual trackpad is activated, tracking a movement of the virtual hand. The technique further includes determining an action to be performed in relation to the distant virtual object that corresponds to the movement and, subsequently, performing the action.

Abstract: A camera system that captures an HDR (High Dynamic Range) image with an improved burst duration time and faster frame rate. The camera system determines a set of different exposure settings for creation of an HDR image. The camera system provides the set of exposure settings to the camera sensor in a series of sequential timing windows. A sensor of the camera system outputs a plurality of stale frames in sequential timing windows for receiving the set of different exposure settings. The plurality of stale frames are followed by a set of image frames in sequential timing windows, with each image captured at a different exposure setting of the set of different exposure settings. The camera system may generate a HDR image using the captured sequence of images.

Abstract: The disclosed computer-implemented method may include creating a computer-generated model for a haptic feedback system including a plurality of actuators arranged in a first layer of the haptic feedback system, and a plurality of channels routed in a second layer of the haptic feedback system, the second layer being below the first layer, printing a three-dimensional wax mold structure of the computer-generated model, and forming the haptic feedback system in a single step using the three-dimensional wax mold structure. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Systems and methods for managing avatar communications may include a wireless communication node which receives a data packet from a first wireless communication device. The data packet may include an identifier corresponding to a user of the first wireless communication device. The wireless communication node may generate an avatar for the user according to the identifier, receive an expression code from the first wireless communication device, and/or configure the avatar for the user according to the expression code. The wireless communication node may transmit video data corresponding to the avatar to an address of a second wireless communication device.

Abstract: Systems and methods for supporting a temporary data boost include a first wireless communication device which receives a signal from a second wireless communication device. The signal can include information for obtaining a model from a server used by the first wireless communication device to generate an avatar associated with a user of the second wireless communication device. The first wireless communication device can transmit a request to retrieve the model from the server, where the request identifies a data size of the model and an address of the server. The first wireless communication device may receive, via the core network from the server, data corresponding to the model from the server, where the data is prioritized by the core network according to the request.

Abstract: Techniques for enhancing brightness and power efficiency in augmented reality (AR) display devices are described. To enhance brightness and power efficiency a near-eye display device's duty cycle may be adjusted based on a type of usage (e.g., world-locked or head-locked); a persistence or a display rate may be varied based on head movement speed; the brightness may be adjusted based on sensed ambient light; ambient brightness may be matched by utilizing camera-based scene understanding determining a user's gaze direction and then decreasing brightness of the gaze's peripheral; the display brightness may be controlled based on gaze and/or eye motion; and/or if the user is moving, world-locked rendering (WLR) targets and/or refresh rates may be altered, or WLR varied for peripheral content based on a comparison of gaze direction and a virtual object location.

Abstract: Apparatuses, systems, and methods are described for a head-mounted display (HMD) headset having a pass-through configuration for a stereoscopic view. The HMD may have right and left exterior-facing stereo cameras mounted on a front face of the HMD and in the same visual plane as the user's eyes, where the exterior-facing stereo cameras collect images for stereo view synthesis. The HMD may include a processor and a memory storing instructions, which, when executed by the processor, cause the processor to perform stereo view synthesis with a machine-learning (ML) based technique including at least disocclusion filtering, in which disocclusion hole regions may be substantially removed.

Abstract: Systems, methods, client devices, and non-transitory computer-readable media are disclosed for displaying a context-aware avatar overlay editor within an active extended-reality environment to modify an avatar without suspending or navigating away from the extended-reality environment. For example, the disclosed systems can provide an integrated avatar overlay editor within an application corresponding to the extended-reality environment. Furthermore, the disclosed systems can utilize the integrated avatar overlay editor to provide, for display as an overlay user interface in the extended-reality environment, a context-aware avatar overlay editor. In addition, the disclosed systems can utilize a contextual recommendation engine to provide avatar modifications within the context-aware avatar overlay editor that are relevant to the active extended-reality environment.

Abstract: An apparatus, system, and method for a lens assembly for a head-mounted device includes a frame and a lens assembly. The lens assembly is configured to be carried by the frame. The lens assembly includes a lens bulk, an edge thickness, and a power layer. The edge thickness includes a predetermined thickness value that is configured to be compatible with (e.g., a slot in) the frame. The power layer is configured to be set to one of a number of predetermined power levels while maintaining the edge thickness within the predetermined thickness value. The power layer is configured to define a course power level of the lens assembly (e.g., in the range of ?6.00 D to +6.00 D).

Abstract: An illuminator for illuminating a display panel includes a lightguide with an array of buried slanted bulk reflectors that out-couple portions of the light beam propagating in the lightguide through one of the lightguide surfaces. Polarization beam-splitting slanted surfaces may be used to provide polarized output. Such an illuminator may be used with a reflective display panel operating by polarization. The beam-splitting slanted surfaces operate as a polarizer, providing polarized illuminating light. The light reflected by the reflective panel may propagate back through the illuminator, and the polarization beam-splitting slanted surfaces may operate also as analyzer.

Abstract: Apparatuses, methods, and systems for an ocular hydration sensor/reflectometer system in a near-eye display device are described. In one aspect, a near-eye display device may include a projector to project light onto a user's eye, a photodetector to receive reflections from the tear film of the user's eye (e.g., the tear glints), and a controller to make ocular hydration measurements from the received reflections. The ocular hydration measurements may be used to (1) re-calibrate an eye tracking system of the near-eye display device (by changing parameters such as, e.g., light intensity and/or exposure time); (2) prompt the user to take remedial action; and/or (3) keep track of the user's eye health over time. The projector, photodetector, and/or controller may be integrated into, separate from, or partially integrated/partially separate from the eye tracking system.

Abstract: Disclosed herein are systems and method for using a cellular communication chain integrated with RFID wireless communication to communicate with an external RFID tag and a cellular wireless base station. A front end circuit can receive a first RF signal as input and can provide, as output, a processed first RF signal for wireless communication via a cellular network and be a low-band signal. An RFID circuit can generate a second RF signal for wireless communication with an RF identifier tag. A switch circuit or one or more toggle switches can be configured to route the processed first RF signal for transmission via an antenna for the wireless communication via the cellular network and route the second RF signal for transmission via the antenna for the wireless communication with the RF identifier tag.

Abstract: An illumination system for eye tracking is described herein. The illumination system may include a laser light source and an ultra-fast scanning micro-electromechanical system (MEMS) operating at a frequency range from about ten (10) kilohertz (kHz) to about one-hundred (100) kilohertz (kHz) to reflect laser light to the eye and generating a desired fringe pattern controlling intensity and timing. A surface of the MEMS may include diffractive optical element (DOE) to reflect the laser light as a concentrated optical beam. The light may also be projected by grating-based illuminators on a photonic integrated circuit (PIC) controlled through adiabatic couplers projecting multiple binary/grayscale images onto the eye. On the detection side, a 2D single-photon avalanche diode (SPAD) sensor or a SPAD array detector and an active MEMS shutter array may be used. Compressive sensing techniques may be applied on the detection side.

Abstract: A method implemented by a multi-chip package (MCP) electronic device including a die-to-die (D2D) interface is provided. The method includes receiving, by a receiver portion of a first die of the D2D interface, and from a transmitter portion of a second die of the D2D interface, a first timing signal and a second timing signal. The method includes generating a timing calibration signal based on a timing value corresponding to a midpoint of an estimated margin between overlaying segments of the first timing signal and a timing value corresponding to a delay of a unit delay associated with the receiver portion. The method includes generating an output timing signal based on the timing calibration signal, and selecting a timing delay signal based on the output timing signal and the timing calibration signal. The timing delay signal is selected to reduce a potential glitch power associated with the receiver portion.

Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.