Abstract: In one embodiment, a method includes capturing images of a first user wearing a VR display device in a real-world environment. The method includes receiving a VR rendering of a VR environment. The VR rendering is from the perspective of the mobile computing device with respect to the VR display device. The method includes generating a first MR rendering of the first user in the VR environment. The first MR rendering of the first user is based on a compositing of the images of the first user and the VR rendering. The method includes receiving an indication of a user interaction with one or more elements of the VR environment in the first MR rendering. The method includes generating, in real-time responsive to the indication of the user interaction with the one or more elements, a second MR rendering of the first user in the VR environment. The one or more elements are modified according to the interaction.

Abstract: A display is provided. The display includes a plurality of light-emitting elements configured to emit a first light associated with a first predetermined wavelength band. The display also includes an optical assembly including a reflective polarizer, a color conversion layer, and a color filter layer. The optical assembly is configured to at least partially convert the first light associated with the first predetermined wavelength band into a second light associated with a second predetermined wavelength band, the second light being a polarized light of a predetermined polarization.

Abstract: Mixed reality (MR) user interactions are enabled through a combination of eye tracking (user gaze determination) and secondary inputs such as finger gestures, hand gestures, eye gestures, wrist band device input, handheld controller input, and similar ones. A location of interest in displayed content may be identified through the user's gaze, fixation, and/or saccades, or other actions, such as zoom, rotate, pan, move, open actionable menus, etc., may be performed on the location of interest based on the secondary inputs.

Abstract: The disclosed system may include a housing dimensioned to secure various components including at least one physical processor and various sensors. The system may also include a camera mounted to the housing, as well as physical memory with computer-executable instructions that, when executed by the physical processor, cause the physical processor to: acquire images of a surrounding environment using the camera mounted to the housing, identify features of the surrounding environment from the acquired images, generate a map using the features identified from the acquired images, access sensor data generated by the sensors, and determine a current pose of the system in the surrounding environment based on the features in the generated map and the accessed sensor data. Various other methods, apparatuses, and computer-readable media are also disclosed.

Abstract: A system on a chip (SoC) includes a first subsystem, a second subsystem and a compression block connected to the first and second subsystems, wherein the compression block includes a decoder and an encoder. The compression block receives spill data generated by a compute element in one of the first and second subsystems, compresses the spill data using the encoder and stores the compressed spill data in a data block in local memory of one of the compute elements.

Abstract: In one embodiment, a method may obtain, from an application, (a) an image and (b) a layer frame having a first pose in front of the image. The method may generate, for a first viewpoint associated with a first time, a first display frame by separately rendering the image and the layer frame having the first pose into a display buffer. The method may display the first display frame at the first time. The method may determine an extrapolated pose for the layer frame based on the first pose of the layer frame and a second pose of a previously submitted layer frame. The method may generate, for a second viewpoint associated with a second time, a second display frame by separately rendering the image and the layer frame having the extrapolated pose into the display buffer. The method may display the second display frame at the second time.

Abstract: Embodiments of the present disclosure relate to a high performance backlight device with photonic integrated circuits. The backlight device includes a light source assembly, a multi-mode slab waveguide, and an out-coupling assembly. The light source assembly includes one or more light sources that generate light in accordance with emission instructions, and a de-speckling mechanism that conditions the generated light to mitigate speckle. The multi-mode slab waveguide in-couples the conditioned light and expands the in-coupled conditioned light in two dimensions to form a homogenous area of conditioned light within a region of the multi-mode slab waveguide. The out-coupling assembly out-couples the conditioned light from the region in a direction normal to the two dimensions, wherein a light modulation layer forms an image from the out-coupled conditioned light.

Abstract: The disclosure includes near-eye optical elements configured to suppress stray infrared light. Infrared light sources illuminate an eyebox area. A combiner layer may receive reflected infrared light and direct the reflected infrared light to a camera.

Abstract: A source-camera assembly with an isolated light path for a reference pixel is described. The assembly may include a projector, a camera assembly, a reference waveguide, and an overmold. The projector may include a source array configured to emit light and a lens assembly configured to direct the light into a local area. The camera assembly may include a sensor and a reference pixel. The sensor may be configured to detect the emitted light reflected from an object within the local area. The reference waveguide is configured to guide a portion of the light emitted by the projector from the source array to the reference pixel. The light detected by the sensor and the light detected by the reference pixel may be used to determine depth information for the object. The overmold is opaque to the emitted light and covers portions of the projector, the camera assembly, and the reference waveguide.

Abstract: An electromechanical actuator includes a primary electrode, a secondary electrode overlying at least a portion of the primary electrode, and an electroactive layer disposed between the primary electrode and the secondary electrode, where the electroactive layer has a first curvature when zero voltage is applied between the primary electrode and the secondary electrode, and a second curvature when a non-zero voltage is applied between the primary electrode and the secondary electrode.

Abstract: An apparatus, system, and method for micro-electro-mechanical system (MEMS) micromirror including a plurality of stiffening structures is described. The MEMS micromirror includes a mirror surface to reflect light, a support platform coupled along a mirror surface, and a plurality of stiffening structures formed from or coupled to the support platform. In some examples, a dimensionality or density of the stiffening structures scale across an area of the support platform in a manner to assist in keeping the mirror surface flat under torsional force.

Abstract: A method includes receiving a source shape that is to be blended with a destination shape stored in a color buffer for an image; in response to determining that the source shape is associated with a blending mode that requires updates to pixels in the color buffer uncovered by the source shape: identifying empty tiles in the color buffer uncovered by the source shape and non-empty tiles in the color buffer covered by the source shape; for each of the empty tiles, sending instructions to clear pixel values associated with the empty tile in the color buffer; and for each of the non-empty tiles: identifying pixels of the non-empty tile that are covered by the destination shape but not the source shape; and sending instructions to clear pixel values associated with the pixels.

Abstract: Embodiments relate to a display device including pixels that compensate a threshold voltage of a driving transistor, the pixels arranged in a plurality of rows. The gate of the driving transistor of each pixel is coupled to a pixel data switch and a reference voltage switch, configured to selectively provide pixel data provided via a data line and a reference voltage provided via a separate reference voltage line to the gate of the driving transistor, respectively. As pixel data and the reference voltage are provided to the driving transistor via separate lines, the compensation period of the pixel may overlap in time with a data writing period of pixels of a previous row of the display device, increasing the rate at which the display device is able to program the pixels of each row.

Abstract: An audio system controls feedback when beamforming an output for production by transducers by generating a beamforming output signal based on audio from a first set and a second set of acoustic sensors. The first set may include acoustic sensors that may experience feedback from the transducers. The second set may exclude the acoustic sensors that cause feedback. The beamforming output from each set are combined as a weighted combination based on a beamforming coefficient that may be dynamically set to increase contribution of the first set until the combined output causes feedback, enabling the total beamforming output to benefit from a larger set of acoustic sensors while avoiding detrimental feedback. The interaural characteristics of the external environment may also be analyzed and the beamforming output modified to increase a difference in the interaural characteristic and thereby increase perception of the beamforming output.

Abstract: Methods and systems described herein are directed to a virtual personal interface (herein “personal interface”) for controlling an artificial reality (XR) environment, such as by providing user interfaces for interactions with a current XR application, providing detail views for selected items, navigating between multiple virtual worlds without having to transition in and out of a home lobby for those worlds, executing aspects of a second XR application while within a world controlled by a first XR application, and providing 3D content that is separate from the current world. While in at least one of those worlds, the personal interface can itself present content in a runtime separate from the current virtual world, corresponding to an item, action, or application for that world. XR applications can be defined for use with the personal interface to create both a 3D world portion and 2D interface portions that are displayed via the personal interface.

Abstract: The disclosed computer-implemented method may include creating a computer-generated model for a haptic feedback system including a plurality of actuators arranged in a first layer of the haptic feedback system, and a plurality of channels routed in a second layer of the haptic feedback system, the second layer being below the first layer, printing a three-dimensional wax mold structure of the computer-generated model, and forming the haptic feedback system in a single step using the three-dimensional wax mold structure. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A virtual trackpad engine is configured to perform a technique for accessing and manipulating distant virtual objects in an XR environment. The technique includes generating, in an extended reality (XR) environment, a virtual model corresponding to a hand of a user. The technique also includes generating a virtual trackpad in the XR environment, where a surface of the virtual trackpad is mapped to a surface of a distant virtual object in the XR environment. Further, the technique includes determining if the virtual trackpad is activated and responsive to a determination that the virtual trackpad is activated, tracking a movement of the virtual hand. The technique further includes determining an action to be performed in relation to the distant virtual object that corresponds to the movement and, subsequently, performing the action.

Abstract: A camera system that captures an HDR (High Dynamic Range) image with an improved burst duration time and faster frame rate. The camera system determines a set of different exposure settings for creation of an HDR image. The camera system provides the set of exposure settings to the camera sensor in a series of sequential timing windows. A sensor of the camera system outputs a plurality of stale frames in sequential timing windows for receiving the set of different exposure settings. The plurality of stale frames are followed by a set of image frames in sequential timing windows, with each image captured at a different exposure setting of the set of different exposure settings. The camera system may generate a HDR image using the captured sequence of images.

Abstract: Systems and methods for managing avatar communications may include a wireless communication node which receives a data packet from a first wireless communication device. The data packet may include an identifier corresponding to a user of the first wireless communication device. The wireless communication node may generate an avatar for the user according to the identifier, receive an expression code from the first wireless communication device, and/or configure the avatar for the user according to the expression code. The wireless communication node may transmit video data corresponding to the avatar to an address of a second wireless communication device.

Abstract: Apparatuses, systems, and methods are described for a head-mounted display (HMD) headset having a pass-through configuration for a stereoscopic view. The HMD may have right and left exterior-facing stereo cameras mounted on a front face of the HMD and in the same visual plane as the user's eyes, where the exterior-facing stereo cameras collect images for stereo view synthesis. The HMD may include a processor and a memory storing instructions, which, when executed by the processor, cause the processor to perform stereo view synthesis with a machine-learning (ML) based technique including at least disocclusion filtering, in which disocclusion hole regions may be substantially removed.