Abstract: The disclosed projector device may include (1) a first monochromatic emitter array having a plurality of emitters of a first color disposed in a two-dimensional configuration and (2) a second monochromatic emitter array having a plurality of emitters of a second color disposed in a two-dimensional configuration. The first and second monochromatic emitter arrays may be configured to emit images of the first and second colors into a waveguide configuration, and the first color may be different than the second color. Associated display systems and methods are also provided.

Abstract: An artificial reality system includes a head mounted display (HMD) and a physical overlay engine that generates overlay image data, referred to herein as a physical overlay image, corresponding to the physical objects in a three-dimensional (3D) environment. In response to an activation condition, a rendering engine of the artificial reality system renders the overlay image data to overlay artificial reality content for display on the HMD, thereby apprising a user of the HMD of their position with respect to the physical objects in the 3D environment.

Abstract: Disclosed herein are techniques for improving the light emitting efficiency of micro light emitting diodes. According to certain embodiments, micro-LEDs having small physical dimensions are fabricated on III-nitride materials with semi-polar crystal lattice orientations to reduce the surface recombination of excess charge carriers that does not generate photons and to reduce the polarization induced internal field that may cause energy band shift and aggravate the Quantum-Confined Stark Effect, thereby increasing the peak quantum efficiencies and/or reducing the peak efficiency current density of the micro-LEDs.

Abstract: A waveguide coupler may be coupled to a multi-beam light source, such as an array of superluminescent light-emitting diodes. The waveguide coupler includes a substrate having an end facet and a surface, e.g. a top flat surface, adjoining the end facet. At least one tilted reflector is supported by the substrate. A plurality of waveguides supported by the substrate extend between the end facet and the at least one tilted reflector. The at least one tilted reflector is configured to redirect light propagating in the plurality of waveguides to the surface of the substrate. In this manner, the waveguide coupler may provide an array of surface emission points on a substrate. All the surface emission points are disposed in one plane and may be suitably configured for subsequent joint collimation for use e.g. in a scanning projector display.

Abstract: This disclosure describes techniques that include aligning processing of audio samples collected by multiple audio sensors or microphones. In one example, this disclosure describes a method comprising enabling a first microphone; processing, by an audio processor and using a first processing pipeline, audio data samples collected by the first microphone; enabling a second microphone a period of time after enabling the first microphone; processing, by the audio processor and using a second processing pipeline, a sample of audio data collected by the second microphone by synchronizing starting times for the first and second processing pipelines.

Abstract: A virtual reality (VR) system includes a console an imaging device, a head mounted display (HMD) and a user input device. The console includes a virtual reality (VR) engine, a tracking module and an application store. The HMD includes a display element configured to display content to a user wearing the HMD. The virtual reality engine is configured to determine a vector for a virtual object thrown at a target in response to physical input from the user, a gaze vector for the eyes of the user and a virtual object position vector for the target and modify the vector for the virtual object based on at least one of the gaze vector and the virtual object position vector.

Abstract: An acoustic element includes a nanovoided polymer layer having a first nanovoid topology in an unactuated state and a second nanovoid topology different than the first nanovoid topology in an actuated state. Capacitive actuation of the nanovoided polymer layer, for instance, can be used to reversibly control the size and shape of the nanovoids within the polymer layer and hence tune its sound damping characteristics or sound transduction behavior, e.g., during operation of the acoustic element. An acoustic element may be configured for passive or active sound attenuation. Various other apparatuses, systems, materials, and methods are also disclosed.

Abstract: An artificial reality system can display notifications in various configurations including in a minimized version or a maximized version. The artificial reality system can initially display a minimized version of the notification. Upon identifying a first trigger event, such as the user's gaze resting on the minimized version of the notification or a rotation of a user's wrist, the artificial reality system can change the display of the notification from the minimized version to the maximized version. The artificial reality system can identify a second trigger event, such as the user's gaze not being directed to the maximized version of the notification or a rotation of the wrist in an opposite direction from the first wrist rotation. In response to the second trigger event, the artificial reality system can stop display of the maximized version of the notification.

Abstract: A display system comprises a light source assembly, a display assembly, a camera assembly, and a controller. The light source assembly is configured to generate visible light and infrared light. The display assembly is configured to generate image light using the visible light and to generate tracking light using the infrared light. The tracking light and the image light pass through a beam splitter prior to being projected into a local area. The camera assembly is configured to capture one or more images of the local area illuminated with the tracking light. The images are illuminated with the tracking light that passes through the beam splitter prior to be being captured by the camera assembly. The controller is configured to calculate depth information for objects in the local area using the one or more images.

Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.

Abstract: In a waveguide display, a first projector is configured to generate display light for a first field of view (FOV) of a display image. A first input coupler is configured to couple the display light for the first FOV into a visibly transparent substrate. A first set of gratings is configured to couple the display light for the first FOV out of the substrate at a first two-dimensional array of locations of the substrate. A second projector is configured to generate display light for a second FOV of the display image different from the first FOV. A second input coupler is configured to couple the display light for the second FOV into the substrate. A second set of gratings is configured to couple the display light for the second FOV out of the substrate at a second two-dimensional array of locations of the substrate.

Abstract: In one embodiment, a method for tracking includes capturing a first frame of the environment using a first camera, identifying, in the first frame, a first patch that corresponds to the first feature, accessing a first local memory of the first camera that stores reference patches identified in one or more previous frames captured by the first camera, and determining that none of the reference patches stored in the first local memory corresponds to the first feature. The method further includes receiving, from a second camera through a data link connecting the second camera with the first camera, a reference patch corresponding to the first feature. The reference patch is identified in a previous frame captured by the second camera and of the second camera. The method may then determine correspondence data between the first patch and the reference patch, and tracks the first feature in the environment based on the determined correspondence data.

Abstract: In one example, an apparatus comprises: a lens assembly comprising one or more polymer layers, each layer including a lens portion and an extension portion and an image sensor positioned below the lens assembly and bonded to the lens assembly via a bonding layer and configured to sense light that passes through the lens portion of the one or more polymer layers.

Abstract: In one embodiment, a system may access a codec that encodes an appearance associated with a subject and comprise codec portions that respectively correspond to body parts of the subject. The system may generate a training codec that comprises a first subset of the codec portions (a first set of body parts) and a modified second subset of the codec portions (muted body parts). The system may decode the training codec using a machine-learning model to generate a mesh of the subject. The system may transform the mesh of the subject based on a predetermined pose. The system may update the machine-learning model based on a comparison between the transformed mesh and a target mesh of the subject having the predetermined pose. The system in the present application can train a machine-learning model to render an avatar with a pose using uncorrelated codec portions corresponding to different body parts.

Abstract: A design system generates a design for an eyewear frame customized for a user. The eyewear frame provides audio content to the user. The design system captures anthropometric data of the user. Using machine learning techniques, the design system determines features of the user from the anthropometric data and generates a three dimensional (3D) geometry of the portion of the user's head. A design for the customized eyewear frame is generated based on the 3D geometry of the portion of the user's head. The design of the customized eyewear frame includes design parameters that describe a shape of a coupling element that ensures the eyewear frame is customized to the user's head.

Abstract: Methods and apparatus for substantially real-time detection of spike events in neuromuscular data. The method comprises receiving a plurality of neuromuscular signals from a plurality of neuromuscular sensors arranged on one or more wearable devices worn by a user, detecting, based on the plurality of neuromuscular signals or information derived from the plurality of neuromuscular signals, at least one spike event corresponding to firing of an action potential in at least one motor unit, determining, based on the plurality of neuromuscular signals or the information derived from the plurality of neuromuscular signals, a biological source of the detected at least one spike event, and generating at least one output based, at least in part, on the detected at least one spike event and/or the determined biological source of the detected at least one spike event.

Abstract: An optical device includes a waveguide, a projector, a reflective display, and an in-coupler. The waveguide has a first side and an opposing second side. The projector is configured to project illumination light toward the first side of the waveguide. The reflective display is configured to receive the illumination light and to output image light toward the second side of the waveguide. The in-coupler is configured to receive the image light output by the reflective display and redirect a portion of the image light so that the portion of the image light undergoes total internal reflection inside the waveguide.

Abstract: There is disclosed a method of and apparatus for predictive tracking for a head mounted display. The method comprises obtaining one or more three-dimensional angular velocity measurements from a sensor monitoring the head mounted display and setting a prediction interval based upon the one or more three-dimensional angular velocity measurements such that the prediction interval is substantially zero when the head mounted display is substantially stationary and the prediction interval increases up to a predetermined latency interval when the head mounted display is moving at an angular velocity of or above a predetermined threshold. The method further includes predicting a three-dimensional orientation for the head mounted display to create a predicted orientation at a time corresponding to the prediction interval, and generating a rendered image corresponding to the predicted orientation for presentation on the head mounted display.

Abstract: A depth camera assembly (DCA) determines depth information. The DCA projects a dynamic structured light pattern into a local area and captures images including a portion of the dynamic structured light pattern. The DCA determines regions of interest in which it may be beneficial to increase or decrease an amount of texture added to the region of interest using the dynamic structured light pattern. For example, the DCA may identify the regions of interest based on contrast values calculated using a contrast algorithm, or based on the parameters received from a mapping server including a virtual model of the local area. The DCA may selectively increase or decrease an amount of texture added by the dynamic structured light pattern in portions of the local area. By selectively controlling portions of the dynamic structured light pattern, the DCA may decrease power consumption and/or increase the accuracy of depth sensing measurements.

Abstract: A method to suppress a rainbow effect and an optical device thereof are provided. The method includes receiving, by a dimming element, a light from a real world. The method further includes attenuating, by the dimming element, an intensity of the light with a degree of attenuation growing with an incidence angle. The dimming element includes a liquid crystal (LC) dimming element.