Abstract: A head-mounted display (HMD) includes a multifocal block having one or more possible focal distances and includes a multifocal structure. The multifocal structure has a first focal distance and a second focal distance of the one or more possible focal distances. The multifocal structure includes one or more optical components positioned in series such that light from an electronic display is received and passes through each of the one or more optical components at least once before being output from the multifocal structure. The one or more optical components includes a switchable half waveplate (SHWP). The SHWP has a first state that causes the multifocal structure to output image light at the first focal distance, and a second state that causes the multifocal structure to output the image light at the first focal distance.

Abstract: An auto-focus head-mounted display (HMD) dynamically generates aberration-adjusted images based on measured accommodation of user's eye(s). An aberration-adjusted image is an image distorted to correct aberrations that would otherwise occur at a retina of the user due to image light passing through optics of the HMD. The aberration-adjusted image corrects the aberrations of the HMD and “accounts” for the aberrations of the eye so that the resulting retinal image is free of optical aberrations due to the HMD but preserves correct eye optical aberrations that are correlated with a current accommodative state of the eye.

Abstract: A head-mounted display (HMD) divides an image into a high resolution (HR) inset portion at a first resolution, a peripheral portion, and a transitional portion. The peripheral portion is downsampled to a second resolution that is less than the first resolution. The transitional portion is blended such that there is a smooth change in resolution that corresponds to a change in resolution between a fovea region and a non-fovea region of a retina. An inset region is generated using the HR inset portion and the blended transitional portion, and a background region is generated using the downsampled peripheral portion. The inset region is provided to a HR inset display, and the background region is provided to a peripheral display. An optics block combines the displayed inset region with the displayed background region to generate composite content.

Abstract: The disclosed apparatus may include (1) a plurality of monochromatic emitter arrays, where each of the plurality of monochromatic emitter arrays has a plurality of emitters disposed in a two-dimensional configuration and emits a monochromatic image of a corresponding color, (2) a waveguide configuration that includes (a) a top surface, (b) a bottom surface disposed opposite the top surface, (c) a coupling area that receives the monochromatic images, and (d) a decoupling area that projects a plurality of instances of a polychromatic image including a combination of the monochromatic images toward an eyebox through the bottom surface, and (3) an actuator system that produces lateral shifting of the plurality of instances of the polychromatic image between at least two positions relative to the waveguide configuration. Various other methods and systems are also disclosed.

Abstract: The disclosed apparatus may include a waveguide configuration that may include (1) a coupling area having at least one coupling element configured to receive a plurality of monochromatic images, where each of the monochromatic images is of a predetermined wavelength of light, (2) a propagation area in which light, received via the at least one coupling element, moves within a length of the waveguide configuration, and (3) a decoupling area that extends along the propagation area and includes decoupling elements that project a polychromatic image toward an eyebox, where the polychromatic image includes the monochromatic images of the predetermined wavelengths of light. Associated systems and devices are also provided herein.

Abstract: The disclosed projector device may include (1) a first monochromatic emitter array having a plurality of emitters of a first color disposed in a two-dimensional configuration and (2) a second monochromatic emitter array having a plurality of emitters of a second color disposed in a two-dimensional configuration. The first and second monochromatic emitter arrays may be configured to emit images of the first and second colors into a waveguide configuration, and the first color may be different than the second color. Associated display systems and methods are also provided.

Abstract: A depth camera assembly (DCA) determines depth information for a scene in a field of view of the DCA. The DCA includes a structured light (SL) illuminator, a camera, and a controller. The SL illuminator includes a source assembly, a SL element, a liquid crystal (LC) array, and a polarizer. The source assembly generates light, and the SL element generates a SL pattern using the generated light source. The LC array includes a plurality of addressable cells configured to polarize the SL pattern in accordance with adjustment instructions. The polarizer attenuates portions of the SL pattern based on the polarization of the portions of the SL pattern. The camera captures an image of the SL pattern, and the controller identifies portions of the image that are saturated and generates adjustment instructions based in part on the identified portions of the image, and provides the adjustment instructions to the LC array.

Abstract: A head-mounted display (HMD) includes an electronic display configured to emit image light, an optical assembly that provides optical correction to the image light, an eye tracking system, and a varifocal module. The optical assembly includes a back optical element configured to receive the image light from the electronic display, and a coupling assembly configured to couple a front optical element to a location within the optical assembly such that the front optical element receives light transmitted by the back optical element. The optical correction is determined in part by an optical characteristic of the front optical element that is replaceable. The eye tracking system determines eye tracking information for a first eye of a user of the HMD. A varifocal module adjusts focus of images displayed on the electronic display, based on the eye tracking information and the optical correction.

Abstract: A head mounted display (HMD) includes an electronic display, a microlens array, and an optics block. The electronic display is composed of a plurality of sub-pixels, and each sub-pixel is configured to emit image light according to respective emission distribution. The microlens array is coupled to the electronic display and includes a plurality of microlenses. The microlens array concentrates the emission distributions of the sub-pixels to form concentrated image light and directs the concentrated image light towards a target region. The optics block is positioned in the target region. The optics block is configured to direct the concentrated image light from the microlens array to an exit pupil of the HMD corresponding to a location of an eye of a user of the HMD.

Abstract: An eye tracker for determining a position of an eye, which may be integrated into a head-mounted display. The eye tracker includes a waveguide, switchable Bragg gratings (SBGs) that selectively out couple light from the waveguide, light sources coupled to the waveguide, a detector coupled to a return path of the waveguide, and a controller. The controller instructs at least one light source to emit at least one light beam propagating through the waveguide, and activates at least one SBG to out-couple the at least one light beam from the waveguide toward the eye. The waveguide in-couples at least one reflected light signal reflected from the eye that originates from the at least one light beam out-coupled from the waveguide. The detector detects the at least one reflected light signal. The controller determines a position of the eye using the detected at least one reflected light signal.

Abstract: Disclosed is a system and method for tracking a user's eye using structured light. The structured light system is calibrated by training a model of surface of the user's eye. A structured light emitter projects a structured light pattern (e.g., infrared structured light) onto a portion of the surface of the eye. From the viewpoint of a camera, the illumination pattern appears distorted. Based on the distortion of the illumination pattern in the captured image, the eye tracking system can determine the shape of the portion of the user's eye that the structured light is incident upon. By comparing the determined shape of the portion of the user's eye to the model, the orientation of the eye may be determined. The eye tracking system or elements thereof may be part of a head-mounted display, e.g., as part of a virtual reality system.

Abstract: A distributed augmented reality system for producing rendered environment includes a neckband formed from a first arm, second arm, and computation compartment. A power source is embedded in the first and/or second arm, while a processor is embedded in the computation compartment of the neckband. The neckband may be capable of producing an AR, VR or MR environment, or any combination thereof. The neckband device may be used with a coupled eyewear device system encompassing a Near-Eye Display (NED) and/or secondary user device, which may also produce an AR, VR or MR environment, or any combination thereof. The neckband device may provide power and computation to the eyewear device, allowing for a reduced form factor AR/VR/MR eyewear device.

Abstract: A head-mounted display (HMD) includes an eye tracking system that determines user's eye tracking information based on depth information derived from time-of-flight methods. The eye tracking system includes an illumination source, an imaging device and a controller. The illumination source illuminates the user's eye with a temporally varying irradiance pattern. The imaging device includes a detector that captures temporal phase shifts (temporal distortions) caused by a local geometry and the illumination pattern being reflected from a portion of the eye. The detector comprises multiple pixels, each pixel having multiple units for capturing, over multiple time instants, light signals related to the temporally distorted illumination pattern. The controller determines phase differences between the temporally distorted illumination pattern and the temporally varying irradiance pattern, based on the captured light signals.

Abstract: An eye tracking system comprises a structured light emitter, a camera assembly, and a controller. The structured light emitter illuminates a portion of an eye of a user with a dense structured light pattern. The dense structured light pattern produces a distorted illumination pattern on the portion of the eye. The camera assembly captures one or more images of the distorted illumination pattern that is associated with the portion of the eye. The controller estimates a position of the eye based on the captured one or more images and a model of the eye. The eye tracking system may be part of a head-mounted display.

Abstract: A heartrate monitor distributed adjusted reality system for producing rendered environments includes an eyewear device and a neckband formed from a first arm, second arm, and computation compartment. Optical, electrical and visual sensors are distributed across the neckband and eyewear device at points of contact with a user's tissue. Machine learning modules combine optical, electrical and visual measurements produced by the optical, electrical and visual sensors to determine a user's heartrate and/or other vitals. The neckband and eyewear device may be capable of adapting an adjusted reality environment in response to a determine user heartrate or other vitals.

Abstract: A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA includes an illumination source that projects a known spatial pattern modulated with a temporal carrier signal into the local area. An imaging device capture the modulated pattern projected into the local area. The imaging device includes a detector that comprises different pixel groups that are each activated to captured light at different times. Hence, different pixel groups capture different phases of the temporally modulated pattern from the local area. The DCA determines times for light from the illumination source to be reflected and captured by the imaging device from the phases captured by the different pixel groups and also determines distances between the DCA and objects in the local area based on deformation of the spatial pattern captured by the imaging device.

Abstract: A coded tracking system includes an imaging device and a target object that includes a plurality of locators emitting light according to a first pattern. An image of the target object captured by the imaging device includes light received by the imaging device from a subset of the plurality of locators. A pattern controller is configured to determine a resolution value for an adjacent pair of light sources in the captured image. The resolution value is indicative of the pattern controller being able to resolve the adjacent pair of light sources as two separate sources. The pattern controller determines a second pattern for the locators based on the resolution value. The second pattern improves a likelihood that the pattern controller can resolve between individual light sources emitting light in the second pattern. The pattern controller instructs the target object for the locators to emit light according to the second pattern.

Abstract: An eyewear device has an optical element, a source, a dichroic mirror, and a camera. The optical element has a front surface, a back surface, a rim, and an angled portion of the rim. The source emits light in a first band of light and is configured to illuminate a portion of an eye of a user of the eyewear device. The dichroic mirror is arranged proximate to the angled portion of the rim, is reflective in the first band of light, is transmissive in a second band of light, and is configured to direct light in the first band reflected from the portion of the eye toward a first position. The camera is located in the first position that is located in a plane of the optical element, and the camera is configured to capture images of the light in the first band reflected by the dichroic mirror.

Abstract: An eye tracker for determining a position of an eye, which may be integrated into a head-mounted display. The eye tracker includes at least one waveguides with an array of grating structures, an array of light sources, a detector, and a controller. The controller activates at least one light source at a time to emit at least one light beam that propagates through the at least one waveguide and couple out via the array of grating structures towards a user's eye. Light signals reflected from the user's eye and skin surfaces are coupled into the at least one waveguide and propagate to the detector that captures the reflected light signals. The controller calculates magnitudes of the reflected light signals to obtain a signature of converted light signals, and determines a position and orientation of the user's eye based on the signature of converted light signals.

Abstract: A depth camera assembly (DCA) includes a projector, a detector and a controller. The projector emits a tiled structured light (SL) pattern onto a local area. Each illumination source of the projector includes one or more light emitters and an augmented diffractive optical element (ADOE) designed with a pattern mask. The ADOE diffracts at least a portion of light beams emitted from the light emitters to form a first SL pattern projection having a field-of-view corresponding to a first tileable boundary. The pattern mask prevents projection of light that would otherwise be diffracted outside the first tileable boundary. The first SL pattern projection is combined with at least a second SL pattern projection into the tiled SL pattern illuminating objects in the local area. The detector captures images of the objects illuminated by the SL pattern. The controller determines depth information for the objects using the captured images.