Abstract: A head-mounted display (HMD) includes an eye tracking system that determines user's eye tracking information based on depth information derived from time-of-flight methods. The eye tracking system includes an illumination source, an imaging device and a controller. The illumination source illuminates the user's eye with a temporally varying irradiance pattern. The imaging device includes a detector that captures temporal phase shifts (temporal distortions) caused by a local geometry and the illumination pattern being reflected from a portion of the eye. The detector comprises multiple pixels, each pixel having multiple units for capturing, over multiple time instants, light signals related to the temporally distorted illumination pattern. The controller determines phase differences between the temporally distorted illumination pattern and the temporally varying irradiance pattern, based on the captured light signals.

Abstract: A head-mounted display (HMD) presents content for viewing by users. The HMD includes a display element, an optics block, and a camera. The display element includes content pixels for providing light corresponding to the displayed content and one or more tracking pixels for providing tracking light used for tracking the user's eye movements. The optics block directs light from the display element (light corresponding to the displayed content and that of tracking light) to an exit pupil of the HMD. The camera captures one or images of an eye of the user in response to projecting tracking light on the eye, where the one or more captured images include a distortion of the projected tracking light and are used in determining an orientation of the eye at a time of capturing the one or more images of the eye.

Abstract: A head-mounted display (HMD) that includes a high resolution (HR) inset display and a peripheral display. The HR inset display is configured to display an inset region that includes a portion of an image at a first resolution that corresponds to a resolution of a fovea region of a human eye. The peripheral display displays a background region, the background region having a second resolution that is less than the first resolution, the second resolution corresponding to a resolution of a non-fovea region of the human eye. The HMD includes an optics block that combines the inset region and the background region to create composite content at retinal resolution, and direct the composite content to an exit pupil of the HMD corresponding to a location of an eye of a user of the HMD.

Abstract: A head mounted display (HMD) comprises an eye tracking system configured to enable eye-tracking using polarization. The eye tracking system includes an illumination source and an eye tracking unit comprising a polarization sensitive optical detector. The one or more illumination sources are configured to illuminate an eye and generate reflections directed towards the optical detector. The eye tracking unit is configured to determine a 3D shape of the eye based on the polarization of the reflections. The determined 3D shape of the eye is used to update a stored model of the eye in response to the one or more model parameter values extracted from the determined depth map of the corneal surface. The eye tracking system determines eye tracking information based on the updated model in order to improve eye tracking performance.

Abstract: Disclosed is a system and method for tracking a user's eye using structured light. The structured light system is calibrated by training a model of surface of the user's eye. A structured light emitter projects a structured light pattern (e.g., infrared structured light) onto a portion of the surface of the eye. From the viewpoint of a camera, the illumination pattern appears distorted. Based on the distortion of the illumination pattern in the captured image, the eye tracking system can determine the shape of the portion of the user's eye that the structured light is incident upon. By comparing the determined shape of the portion of the user's eye to the model, the orientation of the eye may be determined. The eye tracking system or elements thereof may be part of a head-mounted display, e.g., as part of a virtual reality system.

Abstract: A distributed augmented reality system for producing rendered environment includes a neckband formed from a first arm, second arm, and computation compartment. A power source is embedded in the first and/or second arm, while a processor is embedded in the computation compartment of the neckband. The neckband may be capable of producing an AR, VR or MR environment, or any combination thereof. The neckband device may be used with a coupled eyewear device system encompassing a Near-Eye Display (NED) and/or secondary user device, which may also produce an AR, VR or MR environment, or any combination thereof. The neckband device may provide power and computation to the eyewear device, allowing for a reduced form factor AR/VR/MR eyewear device.

Abstract: A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA includes an illumination source that projects a known spatial pattern modulated with a temporal carrier signal into the local area. An imaging device capture the modulated pattern projected into the local area. The imaging device includes a detector that comprises different pixel groups that are each activated to captured light at different times. Hence, different pixel groups capture different phases of the temporally modulated pattern from the local area. The DCA determines times for light from the illumination source to be reflected and captured by the imaging device from the phases captured by the different pixel groups and also determines distances between the DCA and objects in the local area based on deformation of the spatial pattern captured by the imaging device.

Abstract: A head-mounted display (HMD) includes an eye tracking system that determines user's eye tracking information based on depth information derived from time-of-flight methods. The eye tracking system includes an illumination source, an imaging device and a controller. The illumination source illuminates the user's eye with a temporally varying irradiance pattern. The imaging device includes a detector that captures temporal phase shifts (temporal distortions) caused by a local geometry and the illumination pattern being reflected from a portion of the eye. The detector comprises multiple pixels, each pixel having multiple units for capturing, over multiple time instants, light signals related to the temporally distorted illumination pattern. The controller determines phase differences between the temporally distorted illumination pattern and the temporally varying irradiance pattern, based on the captured light signals.

Abstract: A head-mounted display (HMD) includes an electronic display configured to emit image light, an optical assembly that provides optical correction to the image light, an eye tracking system, and a varifocal module. The optical assembly includes a back optical element configured to receive the image light from the electronic display, and a coupling assembly configured to couple a front optical element to a location within the optical assembly such that the front optical element receives light transmitted by the back optical element. The optical correction is determined in part by an optical characteristic of the front optical element that is replaceable. The eye tracking system determines eye tracking information for a first eye of a user of the HMD. A varifocal module adjusts focus of images displayed on the electronic display, based on the eye tracking information and the optical correction.

Abstract: A depth camera assembly (DCA) includes a projector, a detector and a controller. The projector emits a tiled structured light (SL) pattern onto a local area. Each illumination source of the projector includes one or more light emitters and an augmented diffractive optical element (ADOE) designed with a pattern mask. The ADOE diffracts at least a portion of light beams emitted from the light emitters to form a first SL pattern projection having a field-of-view corresponding to a first tileable boundary. The pattern mask prevents projection of light that would otherwise be diffracted outside the first tileable boundary. The first SL pattern projection is combined with at least a second SL pattern projection into the tiled SL pattern illuminating objects in the local area. The detector captures images of the objects illuminated by the SL pattern. The controller determines depth information for the objects using the captured images.

Abstract: A head-mounted display (HMD) includes an eye tracking system that determines user's eye tracking information based on combining structured light information and time-of-flight information. The eye tracking system includes an illumination source, an imaging device and a controller. The illumination source modulates a structured light by a carrier signal and illuminates a user's eye with the modulated structured light. The imaging device includes a detector that captures the modulated structured light. The detector comprises a plurality of pixel groups, each pixel group receiving a control signal determining when a pixel group captures light, the control signal causing pixel groups to capture light at different times relative to other pixel groups. The controller determines phases of the carrier signal based on intensities of light received by different pixel groups and generates depth information related to surfaces of the user's eye, which is used to model and track the user's eye.

Abstract: A head-mounted display (HMD) includes an eye tracking system that determines user's eye tracking information based on combining structured light information and time-of-flight information. The eye tracking system includes an illumination source, an imaging device and a controller. The illumination source modulates a structured light by a carrier signal and illuminates a user's eye with the modulated structured light. The imaging device includes a detector that captures the modulated structured light. The detector comprises a plurality of pixel groups, each pixel group receiving a control signal determining when a pixel group captures light, the control signal causing pixel groups to capture light at different times relative to other pixel groups. The controller determines phases of the carrier signal based on intensities of light received by different pixel groups and generates depth information related to surfaces of the user's eye, which is used to model and track the user's eye.

Abstract: A head-mounted display (HMD) includes a multifocal block having one or more possible focal distances and includes a multifocal structure. The multifocal structure has a first focal distance and a second focal distance of the one or more possible focal distances. The multifocal structure includes one or more optical components positioned in series such that light from an electronic display is received and passes through each of the one or more optical components at least once before being output from the multifocal structure. The one or more optical components includes a switchable half waveplate (SHWP). The SHWP has a first state that causes the multifocal structure to output image light at the first focal distance, and a second state that causes the multifocal structure to output the image light at the first focal distance.

Abstract: A head-mounted display (HMD) includes a display, an optical assembly and an eye tracking system that determines user's eye tracking information. The optical assembly comprises a front optical element in series with a back optical element adjacent to the display. One surface of the back optical element is coated to reflect infrared (IR) light. The eye tracking system includes an illumination source and an imaging device positioned between the front optical element and the back optical element. The illumination source emits IR light that illuminates the coated surface and reflects towards the user's eye. The imaging device captures an image of the user's eye based on light reflected from the user's eye and from the coated surface. The eye tracking information is determined based on the captured image. The HMD adjusts presentation of images displayed on the display, based on the eye tracking information.

Abstract: Disclosed is a system and method for tracking a user's eye using structured light. The structured light system is calibrated by training a model of surface of the user's eye. A structured light emitter projects a structured light pattern (e.g., infrared structured light) onto a portion of the surface of the eye. From the viewpoint of a camera, the illumination pattern appears distorted. Based on the distortion of the illumination pattern in the captured image, the eye tracking system can determine the shape of the portion of the user's eye that the structured light is incident upon. By comparing the determined shape of the portion of the user's eye to the model, the orientation of the eye may be determined. The eye tracking system or elements thereof may be part of a head-mounted display, e.g., as part of a virtual reality system.

Abstract: A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA includes an illumination source that projects a known spatial pattern modulated with a temporal carrier signal into the local area. An imaging device capture the modulated pattern projected into the local area. The imaging device includes a detector that comprises different pixel groups that are each activated to captured light at different times. Hence, different pixel groups capture different phases of the temporally modulated pattern from the local area. The DCA determines times for light from the illumination source to be reflected and captured by the imaging device from the phases captured by the different pixel groups and also determines distances between the DCA and objects in the local area based on deformation of the spatial pattern captured by the imaging device.

Abstract: A head-mounted display (HMD) divides an image into a high resolution (HR) inset portion at a first resolution, a peripheral portion, and a transitional portion. The peripheral portion is downsampled to a second resolution that is less than the first resolution. The transitional portion is blended such that there is a smooth change in resolution that corresponds to a change in resolution between a fovea region and a non-fovea region of a retina. An inset region is generated using the HR inset portion and the blended transitional portion, and a background region is generated using the downsampled peripheral portion. The inset region is provided to a HR inset display, and the background region is provided to a peripheral display. An optics block combines the displayed inset region with the displayed background region to generate composite content.

Abstract: A head-mounted display (HMD) divides an image into a high resolution (HR) inset portion at a first resolution, a peripheral portion, and a transitional portion. The peripheral portion is downsampled to a second resolution that is less than the first resolution. The transitional portion is blended such that there is a smooth change in resolution that corresponds to a change in resolution between a fovea region and a non-fovea region of a retina. An inset region is generated using the HR inset portion and the blended transitional portion, and a background region is generated using the downsampled peripheral portion. The inset region is provided to a HR inset display, and the background region is provided to a peripheral display. An optics block combines the displayed inset region with the displayed background region to generate composite content.

Abstract: A head-mounted display (HMD) that includes a high resolution (HR) inset display and a peripheral display. The HR inset display is configured to display an inset region that includes a portion of an image at a first resolution that corresponds to a resolution of a fovea region of a human eye. The peripheral display displays a background region, the background region having a second resolution that is less than the first resolution, the second resolution corresponding to a resolution of a non-fovea region of the human eye. The HMD includes an optics block that combines the inset region and the background region to create composite content at retinal resolution, and direct the composite content to an exit pupil of the HMD corresponding to a location of an eye of a user of the HMD.

Abstract: An illumination source in a depth camera assembly (DCA) includes multiple emitters on a single substrate and a diffractive optical element (DOE) assembly including multiple DOEs. Each DOE is configured to generate a structured light pattern from the light emitted from a corresponding emitter. The DOE assembly projects the structured light patterns onto portions of a local area based in part on DOE projection geometries associated with the DOEs. The illumination source may also include a second DOE assembly common to the multiple emitters.