Abstract: An eye tracking system comprises a structured light emitter, a camera assembly, and a controller. The structured light emitter illuminates a portion of an eye of a user with a dense structured light pattern. The dense structured light pattern produces a distorted illumination pattern on the portion of the eye. The camera assembly captures one or more images of the distorted illumination pattern that is associated with the portion of the eye. The controller estimates a position of the eye based on the captured one or more images and a model of the eye. The eye tracking system may be part of a head-mounted display.

Abstract: Techniques for eye-tracking in a near-eye display system are disclosed. One example of a near-eye display system includes a waveguide-based display substrate that is transparent to visible light and configured to be placed in front of a user's eye. The waveguide-based display substrate includes a first surface area configured to specularly reflect a first portion of invisible light reflected by the user's eye to a camera to form a first image of the user's eye in a first area of an image frame, and a light deflector embedded in the waveguide-based display substrate or formed on a second surface area of the waveguide-based display substrate. The light deflector is configured to direct a second portion of the invisible light reflected by the user's eye to the camera to form a second image of the user's eye in a second area of the image frame.

Abstract: A system is describes that includes a head mounted display (HMD) and a portable docking station configured to receive the HMD for calibration of one or more components of the HMD. The portable docking station includes at least one calibration target, e.g., a checkerboard pattern and/or a convex reflector. Techniques of this disclosure include calibrating an image capture device of the HMD based on one or more images of the calibration target captured by the image capture device when the HMD is placed in the portable docking station. The disclosed techniques may be applied to calibrate multiple different components of the HMD, including image capture devices such as eye-tracking cameras and inside-out cameras, displays, illuminators, sensors, and the like. In some examples, a rechargeable battery of the HMD may be charged when the HMD is placed in the portable docking station.

Abstract: Disclosed herein are techniques for eye illumination for eye position tracking. An illuminator for eye illumination includes a light source, a substrate configured to be placed in front of an eye of a user, and at least one reflector located within the substrate. The light source is configured to emit light in a first wavelength range to illuminate the at least one reflector. The at least one reflector is configured to reflect the light in the first wavelength range to the eye of the user, and transmit light in a second wavelength range different from the first wavelength range. The substrate is transparent to both the light in the first wavelength range and the light in the second wavelength range.

Abstract: An eye-tracking system includes a holographic illuminator and a detector. The holographic illuminator includes a light source configured to provide light and a holographic medium optically coupled with the light source. The holographic medium is configured to receive the light provided from the light source and concurrently project a plurality of separate light patterns toward an eye. The detector is configured to detect a reflection of at least a subset of the plurality of separate light patterns, reflected off the eye, for determining a location of a pupil of the eye. Also disclosed is a method for determining a location of a pupil of an eye with the eye-tracking system that includes the holographic illuminator.

Abstract: A method includes providing light from a light source and separating the light into a first portion of the light and a second portion of the light that is spatially separated from the first portion of the light. The method also includes transmitting the first portion of the light through a first set of optical elements to provide a first wide-field beam, transmitting the second portion of the light through a second set of optical elements to provide a second wide-field beam that is spatially separated from the first wide-field beam, and transmitting the second wide-field beam through a third set of optical elements to provide a plurality of separate light patterns. The method further includes concurrently projecting the first wide-field beam and the plurality of separate light patterns onto an optically recordable medium to form a holographic medium.

Abstract: A system for making a holographic medium for use in generating light patterns for eye tracking includes a light source configured to provide light and a beam splitter configured to separate the light into a first portion of the light and a second portion of the light that is spatially separated from the first portion of the light. The system also includes a first set of optical elements configured to transmit the first portion of the light for providing a first wide-field beam onto an optically recordable medium and one or more diffractive optical elements configured to receive the second portion of the light and project a plurality of separate light patterns onto the optically recordable medium for forming the holographic medium.

Abstract: A system for making a holographic medium for use in generating light patterns for eye tracking includes a light source configured to provide light and a beam splitter configured to separate the light into a first portion of the light and a second portion of the light that is spatially separated from the first portion of the light. The system also includes a first set of optical elements configured to transmit the first portion of the light for providing a first wide-field beam onto an optically recordable medium, a second set of optical elements configured to transmit the second portion of the light for providing a second wide-field beam, and a plurality of parabolic reflectors optically coupled with the second set of optical elements and configured to receive the second wide-field beam and project a plurality of separate light patterns onto the optically recordable medium for forming the holographic medium.

Abstract: A system for making a holographic medium includes a light source configured to provide light, and a beam splitter configured to separate the light into a first portion of the light and a second portion of the light that is spatially separated from the first portion of the light. The system also includes a first set of optical elements configured to transmit the first portion of the light for providing a first wide-field beam onto an optically recordable medium, a second set of optical elements configured to transmit the second portion of the light for providing a second wide-field beam, and a plurality of prisms optically coupled with the second set of optical elements and configured to receive the second wide-field beam and project a plurality of separate light patterns onto the optically recordable medium for forming the holographic medium.

Abstract: A system for making a holographic medium for use in generating light patterns for eye tracking includes a light source configured to provide light and a beam splitter configured to separate the light into a first portion of the light and a second portion of the light that is spatially separated from the first portion of the light. The system also includes a first set of optical elements configured to transmit the first portion of the light for providing a first wide-field beam onto an optically recordable medium and a plurality of optical fibers configured to receive the second portion of the light and project a plurality of separate light patterns onto the optically recordable medium for forming the holographic medium.

Abstract: A system for making a holographic medium includes a light source configured to provide light and a beam splitter configured to separate the light into a first portion of the light and a second portion of the light that is spatially separated from the first portion of the light. The system also includes a first set of optical elements configured to transmit the first portion of the light for providing a first wide-field beam onto an optically recordable medium, a second set of optical elements configured to transmit the second portion of the light through for providing a second wide-field beam, and a plurality of lenses optically coupled with the second set of optical elements configured to receive the second wide-field beam and project a plurality of separate light patterns onto the optically recordable medium for forming the holographic medium.

Abstract: A head mounted display (HMD) comprises an eye tracking system configured to perform a calibration process using an eye tracking system of the HMD that includes determining a pupillary axis and/or determining an angular offset between the pupillary axis and the eye's true line of sight. The eye tracking system obtains an eye model captures images of the user's pupil while the user is looking at a target or other content displayed on the HMD. In some embodiments, the calibration process is based on a single image of the user's eye and is performed only once. For example, the process can be performed the first time the user uses the HMD, which stores the calibration data for the user in a memory for future use.

Abstract: An eyewear device has an optical element, a patterned optical filter, and a camera. The optical element receives light that includes light in a visible band and light in an infrared (IR) band. The patterned optical filter is disposed on the optical element and has a filtering portion and a plurality of non-filtering portions. The filtering portion is transmissive to light in the visible band and filtering of light in the IR band. The non-filtering portions are transmissive to light in the visible band and transmissive to light in the IR band. Some portion of the received light in the IR band passes through the non-filtering portions and illuminates a portion of an eye of a user with a pattern. The camera captures images of the portion of the eye that is illuminated with the pattern.

Abstract: A head mounted display (HMD) comprises an eye tracking system configured to enable eye-tracking using light. The eye tracking system implements time-multiplexing by configuring a source assembly comprising a plurality of light sources to project at least a first light pattern towards the user's eye over a first time period, and a second light pattern towards the user's eye over a second time period in accordance with a set of emission instructions. A camera assembly is configured to capture images of the user's eye during the first and second time periods in accordance with a set of imaging instructions, the captured images containing one or more glints corresponding to reflections of the first or second light patterns on the cornea of the user's eye. The location of the glints may be used to determine a shape or orientation of the eye.

Abstract: A method for providing augmented reality contents to a wearer using a head-mounted display device that includes an eye tracking sensor, a light projector, a beam steerer, and a combiner includes determining, with the eye tracking sensor, a position of a pupil of an eye of the wearer. The method also includes projecting, with the light projector, light for rendering images based at least on the augmented reality contents, and changing, with the beam steerer, a direction of the light from the light projector based on the position of the pupil. The light from the beam steerer is directed toward the combiner and the light from the beam steerer and light from an outside of the head-mounted display device are combined, by the combiner, to provide an overlap of a rendered image and a real image that corresponds to the light from the outside of the head-mounted display device.

Abstract: A head mounted display (HMD) comprises an eye tracking system configured to enable eye-tracking using light. The eye tracking system implements time-multiplexing by configuring a source assembly comprising a plurality of light sources to project at least a first light pattern towards the user's eye over a first time period, and a second light pattern towards the user's eye over a second time period in accordance with a set of emission instructions. A camera assembly is configured to capture images of the user's eye during the first and second time periods in accordance with a set of imaging instructions, the captured images containing one or more glints corresponding to reflections of the first or second light patterns on the cornea of the user's eye. The location of the glints may be used to determine a shape or orientation of the eye.

Abstract: An eye tracker characterization system comprising a scanning retinal imaging unit and a controller. The scanning retinal imaging unit characterizes eye tracking information determined by an eye tracking unit under test. The scanning retinal imaging unit includes a scanning optics assembly and a detector. The scanning optics assembly scans light in a first band across a retinal region of an eye of a user. The detector detects the scanned light reflected from the retinal region. The controller selects eye tracking information received from the eye tracking unit under test and corresponding eye tracking parameters received from the scanning retinal imaging unit. The controller calculates differences between the selected eye tracking information and the corresponding selected eye tracking parameters, and characterizes the selected eye tracking information based on the calculated differences.

Abstract: A wearable eye tracking system includes a pair of looping coils in a Helmholtz configuration and an additional looping coil. In one configuration, areas enclosed by the pair of looping coils in the Helmholtz configuration are in parallel with each other, while an area enclosed by the additional looping coil is offset from (i.e., not parallel with) the areas enclosed by the pair of looping coils. In this configuration, the pair of looping coils generates uniform magnetic fields between the two areas of the pair of looping coils in a first direction orthogonal to the areas of the pair of looping coils, and the additional looping coil generates additional non-uniform (or divergent) magnetic fields in a second direction transversal to the first direction.

Abstract: Embodiments relate to a head-mounted display including an eye tracking system. The eye tracking system includes a source assembly, a camera, and a controller. In some embodiments, the source assembly is a plurality of sources and are positioned to illuminate at least a peripheral area of a cornea of an eye. In some embodiments, the sources are masked to be a particular shape. The peripheral region is a location on the eye where the cornea transitions to the sclera. In some embodiments, the camera can detect a polarization of the reflected light, and uses polarization to disambiguate possible reflection locations. Similarly, time of flight may also be used to disambiguate potential reflection locations. The controller uses information from the detector to track positions of the user's eyes.

Abstract: Disclosed is a system and method for tracking a user's eye using structured light. The structured light system is calibrated by training a model of surface of the user's eye. A structured light emitter projects a structured light pattern (e.g., infrared structured light) onto a portion of the surface of the eye. From the viewpoint of a camera, the illumination pattern appears distorted. Based on the distortion of the illumination pattern in the captured image, the eye tracking system can determine the shape of the portion of the user's eye that the structured light is incident upon. By comparing the determined shape of the portion of the user's eye to the model, the orientation of the eye may be determined. The eye tracking system or elements thereof may be part of a head-mounted display, e.g., as part of a virtual reality system.