Abstract: A stereoscopic 3D imaging system includes multiple imaging sensors with adjustable optics. The adjustable optics are variable to alter the FOV of each of the multiple imaging sensors to improve angular resolution of the imaging system.

Abstract: Techniques for de-aliasing depth ambiguities included within infrared phase depth images are described herein. An illuminator emits reference light towards a target object. Some of this light is reflected back and detected. A phase image is generated based on phase differences between the reference light and the reflected light. The phase differences represent changes in depth within overlapping sinusoidal periods of the reference and reflected light. The phase image also includes ambiguities because multiple different depths within the phase image share the same phase difference value, even though these depths actually correspond to different real-world depths. The phase image is fed as input to a machine learning (“ML”) component, which is configured to de-alias the ambiguities by determining, for each pixel in the phase image, a corresponding de-aliasing interval. A depth map is generated based on the phase image and any de-aliasing intervals generated by the ML component.

Abstract: A multi-section laser device is configured with a gain section and an integrated photodetector section. The photodetector section, rather than being a separate component, is integrated directly into the body of the laser. The integrated photodetector section absorbs photons generated by the gain section and creates a photocurrent that is proportional to the output of the multi-section laser device. The measured photocurrent is usable to calculate power output of the multi-section laser device and to identify any adjustments that may be needed to be made to the laser in order to achieve desired laser light output.

Abstract: Techniques for improving laser image quality are disclosed herein. An ultra-compact illumination module includes multiple illuminators, photodetectors, and color filters. The illuminators each emit a different spectrum of light. Because of the compact nature of the module and the positioning of the illuminators relative to one another, the different spectrums of light overlap one another prior to being detected by the photodetectors. Each of the photodetectors is associated with a corresponding one of the illuminators, and each of the color filters is associated with a corresponding one of the photodetectors. Each color filter is positioned in-between its corresponding illuminator and photodetector and passes a particular spectrum of light while filtering out other spectrums of light. Consequently, the photodetectors each receive spectrally filtered light having passed through at least one of the color filters. The power output of the illuminators can also be corrected based on output from the photodetectors.

Abstract: A head-mounted display comprises a stereo pair of outward-facing cameras that are separated by a baseline distance when the head-mounted display is being worn by the user, and a controller. The controller is configured to receive an inter-pupil distance (IPD) of the user and to compare the IPD to the baseline distance of the stereo pair of outward-facing cameras. Image data of an environment is received from the stereo pair of outward-facing cameras. If the difference between the IPD and the baseline distance is less than a first threshold, the image data is passed through to the head-mounted display without correcting for the IPD. If the difference between the IPD and the baseline distance is greater than the first threshold, the image data is reprojected based on the IPD prior to displaying the image data on the head-mounted display.

Abstract: An improved eye tracking illumination system is disclosed. The system includes (i) an RGB laser device that is associated with a first collimating optic and (ii) an IR illumination device that is associated with a second collimating optic. The system also includes a DMA that has a MEMS mirror system. The DMA optically combines IR light and RGB light to generate combined light. The combined light is then directed towards a user's eye via a transport medium (e.g., a waveguide). One or more photodetector(s) are positioned to capture reflected light that is reflected off of the user's eye. The photodetectors include an IR detector configured to detect reflected IR light off of the user's eye in order to perform eye tracking.

Abstract: Techniques are provided to re-arrange the placement of a photodiode within an illumination system to achieve improved characteristics and reduced form factor. An illumination system includes a laser assembly, a MEMS mirror system, a beam combiner, and a photodiode. The laser assembly includes RGB lasers, and the MEMS mirror system redirects laser light produced by the RGB lasers to illuminate pixels in an image frame. The beam combiner combines the laser light. The photodiode is provided to determine a power output of the laser assembly by receiving and measuring some of the laser light. The photodiode may be beneficially positioned before or after collimating optics and/or the beam combiner.

Abstract: An improved iris recognition illumination system is disclosed. The system includes (i) an RGB laser device that is associated with a first collimating optic and (ii) an IR illumination device that is associated with a second collimating optic. The system also includes a DMA that has a MEMS mirror system. The DMA optically combines IR light and RGB light to generate combined light. The combined light is then directed towards a user's iris via a transport medium (e.g., a waveguide). One or more photodetector(s) are positioned to capture reflected light that is reflected off of the user's iris. The photodetectors include an IR detector configured to detect reflected IR light off of the user's iris in order to perform iris recognition.

Abstract: Techniques are provided to dynamically generate and render an object bounding fence in a mixed-reality scene. Initially, a sparse spatial mapping is accessed. The sparse spatial mapping beneficially includes perimeter edge data describing an object's edge perimeters. A gravity vector is also generated. Based on the perimeter edge data and the gravity vector, two-dimensional (2D) boundaries of the object are determined and a bounding fence mesh of the environment is generated. A virtual object is then rendered, where the virtual object is representative of at least a portion of the bounding fence mesh and visually illustrates a bounding fence around the object.

Abstract: Techniques are provided to dynamically generate and render an object bounding fence in a mixed-reality scene. Initially, a sparse spatial mapping is accessed. The sparse spatial mapping beneficially includes perimeter edge data describing an object's edge perimeters. A gravity vector is also generated. Based on the perimeter edge data and the gravity vector, two-dimensional (2D) boundaries of the object are determined and a bounding fence mesh of the environment is generated. A virtual object is then rendered, where the virtual object is representative of at least a portion of the bounding fence mesh and visually illustrates a bounding fence around the object.

Abstract: Disclosed is a technique for 3D reconstruction through a combination of time-of-flight (ToF) and stereoscopy. Use of a single modulation frequency in ToF computation provides a set of ambiguous distances. To determine a single accurate distance out of this candidate set, a stereoscopic comparison of an image pair provides a disambiguating distance. The stereoscopic comparison uses a stored virtual image of at least part of the emitted light, and the detected image of light reflected from an object. The stereoscopic distance is used to determine which of the multiple accurate distances is correct based on proximity. The closest of the multiple distances to the disambiguating distance is taken as the actual distance.

Abstract: A method for active eye-tracking comprises pulsing on and off a plurality of infrared optical sources configured to emit infrared light with a narrow spectral linewidth toward an eye of a user, such that a pulse-on duration is less than a duration needed to fully thermalize each optical source. One or more shuttered optical sensors are configured to receive infrared light reflected off the eye of the user. The shuttered optical sensors are opened for a detection duration based on the pulse-on duration, the shuttered optical sensors. A conformation of the user's eye is indicated based on infrared light received at the shuttered optical sensor during the detection duration.

Abstract: Disclosed are a device and a method of depth sensing that handle light leakage issues. In some embodiments, the depth sensing device includes a light emitter that illuminates an environment of the depth sensing device. The device identifies a first portion of the emitted light that is prevented from reaching the environment of the device due to being redirected by an optical component located in proximity to the light emitter. An imaging sensor of the device detects a second portion of the emitted light that reaches and is reflected by a surface in the environment of the device other than a surface of the optical component. The device generates, based on the second portion of the emitted light, a depth map that includes a plurality of values corresponding to distances relative to the device, wherein said generating excludes from consideration the identified first portion of the emitted light.

Abstract: A head-mounted device (“HMD”) is configured to perform intrinsic and/or extrinsic calibration of the HMD's camera system by exploiting a displayed electronic image rendered on a separate display screen. A series of images are captured using one or more of the HMD's cameras. The displayed image is a known image that includes markers with known characteristics to the HMD. The known characteristics include known marker shapes and a number of coded or un-coded markers. Each image in the series captures the displayed image at a different angle or distance relative to another image in the series. The HMD then identifies, from within the series of images, two-dimensional image positions of the markers. The HMD uses the two-dimensional image positions and a determined three-dimensional position of the markers to perform a bundle adjustment used to subsequently determine a position and angular alignment of the separate display screen relative to the HMD.

Abstract: An improved iris recognition illumination system is disclosed. The system includes (i) an RGB laser device that is associated with a first collimating optic and (ii) an IR illumination device that is associated with a second collimating optic. The system also includes a DMA that has a MEMS mirror system. The DMA optically combines IR light and RGB light to generate combined light. The combined light is then directed towards a user's iris via a transport medium (e.g., a waveguide). One or more photodetector(s) are positioned to capture reflected light that is reflected off of the user's iris. The photodetectors include an IR detector configured to detect reflected IR light off of the user's iris in order to perform iris recognition.

Abstract: An improved eye tracking illumination system is disclosed. The system includes (i) an RGB laser device that is associated with a first collimating optic and (ii) an IR illumination device that is associated with a second collimating optic. The system also includes a DMA that has a MEMS mirror system. The DMA optically combines IR light and RGB light to generate combined light. The combined light is then directed towards a user's eye via a transport medium (e.g., a waveguide). One or more photodetector(s) are positioned to capture reflected light that is reflected off of the user's eye. The photodetectors include an IR detector configured to detect reflected IR light off of the user's eye in order to perform eye tracking.

Abstract: An illumination system having a reduced z-dimensional profile, which is achieved by reflecting light out of plane relative to a light source that generated the light, is disclosed herein. This illumination system includes an IR illumination device, a collimating optic, a turning optic, and a waveguide. The turning optic is specially configured to receive IR light from the IR illumination device and to reflect the IR light out of plane relative to the emission orientation of the IR illumination device. The reflected IR light is reflected towards the collimating optic. The waveguide is positioned in a fixed position relative to the collimating optic and includes an input port or grating to receive the collimated IR light. By reflecting light out of the plane, the size of the illumination system can be beneficially reduced in the z-direction.

Abstract: Techniques are provided to re-arrange the placement of a photodiode within an illumination system to achieve improved characteristics and reduced form factor. An illumination system includes a laser assembly, a MEMS mirror system, a beam combiner, and a photodiode. The laser assembly includes RGB lasers, and the MEMS mirror system redirects laser light produced by the RGB lasers to illuminate pixels in an image frame. The beam combiner combines the laser light. The photodiode is provided to determine a power output of the laser assembly by receiving and measuring some of the laser light. The photodiode may be beneficially positioned before or after collimating optics and/or the beam combiner.

Abstract: Techniques are provided to reduce the form factor of laser-based systems by multi-purposing a photodiode used to help control the output of a laser. A reflective photodiode comprises a light receiving surface and a reflective coating. The light receiving surface is configured to absorb some incident light and to convert it into electrical current. The reflective coating is disposed on the light receiving surface and is configured to reflect some of the incident light away from the light receiving surface. The reflective coating also permits some of the incoming light to pass therethrough for absorption.

Abstract: Techniques are provided for increasing a laser light's spectral linewidth while simultaneously improving how a laser is controlled by causing the laser to operate at higher power levels. An illumination energy value for a pixel and an illumination time period for the pixel are both determined. A number of laser pulses that are to be emitted by the laser assembly to illuminate the pixel during the illumination time period is also determined. This number is based on the illumination energy value for the pixel. Then, within the illumination time period and in accordance with the determined number of laser pulses, the pixel is illuminated by causing the laser assembly to emit one or more laser pulses that cause the pixel to be illuminated at the illumination energy value.