Abstract: A sensor includes a plurality of pixels that each have dedicated compute circuitry within a compute layer. The plurality of pixels includes a first group of pixels and a second group of pixels. The first group of pixels is configured to detect light from a local area that has a first modulation frequency. The second group of pixels is configured to detect light from the local area that has a second modulation frequency. The compute layer is positioned below the plurality of pixels, and includes the compute circuitry for each of the plurality of pixels. The compute layer is configured to determine depth information for the local area using an indirect time-of-flight technique and one or both of the detected light that has the first modulation frequency and the detected light that has the second modulation frequency.

Abstract: The disclosed depth camera assembly may include a projector device to project light into an imaging environment. The projector device may include a light source and may also include a diffractive optical element that separates light emitted by the light source into a plurality of light regions including a plurality of separate wavelength ranges, such that each of the plurality of light regions contain light from only one of the plurality of separate wavelength ranges. The projector device may also include an interference filter. A head-mounted display system and related methods are also disclosed.

Abstract: A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).

Abstract: A sensor includes a first image pixel array including first image pixels and a second image pixel array including second image pixels. A polarization layer is disposed between the first image pixels and the second image pixels. Scene light incident upon the second image pixels propagates through the first image pixels and the polarization layer to reach the second image pixels.

Abstract: A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).

Abstract: Coverglass is disposed over an image sensor. The coverglass includes a trench extending a depth into the coverglass. The trench is configured to receive a lens assembly and the lens assembly may be bonded to the trench.

Abstract: An exemplary imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of a light signal received from the scene through the lens, a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens, and a processing subsystem programmed to determine a phase difference associated with the light signal based on the at least two different phase delays. Related systems and methods are also provided.

Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).

Abstract: An imaging system comprises two cameras and a processor. A first camera comprises a first grid of pixels configured to detect light in a broadband channel and a plurality of clusters of color filters sparsely arranged over the first grid of pixels. Each color filter passes light in a color channel to the grid of pixels. A second camera comprises a second grid of pixels configured to detect light in a broadband channel. The processor is configured to generate an aggregate image by combining a first image captured by the first camera and a second image captured by the second camera. The processor is also configured to add color values to the aggregate image based on color data captured by the first camera with the clusters of color filters. Additionally, the processor is configured to present the aggregate image with added color values on an electronic display.

Abstract: A sensor includes a first image pixel array including first image pixels and a second image pixel array including second image pixels. A polarization layer is disposed between the first image pixels and the second image pixels. Scene light incident upon the second image pixels propagates through the first image pixels and the polarization layer to reach the second image pixels.

Abstract: The disclosed systems and methods may include an example assembly for isolating an inertial measurement unit, for example, in the case of a virtual reality system. Additionally, an example system may include shock-absorbing devices, for example for head-mounted displays. In some examples, the disclosed systems and methods may include a form-in-place gasket for water ingress protection around a flexible printed circuit board. The disclosed systems may also include a system for enhancing remote or virtual social experiences using biosignals. The disclosed systems may additionally include a split device with identity fixed to physical location. Various other related methods and systems are also disclosed.

Abstract: A disclosed imaging device may include an image sensor, a lens system, and an aperture filter. The aperture filter may include a first concentric region that passes light of a first wavelength range and that blocks light of a second wavelength range and a second concentric region that passes light of the first wavelength range and light of the second wavelength range. The lens system may direct received light through the aperture filter toward the image sensor. The lens system and the aperture filter may provide a first depth-of-field associated with the first wavelength range and a second depth-of-field associated with the second wavelength range. Associated systems and methods are also disclosed.

Abstract: A camera calibration system includes at least two monochrome cameras and a controller. Each monochrome camera includes a sensor array and a sparse array of filter elements. The sensor array captures one or more images of a local area and includes a plurality of broadband pixels. The sparse array of filter elements is coupled to a portion of the broadband pixels. At least some of the portion of the broadband pixels are along a periphery of the sensor array. Each of the filter elements has a respective passband that is narrower than a passband of the broadband pixels. The controller corrects for lateral chromatic aberration in an image generated from the images captured by the monochrome cameras by using calibration information and portions of the image corresponding to the portion of the broadband pixels that are coupled to the sparse array of filter elements.

Abstract: An image sensor includes a two-dimensional array of active pixels, where each active pixel in the two-dimensional array of active pixels includes a respective photodiode. The image sensor also includes a plurality of lock-in pixels at two or more regions of the two-dimensional array. Each of the plurality of lock-in pixels includes two pixel elements that share a common photodiode. Each pixel element of the two pixel elements in a lock-in pixel includes a charge storage node and a switch configured to receive a respective control signal to selectively connect the respective charge storage node to the common photodiode.

Abstract: A head-mounted display (HMD) system includes a projector system configured to emit a structured light (SL) pattern onto one or more objects in a local area, the projected SL pattern comprises at least a first SL pattern having a first field of view (FOV) corresponding to a first tileable boundary, and a second SL pattern having a second FOV corresponding to a second tileable boundary. Each of the projected SL patterns contains fiducials at predetermined locations within the SL pattern. An imaging device captures images of the local area including at least portions of the first SL pattern or the second SL patterns. The detected locations of the fiducials in the captured images is used to determine the boundary locations of the first and second SL patterns. Depth information of the local area is generated based upon the determined locations of the first and second SL patterns.

Abstract: An exemplary imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of a light signal received from the scene through the lens, a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens, and a processing subsystem programmed to determine a phase difference associated with the light signal based on the at least two different phase delays. Related systems and methods are also provided.

Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).

Abstract: An exemplary imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of a light signal received from the scene through the lens, a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens, and a processing subsystem programmed to determine a phase difference associated with the light signal based on the at least two different phase delays. Related systems and methods are also provided.

Abstract: An exemplary depth imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce different phase delays into a wavefront of the light, and a housing that secures the matrix between the optical sensor and the lens. The device further includes a communication bus coupled to a processing subsystem that directs the optical sensor to capture at least two different perspectives of the scene to create an output image indicating depth within the scene. The device includes a positioning system that couples an optical component of the device to the housing. The optical component may include at least one of the lens, the optical sensor, or the matrix. Other related systems and methods are also provided.

Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).