Abstract: A sensor includes a plurality of pixels that each have dedicated compute circuitry within a compute layer. The plurality of pixels includes a first group of pixels and a second group of pixels. The first group of pixels is configured to detect light from a local area that has a first modulation frequency. The second group of pixels is configured to detect light from the local area that has a second modulation frequency. The compute layer is positioned below the plurality of pixels, and includes the compute circuitry for each of the plurality of pixels. The compute layer is configured to determine depth information for the local area using an indirect time-of-flight technique and one or both of the detected light that has the first modulation frequency and the detected light that has the second modulation frequency.

Abstract: The disclosed depth camera assembly may include a projector device to project light into an imaging environment. The projector device may include a light source and may also include a diffractive optical element that separates light emitted by the light source into a plurality of light regions including a plurality of separate wavelength ranges, such that each of the plurality of light regions contain light from only one of the plurality of separate wavelength ranges. The projector device may also include an interference filter. A head-mounted display system and related methods are also disclosed.

Abstract: A facial tracking device including an illuminator and a photon detector. The illuminator configured to project a light toward a first portion of a head of a user and the photon detector configured to detect light reflected from a second portion of the head of the user. The facial tracking device further including a processor that is connected to the illuminator and photon detector and configured to cause the illuminator to project the light toward the head of the user, receive information from the photon detector, and determine a facial expression of the user.

Abstract: A camera module includes an image sensor, a lens assembly, a printed circuit board, and a substrate. The image sensor has edges that define a two-dimensional footprint substantially parallel to a surface of the image sensor. The lens assembly is coupled to a top surface of the image sensor and focuses light onto the top surface of the image sensor. Edges of the lens assembly do not extend beyond the footprint. The printed circuit board is below the image sensor and controls the image sensor. The substrate is coupled to a bottom surface of the image sensor and to a top surface of the printed circuit board. The substrate electrically couples the image sensor to the printed circuit board. Edges of the substrate do not extend beyond the footprint.

Abstract: A sensor includes a first image pixel array including first image pixels and a second image pixel array including second image pixels. A polarization layer is disposed between the first image pixels and the second image pixels. Scene light incident upon the second image pixels propagates through the first image pixels and the polarization layer to reach the second image pixels.

Abstract: A facial tracking device including an illuminator and a photon detector. The illuminator configured to project a light toward a first portion of a head of a user and the photon detector configured to detect light reflected from a second portion of the head of the user. The facial tracking device further including a processor that is connected to the illuminator and photon detector and configured to cause the illuminator to project the light toward the head of the user, receive information from the photon detector, and determine a facial expression of the user.

Abstract: An exemplary imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of a light signal received from the scene through the lens, a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens, and a processing subsystem programmed to determine a phase difference associated with the light signal based on the at least two different phase delays. Related systems and methods are also provided.

Abstract: An imaging system comprises two cameras and a processor. A first camera comprises a first grid of pixels configured to detect light in a broadband channel and a plurality of clusters of color filters sparsely arranged over the first grid of pixels. Each color filter passes light in a color channel to the grid of pixels. A second camera comprises a second grid of pixels configured to detect light in a broadband channel. The processor is configured to generate an aggregate image by combining a first image captured by the first camera and a second image captured by the second camera. The processor is also configured to add color values to the aggregate image based on color data captured by the first camera with the clusters of color filters. Additionally, the processor is configured to present the aggregate image with added color values on an electronic display.

Abstract: A sensor includes a first image pixel array including first image pixels and a second image pixel array including second image pixels. A polarization layer is disposed between the first image pixels and the second image pixels. Scene light incident upon the second image pixels propagates through the first image pixels and the polarization layer to reach the second image pixels.

Abstract: A facial tracking device including an illuminator and a photon detector. The illuminator configured to project a light toward a first portion of a head of a user and the photon detector configured to detect light reflected from a second portion of the head of the user. The facial tracking device further including a processor that is connected to the illuminator and photon detector and configured to cause the illuminator to project the light toward the head of the user, receive information from the photon detector, and determine a facial expression of the user.

Abstract: A camera calibration system includes at least two monochrome cameras and a controller. Each monochrome camera includes a sensor array and a sparse array of filter elements. The sensor array captures one or more images of a local area and includes a plurality of broadband pixels. The sparse array of filter elements is coupled to a portion of the broadband pixels. At least some of the portion of the broadband pixels are along a periphery of the sensor array. Each of the filter elements has a respective passband that is narrower than a passband of the broadband pixels. The controller corrects for lateral chromatic aberration in an image generated from the images captured by the monochrome cameras by using calibration information and portions of the image corresponding to the portion of the broadband pixels that are coupled to the sparse array of filter elements.

Abstract: An image sensor includes a two-dimensional array of active pixels, where each active pixel in the two-dimensional array of active pixels includes a respective photodiode. The image sensor also includes a plurality of lock-in pixels at two or more regions of the two-dimensional array. Each of the plurality of lock-in pixels includes two pixel elements that share a common photodiode. Each pixel element of the two pixel elements in a lock-in pixel includes a charge storage node and a switch configured to receive a respective control signal to selectively connect the respective charge storage node to the common photodiode.

Abstract: An exemplary imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of a light signal received from the scene through the lens, a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens, and a processing subsystem programmed to determine a phase difference associated with the light signal based on the at least two different phase delays. Related systems and methods are also provided.

Abstract: An exemplary imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of a light signal received from the scene through the lens, a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens, and a processing subsystem programmed to determine a phase difference associated with the light signal based on the at least two different phase delays. Related systems and methods are also provided.

Abstract: An exemplary depth imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce different phase delays into a wavefront of the light, and a housing that secures the matrix between the optical sensor and the lens. The device further includes a communication bus coupled to a processing subsystem that directs the optical sensor to capture at least two different perspectives of the scene to create an output image indicating depth within the scene. The device includes a positioning system that couples an optical component of the device to the housing. The optical component may include at least one of the lens, the optical sensor, or the matrix. Other related systems and methods are also provided.

Abstract: The disclosed imaging device may include an optical sensor, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of the light from the scene, and a housing that couples the matrix of variable-phase optical elements to the optical sensor. The housing may position the matrix at least substantially perpendicular to an optical axis of the optical sensor and may enable the optical sensor to capture at least two different perspectives of the scene per output image. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: An imaging device may include (1) an aperture, (2) a camera lens positioned to direct light received through the aperture to a plurality of image sensor elements at a front side of an image sensor array, and (3) the image sensor array. The plurality of image sensor elements may collect a portion of the light received through the aperture. A light-disrupting element may be disposed at a back side of the image sensor array. The light-disrupting element at the back side of the image sensor array may prevent at least a portion of the light that is not collected by the plurality of image sensor elements from reflecting back to the plurality of image sensor elements. Various other devices, systems, and methods are also disclosed.

Abstract: An imaging device may include (1) an aperture, (2) a lens positioned to direct light received through the aperture to a front side of an image sensor; and (3) the image sensor. The image sensor may include (1) a light capture layer including a photosensitive material that is dimensioned such that (a) a first portion of the light having less than a predetermined wavelength is captured by the light capture layer, producing a current, and (b) a second portion of the light having at least the predetermined wavelength passes through the light capture layer, (2) a conduction pathway that conducts the produced current to a current sink, and (3) an image sensor layer that includes at least one image sensor element positioned to receive the second portion of the light that passes through the light capture layer. Various other devices, systems, and methods are also disclosed.

Abstract: An optical proximity detector includes a plurality photodetectors (PDs) and a winner-take-all (WTA) circuit. Each of the PDs has a respective field of view (FOV) and produces a respective analog current detection signal indicative of light incident on and detected by the PD. In an embodiment, the WTA circuit includes a comparator and a multiplexor (MUX). The comparator compares the analog current detection signals produced by the PDs and produces a selection signal in dependence thereon. The MUX receives the analog current detection signals produced by the PDs and outputs one of the analog current detection signals in dependence on the selection signal produced by the comparator. Circuitry, which is shared by the PDs, produces a digital detection signal corresponding to the one of the analog current detection signals output by the MUX. Such design can be used to reduce power consumption, size and cost of an optical proximity detector.

Abstract: The disclosed system may include (1) a light source, (2) a first diffractive optical element (DOE), optically coupled with the light source, that produces a first diffracted light pattern, (3) at least one additional DOE, optically coupled with the light source in series with the first DOE, that produces at least one additional diffracted light pattern, (4) an actuator that moves, in response to a first actuator control signal, the first DOE in a first plane perpendicular to an optical axis of the system, and (5) a lens, optically coupled with the first DOE and the at least one additional DOE, that projects structured light onto a local area based on the first diffracted light pattern and the at least one additional diffracted light pattern. Various other systems and methods are also disclosed.