Abstract: An eye-tracking system includes a substrate transparent to visible light and configured to be placed in a field of view of an eye of a user, a plurality of waveguides on the substrate, a light source optically coupled to the plurality of waveguides, and a plurality of polarization volume holograms (PVHs) in the field of view of the eye of the user. Each PVH of the plurality of PVHs is optically coupled to a respective waveguide of the plurality of waveguides and is configured to couple a respective light beam out of the respective waveguide towards the eye of the user.

Abstract: Imaging systems, cameras, and image sensors of this disclosure include imaging pixels that include subpixels. Diffractive optical elements such as a metasurface lens layers or a liquid crystal polarization hologram (LCPH) are configured to focus image light to the subpixels of the imaging pixels. Microlens regions of the diffractive optical elements may focus the image light to the subpixels of the imaging pixels.

Abstract: Imaging systems, cameras, and image sensors of this disclosure include imaging pixels that include subpixels. Diffractive optical elements such as a metasurface lens layers or a liquid crystal polarization hologram (LCPH) are configured to focus image light to the subpixels of the imaging pixels.

Abstract: Imaging signals are generated in response to image light. Event signals are generated in response to receive the imaging signals from imaging pixels. A Region of Interest (ROI) of the imaging pixels is identified from a spatial concentration of event signals in the ROI of imaging pixels within a time period. An ROI portion of the imaging pixels in the ROI are driven to capture an ROI image frame.

Abstract: An eyebox region is illuminated with a fringe illumination pattern. An event sensor is configured to generate event-signals. Eye motion is determined from the event-signals. Eye-features are extracted from data generated by the event sensors and a predicted gaze vector is generated from the eye-features.

Abstract: A system for three-dimensional object sensing using fringe-projection profilometry with Fourier transform analysis is described. A fringe-projection profilometry (FPP) projector simultaneously transmits a frequency signal pattern (i.e., modulated or AC signal) and a zero-frequency signal pattern (i.e., unmodulated or DC signal) onto an object's surface. Alternatively, the projector projects two frequency signal patterns phase-shifted by 180 degrees. A dual readout sensor captures reflections of both signals from the object's surface as adjacent frames, and the DC signal is extracted by subtraction of addition to obtain an enhanced signal. The enhanced signal is used to generate a wrapped phase map through Fourier transform profilometry (FTP). The resulting wrapped phase map is unwrapped, and three-dimensional reconstruction of the object's surface is generated by converting phase from the unwrapped phase map to three-dimensional coordinates.

Abstract: Systems and methods of the present disclosure include a digital image sensor pixel configured to perform digital correlated double-sampling (D-CDS) operations to compensate for fixed pattern noise (FPN) induced by comparator propagation delay variation across a digital pixel array. The pixel and D-CDS operations also support quantization of incident light using two pixel memory banks. The pixel includes data retention logic coupled to selectively lock and unlock the output of a comparator. The output of the comparator is combined with memory bank write enable signals to convert photodiode charge into digital pixel values stored in the two memory banks. The digital pixel values stored in the memory banks may be added or subtracted to generate an FPN compensated digital pixel value.

Abstract: According to examples, a depth sensing apparatus may include an illumination source to output a light beam onto a polarizing beam separation element (PBSE). The PBSE may generate a right hand circularly polarized (RCP) beam and a left hand circularly polarized (LCP) beam to be projected onto a target area, in which the RCP beam and the LCP beam may create an interference with respect to each other. The depth sensing apparatus also includes an imaging component to capture an image of the target area with the RCP beam and the LCP beam projected on the target area, in which the captured image is to be analyzed for depth sensing of the target area. The depth sensing apparatus further includes a polarizer that may increase an intensity of the interference pattern.

Abstract: An optical system is configured to support eye tracking operations in a head mounted device. The optical system includes a transparent layer, a laser, and first and second output couplers. The laser is configured to emit light into the transparent layer. The first output coupler is configured to out-couple a first portion of the light from a first location of the transparent layer. The second output coupler is configured to out-couple a second portion of the light from a second location of the transparent layer. The first and second output couplers are in the field-of-view of a user. A combination of the first portion of the light and the second portion of the light out-coupled from the first output coupler and the second output coupler is configured to generate a fringe pattern, for example, on an eye of a user of the head mounted device.

Abstract: A depth camera assembly (DCA) for depth sensing of a local area. The DCA includes a transmitter, a receiver, and a controller. The transmitter illuminates a local area with outgoing light in accordance with emission instructions. The transmitter includes a fine steering element and a coarse steering element. The fine steering element deflects one or more optical beams at a first deflection angle to generate one or more first order deflected scanning beams. The coarse steering element deflects the one or more first order deflected scanning beams at a second deflection angle to generate the outgoing light projected into the local area. The receiver captures one or more images of the local area including portions of the outgoing light reflected from the local area. The controller determines depth information for one or more objects in the local area based in part on the captured one or more images.

Abstract: A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA projects a series of sinusoidal patterns into the local area DCA and captures images of the sinusoidal patterns via a sensor. Each pixel of the augmented sensor includes a plurality of charge bins, and charge accumulated by a photodiode of a pixel during different time intervals (e.g., times when different sinusoidal patterns are emitted) is stored in a different charge storage bin. Charge may be retrieved from different charge storage bins to determine depth from the DCA.

Abstract: In one example, an apparatus comprises a plurality of sub-pixels arranged sideway, a shared optical element positioned over the plurality of sub-pixels, the shared optical element being configured to direct light originating from a same location in a scene to each sub-pixel in the plurality of sub-pixels; one or more polarizers positioned between the shared optical element and one or more first sub-pixels of the plurality of sub-pixels and configured to selectively pass one or more components of the light having one or more pre-determined polarization states, to enable the photodiodes of each of the one or more first sub-pixels to generate signals based on intensities of the one or more components; and one or more processors configured to generate polarimetric measurements of the received light based on signals obtained from the photodiodes of the one or more first sub-pixels and polarization properties of the one or more polarizers.

Abstract: In some examples, an apparatus comprises: a first photodiode to sense a first component of light associated with a first wavelength, and a second photodiode configured to sense a second component of the light associated with a second wavelength, the first component and the second component being associated with, respectively, a first wavelength and a second wavelength. The apparatus further comprises a first optical structure and a second optical structure positioned over, respectively, the first photodiode and the second photodiode. The first optical structure is configured to increase a propagation path of the first component of the light within the first photodiode and has a first optical property based on the first wavelength. The second optical structure is configured to increase a propagation path of the second component of the light within the second photodiode, and has a second optical property based on the second wavelength.

Abstract: A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA projects a series of sinusoidal patterns into the local area DCA and captures images of the sinusoidal patterns via a sensor. Each pixel of the augmented sensor includes a plurality of charge bins, and charge accumulated by a photodiode of a pixel during different time intervals (e.g., times when different sinusoidal patterns are emitted) is stored in a different charge storage bin. Charge may be retrieved from different charge storage bins to determine depth from the DCA.

Abstract: A depth camera assembly (DCA) has a light source assembly, a mask, a camera assembly, and a controller. The light source assembly includes at least one light source. The mask is configured to generate an interference pattern that is projected into a target area. The mask has two openings configured to pass through light emitted by the at least one light source, and the light passed through the two openings forms an interference pattern across the target area. The interference pattern has a phase based on a position of the light source. The camera assembly is configured to capture images of a portion of the target area that includes the interference pattern. The controller is configured to determine depth information for the portion of the target area based on the captured images.

Abstract: An eye-tracking system includes a substrate transparent to visible light and configured to be placed in a field of view of an eye of a user, a plurality of waveguides on the substrate, a light source optically coupled to the plurality of waveguides, and a plurality of polarization volume holograms (PVHs) in the field of view of the eye of the user. Each PVH of the plurality of PVHs is optically coupled to a respective waveguide of the plurality of waveguides and is configured to couple a respective light beam out of the respective waveguide towards the eye of the user.

Abstract: Imaging systems, cameras, and image sensors of this disclosure include imaging pixels that include subpixels. Diffractive optical elements such as a metasurface lens layers or a liquid crystal polarization hologram (LCPH) are configured to focus image light to the subpixels of the imaging pixels.

Abstract: An image sensor includes imaging pixels and a patterned liquid crystal polarizer (LCP). The imaging pixel include subpixels. The patterned LCP is disposed over the subpixels and configured to direct a particular polarized portion of imaging light to particular subpixels.

Abstract: A depth camera assembly (DCA) has a light source assembly, a mask, a camera assembly, and a controller. The light source assembly includes at least one light source. The mask is configured to generate an interference pattern that is projected into a target area. The mask has two openings configured to pass through light emitted by the at least one light source, and the light passed through the two openings forms an interference pattern across the target area. The interference pattern has a phase based on a position of the light source. The camera assembly is configured to capture images of a portion of the target area that includes the interference pattern. The controller is configured to determine depth information for the portion of the target area based on the captured images.

Abstract: A switchable fringe pattern illuminator includes an optical path switch configured to receive light and dynamically control an amount of light that is provided to a first waveguide and an amount of light that is provided to a second waveguide. A first projector configured to generate a first fringe pattern using light from the first waveguide. The first fringe pattern illuminates a first portion of a target area. A second projector configured to generate a second fringe pattern using light from the second waveguide. The second fringe pattern illuminates a second portion of a target area. The illuminator may be part of a depth camera assembly (DCA). The DCA is configured to capture images of a portion of the target area. The DCA is further configured to determine depth information for an object in the target area based in part on the captured images.