Abstract: Disclosed are an audio synchronous circuit and an audio synchronous method. The audio synchronous circuit receives at least one beacon packet to generate WiFi time synchronization function (TSF) data, compares the WiFi TSF data with I2S TSF data according to a synchronous control signal to obtain a frequency offset, and compensates a digital audio clock according to the frequency offset. Thus, the audio synchronous circuit can adjust a frequency of the digital audio clock according to the frequency offset to complete synchronization with a transmitter, to avoid unpredictable delays caused by software processing and wireless channel competition, and achieve the purpose of more accurate time synchronization.

Abstract: An off-normal bottom-emitting vertical cavity surface emitting laser (VCSEL) is integrated with a photonic integrated circuit (PIC) for incident light from the VCSEL to efficiently couple to a waveguide via a grating coupler in the PIC. Diffraction of the light by the grating coupler is in a direction that is aligned with an input of the waveguide such that most or all of the light enters the waveguide. The off-normal VCSEL output is achieved by arranging an output facet at a bottom surface of the VCSEL with decentered micro-lenses, micro-prisms, gratings, diffractive optical elements, and/or metasurfaces. The diffractive optical elements or metasurfaces may also be used for beam divergence mitigation and/or polarization control.

Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters having a plurality of subarrays and an optical assembly. Each subarray includes one or more independently addressable channels emitting light in accordance with emission instructions. At least two of the subarrays are adjacent to each other and do not overlap. The optical assembly is configured to tile portions of the emitted light to form a light pattern for projection to a target area. The light pattern has a first plurality of sections and a second plurality of sections. Each section of the first plurality represents a first respective portion of the light pattern emitted from a corresponding subarray. Each section of the second plurality represents a second respective portion of the light pattern formed by tiling light emitted from two or more of the subarrays.

Abstract: A dot array illuminator includes an illumination source that includes one or more source arrays and a microlens array (MLA). A source array is an array of light emitting components. The source arrays are positioned on a substrate according to a geometric configuration. The MLA includes lens arrays that are arranged in a similar geometric configuration. The microlens array are separated from the source arrays by a distance and are substantially parallel to the source arrays. The microlens array overlaps with the source arrays and is of a dimension such that it can receive substantially all light emitted by the illumination source. The illumination source emits light towards the MLA. The MLA receives the light and outputs structured pattern light by interpolating received light.

Abstract: A depth camera assembly (DCA) determines depth information. The DCA projects a dynamic structured light pattern into a local area and captures images including a portion of the dynamic structured light pattern. The DCA determines regions of interest in which it may be beneficial to increase or decrease an amount of texture added to the region of interest using the dynamic structured light pattern. For example, the DCA may identify the regions of interest based on contrast values calculated using a contrast algorithm, or based on the parameters received from a mapping server including a virtual model of the local area. The DCA may selectively increase or decrease an amount of texture added by the dynamic structured light pattern in portions of the local area. By selectively controlling portions of the dynamic structured light pattern, the DCA may decrease power consumption and/or increase the accuracy of depth sensing measurements.

Abstract: A depth camera assembly for depth sensing of a local area includes an illumination source, an imaging device, and a controller. The illumination source illuminates a local area with light emitted in accordance with emission instructions generated by the controller. The illumination source includes an array of optical sources and an optical assembly. Operation of each optical source in the array is controllable based in part on the emission instructions. The optical assembly is configured to project the light into the local area. The imaging device captures one or more images of at least a portion of the light reflected from one or more objects in the local area. The controller determines depth information for the one or more objects based in part on the captured one or more images.

Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.

Abstract: A depth estimation system is described capable of determining depth information using two images from two cameras. A first camera captures a first image and a second camera captures a second image, both images including a plurality of light channels. A scan direction is selected from a plurality of scan directions. For the selected scan direction, along each of a plurality of scanlines, the system compares pixels from the first image to pixels from the second image. The comparison is based on calculating a census transform for each pixel in the first image and a census transform for each pixel in the second image. This comparison is used to determine a stereo correspondence between the pixels in the first image and the pixels in the second image. The system generates a depth map based on the stereo correspondence.

Abstract: A depth camera assembly (DCA) has a light source assembly, a mask, a camera assembly, and a controller. The light source assembly includes at least one light source. The mask is configured to generate an interference pattern that is projected into a target area. The mask has two openings configured to pass through light emitted by the at least one light source, and the light passed through the two openings forms an interference pattern across the target area. The interference pattern has a phase based on a position of the light source. The camera assembly is configured to capture images of a portion of the target area that includes the interference pattern. The controller is configured to determine depth information for the portion of the target area based on the captured images.

Abstract: A depth camera assembly (DCA) has a light source assembly, a mask, a camera assembly, and a controller. The light source assembly includes at least one light source. The mask is configured to generate an interference pattern that is projected into a target area. The mask has two openings configured to pass through light emitted by the at least one light source, and the light passed through the two openings forms an interference pattern across the target area. The interference pattern has a phase based on a position of the light source. The camera assembly is configured to capture images of a portion of the target area that includes the interference pattern. The controller is configured to determine depth information for the portion of the target area based on the captured images.

Abstract: A switchable fringe pattern illuminator includes an optical path switch configured to receive light and dynamically control an amount of light that is provided to a first waveguide and an amount of light that is provided to a second waveguide. A first projector configured to generate a first fringe pattern using light from the first waveguide. The first fringe pattern illuminates a first portion of a target area. A second projector configured to generate a second fringe pattern using light from the second waveguide. The second fringe pattern illuminates a second portion of a target area. The illuminator may be part of a depth camera assembly (DCA). The DCA is configured to capture images of a portion of the target area. The DCA is further configured to determine depth information for an object in the target area based in part on the captured images.

Abstract: A direct time of flight depth system includes an addressable illumination source, an active depth sensor, and a controller. The addressable illumination source includes an array of emitters and an optical assembly that is used to generate an array of dots emitted into a local area. Each emitter is independently addressable, allowing selective illumination of different portions of the local area. The addressable illumination source is aligned with the active depth sensor so each dot maps to a corresponding macropixel (e.g., 4×4 array of SPADs) on the active depth sensor. Data from the active depth sensor is readout and used to determine depth information.

Abstract: A photonic integrated circuit assembly generates light for use in a display system or a depth sensing system. The photonic integrated circuit assembly includes optical conditioning elements integrated into a photonic integrated circuit. The photonic integrated circuit includes one or more light sources on the photonic integrated circuit. The photonic integrated circuit includes a waveguide and one or more gratings located in a core of the photonic integrated circuit. The gratings may collimate and/or collocate light emitted by the light source. The photonic integrated circuit may include a beam shaping element integrated into the photonic integrated circuit. A MEMS scanner may use the collocated and/or collimated light emitted by the photonic integrated circuit to generate a display for a user or to generate a structured light pattern for use in a depth sensing system.

Abstract: Methods and systems for providing illumination for depth sensing are provided. In one example, an apparatus comprises an illuminator, an optical sensor, and a controller. The illuminator comprises a photonic integrated circuit (PIC) and a diffractive optical element (DOE). The PIC including a laser source and at least one waveguide including optical turning features. The at least one waveguide propagates light transmitted by the laser source along a first axis parallel to a top surface of the PIC. The optical turning features diverts the light to form collimated light beams to exit the at least one waveguide and the top surface along a second axis. The DOE can diffract and project the collimated light beams. The optical sensor can detect the collimated light beams reflected off an object. The controller can determine a depth of the object with respect to the apparatus based on the detection.

Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.

Abstract: A depth camera assembly (DCA) determines depth information. The DCA projects a dynamic structured light pattern into a local area and captures images including a portion of the dynamic structured light pattern. The DCA determines regions of interest in which it may be beneficial to increase or decrease an amount of texture added to the region of interest using the dynamic structured light pattern. For example, the DCA may identify the regions of interest based on contrast values calculated using a contrast algorithm, or based on the parameters received from a mapping server including a virtual model of the local area. The DCA may selectively increase or decrease an amount of texture added by the dynamic structured light pattern in portions of the local area. By selectively controlling portions of the dynamic structured light pattern, the DCA may decrease power consumption and/or increase the accuracy of depth sensing measurements.

Abstract: A depth estimation system is described capable of determining depth information using two images from two cameras. A first camera captures a first image and a second camera captures a second image, both images including a plurality of light channels. A scan direction is selected from a plurality of scan directions. For the selected scan direction, along each of a plurality of scanlines, the system compares pixels from the first image to pixels from the second image. The comparison is based on calculating a census transform for each pixel in the first image and a census transform for each pixel in the second image. This comparison is used to determine a stereo correspondence between the pixels in the first image and the pixels in the second image. The system generates a depth map based on the stereo correspondence.

Abstract: A direct time of flight depth system includes an addressable illumination source, an active depth sensor, and a controller. The addressable illumination source includes an array of emitters and an optical assembly that is used to generate an array of dots emitted into a local area. Each emitter is independently addressable, allowing selective illumination of different portions of the local area. The addressable illumination source is aligned with the active depth sensor so each dot maps to a corresponding macropixel (e.g., 4×4 array of SPADs) on the active depth sensor. Data from the active depth sensor is readout and used to determine depth information.

Abstract: A depth camera assembly (DCA) optimizes illumination and image capture of a local area to generate depth information of the local area. The DCA determines depth information for a first portion of the local area viewable at a first pose. The DCA is moved from the first pose to a second pose, where a second portion of the local area is viewable and overlaps with the first portion. The overlapping region is not illuminated by the DCA. A non-overlapping portion of the second portion is illuminated, captured, and depth information determined.

Abstract: A depth camera assembly (DCA) determines depth information. The DCA projects a dynamic structured light pattern into a local area and captures images including a portion of the dynamic structured light pattern. The DCA determines regions of interest in which it may be beneficial to increase or decrease an amount of texture added to the region of interest using the dynamic structured light pattern. For example, the DCA may identify the regions of interest based on contrast values calculated using a contrast algorithm, or based on the parameters received from a mapping server including a virtual model of the local area. The DCA may selectively increase or decrease an amount of texture added by the dynamic structured light pattern in portions of the local area. By selectively controlling portions of the dynamic structured light pattern, the DCA may decrease power consumption and/or increase the accuracy of depth sensing measurements.