Abstract: Systems and techniques are described for depth sensing. For example, a method can include obtaining a first depth image of a scene. The first depth image of the scene is associated with a first illumination configuration including illuminating the scene with a first type of illumination. The method can include obtaining a second depth image of the scene, wherein the second depth image is associated with a second illumination configuration, different from the first illumination configuration. The second illumination configuration includes illuminating the scene with a second type of illumination. The method can include determining, based on the second depth image, multipath interference (MPI) associated with the first depth image. The method can further include generating based on determining the MPI associated with the first depth image an adjusted depth image including one or more pixels from the first depth image and one or more adjusted pixels.

Abstract: Systems and techniques are provided for imaging with a meta-lens. For instance, a process can include receiving light at a first substrate, the first substrate comprising a first meta-lens; receiving a first portion of the light at a second substrate, the second substrate including an optical sensor, wherein: the optical sensor is directly covered by a solid covering, and the first substrate is mechanically coupled to the second substrate such that the solid covering is between the first substrate and the second substrate; and receiving, by the optical sensor and through the solid covering, at least a second portion of the light focused by the first meta-lens.

Abstract: A method performed by an electronic device is described. The method includes obtaining a first image from a first camera, the first camera having a first focal length and a first field of view. The method also includes obtaining a second image from a second camera, the second camera having a second focal length and a second field of view disposed within the first field of view. The method further includes aligning at least a portion of the first image and at least a portion of the second image to produce aligned images. The method additionally includes fusing the aligned images based on a diffusion kernel to produce a fused image. The diffusion kernel indicates a threshold level over a gray level range. The method also includes outputting the fused image. The method may be performed for each of a plurality of frames of a video feed.

Abstract: A method performed by an electronic device is described. The method includes obtaining a first image from a first camera, the first camera having a first focal length and a first field of view. The method also includes obtaining a second image from a second camera, the second camera having a second focal length and a second field of view disposed within the first field of view. The method further includes aligning at least a portion of the first image and at least a portion of the second image to produce aligned images. The method additionally includes fusing the aligned images based on a diffusion kernel to produce a fused image. The diffusion kernel indicates a threshold level over a gray level range. The method also includes outputting the fused image. The method may be performed for each of a plurality of frames of a video feed.

Abstract: Techniques and systems are provided for high resolution time-of-flight (ToF) depth imaging. In some examples, an apparatus includes a projection system including one or more light-emitting devices, each light-emitting device being configured to illuminate at least one portion of an entire field-of-view (FOV) of the projection system. The entire FOV includes a plurality of FOV portions. The apparatus also includes a receiving system including a sensor configured to sequentially capture a plurality of images based on a plurality of illumination reflections corresponding to light emitted by the one or more light-emitting devices. Each image of the plurality of images corresponds to one of the plurality of FOV portions. An image resolution associated with each image corresponds to a full resolution of the sensor. The apparatus further includes a processor configured to generate, using the plurality of images, an increased resolution depth map associated with the entire FOV.

Abstract: Aspects of the present disclosure relate to depth sensing using a device. An example device includes a light projector configured to project light in a first and a second distribution. The first and the second distribution include a flood projection when the device operates in a first mode and a pattern projection when the device operates in a second mode, respectively. The example device includes a receiver configured to detect reflections of light projected by the light projector. The example device includes a processor connected to a memory storing instructions. The processor is configured to determine first depth information based on reflections detected by the receiver when the device operates in the first mode, determine second depth information based on reflections detected by the receiver when the device operates in the second mode, and resolve multipath interference (MPI) using the first depth information and the second depth information.

Abstract: Systems and techniques are provided for meta-lens cameras. For example, an apparatus can include a first substrate including a first aperture and a second substrate including a first meta-lens. The first substrate and the second substrate are mechanically coupled such that at least a first portion of the first aperture is disposed over at least a second portion of the first meta-lens.

Abstract: Systems and techniques are described for large field of view digital imaging. A device's first image sensor captures a first image based on first light redirected from a first path onto a redirected first path by a first light redirection element, and the device's second image sensor captures a second image based on second light redirected from a second path onto a redirected second path by a second light redirection element. A virtual extension of the first path beyond the first light redirection element can intersect with a virtual extension of the second path intersect beyond the second light redirection element. The device can modify the first image and second image using perspective distortion correction, and can generate a combined image by combining the first image and the second image. The combined image can have a larger field of view than the first image and/or the second image.

Abstract: A method and device is provided that compensates for different reflectivity/absorption coefficients of objects in a scene/object when performing active depth sensing using structured light. A receiver sensor captures an image of a scene onto which a code mask is projected. One or more parameters are ascertained from the captured image. Then a light source power for a projecting light source is dynamically adjusted according to the one or more parameters to improve decoding of the code mask in a subsequently captured image. Depth information for the scene may then be ascertained based on the captured image based on the code mask. In one example, the light source power is fixed at a particular illumination while an exposure time for the receiver sensor is adjusted. In another example, an exposure time for the receiver sensor is maintained/kept at a fixed value while the light source power is adjusted.

Abstract: Aspects of the present disclosure relate to an image sensor. An example apparatus includes an image sensor including one or more pixels. Each pixel of the one or more pixels includes a photodetector, and the photodetector includes a photosensitive surface including germanium. In some implementations, the photodetector includes a photodiode including an intrinsic silicon layer doped with germanium or including germanium crystals. The intrinsic layer may be between a p? layer and an n? layer not including germanium. The intrinsic layer may be configured to absorb photons of the light received at the intrinsic layer. The light may include one or more reflections of an emitted light for active depth sensing. For example, the emitted light may be frequency modulated and having a first wavelength for indirect time-of-flight depth sensing. Sampling circuits may generate voltages indicating a phase difference between the emitted light and a reflection of the emitted light.

Abstract: This disclosure provides systems, methods, and apparatuses for sensing a scene. In one aspect, a device may illuminate the scene using a sequence of two or more periods. Each period may include a transmission portion during which a plurality of light pulses are emitted onto the scene. Each period may include a non-transmission portion corresponding to an absence of emitted light. The device may receive, during each transmission portion, a plurality of light pulses reflected from the scene. The device may continuously accumulate photoelectric charge indicative of the received light pulses during an entirety of the sequence. The device may transfer the accumulated photoelectric charge to a readout circuit after an end of the sequence.

Abstract: Techniques and systems are provided for high resolution time-of-flight (ToF) depth imaging. In some examples, an apparatus includes a projection system including one or more light-emitting devices, each light-emitting device being configured to illuminate at least one portion of an entire field-of-view (FOV) of the projection system. The entire FOV includes a plurality of FOV portions. The apparatus also includes a receiving system including a sensor configured to sequentially capture a plurality of images based on a plurality of illumination reflections corresponding to light emitted by the one or more light-emitting devices. Each image of the plurality of images corresponds to one of the plurality of FOV portions. An image resolution associated with each image corresponds to a full resolution of the sensor. The apparatus further includes a processor configured to generate, using the plurality of images, an increased resolution depth map associated with the entire FOV.

Abstract: Systems and techniques are described for large field of view digital imaging. A device's first image sensor captures a first image based on first light redirected from a first path onto a redirected first path by a first light redirection element, and the device's second image sensor captures a second image based on second light redirected from a second path onto a redirected second path by a second light redirection element. A virtual extension of the first path beyond the first light redirection element can intersect with a virtual extension of the second path intersect beyond the second light redirection element. The device can modify the first image and second image using perspective distortion correction, and can generate a combined image by combining the first image and the second image. The combined image can have a larger field of view than the first image and/or the second image.

Abstract: Methods, systems, and devices for display notch mitigation for cameras and projectors are described. A device may support receiving a plurality of light rays via an upper surface of a prism. The prism and a camera assembly of the device are positioned behind a display substrate of the device. The device may support reflecting the plurality of light rays across a reflection surface. The reflection surface may form an angle with the upper surface of the prism. The device may receiver the plurality of light rays via the camera assembly positioned behind the display substrate based on reflecting the plurality of light rays across the reflection surface. The device may additionally support emitting a plurality of light rays via a projector assembly, reflecting the plurality of light rays across the reflection surface, and emitting the plurality of light rays via the upper surface of the prism.

Abstract: Aspects of the present disclosure relate to an image sensor. An example apparatus includes an image sensor including one or more pixels. Each pixel of the one or more pixels includes a photodetector, and the photodetector includes a photosensitive surface including germanium. In some implementations, the photodetector includes a photodiode including an intrinsic silicon layer doped with germanium or including germanium crystals. The intrinsic layer may be between a p? layer and an n? layer not including germanium. The intrinsic layer may be configured to absorb photons of the light received at the intrinsic layer. The light may include one or more reflections of an emitted light for active depth sensing. For example, the emitted light may be frequency modulated and having a first wavelength for indirect time-of-flight depth sensing. Sampling circuits may generate voltages indicating a phase difference between the emitted light and a reflection of the emitted light.

Abstract: Aspects relate to digital imaging. An example method includes receiving a first image frame of a scene captured by a first image sensor. The method also includes receiving a second image frame of the scene captured by a second image sensor. The second image frame is captured concurrently with capture of the first image frame. The method also includes receiving a third image frame of the scene captured by a third image sensor. The third image frame is captured concurrently with capture of the first image frame. The method also includes generating a combined image from the first image frame, the second image frame, and the third image frame. The combined image includes a first field of view that is wider than a field of view of the first image frame.

Abstract: This disclosure provides systems, methods, and apparatuses for sensing a scene. In one aspect, a device may illuminate the scene using a sequence of two or more periods. Each period may include a transmission portion during which a plurality of light pulses are emitted onto the scene. Each period may include a non-transmission portion corresponding to an absence of emitted light. The device may receive, during each transmission portion, a plurality of light pulses reflected from the scene. The device may continuously accumulate photoelectric charge indicative of the received light pulses during an entirety of the sequence. The device may transfer the accumulated photoelectric charge to a readout circuit after an end of the sequence.

Abstract: Aspects of the present disclosure relate to depth sensing using a device. An example device includes a light projector configured to project light in a first and a second distribution. The first and the second distribution include a flood projection when the device operates in a first mode and a pattern projection when the device operates in a second mode, respectively. The example device includes a receiver configured to detect reflections of light projected by the light projector. The example device includes a processor connected to a memory storing instructions. The processor is configured to determine first depth information based on reflections detected by the receiver when the device operates in the first mode, determine second depth information based on reflections detected by the receiver when the device operates in the second mode, and resolve multipath interference (MPI) using the first depth information and the second depth information.

Abstract: Aspects of the present disclosure relate to systems and methods for determining a resampler for resampling or converting non-Bayer patter color filter array image data to Bayer pattern image data. An example device may include a camera having an image sensor with a non-Bayer pattern color filter array configured to capture non-Bayer pattern image data for an image. The example device also may include a memory and a processor coupled to the memory. The processor may be configured to receive the non-Bayer pattern image data from the image sensor, divide the non-Bayer pattern image data into portions, determine a sampling filter corresponding to the portions, and determine, based on the determined sampling filter, a resampler for converting non-Bayer pattern image data to Bayer-pattern image data.

Abstract: Various embodiments are directed to a light pipe. The light pipe may include a channel within a substrate of an image sensor. The channel may be formed by a plurality of layers. The plurality of layers may include a first layer and a second layer. The second layer may be spaced apart from the first layer along an axis of the channel.