Abstract: Methods, systems, and devices for image processing are described. Devices with one or more sensors (e.g., devices with multiple cameras, such as a dual camera device) may perform flash metering techniques, using an auxiliary camera, during a flash duration used for main camera image capture. For example, a dual camera device may control camera flash parameters (e.g., flash duration, flash power), via auxiliary camera flash metering, during main camera image capture (e.g., during main camera exposure for image capture operations). A main camera may begin exposure and a flash may be initiated. During the flash, an auxiliary camera may be configured to perform flash metering operations (e.g., via images captured by the auxiliary camera). Based on flash metering information from the auxiliary camera, the dual camera device may configure or adjust camera settings (e.g., exposure settings, flash duration, flash end time, flash power) during main camera exposure and image capture.

Abstract: Various embodiments are directed to a device including an infrared phase detection autofocus (PDAF) sensor. The device may include a projector configured to transmit a source light onto a scene. The device may include the infrared PDAF sensor configured to receive reflections of the source light off of objects within the scene. The infrared PDAF sensor may include a first set of pixels including focus pixels. The device may include a processor coupled to the infrared PDAF sensor and a memory. The processor may be configured to generate first depth data based on the received reflections of the source light. The processor may be configured to generate second depth data based on signals generated from corresponding pairs of the focus pixels. The processor may be configured to generate combined depth data based on the first depth data and the second depth data.

Abstract: Examples of capturing and processing image data are described. A device may include a camera including a camera sensor that includes a plurality of tiles that each include four sub-tiles. The camera may also include a color filter array coupled to the camera sensor and including a plurality of red, blue, and green color filters. A first sub-tile of each tile may include a phase detection pixel coupled to a microlens shared with at least one other pixel of the tile and an imaging pixel not coupled to a second microlens different from the first microlens. The device may also include a processor coupled to the camera and configured to control one or more first exposure settings of the phase detection pixel and control one or more second exposure settings of the non-phase detection pixel. Control of the second exposure settings is independent from control of the first exposure settings.

Abstract: Aspects of the present disclosure relate to quad color filter array image sensors. A quad color filter array (CFA) image sensor is configured to capture image data. The quad CFA image sensor includes a quad CFA and an image sensor coupled to the quad CFA. The image sensor includes a plurality of quads including a plurality of pixels. For each quad, each pixel of the plurality of pixels is coupled to a same color filter of the plurality of color filters, a first pixel of the plurality of pixels is associated with a first exposure region of the quad and corresponds to a first aperture size, a second pixel of the plurality of pixels is associated with a second exposure region of the quad and corresponds to a second aperture size, and at least two pixels of the plurality of pixels are configured as phase detection pixels.

Abstract: A method synchronizes autofocus in a system having a master camera and a slave camera. The method comprises: focusing the slave camera based on a map and a result of an autofocus operation by the master camera, while capturing each of a plurality of images. The map relates a plurality of master camera lens positions of the master camera to corresponding slave camera lens positions of the slave camera. An autofocus operation is periodically performed in the slave camera to determine an additional slave camera lens position for an additional image. The map is adaptively updated, based at least partially on the additional slave camera lens position.

Abstract: Aspects of the present disclosure relate to systems and methods for compensating for camera motion during an autofocus operation. An example device may include a processor and a memory. The processor may be configured to measure a plurality of focus values. Each focus value is measured at a different focal length. The processor also may be configured to detect that a camera motion exists for the measurement of one or more of the plurality of focus values. The processor further may be configured to determine a focal length based on the plurality of measured focus values and the detected camera motion.

Abstract: Aspects of the present disclosure relate to systems and methods for decorrelating one or more saturated regions of an image. In one example, a first phase image and a corresponding second phase image may be obtained. One or more saturated regions of the first phase image and second phase image may be determined. A weight may be applied to each pixel in the one or more saturated regions of the first and second phase images may be weighted to generate a weighted first phase image and a weighted second phase image, and one or more image processing operations may be performed on the weighted first and second phase images.

Abstract: Image processing can include receiving an aperture level and producing a full-color image. The full-color image can be produced by assigning a greater weight to first sensor pixels and assigning a lesser weight to second sensor pixels based on the received aperture level. The greater weight can exceed the lesser weight. An image sensor panel can include the first sensor pixels and the second sensor pixels. Each of the first sensor pixels can have a first color-filter-independent-photosensitivity (CFIP) and each of the second sensor pixels having a second CFIP. The first CFIP can be larger or smaller than the second CFIP.

Abstract: Methods, systems, and devices for dual phase detection auto focus (PDAF) power optimization are described. A camera device may capture a frame including a pixel array representing a scene. In some examples, each pixel of the pixel array may be a phase detection (PD) pixel having one or more values, or one or more PD pixels positioned randomly across the pixel array. The camera device may identify a configuration of the pixel array, and determine a condition of the pixel array relative to the configuration. The configuration may be a binning configuration or a frame pattern configuration, and the condition may include an illumination condition related to the pixel array representing the scene. The camera device may determine and apply a reconfiguration to at least a portion of the pixel array based on the condition of the pixel array, and determine a lens position of the camera device therewith.

Abstract: Aspects of the present disclosure relate to systems and methods for decorrelating one or more saturated regions of an image. In one example, a first phase image and a corresponding second phase image may be obtained. One or more saturated regions of the first phase image and second phase image may be determined. A weight may be applied to each pixel in the one or more saturated regions of the first and second phase images may be weighted to generate a weighted first phase image and a weighted second phase image, and one or more image processing operations may be performed on the weighted first and second phase images.

Abstract: An imaging system includes a sensor comprising a pixel. The pixel comprises first and second photodiodes sharing a common microlens configured to converge light onto a first area of the first photodiode and a second area of the second photodiode. An effective optical center of the first area is offset from a centroid of the first photodiode. An effective optical center of the second area is offset from a centroid of the second photodiode. A processor is configured to: receive a first luminance value from the first photodiode; receive a second luminance value from the second photodiode; and resample a plurality of luminance values including the first second luminance values to provide a luminance of a first resampled pixel having an optical center at a centroid of the first photodiode and a luminance of a second resampled pixel having an optical center at a centroid of the second photodiode.

Abstract: Methods, systems, and devices for dual phase detection auto focus (PDAF) power optimization are described. A camera device may capture a frame including a pixel array representing a scene. In some examples, each pixel of the pixel array may be a phase detection (PD) pixel having one or more values, or one or more PD pixels positioned randomly across the pixel array. The camera device may identify a configuration of the pixel array, and determine a condition of the pixel array relative to the configuration. The configuration may be a binning configuration or a frame pattern configuration, and the condition may include an illumination condition related to the pixel array representing the scene. The camera device may determine and apply a reconfiguration to at least a portion of the pixel array based on the condition of the pixel array, and determine a lens position of the camera device therewith.

Abstract: Aspects of the present disclosure relate to systems and methods for hybrid depth map processing. An example device may include a first sensor having a plurality of focus pixels, the focus pixels configured to capture images from at least a first perspective and a second perspective, where a difference between the first and second perspectives is associated with a first direction. The device may further include a second image sensor separated from the first image sensor in a second direction orthogonal to the first direction. The device may be configured to receive a first image from the first image sensor, where the first image includes first image data captured from the first perspective, and second image data captured from the second perspective. The device may be further configured to receive a second image from the second image sensor, and to generate a hybrid depth map based at least in part on the first image and the second image.

Abstract: Methods, systems, and apparatuses are provided to perform phase-detection autofocus control. By way of example, the methods can receive luminance values measured by a plurality of sensing elements in a sensor array, and the sensing elements can include imaging pixels and phase-detection pixels. The methods can compare luminance values measured by at least one of the phase-detection pixels to luminance values associated with a subset of the imaging pixels including two or more imaging pixels. The comparison can be performed at extended horizontal density or full horizontal density along a first sensor-array row that includes the at least one phase-detection pixel and the two or more imaging pixels. The methods can also perform a phase-detection autofocus operation based on an outcome of the comparison.

Abstract: Methods and apparatuses for calibration of phase detection auto focus (PDAF) camera systems are disclosed. In one aspect, the method involves capturing a first image of a scene at an initial lens position, the first image including a first left image and a first right image captured using left and right photodiodes. The method may also involve calculating an initial phase difference between the first left image and first right image and estimating an in-focus lens position based on the initial phase difference. The method may further involve moving the lens to a final lens position at which a final phase difference between a second left image and a second right image of a second image captured at the final lens position is substantially zero and calibrating the estimation of the in-focus lens position based on the initial lens position, the final lens position, and the initial phase difference.

Abstract: Image processing can include receiving an aperture level and producing a full-color image. The full-color image can be produced by assigning a greater weight to first sensor pixels and assigning a lesser weight to second sensor pixels based on the received aperture level. The greater weight can exceed the lesser weight. An image sensor panel can include the first sensor pixels and the second sensor pixels. Each of the first sensor pixels can have a first color-filter-independent-photosensitivity (CFIP) and each of the second sensor pixels having a second CFIP. The first CFIP can be larger or smaller than the second CFIP.

Abstract: Aspects of the present disclosure relate to systems and methods for compensating for camera motion during an autofocus operation. An example device may include a processor and a memory. The processor may be configured to measure a plurality of focus values. Each focus value is measured at a different focal length. The processor also may be configured to detect that a camera motion exists for the measurement of one or more of the plurality of focus values. The processor further may be configured to determine a focal length based on the plurality of measured focus values and the detected camera motion.

Abstract: A method synchronizes autofocus in a system having a master camera and a slave camera. The method comprises: focusing the slave camera based on a map and a result of an autofocus operation by the master camera, while capturing each of a plurality of images. The map relates a plurality of master camera lens positions of the master camera to corresponding slave camera lens positions of the slave camera. An autofocus operation is periodically performed in the slave camera to determine an additional slave camera lens position for an additional image. The map is adaptively updated, based at least partially on the additional slave camera lens position.

Abstract: Methods, systems, and apparatuses are provided to perform phase-detection autofocus control. By way of example, the methods can receive luminance values measured by a plurality of sensing elements in a sensor array, and the sensing elements can include imaging pixels and phase-detection pixels. The methods can compare luminance values measured by at least one of the phase-detection pixels to luminance values associated with a subset of the imaging pixels including two or more imaging pixels. The comparison can be performed at extended horizontal density or full horizontal density along a first sensor-array row that includes the at least one phase-detection pixel and the two or more imaging pixels. The methods can also perform a phase-detection autofocus operation based on an outcome of the comparison.

Abstract: An imaging system includes a sensor comprising a pixel. The pixel comprises first and second photodiodes sharing a common microlens configured to converge light onto a first area of the first photodiode and a second area of the second photodiode. An effective optical center of the first area is offset from a centroid of the first photodiode. An effective optical center of the second area is offset from a centroid of the second photodiode. A processor is configured to: receive a first luminance value from the first photodiode; receive a second luminance value from the second photodiode; and resample a plurality of luminance values including the first second luminance values to provide a luminance of a first resampled pixel having an optical center at a centroid of the first photodiode and a luminance of a second resampled pixel having an optical center at a centroid of the second photodiode.