Abstract: This disclosure provides systems, methods, and devices for image capture and image processing that support capture using a variable aperture (VA) camera. In a first aspect, a method of image processing includes determining a plurality of depths for a scene, the plurality of depths corresponding to a plurality of regions of interest; determining an aperture size for a camera based on the plurality of depths; determining a lens position for the camera based on the aperture size and the plurality of depths; and controlling the camera to adjust a variable aperture (VA) of the camera based on the aperture size and to adjust a lens associated with the variable aperture (VA) based on the lens position. Other aspects and features are also claimed and described.

Abstract: The present disclosure provides systems, apparatus, methods, and computer-readable media that support multi-frame depth-of-field (MF-DOF) for deblurring background regions of interest (ROIs), such as background faces, that may be blurred due to a large aperture size or other characteristics of the camera used to capture the image frame. The processing may include the use of two image frames obtained at two different focus points corresponding to the multiple ROIs in the image frame. The corrected image frame may be determined by deblurring one or more ROIs of the first image frame using an AI-based model and/or local gradient information. The MF-DOF may allow selectively increasing a depth-of-field (DOF) of an image to provide focused capture of multiple regions of interest, without causing a reduction in aperture (and subsequently an amount of light available for photography) or background blur that may be desired for photography.

Abstract: This disclosure provides systems, methods, and devices for image capture using an autofocus (AF) algorithm. In a first aspect, a method for autofocus includes receiving first image data of a first scene from a first image sensor of a first camera, the first image data comprising phase shift information; determining a first focal distance for the first scene based on a machine learning algorithm by inputting the phase shift information to the machine learning algorithm; and controlling a focal position of the first camera based on the first focal distance. Other aspects and features are also claimed and described.

Abstract: This disclosure provides systems, methods, and devices for image capture using an autofocus (AF) algorithm. In a first aspect, a method for autofocus includes receiving first image data of a first scene from a first image sensor of a first camera, the first image data comprising phase shift information; determining a first focal distance for the first scene based on a machine learning algorithm by inputting the phase shift information to the machine learning algorithm; and controlling a focal position of the first camera based on the first focal distance. Other aspects and features are also claimed and described.

Abstract: Systems, methods, and non-transitory media are provided for frequency domain edge enhancement of multi-exposure high dynamic range (HDR) images. An example method can include determining an alignment between an HDR frame and a frame having an exposure time above a threshold; adjusting the frame based on the alignment; determining a gradient estimation map representing differences between image blocks in the HDR frame and image blocks in the frame; and generating, based on the gradient estimation map, a merged frame that includes a combination of at least some image data from the HDR frame and at least some image data from the frame.

Abstract: Systems and techniques are provided for processing image data. According to some aspects, a process can include obtaining a frame captured using an image sensor of a device. The process can include detecting an orientation of the device using a position sensor. The process can further include determining, based on the orientation, a transform to be applied to a region of interest in the frame. The process can include applying the transform to the region of interest. The process can further include providing the transformed region of interest to the object detection algorithm.

Abstract: Disclosed are systems, apparatuses, processes, and computer-readable media to capture images with subjects at different depths of fields. A method of processing image data includes determining, based on a depth map of a previously captured image, a first distance to a first object and a second distance to a second object; identifying a focal point of a camera lens at least in part using the first distance and the second distance; capturing an image using the focal point as a basis for the capture, the image including a first region corresponding to the first object and a second region corresponding to the second object; and generating a second image from the image at least in part by enhancing at least one of the first region or the second region using a point spread function (PSF).

Abstract: Image processing performed on images captured with image capture devices may be used to improve upon some of the problems with images captured from devices, including images captured from devices with larger aperture lenses, and, in some particular examples, mobile devices with larger aperture lenses. Multiple images may be captured by the capture device and processing applied to generate a single image through fusing of the multiple images. One potential benefit obtained with fusion of multiple images is a single image with an effective depth of focus (DOF) larger than that available in a single image obtained from the capture device. The DOF of the fused image may be larger than a single image and/or may include multiple distinct in-focus focal distances, whereas a single image from a single capture device has only a single in-focus focal distance.

Abstract: This disclosure provides systems, methods, and devices for image processing that support enhanced image effects, such as bokeh effect, applied in image processing. In a first aspect, a method of image processing includes determining a depth map corresponding to the first scene based on first image data and second image data captured at different aperture sizes; determining a focus map based on the depth map and a simulated aperture size different from the first aperture size and the second aperture size; and determining an output image frame based on the focus map, the first image data, and the second image data. Other aspects and features are also claimed and described.

Abstract: A device for camera processing is configured to receive a preview image, and determine if the preview image is a high dynamic range (HDR) scene based on brightness values of pixels of the preview image. The device may further determine to use a single frame image capture technique based on a determination that the preview image is not an HDR scene, and determine to use one of a plurality of HDR image capture techniques based on a determination that the preview image is an HDR scene, and further based on motion detected in the preview image. The device may then generate an output image using one or more images captured using the single frame image capture technique or one of the plurality of HDR image capture techniques.

Abstract: Aspects of the present disclosure relate to systems and methods for image focusing for devices including multiple cameras. An example method includes estimating a focus distance associated with an image captured by a first camera, determining, based at least in part on the estimated focus distance, to switch from the first camera to a second camera, switching from the first camera to the second camera, completing a focusing operation using the second camera and presenting an updated image captured by the second camera.

Abstract: Systems and techniques described herein relate to techniques for improving image detection. In some examples, aspects relate to systems and techniques for improving image detection by performing tracking of objects within captured image frames. A process can include obtaining, from an image capture device, a first image frame including an object. The process can further include determining, using an object detector, an object validation score associated with detection of the object in the first image frame, and determining the object validation score is less than a validation threshold. Based on the object validation score being less than the validation threshold, the process can include tracking the object for one or more image frames received subsequent to the first image frame.

Abstract: A method of camera processing including receiving a first image, determining one or more first automatic white balance (AWB) parameters for the first image, determining one or more second AWB parameters for a region-of-interest (ROI) of the first image, applying the one or more first AWB parameters to one or more of the first image or a second image, and adjusting the ROI of one or more of the first image or the second image based on the one or more second AWB parameters.

Abstract: The present disclosure provides systems, apparatus, methods, and computer-readable media that support improved image signal processing, particularly in low-light or high dynamic range (HDR) scenes. The image processing techniques may include performing two automatic exposure control (AEC) operations, in which a first AEC operation targets obtaining good conditions for autofocus (AF) operation, and a second AEC operation follows the AF operation and targets obtaining good conditions for an image capture. The image processing techniques may also include communication between the AEC operations and AF operations to coordinate the operations by locking and releasing exposure levels and focus positions as part of the image signal processing.

Abstract: The present disclosure provides systems, apparatus, methods, and computer-readable media that support multi-frame depth-of-field (MF-DOF) for deblurring background regions of interest (ROIs), such as background faces, that may be blurred due to a large aperture size or other characteristics of the camera used to capture the image frame. The processing may include the use of two image frames obtained at two different focus points corresponding to the multiple ROIs in the image frame. The corrected image frame may be determined by deblurring one or more ROIs of the first image frame using an AI-based model and/or local gradient information. The MF-DOF may allow selectively increasing a depth-of-field (DOF) of an image to provide focused capture of multiple regions of interest, without causing a reduction in aperture (and subsequently an amount of light available for photography) or background blur that may be desired for photography.

Abstract: Systems and techniques are provided for processing image data. According to some aspects, a process can include obtaining a frame captured using an image sensor of a device. The process can include detecting an orientation of the device using a position sensor. The process can further include determining, based on the orientation, a transform to be applied to a region of interest in the frame. The process can include applying the transform to the region of interest. The process can further include providing the transformed region of interest to the object detection algorithm.

Abstract: In general, techniques are described regarding fusing or combining frames of image data to generate composite frames of image data. Cameras comprising camera processors configured to perform the techniques are also disclosed. A camera processor may capture multiple frames at various focal lengths. The frames of image data may have various regions of the respective frame in focus, whereas other regions of the respective frame may not be in focus, due to particular configurations of lens and sensor combinations used. The camera processor may combine the frames to achieve a single composite frame having both a first region (e.g., a center region) and a second region (e.g., an outer region) in focus.

Abstract: A multi-point measurement of a scene captured in an image frame may be used to process the image frame, such as by applying white balance corrections to the image frame. In some examples, the image frame may be segmented into portions that are illuminated by different illumination sources. Different portions of the image frame may be white balanced differently based on the color temperature of the illumination source for the corresponding portion. Infrared measurements of multiple points in the scene may be used to determine a characteristic of the illumination source of different portions of the scene. For example, a picture that includes indoor and outdoor portions may be illuminated by at least two illumination sources that produce different infrared measurements values. White balancing may be applied differently to these two portions to correct for color temperature of the different sources.

Abstract: An apparatus configured for image processing comprises one or more processors configured to determine data associated with a distance between an object and the apparatus and determine a plurality of lens positions of a camera lens based on the data associated with the distance between the object and the apparatus. The one or more processors are further configured to determine, for each one of the plurality of lens positions, a respective focus value to generate a plurality of focus values. To determine, for each one of the plurality of lens positions, the respective focus value, the one or more processors are configured to determine, for each one of the plurality of lens positions, phase difference information. The one or more processors are further configured to determine a final lens position based on the plurality of focus values.

Abstract: Image processing performed on images captured with image capture devices may be used to improve upon some of the problems with images captured from devices, including images captured from devices with larger aperture lenses, and, in some particular examples, mobile devices with larger aperture lenses. Multiple images may be captured by the capture device and processing applied to generate a single image through fusing of the multiple images. One potential benefit obtained with fusion of multiple images is a single image with an effective depth of focus (DOF) larger than that available in a single image obtained from the capture device. The DOF of the fused image may be larger than a single image and/or may include multiple distinct in-focus focal distances, whereas a single image from a single capture device has only a single in-focus focal distance.