Abstract: Systems and techniques are provided for processing one or more frames. For example, a process can include obtaining a first plurality of frames associated with a first settings domain from an image capture system, wherein the first plurality of frames is captured prior to obtaining a capture input. The process can include obtaining a reference frame associated with a second settings domain from the image capture system, wherein the reference frame is captured proximate to obtaining the capture input. The process can include obtaining a second plurality of frames associated with the second settings domain from the image capture system, wherein the second plurality of frames is captured after the reference frame. The process can include, based on the reference frame, transforming at least a portion of the first plurality of frames to generate a transformed plurality of frames associated with the second settings domain.

Abstract: A system includes one or more memories configured to store a camera image captured with a camera; and processing circuitry in communication with the one or more memories. The processing circuitry is configured to identify, in the camera image, a first camera image portion and a second camera image portion, apply primary phase detection autofocus (PDAF) to the first camera image portion, and apply the primary PDAF and secondary PDAF to the second camera image portion. Additionally, the processing circuitry is configured to control, based on applying the primary PDAF to the first camera image portion and without applying the secondary PDAF to the first camera image portion and based on applying the primary PDAF and the secondary PDAF to the second camera image portion, the camera to bring the first camera image portion and the second camera image portion into focus.

Abstract: Systems and techniques are provided for processing one or more frames. For example, a process can include obtaining a first plurality of frames associated with a first settings domain from an image capture system, wherein the first plurality of frames is captured prior to obtaining a capture input. The process can include obtaining a reference frame associated with a second settings domain from the image capture system, wherein the reference frame is captured proximate to obtaining the capture input. The process can include obtaining a second plurality of frames associated with the second settings domain from the image capture system, wherein the second plurality of frames is captured after the reference frame. The process can include, based on the reference frame, transforming at least a portion of the first plurality of frames to generate a transformed plurality of frames associated with the second settings domain.

Abstract: This disclosure provides systems, methods, and devices for image signal processing that support compression of phase detection (PD) data. In a first aspect, a method of image processing includes receiving image data and first phase detection data corresponding to the image data; determining a first channel of the first phase detection data and a second channel of the first phase detection data; and coding the first phase detection data to determine second phase detection data by separately coding the first channel and the second channel. Other aspects and features are also claimed and described.

Abstract: A device for image capture comprises a memory and one or more processors coupled to the memory and configured to: receive, during a preview mode or a recording, a first image, generate a first saliency map indicative of relative saliency of different regions within the first image, wherein the relative saliency of the different regions is indicative of a likelihood of attracting viewer gaze, generate one or more additional images based on manipulating pixels in the first image, generate one or more additional saliency maps indicative of relative saliency of different regions within the one or more additional images, and determine, during the preview mode or the recording, a camera setting based on the first saliency map and the one or more additional saliency maps.

Abstract: Systems and techniques are provided for processing images. For example, a process can include obtaining a first color image including first one or more pixels from a first image sensor and obtaining a second color image including second one or more pixels from a second sensor, the second color image including infrared (IR) information from a second image sensor. The process can include determining a transformation between colors associated with the first one or more pixels and colors associated with the second one or more pixels based on a comparison associated with the first one or more pixels and the second one or more pixels. The process can include generating a color corrected image at least in part by transforming the second color image including IR information to a color corrected image based on the determined transformation.

Abstract: This disclosure provides systems, methods, and devices for image signal processing that support variable aperture (VA) camera operation. In a first aspect, a method of image processing includes receiving first image data from a variable aperture (VA) camera acquired at a first aperture size; determining a first set of output image frames based on the first image data; receiving second image data from the VA camera acquired during an aperture size transition; and determining a second set of output image frames based on the first image data and the second image data, wherein determining the second set of output image frames comprises adjusting a characteristic of the second image data based on the first image data. Other aspects and features are also claimed and described.

Abstract: This disclosure provides systems, methods, and devices for image capture and image processing that support capture using a variable aperture (VA) camera. In a first aspect, a method of image processing includes determining a plurality of depths for a scene, the plurality of depths corresponding to a plurality of regions of interest; determining an aperture size for a camera based on the plurality of depths; determining a lens position for the camera based on the aperture size and the plurality of depths; and controlling the camera to adjust a variable aperture (VA) of the camera based on the aperture size and to adjust a lens associated with the variable aperture (VA) based on the lens position. Other aspects and features are also claimed and described.

Abstract: Systems and techniques are described for imaging. For instance a process can include obtaining a first image captured using a first portion of an image sensor. The process can further include obtaining a second image captured using a second portion of the image sensor, wherein the second portion is different from the first portion, determining an image capture setting based on the second image, and applying the image capture setting to the first image.

Abstract: A device for image capture comprises a memory and one or more processors coupled to the memory and configured to: receive, during a preview mode or a recording, a first image, generate a first saliency map indicative of relative saliency of different regions within the first image, wherein the relative saliency of the different regions is indicative of a likelihood of attracting viewer gaze, generate one or more additional images based on manipulating pixels in the first image, generate one or more additional saliency maps indicative of relative saliency of different regions within the one or more additional images, and determine, during the preview mode or the recording, a camera setting based on the first saliency map and the one or more additional saliency maps.

Abstract: This disclosure provides systems, methods, and devices for image capture and image processing that support capture using a variable aperture (VA) camera. In a first aspect, a method of image processing includes determining a plurality of depths for a scene, the plurality of depths corresponding to a plurality of regions of interest; determining an aperture size for a camera based on the plurality of depths; determining a lens position for the camera based on the aperture size and the plurality of depths; and controlling the camera to adjust a variable aperture (VA) of the camera based on the aperture size and to adjust a lens associated with the variable aperture (VA) based on the lens position. Other aspects and features are also claimed and described.

Abstract: This disclosure provides systems, methods, and devices for image signal processing that support variable aperture (VA) camera operation. In a first aspect, a method of image processing includes receiving first image data from a variable aperture (VA) camera acquired at a first aperture size; determining a first set of output image frames based on the first image data; receiving second image data from the VA camera acquired during an aperture size transition; and determining a second set of output image frames based on the first image data and the second image data, wherein determining the second set of output image frames comprises adjusting a characteristic of the second image data based on the first image data. Other aspects and features are also claimed and described.

Abstract: Systems and techniques are provided for processing one or more frames. For example, a process can include obtaining a first plurality of frames associated with a first settings domain from an image capture system, wherein the first plurality of frames is captured prior to obtaining a capture input. The process can include obtaining a reference frame associated with a second settings domain from the image capture system, wherein the reference frame is captured proximate to obtaining the capture input. The process can include obtaining a second plurality of frames associated with the second settings domain from the image capture system, wherein the second plurality of frames is captured after the reference frame. The process can include, based on the reference frame, transforming at least a portion of the first plurality of frames to generate a transformed plurality of frames associated with the second settings domain.

Abstract: Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.

Abstract: Various embodiments are directed to a device including an infrared phase detection autofocus (PDAF) sensor. The device may include a projector configured to transmit a source light onto a scene. The device may include the infrared PDAF sensor configured to receive reflections of the source light off of objects within the scene. The infrared PDAF sensor may include a first set of pixels including focus pixels. The device may include a processor coupled to the infrared PDAF sensor and a memory. The processor may be configured to generate first depth data based on the received reflections of the source light. The processor may be configured to generate second depth data based on signals generated from corresponding pairs of the focus pixels. The processor may be configured to generate combined depth data based on the first depth data and the second depth data.

Abstract: Systems and techniques are provided for processing one or more frames. For example, a process can include obtaining a first plurality of frames associated with a first settings domain from an image capture system, wherein the first plurality of frames is captured prior to obtaining a capture input. The process can include obtaining a reference frame associated with a second settings domain from the image capture system, wherein the reference frame is captured proximate to obtaining the capture input. The process can include obtaining a second plurality of frames associated with the second settings domain from the image capture system, wherein the second plurality of frames is captured after the reference frame. The process can include, based on the reference frame, transforming at least a portion of the first plurality of frames to generate a transformed plurality of frames associated with the second settings domain.

Abstract: Systems and techniques are provided for processing images. For example, a process can include obtaining a first color image including first one or more pixels from a first image sensor and obtaining a second color image including second one or more pixels from a second sensor, the second color image including infrared (IR) information from a second image sensor. The process can include determining a transformation between colors associated with the first one or more pixels and colors associated with the second one or more pixels based on a comparison associated with the first one or more pixels and the second one or more pixels. The process can include generating a color corrected image at least in part by transforming the second color image including IR information to a color corrected image based on the determined transformation.

Abstract: A device for image capture includes a memory configured to store a preview image, and one or more processors coupled to the memory and configured to receive a user selection to focus at a region of the preview image stored in the memory, determine whether there is image content at different depths in the region, based on the determination that there is image content at different depths in the region, output an alternative version of the image content in the region, receive a subsequent user selection within the alternative version, and control a focus level for a camera based on the subsequent user selection.

Abstract: A device for image capture includes a memory configured to store a preview image, and one or more processors coupled to the memory and configured to receive a user selection to focus at a region of the preview image stored in the memory, determine whether there is image content at different depths in the region, based on the determination that there is image content at different depths in the region, output an alternative version of the image content in the region, receive a subsequent user selection within the alternative version, and control a focus level for a camera based on the subsequent user selection.

Abstract: Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.