Abstract: A device for image capture comprises a memory and one or more processors coupled to the memory and configured to: receive, during a preview mode or a recording, a first image, generate a first saliency map indicative of relative saliency of different regions within the first image, wherein the relative saliency of the different regions is indicative of a likelihood of attracting viewer gaze, generate one or more additional images based on manipulating pixels in the first image, generate one or more additional saliency maps indicative of relative saliency of different regions within the one or more additional images, and determine, during the preview mode or the recording, a camera setting based on the first saliency map and the one or more additional saliency maps.

Abstract: A method, including receiving a three-dimensional (3D) map of at least a part of a body of a user (22) of a computerized system, and receiving a two dimensional (2D) image of the user, the image including an eye (34) of the user. 3D coordinates of a head (32) of the user are extracted from the 3D map and the 2D image, and a direction of a gaze performed by the user is identified based on the 3D coordinates of the head and the image of the eye.

Abstract: Aspects of the present disclosure relate to quad color filter array image sensors. A quad color filter array (CFA) image sensor is configured to capture image data. The quad CFA image sensor includes a quad CFA and an image sensor coupled to the quad CFA. The image sensor includes a plurality of quads including a plurality of pixels. For each quad, each pixel of the plurality of pixels is coupled to a same color filter of the plurality of color filters, a first pixel of the plurality of pixels is associated with a first exposure region of the quad and corresponds to a first aperture size, a second pixel of the plurality of pixels is associated with a second exposure region of the quad and corresponds to a second aperture size, and at least two pixels of the plurality of pixels are configured as phase detection pixels.

Abstract: Apparatus for an optical system optimized for PDAF depth sensing are disclosed herein. An example apparatus includes a phase detection auto focus (PDAF) sensor including a plurality of focus pixels and a plurality of micro lenses. The example apparatus also includes an optical system located above the PDAF sensor and configured to direct light to the micro lenses of the PDAF sensor. In some examples, the optical system may be configured to include at least one circular asymmetric subsection of a lens.

Abstract: Apparatus for an optical system optimized for PDAF depth sensing are disclosed herein. An example apparatus includes a phase detection auto focus (PDAF) sensor including a plurality of focus pixels and a plurality of micro lenses. The example apparatus also includes an optical system located above the PDAF sensor and configured to direct light to the micro lenses of the PDAF sensor. In some examples, the optical system includes a lens and an opaque element configured to block light through the lens except for at least one circular asymmetric subsection of the lens.

Abstract: Methods, systems, and devices for image processing are described. Devices with one or more sensors (e.g., devices with multiple cameras, such as a dual camera device) may perform flash metering techniques, using an auxiliary camera, during a flash duration used for main camera image capture. For example, a dual camera device may control camera flash parameters (e.g., flash duration, flash power), via auxiliary camera flash metering, during main camera image capture (e.g., during main camera exposure for image capture operations). A main camera may begin exposure and a flash may be initiated. During the flash, an auxiliary camera may be configured to perform flash metering operations (e.g., via images captured by the auxiliary camera). Based on flash metering information from the auxiliary camera, the dual camera device may configure or adjust camera settings (e.g., exposure settings, flash duration, flash end time, flash power) during main camera exposure and image capture.

Abstract: Various embodiments are directed to a device including an infrared phase detection autofocus (PDAF) sensor. The device may include a projector configured to transmit a source light onto a scene. The device may include the infrared PDAF sensor configured to receive reflections of the source light off of objects within the scene. The infrared PDAF sensor may include a first set of pixels including focus pixels. The device may include a processor coupled to the infrared PDAF sensor and a memory. The processor may be configured to generate first depth data based on the received reflections of the source light. The processor may be configured to generate second depth data based on signals generated from corresponding pairs of the focus pixels. The processor may be configured to generate combined depth data based on the first depth data and the second depth data.

Abstract: A gesture based user interface includes a movement monitor configured to monitor a user's hand and to provide a signal based on movements of the hand. A processor is configured to provide at least one interface state in which a cursor is confined to movement within a single dimension region responsive to the signal from the movement monitor, and to actuate different commands responsive to the signal from the movement monitor and the location of the cursor in the single dimension region.

Abstract: Examples of capturing and processing image data are described. A device may include a camera including a camera sensor that includes a plurality of tiles that each include four sub-tiles. The camera may also include a color filter array coupled to the camera sensor and including a plurality of red, blue, and green color filters. A first sub-tile of each tile may include a phase detection pixel coupled to a microlens shared with at least one other pixel of the tile and an imaging pixel not coupled to a second microlens different from the first microlens. The device may also include a processor coupled to the camera and configured to control one or more first exposure settings of the phase detection pixel and control one or more second exposure settings of the non-phase detection pixel. Control of the second exposure settings is independent from control of the first exposure settings.

Abstract: Aspects of the present disclosure relate to quad color filter array image sensors. A quad color filter array (CFA) image sensor is configured to capture image data. The quad CFA image sensor includes a quad CFA and an image sensor coupled to the quad CFA. The image sensor includes a plurality of quads including a plurality of pixels. For each quad, each pixel of the plurality of pixels is coupled to a same color filter of the plurality of color filters, a first pixel of the plurality of pixels is associated with a first exposure region of the quad and corresponds to a first aperture size, a second pixel of the plurality of pixels is associated with a second exposure region of the quad and corresponds to a second aperture size, and at least two pixels of the plurality of pixels are configured as phase detection pixels.

Abstract: A method synchronizes autofocus in a system having a master camera and a slave camera. The method comprises: focusing the slave camera based on a map and a result of an autofocus operation by the master camera, while capturing each of a plurality of images. The map relates a plurality of master camera lens positions of the master camera to corresponding slave camera lens positions of the slave camera. An autofocus operation is periodically performed in the slave camera to determine an additional slave camera lens position for an additional image. The map is adaptively updated, based at least partially on the additional slave camera lens position.

Abstract: Aspects of the present disclosure relate to systems and methods for compensating for camera motion during an autofocus operation. An example device may include a processor and a memory. The processor may be configured to measure a plurality of focus values. Each focus value is measured at a different focal length. The processor also may be configured to detect that a camera motion exists for the measurement of one or more of the plurality of focus values. The processor further may be configured to determine a focal length based on the plurality of measured focus values and the detected camera motion.

Abstract: Aspects of the present disclosure relate to systems and methods for decorrelating one or more saturated regions of an image. In one example, a first phase image and a corresponding second phase image may be obtained. One or more saturated regions of the first phase image and second phase image may be determined. A weight may be applied to each pixel in the one or more saturated regions of the first and second phase images may be weighted to generate a weighted first phase image and a weighted second phase image, and one or more image processing operations may be performed on the weighted first and second phase images.

Abstract: A method, including receiving, by a computer, a sequence of three-dimensional maps containing at least a hand of a user of the computer, and identifying, in the maps, a device coupled to the computer. The maps are analyzed to detect a gesture performed by the user toward the device, and the device is actuated responsively to the gesture.

Abstract: Image processing can include receiving an aperture level and producing a full-color image. The full-color image can be produced by assigning a greater weight to first sensor pixels and assigning a lesser weight to second sensor pixels based on the received aperture level. The greater weight can exceed the lesser weight. An image sensor panel can include the first sensor pixels and the second sensor pixels. Each of the first sensor pixels can have a first color-filter-independent-photosensitivity (CFIP) and each of the second sensor pixels having a second CFIP. The first CFIP can be larger or smaller than the second CFIP.

Abstract: Methods, systems, and devices for dual phase detection auto focus (PDAF) power optimization are described. A camera device may capture a frame including a pixel array representing a scene. In some examples, each pixel of the pixel array may be a phase detection (PD) pixel having one or more values, or one or more PD pixels positioned randomly across the pixel array. The camera device may identify a configuration of the pixel array, and determine a condition of the pixel array relative to the configuration. The configuration may be a binning configuration or a frame pattern configuration, and the condition may include an illumination condition related to the pixel array representing the scene. The camera device may determine and apply a reconfiguration to at least a portion of the pixel array based on the condition of the pixel array, and determine a lens position of the camera device therewith.

Abstract: Aspects of the present disclosure relate to systems and methods for decorrelating one or more saturated regions of an image. In one example, a first phase image and a corresponding second phase image may be obtained. One or more saturated regions of the first phase image and second phase image may be determined. A weight may be applied to each pixel in the one or more saturated regions of the first and second phase images may be weighted to generate a weighted first phase image and a weighted second phase image, and one or more image processing operations may be performed on the weighted first and second phase images.

Abstract: An imaging system includes a sensor comprising a pixel. The pixel comprises first and second photodiodes sharing a common microlens configured to converge light onto a first area of the first photodiode and a second area of the second photodiode. An effective optical center of the first area is offset from a centroid of the first photodiode. An effective optical center of the second area is offset from a centroid of the second photodiode. A processor is configured to: receive a first luminance value from the first photodiode; receive a second luminance value from the second photodiode; and resample a plurality of luminance values including the first second luminance values to provide a luminance of a first resampled pixel having an optical center at a centroid of the first photodiode and a luminance of a second resampled pixel having an optical center at a centroid of the second photodiode.

Abstract: A gesture based user interface includes a movement monitor configured to monitor a user's hand and to provide a signal based on movements of the hand. A processor is configured to provide at least one interface state in which a cursor is confined to movement within a single dimension region responsive to the signal from the movement monitor, and to actuate different commands responsive to the signal from the movement monitor and the location of the cursor in the single dimension region.

Abstract: Methods, systems, and devices for dual phase detection auto focus (PDAF) power optimization are described. A camera device may capture a frame including a pixel array representing a scene. In some examples, each pixel of the pixel array may be a phase detection (PD) pixel having one or more values, or one or more PD pixels positioned randomly across the pixel array. The camera device may identify a configuration of the pixel array, and determine a condition of the pixel array relative to the configuration. The configuration may be a binning configuration or a frame pattern configuration, and the condition may include an illumination condition related to the pixel array representing the scene. The camera device may determine and apply a reconfiguration to at least a portion of the pixel array based on the condition of the pixel array, and determine a lens position of the camera device therewith.