Abstract: Apparatus for generating images using a mechanical infrared cut-off switch are disclosed herein. An example apparatus including an optical system for generating images includes a mechanical infrared light filter movable between a first position and a second position. The mechanical infrared light filter may be configured to allow infrared light to pass through the optical system while in the first position and configured to filter out infrared light from the optical system while in the second position. The example apparatus also includes an imaging sensor including imaging pixels and infrared pixels, and may be configured to receive light from the optical system. Additionally, the example apparatus includes a processor configured to receive visible light data and infrared light data from the image sensor. The processor may further be configured to generate a combined image based on the visible light data and the infrared light data.

Abstract: Systems, methods, and computer-readable media are provided for generating an image processing effect via disparity-guided salient object detection. In some examples, a system can detect a set of superpixels in an image; identify, based on a disparity map generated for the image, an image region containing at least a portion of a foreground of the image; calculate foreground queries identifying superpixels in the image region having higher saliency values than other superpixels in the image region; rank a relevance between each superpixel and one or more foreground queries; generate a saliency map for the image based on the ranking of the relevance between each superpixel and the one or more foreground queries; and generate, based on the saliency map, an output image having an effect applied to a portion of the output image.

Abstract: Aspects of the present disclosure relate to systems and methods for selectively processing tiles of a captured image. The captured image may be parsed into a plurality of tiles. A subset of the plurality of tiles may be selected based at least in part on at least one metric. The selected tiles may be processed according to a first technique, while each unselected tile may be selectively processed according to one or more techniques different from the first technique. The first technique and the one or more techniques may each be either an image demosaicing technique or an image denoising technique.

Abstract: Methods, systems, and devices for processing color information are described. The method may include receiving a first set of image data collected at an image sensor based on a first color filter array having a first filter pattern, calculating a color saturation gradient based on the first set of image data, and calculating multiple color gradients based on the color saturation gradient. The multiple color gradients may each be associated with a region of the first set of image data, where each color gradient characterizes a color variation along a different direction of the region. The method may include generating a second set of image data including a color value for the region based on comparing a first direction gradient of the multiple color gradients with a second direction gradient of the multiple color gradients. Color values associated with the regions may be mapped to a second color filter array.

Abstract: In general, techniques are described regarding a combined monochrome and chromatic camera sensor. A camera comprising a camera sensor and a processor may be configured to perform the techniques. The camera sensor may include pixel sensors, monochrome filters disposed over a first subset of the pixel sensors, and color filters disposed over a second subset of the pixel sensors. The first subset of the pixel sensors may be configured to capture a monochrome image of a scene. The second subset of the pixel sensors may be configured to capture, concurrently with the capture of the monochrome image, a color image of the scene, where a number of the first subset of the pixel sensors is greater than a number of the second subset of the pixel sensors. The processor may be configured to process the monochrome image and the color image to obtain an enhanced color image of the scene.

Abstract: Methods, systems, and devices for image processing are described. A device may capture image data based on a color filter array (CFA) associated with an image sensor. The image data may include a set of pixels. The device may determine a CFA pattern of the CFA and select a configuration appropriately. The configuration may include an indication of a first set of neighboring pixels for each pixel of the set of pixels to use to determine that a pixel is defective and a second set of neighboring pixels for each pixel of the set of pixels to use to correct the defective pixel. The device may determine that the pixel of the set of pixels is defective using the configuration, and correct the defective pixel using pixel values of the first set of neighboring pixels, or pixel values of the second set of neighboring pixels, or both.

Abstract: Methods, systems, and devices for processing color information are described. The method may include receiving a first set of image data collected at an image sensor based on a first color filter array having a first filter pattern, calculating a color saturation gradient based on the first set of image data, and calculating multiple color gradients based on the color saturation gradient. The multiple color gradients may each be associated with a region of the first set of image data, where each color gradient characterizes a color variation along a different direction of the region. The method may include generating a second set of image data including a color value for the region based on comparing a first direction gradient of the multiple color gradients with a second direction gradient of the multiple color gradients. Color values associated with the regions may be mapped to a second color filter array.

Abstract: The present disclosure relates to methods and devices for image processing. In one aspect, the device may obtain a first image including a set of multiple first pixels. The device can also determine a scale factor for scaling the first image from the first pixels to a set of multiple second pixels. Also, a number of the second pixels can be less than a number of the first pixels, where each second pixel has a second pixel width. Additionally, the device can determine a value for each second pixel based on a weighted average, where each component of the weighted average can be a function of an overlapping area associated with each second pixel and values of corresponding first pixels of the multiple first pixels. The device can also generate a second image based on the determined values for each second pixel.

Abstract: In general, techniques are described regarding a combined monochrome and chromatic camera sensor. A camera comprising a camera sensor and a processor may be configured to perform the techniques. The camera sensor may include pixel sensors, monochrome filters disposed over a first subset of the pixel sensors, and color filters disposed over a second subset of the pixel sensors. The first subset of the pixel sensors may be configured to capture a monochrome image of a scene. The second subset of the pixel sensors may be configured to capture, concurrently with the capture of the monochrome image, a color image of the scene, where a number of the first subset of the pixel sensors is greater than a number of the second subset of the pixel sensors. The processor may be configured to process the monochrome image and the color image to obtain an enhanced color image of the scene.

Abstract: Aspects of the present disclosure relate to systems and methods for selectively processing tiles of a captured image. The captured image may be parsed into a plurality of tiles. A subset of the plurality of tiles may be selected based at least in part on at least one metric. The selected tiles may be processed according to a first technique, while each unselected tile may be selectively processed according to one or more techniques different from the first technique. The first technique and the one or more techniques may each be either an image demosaicing technique or an image denoising technique.

Abstract: A device may identify a first pixel array representing a high dynamic range (HDR) image of a scene. The device may determine one or more image statistics associated with the HDR image based on the first pixel array. The device may generate a corrected pixel array by applying an interpolative operation to the first pixel array, where the image statistics may be determined based on the corrected pixel array. The device may generate one or more tone-mapping curves for the HDR image based on the image statistics. The device may generate a compressed image of the scene by applying the one or more tone-mapping curves to the first pixel array. The device may output the compressed image of the scene (e.g., to a display of the device, to a system memory, etc.).

Abstract: A system and method are disclosed for generating an overshoot-corrected set of edges of an input image. An example method includes, receiving an input image, and generating a coarse set of edge pixels based on the received input image For each given pixel in the coarse set of edge pixels, the example method includes identifying a first pixel of the input image that corresponds to the given pixel in the coarse set of edge pixels; and determining a modified edge pixel for the given pixel based at least in part on differences between the first pixel and one or more pixels of the input image that are located within a vicinity of the first pixel. The example method further includes generating an edge-enhanced version of the input image based at least in part on the modified edge pixels.

Abstract: Methods and apparatuses for image processing are disclosed. An example method may include receiving an image to be processed. The method may further include selecting a pixel of the image. The method may also include determining, for each of a plurality of directions through the selected pixel, a gradient in intensity based on the selected pixel and a set of one or more neighboring pixels along the corresponding direction. The method may further include determining, for each of the plurality of directions, if the set of one or more neighboring pixels is selected for adjusting the intensity of the selected pixel based on the corresponding determined gradient in intensity. The method may also include determining a noise reduction filter for the selected pixel based on the selected sets of one or more neighboring pixels. The method may further include applying the determined noise reduction filter to the selected pixel of the image.

Abstract: A method performed by an electronic device is described. The method includes obtaining an image. The method also includes normalizing a set of frequency band amplitudes of the image based on a plurality of normalization gains to produce a normalized set of frequency band amplitudes. The method further includes producing a processed image based on the normalized set of frequency band amplitudes.

Abstract: A method performed by an electronic device is described. The method includes obtaining an input image. The input image includes image noise. The method also includes removing the image noise from the input image to produce a noise-removed image. The method further includes avoiding enhancing the image noise by performing edge detection on the noise-removed image to produce edge information. The method additionally includes producing a processed image based on the input image and the edge information.

Abstract: In some cases, conventional digital zoom techniques can lead to poor quality images. Disclosed are systems and methods for improving the quality of images generated by digital zoom. For example, in some embodiments, a parallel structure is utilized where an image is passed through a sharpener and a 2D directional upscaler at the same time. Upscaling operations are then performed on the sharpened image. The upscaled sharpened image is added to the output of the 2D directional upscaler to produce an enhanced image.

Abstract: In some cases, conventional digital zoom techniques can lead to poor quality images. Disclosed are systems and methods for improving the quality of images generated by digital zoom. For example, in some embodiments, a parallel structure is utilized where an image is passed through a sharpener and a 2D directional upscaler at the same time. Upscaling operations are then performed on the sharpened image. The upscaled sharpened image is added to the output of the 2D directional upscaler to produce an enhanced image.

Abstract: Certain embodiments relate to systems and methods for dynamic color shading correction, which can estimate the color shading in a captured image on the fly. The color shading may be estimated from the scene statistics of the captured image, and the estimated shading may be used for color shading correction. The color shading estimation method may separate out the color shading component from the actual image content by its unique characteristic in the gradient domain.

Abstract: Certain aspects relate to systems and techniques for correction of color artifacts including both color aberration and color spot artifacts using a unified framework. For example, both color aberration and color spot artifacts can be corrected using a post-processing method implementing directional median filtering on chroma channels. A pixel-by-pixel correction ratio map can be built by analyzing the luma and chroma components of the image to indicate a type of color artifact associated with each pixel in the image, and a directional median filter can be selected for each pixel based on the corresponding correction ratio map value.

Abstract: Certain embodiments relate to systems and methods for dynamic color shading correction, which can estimate the color shading in a captured image on the fly. The color shading may be estimated from the scene statistics of the captured image, and the estimated shading may be used for color shading correction. The color shading estimation method may separate out the color shading component from the actual image content by its unique characteristic in the gradient domain.