Abstract: A device for image capture comprises a memory and one or more processors coupled to the memory and configured to: receive, during a preview mode or a recording, a first image, generate a first saliency map indicative of relative saliency of different regions within the first image, wherein the relative saliency of the different regions is indicative of a likelihood of attracting viewer gaze, generate one or more additional images based on manipulating pixels in the first image, generate one or more additional saliency maps indicative of relative saliency of different regions within the one or more additional images, and determine, during the preview mode or the recording, a camera setting based on the first saliency map and the one or more additional saliency maps.

Abstract: A method and apparatus for determining an auto white balance (AWB) gain based on determined depth information. The method may include receiving an image captured by an image sensor, determining depth information associated with the captured image, assigning weights to a plurality of illuminants based on the determined depth information, determining an auto white balance gain based on the assigned weights and statistics of the captured image, and applying the auto white balance gain to the captured image.

Abstract: An image capture device that includes an adjustment circuit configured to monitor image parameters, generate updated image settings for the image capture device in response to the monitored image parameters, and transmit the updated image settings to one or more processors. The updated image settings configure the one or more processors to determine whether to transition the image capture device from a dynamic scene mode to a static scene mode based on a first image parameter included in the monitored image parameters, wherein the first image parameter is different from a second image parameter used to determine to transition the image capture device from the static scene mode to the dynamic scene mode, and to suspend generation of all or less than all of the updated image settings in response to determining to transition the image capture device from the dynamic scene mode to the static scene mode.

Abstract: A method and apparatus for determining an auto white balance (AWB) gain based on determined depth information. The method may include receiving an image captured by an image sensor, determining depth information associated with the captured image, assigning weights to a plurality of illuminants based on the determined depth information, determining an auto white balance gain based on the assigned weights and statistics of the captured image, and applying the auto white balance gain to the captured image.

Abstract: An image capture device that includes an adjustment circuit configured to monitor image parameters, generate updated image settings for the image capture device in response to the monitored image parameters, and transmit the updated image settings to one or more processors. The updated image settings configure the one or more processors to determine whether to transition the image capture device from a dynamic scene mode to a static scene mode based on a first image parameter included in the monitored image parameters, wherein the first image parameter is different from a second image parameter used to determine to transition the image capture device from the static scene mode to the dynamic scene mode, and to suspend generation of all or less than all of the updated image settings in response to determining to transition the image capture device from the dynamic scene mode to the static scene mode.

Abstract: Apparatus are provided including an image signal carrier, a luminance information evaluator, and a chrominance information modifier. The image signal carrier is encoded with an image signal including luminance information and chrominance information. The luminance information evaluator evaluates the luminance information in the image signal for a given region within the image to identify when the given region is one of substantially white and substantially dark. The chrominance information modifier is provided to modify the chrominance information corresponding to the given region when the given region is one of substantially white and substantially dark.

Abstract: A camera system in normal mode and hand jitter reduction (hjr) mode may comprise generating a first exposure time-gain product by multiplying the normal mode exposure time with the normal mode gain. It may further comprise modifying the normal mode exposure time and gain and multiplying these modified parameters to generate a second exposure time-gain product for a hjr mode that reduces the difference between the first exposure time-gain product and the second exposure time-gain product. To reduce the difference the normal mode frame rate may also be modified. Operation of a camera in normal mode may be in response to a sensed light level being above a threshold. The hjr mode may be selected by the user while the camera is operating. The hjr mode may be used in response to a sensed light level being lower than the threshold.

Abstract: An imaging system generates a gain for a component of an image format. The gain is at least partially dependent on the brightness of the light source illuminating a scene when an image of the scene was generated. The gain can be used to correct the component of the image format for the color shift in the image caused by the light source. In some instances, the imaging system generates a gain for a plurality of the components of the image format or for all of the components of the image format. The gains can be used to correct the components for the color shift in the image caused by the light source.

Abstract: The registration of images comprising generating a plurality of projections from a base frame and generating a plurality of projections from a movement frame. Comparing a set of projections from the base frame, with a second set of projections from the movement frame, and generating a global motion vector estimate to add to the base frame.

Abstract: A method and apparatus for adaptive green channel odd-even mismatch removal to effectuate the disappearance of artifacts caused by the odd-even mismatch in a demosaic processed image. In one example, a calibrated GR channel gain for red rows and a calibrated GB channel gain for blue rows are determined and are a function of valid pixels only in each respective region. After the calibration, in a correction process, the green pixels in red rows of a region are multiplied by the calibrated GR channel gain, and the green pixels in blue rows are multiplied by the calibrated GB channel gain.

Abstract: Techniques are described for predictive focus value calculation within image capture devices. Image capture devices may include digital still cameras and digital video cameras. The techniques include performing an auto-focus process within an image capture device by predicting a focus value for a scene at a lens position of a lens included in the image capture device based on a corrupt focus value for the lens position calculated from a first frame directly after lens settlement. Therefore, the auto-focus process may determine size and direction of movement for the lens to a next lens position based on the predicted valid focus value, and move the lens to the next lens position during a second frame. In this way, the techniques may move the lens to another lens position during each frame, greatly reducing auto-focus latency by potentially doubling or tripling the speed of the auto-focus process.

Abstract: This disclosure describes image processing techniques that facilitate the determination of the lighting condition associated with an image. Once the lighting condition is determined, white balance can be performed on the image such as by applying white balance gains defined for the lighting condition. According to the techniques of this disclosure, gray point lines are defined and plotted for the different lighting conditions, and cylindrical bounding volumes are defined around the gray point lines, e.g., in a three-dimensional color space. The image is then analyzed with respect to each of the cylindrical bounding volumes to determine how many pixels of the image fall within the respective cylindrical bounding volumes formed around the gray point lines for the different lighting conditions. Based on this analysis, the actual lighting condition can be determined.

Abstract: Techniques are described for dynamic automatic exposure compensation within image capture devices. The techniques include dynamically adjusting a default target brightness for a scene to compensate an exposure value (EV) selected by an automatic exposure process. A sensor array obtains light information from the scene at a default target brightness and an image capture controller calculates brightness values of a plurality of regions in the scene based on the light information. An automatic exposure compensation module dynamically adjusts the default target brightness based on the brightness values for the plurality of regions in the scene and threshold values set for the sensor array to set an adjusted target brightness. The sensor array may then capture an image frame of the scene using an EV for the adjusted target brightness. The techniques also include building a hysteresis zone to substantially stabilize the adjusted target brightness over a sequence of image scenes.

Abstract: Techniques for improving the quality of images are described. A first histogram of intensity values may be obtained for an input image and diffused to obtain a second histogram with better intensity coverage. The diffusion may be achieved by filtering the first histogram for multiple iterations with a diffusion function obtained based on a filter function and a diffusion control function. The filter function may control the rate and/or characteristics of the diffusion. The diffusion control function may control shifts in positions of lobes in the first histogram. A transformation function may be determined based on a first cumulative distribution function (CDF) for the first histogram and an inverse function for a second CDF for the second histogram. An output image may be generated by mapping each pixel value in the input image to a corresponding pixel value in the output image based on the transformation function.

Abstract: Apparatus are provided including an image signal carrier, a luminance information evaluator, and a chrominance information modifier. The image signal carrier is encoded with an image signal including luminance information and chrominance information. The luminance information evaluator evaluates the luminance information in the image signal for a given region within the image to identify when the given region is one of substantially white and substantially dark.

Abstract: Techniques are described for predictive focus value calculation within image capture devices. Image capture devices may include digital still cameras and digital video cameras. The techniques include performing an auto-focus process within an image capture device by predicting a focus value for a scene at a lens position of a lens included in the image capture device based on a corrupt focus value for the lens position calculated from a first frame directly after lens settlement. Therefore, the auto-focus process may determine size and direction of movement for the lens to a next lens position based on the predicted valid focus value, and move the lens to the next lens position during a second frame. In this way, the techniques may move the lens to another lens position during each frame, greatly reducing auto-focus latency by potentially doubling or tripling the speed of the auto-focus process.

Abstract: Techniques are described for dynamic automatic exposure compensation within image capture devices. The techniques include dynamically adjusting a default target brightness for a scene to compensate an exposure value (EV) selected by an automatic exposure process. A sensor array obtains light information from the scene at a default target brightness and an image capture controller calculates brightness values of a plurality of regions in the scene based on the light information. An automatic exposure compensation module dynamically adjusts the default target brightness based on the brightness values for the plurality of regions in the scene and threshold values set for the sensor array to set an adjusted target brightness. The sensor array may then capture an image frame of the scene using an EV for the adjusted target brightness. The techniques also include building a hysteresis zone to substantially stabilize the adjusted target brightness over a sequence of image scenes.

Abstract: This disclosure describes image processing techniques that facilitate the determination of the lighting condition associated with an image. Once the lighting condition is determined, white balance can be performed on the image such as by applying white balance gains defined for the lighting condition. According to the techniques of this disclosure, gray point lines are defined and plotted for the different lighting conditions, and cylindrical bounding volumes are defined around the gray point lines, e.g., in a three-dimensional color space. The image is then analyzed with respect to each of the cylindrical bounding volumes to determine how many pixels of the image fall within the respective cylindrical bounding volumes formed around the gray point lines for the different lighting conditions. Based on this analysis, the actual lighting condition can be determined.

Abstract: The registration of images comprising generating a plurality of projections from a base frame and generating a plurality of projections from a movement frame. Comparing a set of projections from the base frame, with a second set of projections from the movement frame, and generating a global motion vector estimate to add to the base frame.

Abstract: A method and apparatus for adaptive green channel odd-even mismatch removal to effectuate the disappearance of artifacts caused by the odd-even mismatch in a demosaic processed image. In one adaptive approach, a calibrated GR channel gain for red rows and a calibrated GB channel gain for blue rows are determined and are a function of valid pixels only in each respective region. After the calibration, in a correction process, the green pixels in red rows of a region are multiplied by the calibrated GR channel gain. On the other hand, the green pixels in blue rows are multiplied by the calibrated GB channel gain. Thus, after demosaic processing, the corrected image has essentially no artifacts caused by odd-even mismatch of the green channel. Alternately, the adaptive green channel odd-even mismatch removal method replaces the center green pixel of a region having an odd number of columns and rows with a normalized weighted green pixel sum total.