Abstract: Electronic devices, computer readable storage media, and related methods are disclosed herein that are configured to stitch together images captured by multiple image capture devices of an image capture system. In particular, various techniques are employed to intelligently extend (and, optionally, smooth) the correspondence mapping between first and second images captured by image capture devices having different fields of view, e.g., fields of view that are at least partially overlapping and at least partially non-overlapping. The techniques may also include determining a “transitional” correspondence in a transitional region between the overlapping and non-overlapping regions of the fields of view, as well as performing one or more appearance correction operations to account for the different properties of the different image capture devices used to capture the first and second images.

Abstract: Media user interfaces are described, including user interfaces for capturing media (e.g., capturing a photo, recording a video), displaying media (e.g., displaying a photo, playing a video), editing media (e.g., modifying a photo, modifying a video), accessing media controls or settings (e.g., accessing controls or settings to capture photos or videos to capture videos), and automatically adjusting media (e.g., automatically modifying a photo, automatically modifying a video).

Abstract: Media user interfaces are described, including user interfaces for capturing media (e.g., capturing a photo, recording a video), displaying media (e.g., displaying a photo, playing a video), editing media (e.g., modifying a photo, modifying a video), accessing media controls or settings (e.g., accessing controls or settings to capture photos or videos to capture videos), and automatically adjusting media (e.g., automatically modifying a photo, automatically modifying a video).

Abstract: Media user interfaces are described, including user interfaces for capturing media (e.g., capturing a photo, recording a video), displaying media (e.g., displaying a photo, playing a video), editing media (e.g., modifying a photo, modifying a video), accessing media controls or settings (e.g., accessing controls or settings to capture photos or videos to capture videos), and automatically adjusting media (e.g., automatically modifying a photo, automatically modifying a video).

Abstract: In various implementations a method includes obtaining a plurality of source images, stabilizing the plurality of source images to generate a plurality of stabilized images, and averaging the plurality of stabilized image to generate a synthetic long exposure image. In various implementations, stabilizing the plurality of source images includes: selecting one of the plurality of source images to serve as a reference frame; and registering others of the plurality of source images to the reference frame by applying a perspective transformation to others of the plurality of the source images.

Abstract: In various implementations a method includes obtaining a plurality of source images, stabilizing the plurality of source images to generate a plurality of stabilized images, and averaging the plurality of stabilized image to generate a synthetic long exposure image. In various implementations, stabilizing the plurality of source images includes: selecting one of the plurality of source images to serve as a reference frame; and registering others of the plurality of source images to the reference frame by applying a perspective transformation to others of the plurality of the source images.

Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel approach to pixel-based registration of non-reference images to a reference frame in a set of commonly captured images is disclosed which makes use of pyramid decomposition to more efficiently detect corners. The disclosed pixel-based registration operation may also be combined with motion sensor data-based registration approaches to register non-reference images with respect to the reference frame. When the registered non-reference images are combined with the pre-selected reference image, the resulting image is a quality stabilized image.

Abstract: Techniques are disclosed for selectively capturing, retaining, and combining multiple sub-exposure images or brackets to yield a final image having diminished motion-induced blur and good noise characteristics. More specifically, after or during the capture of N brackets, the M best may be identified for combining into a single output image, (N>M). As used here, the term “best” means those brackets that exhibit the least amount of relative motion with respect to one another—with one caveat: integer pixel shifts may be preferred over sub-pixel shifts.

Abstract: Systems, methods, and computer readable media to improve image stabilization operations and other image processing operations are described. A novel combination of interleaved image capture and image processing operations, e.g., image registration operations, may be employed on a bracketed capture of still images. Such techniques may result in improved camera performance and processing efficiency, as well as decreased shot-to-shot time intervals. In another embodiment, an image fusion portion of an image post-processing pipeline may also be performed in an interleaved fashion, such that each image in the sequence of obtained bracketed images may be incrementally added to an output composite image after it has been aligned with the preceding image or images from the sequence.

Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.

Abstract: Methods, devices and computer readable media for implementing novel dominant color alleviation techniques for color balancing are described. The techniques take advantage of unique properties of 2D image data histograms accumulated in a chromaticity space, along with other factors such as estimated scene lux and knowledge of plausible scene illuminant white point values within the chromaticity space. The accumulated 2D image data histograms may be refined and “trimmed,” such that the resultant image data passed to an auto white balance solution has much less influence from the dominant colors in the image, even those that overlap the plausible scene illuminant color region. The described techniques provide for white point estimates that are much less prone to dominant color failures.

Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel approach to pixel-based registration of non-reference images to a reference frame in a set of commonly captured images is disclosed which makes use of pyramid decomposition to more efficiently detect corners. The disclosed pixel-based registration operation may also be combined with motion sensor data-based registration approaches to register non-reference images with respect to the reference frame. When the registered non-reference images are combined with the pre-selected reference image, the resulting image is a quality stabilized image.

Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.

Abstract: Systems, methods, and computer readable media to improve image stabilization operations and other image processing operations are described. A novel combination of interleaved image capture and image processing operations, e.g., image registration operations, may be employed on a bracketed capture of still images. Such techniques may result in improved camera performance and processing efficiency, as well as decreased shot-to-shot time intervals. In another embodiment, an image fusion portion of an image post-processing pipeline may also be performed in an interleaved fashion, such that each image in the sequence of obtained bracketed images may be incrementally added to an output composite image after it has been aligned with the preceding image or images from the sequence.

Abstract: Techniques are disclosed for selectively capturing, retaining, and combining multiple sub-exposure images or brackets to yield a final image having diminished motion-induced blur and good noise characteristics. More specifically, after or during the capture of N brackets, the M best may be identified for combining into a single output image, (N>M). As used here, the term “best” means those brackets that exhibit the least amount of relative motion with respect to one another—with one caveat: integer pixel shifts may be preferred over sub-pixel shifts.

Abstract: This disclosure pertains to devices, methods, and computer readable media for improved accuracy of color correction matrix (CCM) coefficient determination based on estimated white point, while maintaining a relatively smooth variation of CCM coefficients over the white point space. The techniques disclosed herein may be achieved via the storage of a limited number of determined CCM multiplier vectors and thus be effective in the camera image pipelines of real image capture devices. With the more accurate CCMs calculated with the disclosed techniques, visible improvement in rendered colors may be achieved as compared to using interpolation from a handful of corner CCMs. The color correction techniques described herein may be implemented by dedicated or general purpose hardware, general application software, or a combination of software and hardware in a computer system.

Abstract: Methods, devices and computer readable media for implementing novel dominant color alleviation techniques for color balancing are described. The techniques take advantage of unique properties of 2D image data histograms accumulated in a chromaticity space, along with other factors such as estimated scene lux and knowledge of plausible scene illuminant white point values within the chromaticity space. The accumulated 2D image data histograms may be refined and “trimmed,” such that the resultant image data passed to an auto white balance solution has much less influence from the dominant colors in the image, even those that overlap the plausible scene illuminant color region. The described techniques provide for white point estimates that are much less prone to dominant color failures.

Abstract: An imaging appliance family is a cooperative system of two or more imaging appliances that are linked together to share images, command and control. Imaging appliances may be linked to each other by introducing the appliances to each other, establishing a communications link, and exchanging appliance information. The appliances may be introduced by a number of different manual or auto-sensing triggers, including buttons and presence detect circuits. Communications may be automatically established in response to the introduction. After communications are established, appliance information is exchanged and the appliances are dynamically configured into a cooperative system. Once linked, the appliances remain logically connected until they are removed from the family.

Abstract: A vertical color filter sensor group formed on a substrate (preferably a semiconductor substrate) and including at least two vertically stacked, photosensitive sensors, and an array of such sensor groups. In some embodiments, a carrier-collection element of at least one sensor of the group has substantially larger area, projected in a plane perpendicular to a normal axis defined by a top surface of a top sensor of the group, than does each minimum-sized carrier-collection element of the group. In some embodiments, the array includes at least two sensor groups that share at least one carrier-collection element. Optionally, the sensor group includes at least one filter positioned relative to the sensors such that radiation that has propagated through or reflected from the filter will propagate into at least one sensor of the group.