Abstract: A method for image enhancement includes capturing multiple input images of a scene, including at least a first input image having a first field of view (FOV) captured with a first focal depth and a second input image having a second FOV captured with a second focal depth. The input images in the sequence are preprocessed so as to align the images. The aligned images are processed in a neural network, which generates an output image having an extended depth of field encompassing at least the first and second focal depths.

Abstract: Devices, methods, and non-transitory program storage devices are disclosed herein to perform predictive image sensor cropping operations to improve the performance of video image stabilization operations, especially for high resolution image sensors. According to some embodiments, the techniques include, for each of one or more respective images of a first plurality of images: obtaining image information corresponding to one or more images in the first plurality of images captured prior to the respective image; predicting, for the respective image, an image sensor cropping region to be read out from the first image sensor; and then reading out, into a memory, a first cropped version of the respective image comprising only the predicted image sensor cropping region for the respective image. Then, a first video may be produced based, at least in part, on the first cropped versions of the one or more respective images of the first plurality of images.

Abstract: This disclosure relates to techniques for generating robust depth estimations for captured images using semantic segmentation. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Such segmentations may be binary (e.g., a ‘person pixel’ or a ‘non-person pixel’) or multi-class (e.g., a pixel may be labelled as: ‘person,’ ‘dog,’ ‘cat,’ etc.). As semantic segmentation techniques grow in accuracy and adoption, it is becoming increasingly important to develop methods of utilizing such segmentations and developing flexible techniques for integrating segmentation information into existing computer vision applications, such as depth and/or disparity estimation, to yield improved results in a wide range of image capture scenarios.

Abstract: This disclosure relates to techniques for the robust usage of semantic segmentation information in image processing techniques, e.g., shallow depth of field (SDOF) renderings. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may be binary (e.g., a ‘person pixel’ or a ‘non-person pixel’) or multi-class (e.g., a pixel may be labelled as: ‘person,’ ‘dog,’ ‘cat,’ etc.). As semantic segmentation techniques grow in accuracy and adoption, it is becoming increasingly important to develop methods of utilizing such segmentations and developing flexible techniques for integrating segmentation information into existing computer vision applications, such as synthetic SDOF renderings, to yield improved results in a wide range of image capture scenarios.

Abstract: Determining disparity includes obtaining a first image of a scene and a second image of a scene, determining correspondences between one or more pixels of the first image and one or more pixels of the second image, performing local denoising on the correspondences based on at least on a strength and direction of gradient values for the one or more pixels of the first image and the one or more pixels of the second image, and generating a disparity map based on the determined correspondences and local denoising.

Abstract: The disclosure pertains to techniques for image processing. One such technique comprises a method for image processing comprising obtaining first light information from a set of light-sensitive pixels for a scene, the pixels including phase detection (PD) pixels and non-PD pixels, generating a first PD pixel image from the first light information, the first PD pixel image having a first resolution, generating a higher resolution image from the plurality of non-PD pixels, wherein the higher resolution image has a resolution greater than the resolution of the first PD pixel image, matching a first pixel of the first PD pixel image to the higher resolution image, wherein the matching is based on a set of correlations between the first pixel and non-PD pixel within a predetermined distance of the first pixel, and determining a disparity map for an image associated with the first light information, based on the match.

Abstract: This disclosure relates to techniques for the robust usage of semantic segmentation information in image processing techniques, e.g., shallow depth of field (SDOF) renderings. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may be binary (e.g., a ‘person pixel’ or a ‘non-person pixel’) or multi-class (e.g., a pixel may be labelled as: ‘person,’ ‘dog,’ ‘cat,’ etc.). As semantic segmentation techniques grow in accuracy and adoption, it is becoming increasingly important to develop methods of utilizing such segmentations and developing flexible techniques for integrating segmentation information into existing computer vision applications, such as synthetic SDOF renderings, to yield improved results in a wide range of image capture scenarios.

Abstract: This disclosure relates to techniques for generating robust depth estimations for captured images using semantic segmentation. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Such segmentations may be binary (e.g., a ‘person pixel’ or a ‘non-person pixel’) or multi-class (e.g., a pixel may be labelled as: ‘person,’ ‘dog,’ ‘cat,’ etc.). As semantic segmentation techniques grow in accuracy and adoption, it is becoming increasingly important to develop methods of utilizing such segmentations and developing flexible techniques for integrating segmentation information into existing computer vision applications, such as depth and/or disparity estimation, to yield improved results in a wide range of image capture scenarios.

Abstract: This disclosure relates to techniques for synthesizing out of focus effects in digital images. Digital single-lens reflex (DSLR) cameras and other cameras having wide aperture lenses typically capture images with a shallow depth of field (SDOF). SDOF photography is often used in portrait photography, since it emphasizes the subject, while deemphasizing the background via blurring. Simulating this kind of blurring using a large depth of field (LDOF) camera may require a large amount of computational resources, i.e., in order to simulate the physical effects of using a wide aperture lens while constructing a synthetic SDOF image. However, cameras having smaller lens apertures, such as mobile phones, may not have the processing power to simulate the spreading of all background light sources in a reasonable amount of time. Thus, described herein are techniques to synthesize out-of-focus background blurring effects in a computationally-efficient manner for images captured by LDOF cameras.

Abstract: This disclosure relates to techniques for synthesizing out of focus effects in digital images. Digital single-lens reflex (DSLR) cameras and other cameras having wide aperture lenses typically capture images with a shallow depth of field (SDOF). SDOF photography is often used in portrait photography, since it emphasizes the subject, while deemphasizing the background via blurring. Simulating this kind of blurring using a large depth of field (LDOF) camera may require a large amount of computational resources, i.e., in order to simulate the physical effects of using a wide aperture lens while constructing a synthetic SDOF image. However, cameras having smaller lens apertures, such as mobile phones, may not have the processing power to simulate the spreading of all background light sources in a reasonable amount of time. Thus, described herein are techniques to synthesize out-of-focus background blurring effects in a computationally-efficient manner for images captured by LDOF cameras.

Abstract: Methods, apparatus, and computer-readable storage media for fast adaptive edge-aware matting in which a matting technique adaptively feathers selections, provides smooth color correspondence matting, and performs well in textured regions. The matting technique may require fewer strokes and less parameter tuning than conventional matting techniques. The matting technique may have two components implemented in a matting pipeline. A color similarity component implements a color similarity constraint technique based on a radial basis function (RBF) technique to generate a color-constrained mask, and a locality constraint component implements a locality constraint technique based on a fast flood fill technique to generate a locality-constrained mask. The final mask (or matte) output may be an element multiply of the masks generated by the two components.

Abstract: A system and method for a blur brush performing adaptive bilateral filtering is disclosed. The method may include receiving user input selecting an area of an image to be filtered, such as by pointing to the image area using the blur brush. The selected image may comprise an edge and a plurality of pixels. The method may operate to the blur brush identifying the edge in the selected image area. The method may operate to apply a filter tool (e.g., a bilateral filter) to the selected image area, while preserving the edge. The methods may be implemented by program instructions executing in parallel on CPU(s) or GPUs.

Abstract: The present invention provides compositions and methods which are adapted to impart color to concrete or mineral substrate surfaces. Specifically, the present invention relates to a composition and methods adapted to treat concrete surfaces which have the advantage of using a non-corrosive acid-based solution.

Abstract: A system and method for a blur brush performing adaptive bilateral filtering is disclosed. The method may include receiving user input selecting an area of an image to be filtered, such as by pointing to the image area using the blur brush. The selected image may comprise an edge and a plurality of pixels. The method may operate to the blur brush identifying the edge in the selected image area. The method may operate to apply a filter tool (e.g., a bilateral filter) to the selected image area, while preserving the edge. The methods may be implemented by program instructions executing in parallel on CPU(s) or GPUs.

Abstract: Methods, apparatus, and computer-readable storage media for fast adaptive edge-aware matting in which a matting technique adaptively feathers selections, provides smooth color correspondence matting, and performs well in textured regions. The matting technique may require fewer strokes and less parameter tuning than conventional matting techniques. The matting technique may have two components implemented in a matting pipeline. A color similarity component implements a color similarity constraint technique based on a radial basis function (RBF) technique to generate a color-constrained mask, and a locality constraint component implements a locality constraint technique based on a fast flood fill technique to generate a locality-constrained mask. The final mask (or matte) output may be an element multiply of the masks generated by the two components.

Abstract: A system and method for performing integral histogram convolution for filtering image data is disclosed. The method may include applying a filter window to a first portion of an image, wherein the filter window includes an interior region and a border region. The method may include generating a plurality of histograms for the pixels in the filter window. The method may include generating spatial weight coefficients for the pixels in the border of the filter window. The method may include generating a plurality of color weight coefficients for the pixels in the filter window. The method may include performing a filtering operation on the pixels in the filter window by applying a respective spatial weight coefficient and a respective color weight coefficient to the values in the plurality of histograms for each respective pixel in the filter window. The methods may be implemented by program instructions executing in parallel on CPU(s) or GPUs.

Abstract: The present invention provides compositions and methods which are adapted to impart color to concrete or mineral substrate surfaces. Specifically, the present invention relates to a composition and methods adapted to treat concrete surfaces which have the advantage of using a non-corrosive acid-based solution.

Abstract: A method of fabricating high quality layered structure oxide ferroelectric thin films. The deposition process is a chemical vapor deposition process involving chemical reaction between volatile metal organic compounds of various elements comprising the layered structure material to be deposited, with other gases in a reactor, to produce a nonvolatile solid that deposits on a suitably placed substrate such as a conducting, semiconducting, insulating, or complex integrated circuit substrate. The source materials for this process may include organometallic compounds such as alkyls, alkoxides, .beta.-diketonates or metallocenes of each individual element comprising the layered structure material to be deposited and oxygen. Preferably, the reactor in which the deposition is done is either a hot wall or a cold wall reactor and the vapors are introduced into this reactor either through a set of bubblers or through a direct liquid injection system.