Abstract: Image Signal Processing (ISP) optimization framework for computer vision applications is disclosed. The tuning of the ISP is performed automatically and presented as a nonlinear multi-objective optimization problem, followed by solving the problem using an evolutionary stochastic solver. An improved ISP of the embodiments of the invention includes at least features of search space reduction for reducing a number of ISP configurations, remapping the generated population to the reduced search space via mirroring, and global optimization function processing, which allow tuning all the blocks of the ISP at the same time instead of the prior art tuning of each ISP block separately. Also shown that an ISP tuned for image quality performs inferior compared with an ISP trained for a specific downstream image recognition task.

Abstract: A computer-vision pipeline is organized as a closed loop of a sensor-processing phase, an image-processing phase, and an object-detection phase, each comprising a respective phase processor coupled to a master processor. The sensor-processing phase creates multiple exposure images, and derives multi-exposure multi-scale zonal illumination-distributions, to be processed independently in the image-processing phase. In a first implementation of the object-detection phase, extracted exposure-specific features are pooled prior to overall object detection. In a second implementation, exposure-specific objects, detected from the exposure-specific features, are fused to produce the sought objects of a scene under consideration. The two implementations enable detecting fine details of a scene under diverse illumination conditions. The master processor performs loss-function computations to derive updated training parameters of the processing phases.

Abstract: Image Signal Processing (ISP) optimization framework for computer vision applications is disclosed. The tuning of the ISP is performed automatically and presented as a nonlinear multi-objective optimization problem, followed by solving the problem using an evolutionary stochastic solver. An improved ISP of the embodiments of the invention includes at least features of search space reduction for reducing a number of ISP configurations, remapping the generated population to the reduced search space via mirroring, and global optimization function processing, which allow tuning all the blocks of the ISP at the same time instead of the prior art tuning of each ISP block separately. Also shown that an ISP tuned for image quality performs inferior compared with an ISP trained for a specific downstream image recognition task.

Abstract: An auto-exposure control is proposed for high dynamic range images, along with a neural network for exposure selection that is trained jointly, end-to-end with an object detector and an image signal processing (ISP) pipeline. Corresponding method and system for high dynamic range object detection are also provided.

Abstract: Image Signal Processing (ISP) optimization framework for computer vision applications is disclosed. The tuning of the ISP is performed automatically and presented as a nonlinear multi-objective optimization problem, followed by solving the problem using an evolutionary stochastic solver. An improved ISP of the embodiments of the invention includes at least features of search space reduction for reducing a number of ISP configurations, remapping the generated population to the reduced search space via mirroring, and global optimization function processing, which allow tuning all the blocks of the ISP at the same time instead of the prior art tuning of each ISP block separately. Also shown that an ISP tuned for image quality performs inferior compared with an ISP trained for a specific downstream image recognition task.

Abstract: Image Signal Processing (ISP) optimization framework for computer vision applications is disclosed. The tuning of the ISP is performed automatically and presented as a nonlinear multi-objective optimization problem, followed by solving the problem using an evolutionary stochastic solver. An improved ISP of the embodiments of the invention includes at least features of search space reduction for reducing a number of ISP configurations, remapping the generated population to the reduced search space via mirroring, and global optimization function processing, which allow tuning all the blocks of the ISP at the same time instead of the prior art tuning of each ISP block separately. Also shown that an ISP tuned for image quality performs inferior compared with an ISP trained for a specific downstream image recognition task.

Abstract: Image Signal Processing (ISP) optimization framework for computer vision applications is disclosed. The tuning of the ISP is performed automatically and presented as a nonlinear multi-objective optimization problem, followed by solving the problem using an evolutionary stochastic solver. An improved ISP of the embodiments of the invention includes at least features of search space reduction for reducing a number of ISP configurations, remapping the generated population to the reduced search space via mirroring, and global optimization function processing, which allow tuning all the blocks of the ISP at the same time instead of the prior art tuning of each ISP block separately. Also shown that an ISP tuned for image quality performs inferior compared with an ISP trained for a specific downstream image recognition task.

Abstract: Method and system for denoising an edge in a raw digital image are described. First, a direction of a normal to the edge near a pixel p is determined, and neighboring pixels are projected to the normal to the edge, forming projected pixels. Then weighted intensities of the neighboring pixels are determined, including set of weights. One dimensional Gaussian filter centered on the pixel p and acting on the projected pixels is applied, and intensities of the neighboring pixels are adjusted according to the set of weights, resulting in a denoised value z of the pixel p using the weighted intensities, thereby denoising the edge of the raw image expediently.

Abstract: Method and system for denoising an edge in a raw digital image are described. First, a direction of a normal to the edge near a pixel p is determined, and neighboring pixels are projected to the normal to the edge, forming projected pixels. Then weighted intensities of the neighboring pixels are determined, including set of weights. One dimensional Gaussian filter centered on the pixel p and acting on the projected pixels is applied, and intensities of the neighboring pixels are adjusted according to the set of weights, resulting in a denoised value z of the pixel p using the weighted intensities, thereby denoising the edge of the raw image expediently.

Abstract: Methods and systems for denoising a digital image are provided. The method includes determining first and second plurality of pixel patches including respective first (p) and second (q) pixels, determining a patch distance between each pair of corresponding pixel patches in the first plurality and the second plurality of pixel patches, determining an effective distance between the first pixel (p) and the second pixel (q), repeating the above steps for the same first pixel (p) and another second pixel (q) until a predetermined number of pixels (q) in the raw digital image is processed, and then denoising the first pixel (p), including determining respective contributions of the pixels (q) into a noise reduction of the pixel (p), using respective effective distances of the pixels (q). A corresponding system is also provided. Embodiments of the invention provide computational advantages for denoising digital images.

Abstract: Methods and systems for denoising a digital image are provided. The method includes determining first and second plurality of pixel patches including respective first (p) and second (q) pixels, determining a patch distance between each pair of corresponding pixel patches in the first plurality and the second plurality of pixel patches, determining an effective distance between the first pixel (p) and the second pixel (q), repeating the above steps for the same first pixel (p) and another second pixel (q) until a predetermined number of pixels (q) in the raw digital image is processed, and then denoising the first pixel (p), including determining respective contributions of the pixels (q) into a noise reduction of the pixel (p), using respective effective distances of the pixels (q). A corresponding system is also provided. Embodiments of the invention provide computational advantages for denoising digital images.