Abstract: An image processing apparatus includes a first acquisition unit configured to acquire noise information about a noise characteristic of an input image generated by image capturing using an optical system, a second acquisition unit configured to acquire a sharpening filter in a real space, the sharpening filter being based on an optical characteristic of the optical system, and a third acquisition unit configured to acquire gain information about gain of the sharpening filter using components of the sharpening filter. The image processing apparatus performs sharpening processing on the input image based on the noise information and the gain information.

Abstract: An image processing apparatus includes a first acquisition unit configured to acquire noise information about a noise characteristic of an input image generated by image capturing using an optical system, a second acquisition unit configured to acquire a sharpening filter in a real space, the sharpening filter being based on an optical characteristic of the optical system, and a third acquisition unit configured to acquire gain information about gain of the sharpening filter using components of the sharpening filter. The image processing apparatus performs sharpening processing on the input image based on the noise information and the gain information.

Abstract: The image processing apparatus is configured to perform image processing on an input image produced by image capturing through an optical system. The apparatus includes a first distribution producer configured to produce a first distribution by using data for approximating a point spread function that corresponds to a condition relating to the image capturing, a second distribution producer configured to produce a second distribution by mirroring a part of the first distribution, a filter producer configured to produce, by using the second distribution, a first filter to be used for a sharpening process, and a processor configured to perform the sharpening process on the input image by using the first filter to produce a sharpened image.

Abstract: An image processing apparatus acquires an input image generated by image pickup via an optical system, and perform unsharp mask processing for the input image using a filter generated based on information of a PSF of the optical system. The filter is generated based on an unsharp mask used for the unsharp mask processing, and includes two-dimensional data having filter coefficients that are arranged rotationally asymmetrically with respect to a filter coefficient corresponding to a target pixel in the input image in convoluting the filter with the input image. A peak position or a center of gravity position of the unsharp mask accords with a position of the filter coefficient corresponding to the target pixel in the filter.

Abstract: An image processing apparatus includes a processor that sharpens an input image on the basis a difference between a filter and a low pass filter, which are generated using of information regarding a point spread function of an optical system corresponding to an image pickup condition of the optical system, or a difference between an image obtained by applying the filter to an input image generated by imaging through the optical system and an image obtained by applying the low pass filter to the input image.

Abstract: An image processing method includes the steps of acquiring a first image shot by using a compound eye image pickup apparatus, acquiring image capturing condition information of the first image, acquiring, depending on the image capturing condition information, optical characteristic information of a plurality of optical systems having a plurality of focal lengths different from each other in the compound eye image pickup apparatus, correcting a deterioration of the first image caused by shooting the first image based on the optical characteristic information, and generating a second image based on information of a position and an angle of a ray obtained from the first image whose deterioration is corrected, and the optical characteristic information contains at least one of information related to aberrations and information related to peripheral illumination of the optical systems.

Abstract: A non-transitory computer-readable storage medium storing an image processing program that causes a computer to execute an image processing method comprising acquiring step of acquiring an input image generated by image pickup through an optical system, generating step of generating a point spread function by using coefficient data of a function approximating a point spread function corresponding to an image-pickup condition of the optical system, and providing step of providing unsharp mask processing to the input image using a filter generated based on information of the point spread function generated by using the coefficient data. The filter is a filter having two-dimensional data.

Abstract: An image pickup apparatus includes an imaging optical system, an image pickup element including a plurality of pixels, a lens array configured such that rays from the same position on an object plane are incident on pixels of the image pickup element different from each other depending on a pupil region of the imaging optical system through which the ray passes, an image processing unit configured to perform image processing for the input image acquired by the image pickup element to generate the output images, and a control unit configured to drive the imaging optical system to perform focus control, the image processing unit is configured to acquire information on a refocus control range, and the control unit is configured to perform the focus control based on the information on the refocus control range.

Abstract: An image processing apparatus includes a processor that sharpens an input image on the basis a difference between a filter and a low pass filter, which are generated using of information regarding a point spread function of an optical system corresponding to an image pickup condition of the optical system, or a difference between an image obtained by applying the filter to an input image generated by imaging through the optical system and an image obtained by applying the low pass filter to the input image.

Abstract: An image processor includes a correction signal generator configured to generate a correction signal by calculating a difference between an image and an image obtained by applying an unsharp mask generated based on a PSF corresponding to an image-pickup conditions of an image-pickup optical system to the image, and a correction signal applier configured to sharpen the image by multiplying the correction signal generated by the generator by a constant and by adding a multiplied correction signal to the image.

Abstract: An image pickup apparatus (10) capable of generating a plurality of output images having different focus positions by reconstructing an input image, the image pickup apparatus includes an input image obtaining unit (100) configured to obtain the input image, an image processing unit (105) configured to generate a display image from the input image, and a display unit (106) configured to display the display image, and the image processing unit (105) obtains a focus control range in which a focus position is controllable, and generates the display image including information on the focus control range by using at least a part of the input image.

Abstract: The image processing apparatus is configured to perform image processing on an input image produced by image capturing through an optical system. The apparatus includes a first distribution producer configured to produce a first distribution by using data for approximating a point spread function that corresponds to a condition relating to the image capturing, a second distribution producer configured to produce a second distribution by mirroring a part of the first distribution, a filter producer configured to produce, by using the second distribution, a first filter to be used for a sharpening process, and a processor configured to perform the sharpening process on the input image by using the first filter to produce a sharpened image.

Abstract: An image pickup apparatus includes an image pickup element which obtains an original image, a storage unit which stores a first optical transfer function different depending on an image pickup condition and on a position in the original image and an image restoration filter or a function designed to generate a second optical transfer function, a data obtaining unit which obtains the first optical transfer function when the aperture value is less than a predetermined value, and the image restoration filter or the second optical transfer function generated based on the function designed to generate the second optical transfer function when the aperture value is not less than the predetermined value, a filter generating unit which generates an image restoration filter based on the first or second optical transfer function, and an image processing unit which generates the restored image by using the image restoration filter.

Abstract: An image pickup apparatus includes an image sensor, and a controller configured to drive a focus unit so that a first position is focused, to acquire first information on a first refocusable range that is available in an image that is captured while the first position is being focused by the focus unit, to acquire second information on a second refocusable range that contains the first position, to acquire information on a second position on which the focus unit is to be focused so as to provide the second refocusable range using the first information and the second information, and make the image sensor capture an image while the second position is being focused by the focus unit.

Abstract: The image processing apparatus performs an image process on a first image produced by image capturing. The apparatus includes: a memory storing coefficient data containing coefficients to be used in an approximation function to approximate a PSF of an image capturing optical system, and a processor performs the image process. The processor produces an approximated point spread function by using the coefficient of the coefficient data corresponding to an optical state of the optical system in the image capturing and two of a pixel pitch of an image sensor, a kernel size of a filter to be used for a sharpening process on the first image and number of taps of the filter; produce the filter by using the approximated PSF; and produce a second image that is a sharpened image by applying the filter to the first image.

Abstract: An image processing method is capable of performing a reconstruction for an input image so as to generate a plurality of output images having a plurality of focus positions different from each other, and the image processing method includes the steps of obtaining the input image that is an image containing information of an object space obtained from a plurality of points of view using an image pickup apparatus having an imaging optical system and an image pickup element including a plurality of pixels, and calculating a pixel shift amount of pixels that are to be combined by the reconstruction for a plurality of virtual imaging planes corresponding to the plurality of focus positions.

Abstract: An image generation method is provided for generating an output image from an input image acquired by an image sensor that has an array of multiple pixels, each of which has arranged therein multiple sub-pixels that each receive a light beam that passes through a different pupil sub-area of an imaging optical system. The method includes a step of generating multiple parallax images that respectively correspond to the different pupil sub-areas; a step of generating multiple pixel shifted images by performing different shifting for each of the parallax images according to a virtual image forming plane of the imaging optical system; and a step of generating an output image that has a higher resolution than the resolution of the parallax images from the pixel shifted images through composition processing.

Abstract: An image processor includes a correction signal generator configured to generate a correction signal by calculating a difference between an image and an image obtained by applying an unsharp mask generated based on a PSF corresponding to an image-pickup conditions of an image-pickup optical system to the image, and a correction signal applier configured to sharpen the image by multiplying the correction signal generated by the generator by a constant and by adding a multiplied correction signal to the image.

Abstract: An image processor includes a correction signal generator configured to generate a correction signal by calculating a difference between an image and an image obtained by applying an unsharp mask generated based on a PSF corresponding to an image-pickup conditions of an image-pickup optical system to the image, and a correction signal applier configured to sharpen the image by multiplying the correction signal generated by the generator by a constant and by adding a multiplied correction signal to the image.

Abstract: An image pickup apparatus includes an imaging optical system, an image pickup element including a plurality of pixels, a lens array configured such that rays from the same position on an object plane are incident on pixels of the image pickup element different from each other depending on a pupil region of the imaging optical system through which the ray passes, an image processing unit configured to perform image processing for the input image acquired by the image pickup element to generate the output images, and a control unit configured to drive the imaging optical system to perform focus control, the image processing unit is configured to acquire information on a refocus control range, and the control unit is configured to perform the focus control based on the information on the refocus control range.