Abstract: The image processing method processes an image generated by image pickup using an optical system (100). The method includes a step of acquiring the image, an image restoration step (S2-S7) of performing image restoration processing to reduce a blur component of the image using an image restoration filter, and a distortion correction step (S8) of performing geometric transformation processing to reduce a distortion component of the image on which the image restoration processing has been performed.

Abstract: An image processing method of performing an image restoration processing of an image, includes the steps of generating a plurality of first optical transfer functions depending on a position of the image using coefficient data depending on an image pickup condition of the image, generating a plurality of second optical transfer functions by rotating the first optical transfer functions around a center of the image or around an optical axis of an image pickup optical system, generating an image restoration filter based on the first optical transfer functions and the second optical transfer functions, and performing the image restoration processing of the image using the image restoration filter.

Abstract: An image processing apparatus (100) includes a detection unit (102) configured to detect a first region in which one of a signal level of a color plane corresponding to at least one color filter of an image acquired from an image pickup element including a plurality of color filters and a signal level of a brightness plane generated from the image monotonically increases or monotonically decreases in a first direction in a predetermined section, a determination unit (103) configured to determine a second region in which color bleeding occurs, based on optical information on the color bleeding of an image pickup optical system and information on the first region, and a correction unit (104) configured to correct the image so as to reduce the color bleeding.

Abstract: An image processor includes a correction signal generator configured to generate a correction signal by calculating a difference between an image and an image obtained by applying an unsharp mask generated based on a PSF corresponding to an image-pickup conditions of an image-pickup optical system to the image, and a correction signal applier configured to sharpen the image by multiplying the correction signal generated by the generator by a constant and by adding a multiplied correction signal to the image.

Abstract: An image pickup apparatus includes an imaging optical system, an image pickup element including a plurality of pixels, a lens array configured such that rays from the same position on an object plane are incident on pixels of the image pickup element different from each other depending on a pupil region of the imaging optical system through which the ray passes, an image processing unit configured to perform image processing for the input image acquired by the image pickup element to generate the output images, and a control unit configured to drive the imaging optical system to perform focus control, the image processing unit is configured to acquire information on a refocus control range, and the control unit is configured to perform the focus control based on the information on the refocus control range.

Abstract: An image is obtained with reduced chromatic aberration as well as improved sharpness. An image processing apparatus includes image acquiring means configured to acquire an input image, and image restoration processing means configured to generate a restored image by calculating the input image and an image restoration filter that is based on a transfer function of an image pickup system that is used to form an object image as the input image, wherein the image restoration filter performs restoration so that when an object is a white point light source, a difference between spectra of two color components in the restored image is made smaller than a difference between spectra of the two color components in the input image.

Abstract: The image processing method acquires an input image and information on an image capturing condition, acquires an optical transfer function corresponding to the image capturing condition, calculates a specific frequency at which an index value obtained by using the optical transfer function becomes a predetermined value in each azimuth direction, and produces a window function to divide a frequency band of the input image into lower and higher frequency side bands than the specific frequency in each azimuth direction. Then, the method produces, by using the window function and the optical transfer function, an image restoration filter to perform the image restoration process on the lower frequency side band of the input image and to restrict the image restoration process on the higher frequency side band thereof, and performs the image restoration process using the image restoration filter.

Abstract: An image generation method is provided for generating an output image from an input image acquired by an image sensor that has an array of multiple pixels, each of which has arranged therein multiple sub-pixels that each receive a light beam that passes through a different pupil sub-area of an imaging optical system. The method includes a step of generating multiple parallax images that respectively correspond to the different pupil sub-areas; a step of generating multiple pixel shifted images by performing different shifting for each of the parallax images according to a virtual image forming plane of the imaging optical system; and a step of generating an output image that has a higher resolution than the resolution of the parallax images from the pixel shifted images through composition processing.

Abstract: The image processing method includes a filter preparation step of preparing an image restoration filter to be commonly used for plural optical apparatuses having mutually different optical characteristics, and a correction information preparation step of preparing correction information varying by the optical characteristic of each of the plural optical apparatuses. The method further includes a processing step of performing an image restoration process, on an input image produced by image capturing through a specific optical apparatus of the plural optical apparatuses, using the image restoration filter and the correction information for the specific optical apparatus.

Abstract: An image pickup apparatus includes an imaging optical system, an image pickup element that includes a plurality of pixels, a lens array configured so that a ray from the same position on an object plane enters the pixels different from each other of the image pickup element in accordance with a pupil region of the imaging optical system through which the ray passes, and a controller configured to change an interval between the lens array and the image pickup element in accordance with a variation of a pupil of the imaging optical system.

Abstract: The image processing method includes a step of acquiring an input image produced by image capturing using an optical system, an image restoration step of performing an image restoration process on the input image to produce a restored image, the image restoration process using an image restoration filter produced based on an optical transfer function of the optical system, and a color shift detection step of detecting color shift included in the restored image, the color shift corresponding to chromatic aberration of magnification of the optical system. The method further includes a restored image color shift reduction step of performing a color shift reduction process on the restored image to reduce the color shift detected in the color shift detection step.

Abstract: An image processing apparatus generates an output image using an input image including object space information, the image processing apparatus includes a region dividing unit configured to divide the input image into a first region and a second region, and a reconstructed image generating unit configured to reconstruct the input image to generate the output image, and the reconstructed image generating unit applies different shooting conditions from each other to the first region and the second region respectively.

Abstract: An image processing method includes the steps of obtaining an image generated by an image pickup system, and performing correction processing for the image by utilizing an image restoration filter generated or selected based on an optical transfer function of the image pickup system. The image restoration filter is a filter configured to reduce a phase degradation component of the image.

Abstract: An image processing apparatus that performs an image restoration processing of an image includes an optical transfer function obtaining portion configured to obtain an optical transfer function depending on an image pickup condition of the image, a threshold frequency obtaining portion configured to obtain a threshold frequency at which an absolute value of the optical transfer function is under a predetermined threshold value, a generating portion configured to generate an image restoration filter that has gain characteristics depending on the threshold frequency using the optical transfer function, and a processing portion configured to perform the image restoration processing of the image using the image restoration filter.

Abstract: The image processing apparatus includes an image obtaining part configured to obtain a first image and a second image. The first image is an image generated by image capturing or generated by expanding part of the captured image and includes a first object image. The second image corresponds to an image captured at a higher image capturing magnification than that for the first image and includes a second object image corresponding to part of the first object image. The apparatus includes a processing part configured to produce a third image whose resolution is higher than that of the first image by performing image processing on the first image using the second image as a constraint condition.

Abstract: The image processing apparatus includes a memory configured to store information on a specific image pickup condition under which a specific blur component is generated in an input image produced by image capturing using an optical system, the specific blur component being caused by the optical system; an image pickup condition acquirer configured to acquire information on an actual image pickup condition when capturing the input image; and a processor configured to perform, when the actual image pickup condition coincides with the specific image pickup condition, a blur detection process to detect the specific blur component included in the input image.

Abstract: An image processing method includes the steps of obtaining an input image that is an image in which information of an object space is obtained from a plurality of points of view using an image pickup apparatus that includes an image pickup element having a plurality of pixels and an imaging optical system, calculating a first position of a virtual imaging plane that corresponds to a specified focus position, setting the virtual imaging plane to a second position that is in a range of a depth of focus of the imaging optical system with reference to the first position so that a maximum value of an apparent pixel pitch that is formed by reconstructing the input image is decreased, and generating an output image in a state where the virtual imaging plane is set to the second position.

Abstract: An image processing method includes the steps of generating a first image through restoration processing of an amplitude component and a phase component of an input image, generating a second image that has an equal state of the phase component to that of the first image and a different state of the amplitude component from that of the first image through restoration processing of the phase component without restoration processing of the amplitude component of the input image, obtaining difference information between the first image and the second image, setting a restoration level adjustment factor used to adjust a restoration degree in the restoration processing, and generating a restoration adjusted image by composing the difference information with the second image according to the restoration level adjustment factor.

Abstract: An image processing apparatus obtains a plurality of pre-restoration images of an object for chromatic components when these images are taken at a first in-focus position to a third in-focus position corresponding to the RGB chromatic components, obtains an image pickup state and an image restoration filter corresponding to the image pickup state for each chromatic component, restores the pre-restoration image at an in-focus position for each chromatic component utilizing the obtained image restoration filter, and synthesizes the restored images.

Abstract: It is an object to provide an image processing device capable of obtaining a high precise image while aberration asymmetry is corrected. An image processing device according to the present invention includes image obtaining means configured to obtain an input image, image restoration means configured to restore the input image using a generated or selected image restoration filter in accordance with a transfer function of an image pickup system used for forming the input image from an object image. The image restoration filter makes a difference between absolute values of transfer functions of two azimuthal directions at a time when the restoration image is obtained from an object smaller than a difference between absolute values of transfer functions of the two azimuthal directions of the image pickup system.