Abstract: An image pickup apparatus (10) capable of generating a plurality of output images having different focus positions by reconstructing an input image, the image pickup apparatus includes an input image obtaining unit (100) configured to obtain the input image, an image processing unit (105) configured to generate a display image from the input image, and a display unit (106) configured to display the display image, and the image processing unit (105) obtains a focus control range in which a focus position is controllable, and generates the display image including information on the focus control range by using at least a part of the input image.

Abstract: To provide an image processing apparatus capable of obtaining a good-quality image even if an unexpected aberration occurs and an image pickup apparatus using the same. An image processing apparatus includes a primary restored image generating module configured to generate a primary restored image by performing image restoration processing on an input image having a plurality of color components, a restoration component generating module configured to generate difference information for each of the plurality of color components by calculating a difference between the input image and the primary restored image, and a secondary restored image generating module configured to generate a secondary restored image using the difference information. The secondary restored image generating module combines a color-combination restoration component based on the difference information for the plurality of color components with one color component of the input image.

Abstract: The image processing method of producing, based on information on positions and angles of light rays obtained from a first image, a second image, the first image being produced by using an image pickup apparatus that introduces the light rays from an image capturing optical system (101) to an image sensor (102) through an optical element array (101c). The method includes a step of acquiring the first image and information on an image capturing condition at a time of producing the first image, a step of acquiring an image restoration filter corresponding to the information on the image capturing condition and corresponding to respective optical transfer functions of the image capturing optical system and the optical element array, a step of performing an image restoration process on the first image by using the image restoration filter, and a step of producing the second image by using the restored first image.

Abstract: An image processing method is capable of performing a reconstruction for an input image so as to generate a plurality of output images having a plurality of focus positions different from each other, and the image processing method includes the steps of obtaining the input image that is an image containing information of an object space obtained from a plurality of points of view using an image pickup apparatus having an imaging optical system and an image pickup element including a plurality of pixels, and calculating a pixel shift amount of pixels that are to be combined by the reconstruction for a plurality of virtual imaging planes corresponding to the plurality of focus positions.

Abstract: An image processing method comprises obtaining a color input image obtained by taking an image using an optical system 101, calculating an amount of characteristics relating to a color of a pixel in the input image as a first calculating step (S4), performing an image restoration process for the input image using an image restoration filter selected or made based on aberration information of the optical system (S5), calculating an amount of characteristics relating to a color of a pixel of a restored image obtained by the image restoration process as a second calculating step (S6), and correcting a signal value of a specific pixel in the restored image in accordance with the amount of characteristics of the specific pixel in the restored image calculated by the second calculating step and the amount of characteristics of a specific pixel of the input image calculated by the first calculating step (S8).

Abstract: The image pickup apparatus includes an imaging optical system to cause light rays from an object plane to image on an image side conjugate plane with respect to the object plane, an image sensor including pixels and to photoelectrically convert the optical image, and an optical element array including optical element cells each of which conjugates the image side conjugate plane with the image sensor and which are arranged so as to cause light rays from a same point on the object plane to enter mutually different pixels depending on positions on a pupil plane of the imaging optical system through which the light rays pass. An arrangement pitch of the optical element cells in the optical element array is 25 times or less of an arrangement pitch of the pixels in the image sensor.

Abstract: To provide an image processing apparatus capable of obtaining a high-quality image, an image processing apparatus of the present invention includes an image restoration processing unit configured to perform a restoration process on an input image and generate a restored image, a difference information generating unit configured to calculate difference information between the restored image and the input image, an adjustment coefficient setting unit configured to be capable of setting a plurality of different adjustment coefficients for the input image, a correction difference information generating unit configured to generate correction difference information on the basis of the adjustment coefficients and the difference information, and a combining unit to combine the correction difference information with the input image and generate a restoration adjusted image.

Abstract: An image processing device capable of obtaining a high precision image while aberration asymmetry is corrected. An image processing device includes image obtaining means configured to obtain an input image, image restoration means configured to restore the input image using a generated or selected image restoration filter in accordance with a transfer function of an image pickup system used for forming the input image from an object image. The image restoration filter makes a difference between absolute values of transfer functions of two azimuthal directions at a time when the restoration image is obtained from an object smaller than a difference between absolute values of transfer functions of the two azimuthal directions of the image pickup system.

Abstract: An image pickup apparatus (301) includes an image pickup element (103), a lens unit (101) configured to collect a ray from an object (201) on an image-side conjugate plane (202), and a lens array (102) that includes a plurality of lens cells, and that is disposed so that the image-side conjugate plane (202) and the image pickup element (103) are conjugate to each other, and the lens array (102) is disposed so as to meet a predetermined conditional expression.

Abstract: The image processing method includes a step of acquiring an image generated by image pickup through an optical system, and a step of performing image restoration processing on the image using an image restoration filter created such that its filter values have a two-dimensional distribution based on aberration information of the optical system. The image restoration filter is a filter in which a position of a cell having a maximum absolute value among the filter values is shifted with respect to a position of a center cell of the image restoration filter by a shift amount according to one of an amount of distortion of the optical system and an amount of chromatic aberration of magnification of the optical system, and which reduces a blur component of the image and at least one of a component of distortion and a component of chromatic aberration of magnification of the image.

Abstract: An image pickup apparatus includes an imaging optical system, an image pickup element that includes a plurality of pixels, a lens array configured so that a ray from the same position on an object plane enters the pixels different from each other of the image pickup element in accordance with a pupil region of the imaging optical system through which the ray passes, and a controller configured to change an interval between the lens array and the image pickup element in accordance with a variation of a pupil of the imaging optical system.

Abstract: The image processing method acquires an input image and information on an image capturing condition, acquires an optical transfer function corresponding to the image capturing condition, calculates a specific frequency at which an index value obtained by using the optical transfer function becomes a predetermined value in each azimuth direction, and produces a window function to divide a frequency band of the input image into lower and higher frequency side bands than the specific frequency in each azimuth direction. Then, the method produces, by using the window function and the optical transfer function, an image restoration filter to perform the image restoration process on the lower frequency side band of the input image and to restrict the image restoration process on the higher frequency side band thereof, and performs the image restoration process using the image restoration filter.

Abstract: An image processing method includes the steps of obtaining an input image that is an image in which information of an object space is obtained from a plurality of points of view using an image pickup apparatus that includes an image pickup element having a plurality of pixels and an imaging optical system, calculating a first position of a virtual imaging plane that corresponds to a specified focus position, setting the virtual imaging plane to a second position that is in a range of a depth of focus of the imaging optical system with reference to the first position so that a maximum value of an apparent pixel pitch that is formed by reconstructing the input image is decreased, and generating an output image in a state where the virtual imaging plane is set to the second position.

Abstract: Provided is an image display apparatus, including: a light modulation element; an illumination optical system which includes at least one light source unit including a plurality of light emitting units two-dimensionally arranged and illuminates the light modulation element; and a projection optical system for enlarging and projecting an image of the light modulation element onto a projection surface, in which: an image of the plurality of light emitting units is imaged at a position corresponding to a stop of the projection optical system; the stop has an aperture shape of rotational asymmetry or of two-fold symmetry; and the plurality of light emitting units have illuminance intensities each independently controlled.

Abstract: An image processing apparatus that performs an image restoration processing of an image includes an optical transfer function obtaining portion configured to obtain an optical transfer function depending on an image pickup condition of the image, a threshold frequency obtaining portion configured to obtain a threshold frequency at which an absolute value of the optical transfer function is under a predetermined threshold value, a generating portion configured to generate an image restoration filter that has gain characteristics depending on the threshold frequency using the optical transfer function, and a processing portion configured to perform the image restoration processing of the image using the image restoration filter.

Abstract: An image processing method of performing an image restoration processing of an image, includes the steps of generating a plurality of first optical transfer functions depending on a position of the image using coefficient data depending on an image pickup condition of the image, generating a plurality of second optical transfer functions by rotating the first optical transfer functions around a center of the image or around an optical axis of an image pickup optical system, generating an image restoration filter based on the first optical transfer functions and the second optical transfer functions, and performing the image restoration processing of the image using the image restoration filter.

Abstract: The image processing method includes a filter preparation step of preparing an image restoration filter to be commonly used for plural optical apparatuses having mutually different optical characteristics, and a correction information preparation step of preparing correction information varying by the optical characteristic of each of the plural optical apparatuses. The method further includes a processing step of performing an image restoration process, on an input image produced by image capturing through a specific optical apparatus of the plural optical apparatuses, using the image restoration filter and the correction information for the specific optical apparatus.

Abstract: An image pickup apparatus (301) includes an image pickup element (103), a lens unit (101) configured to collect a ray from an object (201) on an image-side conjugate plane (202), and a lens array (102) that includes a plurality of lens cells, and that is disposed so that the image-side conjugate plane (202) and the image pickup element (103) are conjugate to each other, and the lens array (102) is disposed so as to meet a predetermined conditional expression.

Abstract: The image processing method includes a step of acquiring an input image produced by image capturing using an optical system, an image restoration step of performing an image restoration process on the input image to produce a restored image, the image restoration process using an image restoration filter produced based on an optical transfer function of the optical system, and a color shift detection step of detecting color shift included in the restored image, the color shift corresponding to chromatic aberration of magnification of the optical system. The method further includes a restored image color shift reduction step of performing a color shift reduction process on the restored image to reduce the color shift detected in the color shift detection step.

Abstract: To provide an image processing apparatus capable of obtaining a high-quality image. An image processing apparatus of the present invention includes an image restoration processing unit configured to perform a restoration process on an input image and generate a restored image, a difference information generating unit configured to calculate difference information between the restored image and the input image, an adjustment coefficient setting unit configured to be capable of setting a plurality of different adjustment coefficients for the input image, a correction difference information generating unit configured to generate correction difference information on the basis of the adjustment coefficients and the difference information, and a combining unit to combine the correction difference information with the input image and generate a restoration adjusted image.