Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, suppressing the occurrence of artifact and color gradation and achieving reduction in computational costs. The image processing device includes a frequency recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to frequency recovery processing using a frequency recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the frequency recovery processing to nonlinear gradation correction, and a phase recovery processing unit which subjects image data subjected to the gradation correction to phase recovery processing using a phase recovery filter based on the point spread function of the optical system.

Abstract: A restoration filter generation device that generates a restoration filter for a restoration process on the basis of a point spread in an optical system, the restoration process being performed on luminance system image data as image data concerning a luminance which is generated on the basis of image data for each color of plural colors acquired by an image pickup device having the optical system, the restoration filter generation device includes a first transfer function acquisition device, a correction information acquisition device, a second transfer function acquisition device, a third transfer function calculation device, and a restoration filter generation device that generates the restoration filter for the restoration process on the basis of the third transfer function calculated by the third transfer function calculation device.

Abstract: The image processing device includes a gradation correction unit (gamma correction processing unit 33) which performs gradation correction, a restoration processing unit, a sharpening processing unit, a sharpening and recovery control unit 37 which is able to adjust a restoration rate of restoration processing and a sharpening rate of sharpening processing by controlling the restoration processing unit and the sharpening processing unit, a sharpening and recovery control unit 37 which acquires a total sharpening and restoration rate based on the restoration rate and the sharpening rate and one rate of the restoration rate and the sharpening rate and calculates the other rate of the restoration rate and the sharpening rate based on the total sharpening and restoration rate, and a brightness information acquisition unit. The sharpening and recovery control unit adjusts the restoration rate and the sharpening rate according to acquired brightness information.

Abstract: A restoration process using a restoration filter that is based on a point spread function for an optical system is performed for original image data acquired from an image-capturing element by an image taking of an object image using the optical system, so that recovery image data are acquired. The above restoration process is performed, in a point-image restoration processing section, for color data of the original image data in which a gradation correction has been performed by a logarithmic process. The restoration filter may be configured by a filter coefficient corresponding to the image data before the logarithmic process, or may be configured by a filter coefficient corresponding to the image data after the logarithmic process. Thus, by performing the restoration process capable of flexibly responding to various properties of the original image, it is possible to reduce the image degradation such as the ringing in the recovery image.

Abstract: An image processing device includes a demosaicing process device, a luminance system image data acquisition device that acquires luminance system image data as image data regarding the luminance, a point image restoration process execution device, an information acquisition device that acquires control information concerning execution of the point image restoration process on the basis of imaging information concerning an imaging condition of a subject, and a point image restoration process control device.

Abstract: A first restoration processing section 110 and a second restoration processing section 120 perform restoration processing on images (luminance data Y), which are successively captured by an image capture section, using a first filter 102, which is a restoration filter generated corresponding to a point spread function of an optical system, and a second filter 104 of which a restoration strength is weaker than that of the first filter 102. Depending on a result of determination which is input from an in-focus determination section 150 and indicates whether or not the image at the current time point is in a target in-focus state, a selection section 122 selects and outputs either luminance data YA which is processed using the first filter 102 or luminance data YB which is processed using the second filter 104.

Abstract: According to an aspect of the present invention, for which of the original image data before the gradation correction and the original image data after the gradation correction the restoration process is performed is determined depending on whether or not the image information meets the condition under which the ringing appears in the recovery image data due to the restoration process. When the gradation correction is performed after the restoration process, there is a probability that the side effect (the ringing or the like) of the restoration process is emphasized by the gradation correction. Therefore, in the case where the image information meets the condition under which the ringing appears, it is possible to prevent such a side effect (the ringing or the like) of the restoration process from being emphasized by the gradation correction, by performing the restoration process for the original image data after the gradation correction.

Abstract: A restoration filter based on a point spread function of an optical system is applied to source image data acquired through photographing using the optical system to acquire restored image data (S13: filter application step). Adjustment of an amplification factor of the difference between source image data and restored image data is performed, and recovered image data is acquired from the difference after adjustment and source image data (S15: gain adjustment step). In the filter application step, a common filter determined regardless of a value of a magnification of an optical zoom of the optical system is used as the restoration filter, and in the gain adjustment step, the amplification factor is determined based on the magnification of the optical zoom of the optical system.

Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and a program capable of acquiring a moving image with excellent image quality while maintaining continuity of a restoration process between frames even if there is a rapid change of a photographing environment in a moving image. An image processing device includes a restoration control processing unit 36 which subjects a moving image including a plurality of frames acquired by photographing using an optical system to a restoration process based on a point spread function of the optical system to acquire recovered image data. The restoration control processing unit 36 controls the restoration process for a frame to be processed among a plurality of frames based on imaging information of a reference frame including a frame after the frame to be processed in a time series.

Abstract: An imaging device 10 according to one aspect of the present invention includes: a subject distance acquisition section 115; a movement amount acquisition section 120 that acquires an amount of movement of the subject on the basis of the subject distance; a restoration processing determination section 125 that determines, on the basis of the amount of movement acquired by the movement amount acquisition section 120, whether the restoration processing should be performed on the images through a restoration filter, a restoration strength of the restoration processing should be adjusted and the restoration processing should be performed on the images, or the restoration processing should not be performed on the images; and a restoration processing execution section 105 that performs the restoration processing on the images through the restoration filter or with the adjusted restoration strength, on the basis of the determination of the restoration processing determination section 125.

Abstract: Source image data is subjected to a logarithmic process (gamma correction process) (S11), and the luminance distribution of source image data is acquired (S12). Then, it is determined whether or not the luminance distribution of source image data corresponds to “a high luminance scene (highlight scene) biased toward a high luminance side” based on a characteristic of a luminance value equal to or greater than a first threshold value in the luminance distribution of source image data (S13). According to the determination result (Y/N of S13), a restoration process based on a point spread function of an optical system is controlled (S14, S15). A restoration filter which is used in the restoration process has a filter coefficient corresponding to image data before the logarithmic process.

Abstract: An imaging device 10 according to an aspect of the present invention includes: an image generation section 100 that generates a moving image; a filter acquisition section 105 that acquires a restoration filter corresponding to a transfer function for the point distribution of an optical system; an aperture value detection section 110 that detects an aperture value of the optical system; a restoration processing determination section 115 that determines whether or not the aperture value detected by the aperture value detection section 110 is equal to or greater than a small-aperture-blurring reference aperture value; and a restoration processing execution section 120 that executes the restoration processing on the moving image through the restoration filter, in case where the restoration processing determination section 115 determines that the aperture value detected by the aperture value detection section 110 is equal to or greater than the small-aperture-blurring reference aperture value.

Abstract: Disclosed is a technique capable of efficiently storing and retaining characteristic data (a restoration filter or the like) of an optical system used for a restoration process in a storage unit with limited storage capacity in consideration of the degree of image restoration. An image processing device includes a characteristic data storage unit 42 which is capable of storing characteristic data of a plurality of types of optical systems, and a restoration processing unit which subjects source image data to a restoration process using a restoration filter based on a point spread function of an optical system to acquire recovered image data. In case where storing new characteristic data in the characteristic data storage unit, characteristic data which is stored in the characteristic data storage unit 42 is controlled based on a restoration evaluation value which is allocated to characteristic data according to the type of optical system.

Abstract: An image processing device includes a point-image restoration processing unit 40 which receives a photographic image as input, and subjects the photographic image to a point-image restoration process based on point-image restoration information to generate a restored image, an area information output unit 45 which outputs area information relating to a specific area in the restored image where restoration strength of the point-image restoration process based on the point-image restoration information is equal to or greater than a threshold value, a display control unit 50 which receives the restored image and the area information as input and performs display control to highlight the specific area in the restored image based on the area information, and a display unit 55 which highlights at least the specific area based on the display control by the display control unit 50.

Abstract: An image capturing device 100 includes: an image pickup unit 248; a chart storage unit 240; a chart transmission control unit 242; a calibration necessity determination unit 244 that determines whether or not calibration of the parameters of the point image restoration processing is required based on a calibration image that is obtained by imaging a calibration chart displayed on an external display device using the image pickup unit 248; a calibration control unit 246 that controls the execution of the calibration according to the determination regarding whether or not the calibration is required that has been performed by the calibration necessity determination unit 244; and a calibration execution unit 247.

Abstract: A restoration filter generation device that generates a restoration filter for a restoration process on the basis of a point spread in an optical system, the restoration process being performed on luminance system image data as image data concerning a luminance which is generated on the basis of image data for each color of plural colors acquired by an image pickup device having the optical system, the restoration filter generation device includes a first transfer function acquisition device, a correction information acquisition device, a second transfer function acquisition device, a third transfer function calculation device, and a restoration filter generation device that generates the restoration filter for the restoration process on the basis of the third transfer function calculated by the third transfer function calculation device.

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

Abstract: A restoration filter generation device according to one embodiment of the present invention includes: an information acquisition unit that acquires information showing a difference that depends on a color of an optical transfer function of an optical system; and a restoration filter generation unit that generates a restoration filter, which weakens restoration strength according to the difference that depends on the color of the optical transfer function on the basis of the information acquired by the information acquisition unit, and makes the restoration strength of the restoration filter weaker than the restoration strength of an ideal filter decided assuming that the difference that depends on the color of the optical transfer function does not exist. As a result, the overcorrection is reduced.

Abstract: An image within a search area of an image of interest is rotated from 0 to 345° in increments of 15°. An evaluation value of facial likeliness of an image after rotation thereof by each angular increment is calculated. A correction angle is calculated based upon a rotation angle (rotational manipulated variable ?) that affords the maximum evaluation value calculated. The image of interest is displayed upon being rotated based upon the correction angle calculated. Thus, the image of interest is displayed in an orientation suitable for appreciation.

Abstract: A restoration filter generation device that generates a restoration filter to perform restoration processing on luminance system image data that is image data related to luminance, which is generated based on image data of respective colors of multiple colors obtained by an imaging device having an optical system, includes an information acquisition device acquiring transfer function information corresponding to point image distribution in the optical system, for each color of the multiple colors, and a restoration filter generation device generating the restoration filter based on the transfer function information acquired by the information acquisition device and generating the restoration filter that performs phase correction of the luminance system image data according to the transfer function information on a single color of the multiple colors.