Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, suppressing the occurrence of artifact and color gradation and achieving reduction in computational costs. The image processing device includes a frequency recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to frequency recovery processing using a frequency recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the frequency recovery processing to nonlinear gradation correction, and a phase recovery processing unit which subjects image data subjected to the gradation correction to phase recovery processing using a phase recovery filter based on the point spread function of the optical system.

Abstract: An imaging device 10 according to one aspect of the present invention includes: a subject distance acquisition section 115; a movement amount acquisition section 120 that acquires an amount of movement of the subject on the basis of the subject distance; a restoration processing determination section 125 that determines, on the basis of the amount of movement acquired by the movement amount acquisition section 120, whether the restoration processing should be performed on the images through a restoration filter, a restoration strength of the restoration processing should be adjusted and the restoration processing should be performed on the images, or the restoration processing should not be performed on the images; and a restoration processing execution section 105 that performs the restoration processing on the images through the restoration filter or with the adjusted restoration strength, on the basis of the determination of the restoration processing determination section 125.

Abstract: The image display apparatus according to an aspect of the present invention comprises: an image input device which inputs an image signal; a particular target detection device which detects a particular target included in the image signal based on a particular target evaluation value indicating the feature of the particular target; a frame display information generation device which generates frame display information indicating a frame surrounding the detected particular target and which causes the frame to change continuously or by stages according to the particular target evaluation value; and a display device which displays the frame based on the generated frame display information. That is, by causing the frame to change continuously or by stages according to the evaluation value of a particular target, it is possible to avoid sudden change in the frame display.

Abstract: A restoration filter generation device that generates a restoration filter to perform restoration processing on luminance system image data that is image data related to luminance, which is generated based on image data of respective colors of multiple colors obtained by an imaging device having an optical system, includes an information acquisition device acquiring transfer function information corresponding to point image distribution in the optical system, for each color of the multiple colors, and a restoration filter generation device generating the restoration filter based on the transfer function information acquired by the information acquisition device and generating the restoration filter that performs phase correction of the luminance system image data according to the transfer function information on a single color of the multiple colors.

Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and a program capable of acquiring a moving image with excellent image quality while maintaining continuity of a restoration process between frames even if there is a rapid change of a photographing environment in a moving image. An image processing device includes a restoration control processing unit 36 which subjects a moving image including a plurality of frames acquired by photographing using an optical system to a restoration process based on a point spread function of the optical system to acquire recovered image data. The restoration control processing unit 36 controls the restoration process for a frame to be processed among a plurality of frames based on imaging information of a reference frame including a frame after the frame to be processed in a time series.

Abstract: A first restoration processing section 110 and a second restoration processing section 120 perform restoration processing on images (luminance data Y), which are successively captured by an image capture section, using a first filter 102, which is a restoration filter generated corresponding to a point spread function of an optical system, and a second filter 104 of which a restoration strength is weaker than that of the first filter 102. Depending on a result of determination which is input from an in-focus determination section 150 and indicates whether or not the image at the current time point is in a target in-focus state, a selection section 122 selects and outputs either luminance data YA which is processed using the first filter 102 or luminance data YB which is processed using the second filter 104.

Abstract: An imaging device 10 according to one aspect of the present invention includes: a subject distance acquisition section 115; a movement amount acquisition section 120 that acquires an amount of movement of the subject on the basis of the subject distance; a restoration processing determination section 125 that determines, on the basis of the amount of movement acquired by the movement amount acquisition section 120, whether the restoration processing should be performed on the images through a restoration filter, a restoration strength of the restoration processing should be adjusted and the restoration processing should be performed on the images, or the restoration processing should not be performed on the images; and a restoration processing execution section 105 that performs the restoration processing on the images through the restoration filter or with the adjusted restoration strength, on the basis of the determination of the restoration processing determination section 125.

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

Abstract: The image display apparatus according to an aspect of the present invention comprises: an image input device which inputs an image signal; a particular target detection device which detects a particular target included in the image signal based on a particular target evaluation value indicating the feature of the particular target; a frame display information generation device which generates frame display information indicating a frame surrounding the detected particular target and which causes the frame to change continuously or by stages according to the particular target evaluation value; and a display device which displays the frame based on the generated frame display information. That is, by causing the frame to change continuously or by stages according to the evaluation value of a particular target, it is possible to avoid sudden change in the frame display.

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

Abstract: Source image data is subjected to a logarithmic process (gamma correction process) (S11), and the luminance distribution of source image data is acquired (S12). Then, it is determined whether or not the luminance distribution of source image data corresponds to “a high luminance scene (highlight scene) biased toward a high luminance side” based on a characteristic of a luminance value equal to or greater than a first threshold value in the luminance distribution of source image data (S13). According to the determination result (Y/N of S13), a restoration process based on a point spread function of an optical system is controlled (S14, S15). A restoration filter which is used in the restoration process has a filter coefficient corresponding to image data before the logarithmic process.

Abstract: An imaging device 10 according to an aspect of the present invention includes: an image generation section 100 that generates a moving image; a filter acquisition section 105 that acquires a restoration filter corresponding to a transfer function for the point distribution of an optical system; an aperture value detection section 110 that detects an aperture value of the optical system; a restoration processing determination section 115 that determines whether or not the aperture value detected by the aperture value detection section 110 is equal to or greater than a small-aperture-blurring reference aperture value; and a restoration processing execution section 120 that executes the restoration processing on the moving image through the restoration filter, in case where the restoration processing determination section 115 determines that the aperture value detected by the aperture value detection section 110 is equal to or greater than the small-aperture-blurring reference aperture value.

Abstract: An image processing device according to an embodiment of the present invention obtains recovery image data by performing restoration processing using a restoration filter based on a point spread function of an optical system, on original image data obtained from an imaging element by imaging using the optical system. The restoration filter used in this restoration processing (a combination filter and realization filter Fr) is generated by combining multiple base filters Fb. Base filter Fb may be arbitrarily selected from filters that are confirmed beforehand to be effective to prevent image quality degradation.

Abstract: An image processing unit 36 includes an information acquisition unit 40, a filter acquisition unit 42, and a filter processing unit 44. The information acquisition unit 40 acquires imaging information of original image data which is acquired by capturing an object image using an optical system. In a case in which the imaging information includes the first imaging condition and does not include the second imaging condition, the filter acquisition unit 42 acquires a sharpening filter which is associated with the first imaging condition and is associated with a representative condition of the second imaging condition. The filter processing unit 44 applies the sharpening filter acquired by the filter acquisition unit 42 to the original image data to acquire sharp image data.

Abstract: An image processing unit 36 includes a frequency analysis unit 40, an optical characteristic acquisition unit 42, and a filter acquisition unit 44. The frequency analysis unit 40 acquires data in the frequency domain of each of first image data and second image data which are acquired by capturing an object image using a first optical system and a second optical system, respectively. The optical characteristic acquisition unit 42 compares the data in the frequency domain of the first image data with the data in the frequency domain of the second image data to acquire frequency characteristic data related to optical characteristics of the second optical system. The filter acquisition unit 44 acquires a sharpening filter associated with the second optical system from a plurality of sharpening filters associated with the first optical system.

Abstract: An image processing unit 36 includes a frequency analysis unit 40, an optical characteristic acquisition unit 42, and a filter acquisition unit 44. The frequency analysis unit 40 acquires data in the frequency domain of each of first image data and second image data which are acquired by capturing an object image using a first optical system and a second optical system, respectively. The optical characteristic acquisition unit 42 compares the data in the frequency domain of the first image data with the data in the frequency domain of the second image data to acquire frequency characteristic data related to optical characteristics of the second optical system. The filter acquisition unit 44 acquires a sharpening filter associated with the second optical system from a plurality of sharpening filters associated with the first optical system.

Abstract: An image capturing device 100 includes: an image pickup unit 248; a chart storage unit 240; a chart transmission control unit 242; a calibration necessity determination unit 244 that determines whether or not calibration of the parameters of the point image restoration processing is required based on a calibration image that is obtained by imaging a calibration chart displayed on an external display device using the image pickup unit 248; a calibration control unit 246 that controls the execution of the calibration according to the determination regarding whether or not the calibration is required that has been performed by the calibration necessity determination unit 244; and a calibration execution unit 247.

Abstract: An image processing unit 36 includes an information acquisition unit 40, a filter acquisition unit 42, and a filter processing unit 44. The information acquisition unit 40 acquires imaging information of original image data which is acquired by capturing an object image using an optical system. In a case in which the imaging information includes the first imaging condition and does not include the second imaging condition, the filter acquisition unit 42 acquires a sharpening filter which is associated with the first imaging condition and is associated with a representative condition of the second imaging condition. The filter processing unit 44 applies the sharpening filter acquired by the filter acquisition unit 42 to the original image data to acquire sharp image data.