Patents by Inventor Kenkichi Hayashi

Kenkichi Hayashi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190347773
    Abstract: An image processing device includes a transfer function input unit to which each of transfer functions of a plurality of imaging systems is input, a calculation unit that calculates a target resolution value which is a target value of recovery processing that recovers a plurality of captured images to be output from each of the plurality of the imaging systems based on the input transfer functions and a predetermined criterion, a recovery-filter generation unit that generates a recovery-filter used for the recovery processing with respect to each of the plurality of imaging systems based on the transfer functions of the plurality of imaging systems and a target resolution value, and a recovered image generation unit that performs the recovery processing with respect to the captured images acquired from the plurality of imaging systems by using the recovery-filter generated for each of the plurality of imaging systems to generate recovered images.
    Type: Application
    Filed: July 23, 2019
    Publication date: November 14, 2019
    Applicant: FUJIFILM Corporation
    Inventors: Yosuke NARUSE, Yasunobu KISHINE, Kenkichi HAYASHI, Yoshiaki ISHII
  • Publication number: 20190340788
    Abstract: An image processing device includes a transfer function input unit to which each of transfer functions of a plurality of imaging-systems is input, a calculation unit that calculates a target resolution value which is a target value of recovery processing that recovers a plurality of captured images to be output from each of the plurality of the imaging-systems based on each of the input transfer functions and a predetermined criterion, a recovery filter generation unit that generates a recovery filter used for the recovery processing with respect to each of the plurality of imaging-systems based on each of the transfer functions of the plurality of imaging-systems and a target resolution value, and a recovered image generation unit that performs the recovery processing with respect to the captured images acquired from the plurality of imaging-systems by using the recovery filter generated for each of the plurality of imaging-systems to generate recovered images.
    Type: Application
    Filed: July 22, 2019
    Publication date: November 7, 2019
    Applicant: FUJIFILM Corporation
    Inventors: Yosuke NARUSE, Yasunobu KISHINE, Kenkichi HAYASHI, Yoshiaki ISHII
  • Publication number: 20190295215
    Abstract: Provided are an image processing device, an image processing method, and a non-transitory computer readable recording medium storing a program which generate a favorable-quality combination image of which distortion is partially corrected with no calculation cost. A plurality of images captured by a plurality of cameras is input, and scaling processing is performed on at least one image of two images to be combined with each other among the plurality of images in a direction perpendicular to a direction in which the two images are combined. A continuous combination image is generated by combining the plurality of images after the scaling processing. The scaling processing is performed on at least the one image of the two images according to a predetermined scaling ratio, and a misalignment on an image of a combined portion of the two images to be combined with each other in the perpendicular direction is suppressed.
    Type: Application
    Filed: June 14, 2019
    Publication date: September 26, 2019
    Applicant: FUJIFILM Corporation
    Inventors: Yasunobu KISHINE, Yoshiaki ISHII, Kenkichi HAYASHI, Yosuke NARUSE
  • Patent number: 10395347
    Abstract: In a case where IR data of a near-infrared light image is data in which a visible light component and a near-infrared light component coexist, a point image restoration process is performed on the IR data using a first point image restoration filter based on a first point spread function for visible light of the optical system and a second point image restoration filter based on a second point spread function for near-infrared light of the optical system. An appropriate point image restoration process is performed on the IR data that is captured in a time zone of twilight or dawn by performing weighted averaging on a point image restoration process using the first point image restoration filter and a point image restoration process using the second point image restoration filter using a first gain ? and a second gain ? according to a light amount ratio between visible light and near-infrared light at the time of capturing the IR data.
    Type: Grant
    Filed: October 20, 2017
    Date of Patent: August 27, 2019
    Assignee: FUJIFILM Corporation
    Inventors: Junichi Tanaka, Kenkichi Hayashi, Yousuke Naruse
  • Patent number: 10339638
    Abstract: An image processing device and an image processing method capable of satisfactorily performing a point image restoration process of a visible light image and a point image restoration process of a near-infrared light image are provided. A point image restoration process is performed on luminance data Y indicating a visible light image and IR data indicating a near-infrared light image using a first point image restoration filter based on a first point spread function with respect to visible light of an optical system and a second point image restoration filter based on a second point spread function with respect to near-infrared light of the optical system. An appropriate point image restoration process is performed on the IR data so that restoration strength (second gain ?) in the point image restoration process for the IR data captured with radiation of near-infrared light is higher than restoration strength (first gain ?) in the point image restoration process for the luminance data Y.
    Type: Grant
    Filed: October 20, 2017
    Date of Patent: July 2, 2019
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Junichi Tanaka, Yousuke Naruse, Masahiko Sugimoto, Kousuke Irie
  • Patent number: 10326947
    Abstract: The present invention provides an image processing device, an imaging device, an image processing method, and a program which are capable of accurately correcting blurring caused in first image data of an image using a near-infrared ray as a light source and, accurately performing a point image restoration process on second image data of an image using visible light and a near-infrared ray as a light source.
    Type: Grant
    Filed: October 20, 2017
    Date of Patent: June 18, 2019
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Junichi Tanaka, Yousuke Naruse, Masahiko Sugimoto
  • Publication number: 20190180426
    Abstract: Provided are an image processing device, an image processing system, an image processing method, and an imaging optical system group capable of suppressing an increase in costs and appropriately restoring an image. In the imaging optical system, in a case where a first MTF curve M1 indicating an MTF value in a first azimuth direction with respect to an amount of defocus from a focal position is compared with a second MTF curve M2 indicating an MTF value in a second azimuth direction with respect to the amount of defocus from the focal position, a ratio of a peak value P1 of the first MTF curve M1 to a peak value P2 of the second MTF curve M2 is equal to or greater than 2, and a ratio of a half-value width HW2 of the second MTF curve M2 to a half-value width HW1 of the first MTF curve M1 is equal to or greater than 1.25. The restoration filter is a common filter corresponding to a representative value of transfer functions in a plurality of same type imaging optical systems.
    Type: Application
    Filed: February 21, 2019
    Publication date: June 13, 2019
    Applicant: FUJIFILM Corporation
    Inventors: Takashi KUNUGISE, Yousuke NARUSE, Kenkichi HAYASHI
  • Publication number: 20190014244
    Abstract: An image processing device, an image processing system, and an image processing method capable of easily correcting image deterioration caused by nonuniform optical characteristics around an optical axis of a lens according to a position in a rotational direction of a lens barrel are provided.
    Type: Application
    Filed: September 13, 2018
    Publication date: January 10, 2019
    Applicant: FUJIFILM Corporation
    Inventors: Yousuke NARUSE, Takashi KUNUGISE, Kenkichi HAYASHI
  • Patent number: 10171803
    Abstract: An image capturing apparatus according to an aspect of the present invention includes an image capturing unit, a display unit that displays an imaged picture imaged by the image capturing unit and a guide linearly shaped along a sagittal direction or a tangential direction in the imaged picture, the guide assisting imaging of a calibration image used for calibration in a point image restoration process, and a parameter calculation unit that calculates a parameter for the point image restoration process on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.
    Type: Grant
    Filed: August 27, 2015
    Date of Patent: January 1, 2019
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Masahiko Sugimoto, Yousuke Naruse
  • Publication number: 20180365812
    Abstract: Provided are an image processing device, an imaging device, and an image processing method which are capable of obtaining a captured image with desired image quality. An image processing unit functioning as an image processing device includes a point image restoration processing unit that performs point image restoration processing using a restoration filter based on a point spread function of a lens unit on image data obtained from an imaging element through imaging of a subject using an imaging unit having the lens unit including a lens and the imaging element, and a determination unit that determines to perform the point image restoration processing using the point image restoration processing unit in a case where a modulation transfer function in a predetermined spatial frequency in which the point image restoration processing contributes is smaller than a threshold value. Here, the modulation transfer function is changed by an imaging condition.
    Type: Application
    Filed: August 23, 2018
    Publication date: December 20, 2018
    Applicant: FUJIFILM Corporation
    Inventors: Kenkichi HAYASHI, Yousuke NARUSE, Yasunobu KISHINE
  • Publication number: 20180365811
    Abstract: Provided are an image processing device, an imaging device, and an image processing method which are capable of obtaining a captured image with desired image quality. An image processing unit functioning as an image processing device includes a point image restoration processing unit that performs point image restoration processing using a restoration filter based on a point spread function of a lens unit on image data obtained from an imaging element through imaging of a subject using an imaging unit having a lens unit including a lens and the imaging element, and a determination unit that determines whether or not to perform the point image restoration processing using the point image restoration processing unit based on spherical aberration of the lens changed by an imaging condition. The point image restoration processing unit performs the point image restoration processing only in a case where the determination unit determines to perform the point image restoration processing.
    Type: Application
    Filed: August 23, 2018
    Publication date: December 20, 2018
    Applicant: FUJIFILM Corporation
    Inventors: Kenkichi HAYASHI, Yousuke NARUSE, Yasunobu KISHINE
  • Patent number: 10083500
    Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.
    Type: Grant
    Filed: June 26, 2017
    Date of Patent: September 25, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi, Masahiko Sugimoto
  • Patent number: 10049438
    Abstract: Further, there are provided a filter acquisition apparatus, a filter acquisition method, a program, and a recording medium, capable of acquiring a filter which is suitably usable in such a filtering process. An image processing apparatus 35 includes a filtering process unit 41 that performs an image filtering process that has a plurality of times of filtering processes. The filtering process unit 41 applies a filter to processing target data to acquire filter application process data, applies a gain to the filter application process data to acquire gain application process data, in each filtering process. In each filtering process, the gain applied to the filter application process data is acquired based on a target frequency characteristic of the image filtering process.
    Type: Grant
    Filed: March 17, 2017
    Date of Patent: August 14, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi
  • Patent number: 10027909
    Abstract: An imaging device 10 according to one aspect of the present invention includes: a subject distance acquisition section 115; a movement amount acquisition section 120 that acquires an amount of movement of the subject on the basis of the subject distance; a restoration processing determination section 125 that determines, on the basis of the amount of movement acquired by the movement amount acquisition section 120, whether the restoration processing should be performed on the images through a restoration filter, a restoration strength of the restoration processing should be adjusted and the restoration processing should be performed on the images, or the restoration processing should not be performed on the images; and a restoration processing execution section 105 that performs the restoration processing on the images through the restoration filter or with the adjusted restoration strength, on the basis of the determination of the restoration processing determination section 125.
    Type: Grant
    Filed: September 14, 2017
    Date of Patent: July 17, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Masahiko Sugimoto, Yousuke Naruse, Kosuke Irie
  • Patent number: 9984448
    Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.
    Type: Grant
    Filed: June 26, 2017
    Date of Patent: May 29, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi, Masahiko Sugimoto
  • Patent number: 9984449
    Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.
    Type: Grant
    Filed: June 26, 2017
    Date of Patent: May 29, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi, Masahiko Sugimoto
  • Patent number: 9965833
    Abstract: Disclosed is a technique capable of efficiently storing and retaining characteristic data (a restoration filter or the like) of an optical system used for a restoration process in a storage unit with limited storage capacity in consideration of the degree of image restoration. An image processing device includes a characteristic data storage unit 42 which is capable of storing characteristic data of a plurality of types of optical systems, and a restoration processing unit which subjects source image data to a restoration process using a restoration filter based on a point spread function of an optical system to acquire recovered image data. In case where storing new characteristic data in the characteristic data storage unit, characteristic data which is stored in the characteristic data storage unit 42 is controlled based on a restoration evaluation value which is allocated to characteristic data according to the type of optical system.
    Type: Grant
    Filed: October 23, 2015
    Date of Patent: May 8, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Masahiko Sugimoto, Kenkichi Hayashi, Yousuke Naruse
  • Patent number: 9906732
    Abstract: A restoration filter based on a point spread function of an optical system is applied to source image data acquired through photographing using the optical system to acquire restored image data (S13: filter application step). Adjustment of an amplification factor of the difference between source image data and restored image data is performed, and recovered image data is acquired from the difference after adjustment and source image data (S15: gain adjustment step). In the filter application step, a common filter determined regardless of a value of a magnification of an optical zoom of the optical system is used as the restoration filter, and in the gain adjustment step, the amplification factor is determined based on the magnification of the optical zoom of the optical system.
    Type: Grant
    Filed: February 1, 2016
    Date of Patent: February 27, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Kosuke Irie, Masahiko Sugimoto, Yousuke Naruse, Kenkichi Hayashi
  • Patent number: 9898807
    Abstract: The image processing device includes a gradation correction unit (gamma correction processing unit 33) which performs gradation correction, a restoration processing unit, a sharpening processing unit, a sharpening and recovery control unit 37 which is able to adjust a restoration rate of restoration processing and a sharpening rate of sharpening processing by controlling the restoration processing unit and the sharpening processing unit, a sharpening and recovery control unit 37 which acquires a total sharpening and restoration rate based on the restoration rate and the sharpening rate and one rate of the restoration rate and the sharpening rate and calculates the other rate of the restoration rate and the sharpening rate based on the total sharpening and restoration rate, and a brightness information acquisition unit. The sharpening and recovery control unit adjusts the restoration rate and the sharpening rate according to acquired brightness information.
    Type: Grant
    Filed: September 2, 2016
    Date of Patent: February 20, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Masahiko Sugimoto, Yousuke Naruse, Kosuke Irie
  • Patent number: 9892495
    Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, effectively performing phase recovery and suppressing the occurrence of artifact due to frequency recovery processing. The image processing device includes a phase recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to phase recovery processing using a phase recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the phase recovery processing to nonlinear gradation correction, and a frequency recovery processing unit which subjects image data subjected to the gradation correction to frequency recovery processing using a frequency recovery filter based on the point spread function of the optical system.
    Type: Grant
    Filed: September 14, 2016
    Date of Patent: February 13, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Masahiko Sugimoto, Kenkichi Hayashi