Patents by Inventor Kenkichi Hayashi

Kenkichi Hayashi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9906732
    Abstract: A restoration filter based on a point spread function of an optical system is applied to source image data acquired through photographing using the optical system to acquire restored image data (S13: filter application step). Adjustment of an amplification factor of the difference between source image data and restored image data is performed, and recovered image data is acquired from the difference after adjustment and source image data (S15: gain adjustment step). In the filter application step, a common filter determined regardless of a value of a magnification of an optical zoom of the optical system is used as the restoration filter, and in the gain adjustment step, the amplification factor is determined based on the magnification of the optical zoom of the optical system.
    Type: Grant
    Filed: February 1, 2016
    Date of Patent: February 27, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Kosuke Irie, Masahiko Sugimoto, Yousuke Naruse, Kenkichi Hayashi
  • Patent number: 9898807
    Abstract: The image processing device includes a gradation correction unit (gamma correction processing unit 33) which performs gradation correction, a restoration processing unit, a sharpening processing unit, a sharpening and recovery control unit 37 which is able to adjust a restoration rate of restoration processing and a sharpening rate of sharpening processing by controlling the restoration processing unit and the sharpening processing unit, a sharpening and recovery control unit 37 which acquires a total sharpening and restoration rate based on the restoration rate and the sharpening rate and one rate of the restoration rate and the sharpening rate and calculates the other rate of the restoration rate and the sharpening rate based on the total sharpening and restoration rate, and a brightness information acquisition unit. The sharpening and recovery control unit adjusts the restoration rate and the sharpening rate according to acquired brightness information.
    Type: Grant
    Filed: September 2, 2016
    Date of Patent: February 20, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Masahiko Sugimoto, Yousuke Naruse, Kosuke Irie
  • Patent number: 9892495
    Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, effectively performing phase recovery and suppressing the occurrence of artifact due to frequency recovery processing. The image processing device includes a phase recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to phase recovery processing using a phase recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the phase recovery processing to nonlinear gradation correction, and a frequency recovery processing unit which subjects image data subjected to the gradation correction to frequency recovery processing using a frequency recovery filter based on the point spread function of the optical system.
    Type: Grant
    Filed: September 14, 2016
    Date of Patent: February 13, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Masahiko Sugimoto, Kenkichi Hayashi
  • Patent number: 9892492
    Abstract: A restoration processing section 38 performs restoration processing using a restoration filter based on a point spread function for image data. An outline enhancement processing section 39 performs sharpening processing using a sharpening filter for image data. A sharpness restoration control section 37 acquires a total sharpness restoration rate based on the restoration rate (restoration strength magnification U) of the image data based on the restoration processing and the sharpening rate (sharpening strength magnification V) of the image data based on the sharpening processing, acquires one of the restoration rate and the sharpening rate, and calculates the other one of the restoration rate and the sharpening rate based on the total sharpness restoration rate.
    Type: Grant
    Filed: April 22, 2016
    Date of Patent: February 13, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi
  • Publication number: 20180040109
    Abstract: An image processing device and an image processing method capable of satisfactorily performing a point image restoration process of a visible light image and a point image restoration process of a near-infrared light image are provided. A point image restoration process is performed on luminance data Y indicating a visible light image and IR data indicating a near-infrared light image using a first point image restoration filter based on a first point spread function with respect to visible light of an optical system and a second point image restoration filter based on a second point spread function with respect to near-infrared light of the optical system. An appropriate point image restoration process is performed on the IR data so that restoration strength (second gain ?) in the point image restoration process for the IR data captured with radiation of near-infrared light is higher than restoration strength (first gain ?) in the point image restoration process for the luminance data Y.
    Type: Application
    Filed: October 20, 2017
    Publication date: February 8, 2018
    Applicant: FUJIFILM Corporation
    Inventors: Kenkichi HAYASHI, Junichi TANAKA, Yousuke NARUSE, Masahiko SUGIMOTO, Kousuke IRIE
  • Publication number: 20180041714
    Abstract: The present invention provides an image processing device, an imaging device, an image processing method, and a program which are capable of accurately correcting blurring caused in first image data of an image using a near-infrared ray as a light source and, accurately performing a point image restoration process on second image data of an image using visible light and a near-infrared ray as a light source.
    Type: Application
    Filed: October 20, 2017
    Publication date: February 8, 2018
    Applicant: FUJIFILM Corporation
    Inventors: Kenkichi HAYASHI, Junichi TANAKA, Yousuke NARUSE, Masahiko SUGIMOTO
  • Publication number: 20180040108
    Abstract: In a case where IR data of a near-infrared light image is data in which a visible light component and a near-infrared light component coexist, a point image restoration process is performed on the IR data using a first point image restoration filter based on a first point spread function for visible light of the optical system and a second point image restoration filter based on a second point spread function for near-infrared light of the optical system. An appropriate point image restoration process is performed on the IR data that is captured in a time zone of twilight or dawn by performing weighted averaging on a point image restoration process using the first point image restoration filter and a point image restoration process using the second point image restoration filter using a first gain ? and a second gain ? according to a light amount ratio between visible light and near-infrared light at the time of capturing the IR data.
    Type: Application
    Filed: October 20, 2017
    Publication date: February 8, 2018
    Applicant: FUJIFILM Corporation
    Inventors: Junichi TANAKA, Kenkichi HAYASHI, Yousuke NARUSE
  • Publication number: 20180040107
    Abstract: The present invention provides an image processing device, an imaging device, an image processing method, and a program capable of effectively performing a point image restoration process on a visible light image and a near-infrared ray image, and improving accuracy of a point image restoration process.
    Type: Application
    Filed: October 20, 2017
    Publication date: February 8, 2018
    Applicant: FUJIFILM Corporation
    Inventors: Kenkichi HAYASHI, Junichi TANAKA, Yousuke NARUSE, Masahiko SUGIMOTO
  • Patent number: 9881362
    Abstract: An image processing device includes a point-image restoration processing unit 40 which receives a photographic image as input, and subjects the photographic image to a point-image restoration process based on point-image restoration information to generate a restored image, an area information output unit 45 which outputs area information relating to a specific area in the restored image where restoration strength of the point-image restoration process based on the point-image restoration information is equal to or greater than a threshold value, a display control unit 50 which receives the restored image and the area information as input and performs display control to highlight the specific area in the restored image based on the area information, and a display unit 55 which highlights at least the specific area based on the display control by the display control unit 50.
    Type: Grant
    Filed: November 5, 2015
    Date of Patent: January 30, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Masahiko Sugimoto, Yousuke Naruse
  • Patent number: 9866750
    Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, suppressing the occurrence of artifact and color gradation and achieving reduction in computational costs. The image processing device includes a frequency recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to frequency recovery processing using a frequency recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the frequency recovery processing to nonlinear gradation correction, and a phase recovery processing unit which subjects image data subjected to the gradation correction to phase recovery processing using a phase recovery filter based on the point spread function of the optical system.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: January 9, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Masahiko Sugimoto, Kenkichi Hayashi
  • Patent number: 9865039
    Abstract: A restoration filter generation device according to one embodiment of the present invention includes: an information acquisition unit that acquires information showing a difference that depends on a color of an optical transfer function of an optical system; and a restoration filter generation unit that generates a restoration filter, which weakens restoration strength according to the difference that depends on the color of the optical transfer function on the basis of the information acquired by the information acquisition unit, and makes the restoration strength of the restoration filter weaker than the restoration strength of an ideal filter decided assuming that the difference that depends on the color of the optical transfer function does not exist. As a result, the overcorrection is reduced.
    Type: Grant
    Filed: September 10, 2015
    Date of Patent: January 9, 2018
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi, Masahiko Sugimoto
  • Publication number: 20180007292
    Abstract: An imaging device 10 according to one aspect of the present invention includes: a subject distance acquisition section 115; a movement amount acquisition section 120 that acquires an amount of movement of the subject on the basis of the subject distance; a restoration processing determination section 125 that determines, on the basis of the amount of movement acquired by the movement amount acquisition section 120, whether the restoration processing should be performed on the images through a restoration filter, a restoration strength of the restoration processing should be adjusted and the restoration processing should be performed on the images, or the restoration processing should not be performed on the images; and a restoration processing execution section 105 that performs the restoration processing on the images through the restoration filter or with the adjusted restoration strength, on the basis of the determination of the restoration processing determination section 125.
    Type: Application
    Filed: September 14, 2017
    Publication date: January 4, 2018
    Applicant: FUJIFILM Corporation
    Inventors: Kenkichi HAYASHI, Masahiko SUGIMOTO, Yousuke NARUSE, Kosuke IRIE
  • Patent number: 9854187
    Abstract: There are provided an image processing apparatus, an image processing method, and a program capable of realizing a desired image filtering process specified based on an optical characteristic of an individual optical system with high accuracy using a simple computation process. Further, there are provided a filter acquisition apparatus, a filter acquisition method, program, and a recording medium capable of acquiring a filter which is suitably usable in an image filtering process. A filtering process unit 41 (image processing apparatus 35) applies a filter to processing target data to acquire filter application process data, applies a gain to the filter application process data to acquire gain application process data, in each filtering process. In each filtering process, the gain applied to the filter application process data is acquired based on a target frequency characteristic of the image filtering process.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: December 26, 2017
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi
  • Patent number: 9826150
    Abstract: There are provided a signal processing device, an imaging apparatus, a parameter generating method, a signal processing method, and a program that enable desired frequency component adjustment without complicating the processing. An image processing unit 35 includes a signal processing section that adjusts a signal according to a frequency and a filter processing control section 37 (automatic strength adjustment section 52) that controls the signal processing section. The signal processing section includes a first filter processing section 38 that performs first filter processing and a second filter processing section 39 that performs second filter processing. The automatic strength adjustment section 52 acquires the adjustment magnification (first gain adjustment magnification U and second gain adjustment magnification V) in one of the first filter processing and the second filter processing, and calculates the adjustment magnification in the other processing based on a total gain adjustment rate D.
    Type: Grant
    Filed: April 22, 2016
    Date of Patent: November 21, 2017
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi
  • Patent number: 9805452
    Abstract: There are provided an image processing apparatus, an image processing method, a program, and a recording medium capable of compatibly achieving a high-accuracy filtering process and reduction in a necessary storage capacity. An image processing apparatus 35 includes a filtering process unit 41 that performs an image filtering process including a plurality of filtering processes. The filtering process unit 41 applies a filter to processing target data to acquire filter application process data, and applies a gain to the filter application process data to acquire gain application process data, in each filtering process. In each filtering process, the gain applied to the filter application process data is acquired based on a target frequency characteristic of the image filtering process determined according to a pixel position in original image data.
    Type: Grant
    Filed: March 17, 2017
    Date of Patent: October 31, 2017
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi
  • Patent number: 9799104
    Abstract: There are provided an image processing apparatus, an image processing method, a program, and a recording medium capable of compatibly achieving a high-accuracy filtering process and reduction in a necessary storage capacity. An image processing apparatus includes a filtering process unit that performs an image filtering process including a plurality of filtering processes. The filtering process unit applies a filter to processing target data to acquire filter application process data, and applies a gain to the filter application process data to acquire gain application process data, in each filtering process. In each filtering process, the gain applied to the filter application process data is acquired based on a “target frequency characteristic of the image filtering process” specified based on an optical characteristic of an optical system used when the original image data is acquired, that is, the optical characteristic according to an imaging condition when the original image data is acquired.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: October 24, 2017
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi
  • Patent number: 9800774
    Abstract: A first restoration processing section 110 and a second restoration processing section 120 perform restoration processing on images (luminance data Y), which are successively captured by an image capture section, using a first filter 102, which is a restoration filter generated corresponding to a point spread function of an optical system, and a second filter 104 of which a restoration strength is weaker than that of the first filter 102. Depending on a result of determination which is input from an in-focus determination section 150 and indicates whether or not the image at the current time point is in a target in-focus state, a selection section 122 selects and outputs either luminance data YA which is processed using the first filter 102 or luminance data YB which is processed using the second filter 104.
    Type: Grant
    Filed: January 4, 2016
    Date of Patent: October 24, 2017
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi, Masahiko Sugimoto, Kosuke Irie
  • Patent number: 9799105
    Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and a program capable of acquiring a moving image with excellent image quality while maintaining continuity of a restoration process between frames even if there is a rapid change of a photographing environment in a moving image. An image processing device includes a restoration control processing unit 36 which subjects a moving image including a plurality of frames acquired by photographing using an optical system to a restoration process based on a point spread function of the optical system to acquire recovered image data. The restoration control processing unit 36 controls the restoration process for a frame to be processed among a plurality of frames based on imaging information of a reference frame including a frame after the frame to be processed in a time series.
    Type: Grant
    Filed: January 22, 2016
    Date of Patent: October 24, 2017
    Assignee: FUJIFILM Corporation
    Inventors: Masahiko Sugimoto, Kenkichi Hayashi, Yousuke Naruse, Kosuke Irie
  • Patent number: 9799101
    Abstract: A restoration filter generation device that generates a restoration filter to perform restoration processing on luminance system image data that is image data related to luminance, which is generated based on image data of respective colors of multiple colors obtained by an imaging device having an optical system, includes an information acquisition device acquiring transfer function information corresponding to point image distribution in the optical system, for each color of the multiple colors, and a restoration filter generation device generating the restoration filter based on the transfer function information acquired by the information acquisition device and generating the restoration filter that performs phase correction of the luminance system image data according to the transfer function information on a single color of the multiple colors.
    Type: Grant
    Filed: September 3, 2015
    Date of Patent: October 24, 2017
    Assignee: FUJIFILM Corporation
    Inventors: Yousuke Naruse, Kenkichi Hayashi, Masahiko Sugimoto
  • Patent number: 9794500
    Abstract: An imaging device 10 according to one aspect of the present invention includes: a subject distance acquisition section 115; a movement amount acquisition section 120 that acquires an amount of movement of the subject on the basis of the subject distance; a restoration processing determination section 125 that determines, on the basis of the amount of movement acquired by the movement amount acquisition section 120, whether the restoration processing should be performed on the images through a restoration filter, a restoration strength of the restoration processing should be adjusted and the restoration processing should be performed on the images, or the restoration processing should not be performed on the images; and a restoration processing execution section 105 that performs the restoration processing on the images through the restoration filter or with the adjusted restoration strength, on the basis of the determination of the restoration processing determination section 125.
    Type: Grant
    Filed: January 4, 2016
    Date of Patent: October 17, 2017
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Masahiko Sugimoto, Yousuke Naruse, Kosuke Irie