Patents by Inventor Kazuya Nobayashi

Kazuya Nobayashi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10659766
    Abstract: Provided is a confidence generation apparatus including: an acquisition unit configured to acquire a depth image signal which includes depth information representing a depth to an object in each of a plurality of pixels; and a generation unit configured to generate global confidence which represents confidence in a global region of the depth image signal. The generation unit includes: a first generation processing unit configured to generate local confidence which represents the confidence in the depth information in each of the plurality of pixels; a region division processing unit configured to divide the depth image signal into a plurality of regions based on the depth information; and a second generation processing unit configured to generate the global confidence in each of the plurality of regions based on the local confidence.
    Type: Grant
    Filed: October 18, 2016
    Date of Patent: May 19, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Kazuya Nobayashi, Takashi Sasaki
  • Patent number: 10582180
    Abstract: Provided is a depth image correction apparatus to correct depth information in a depth image, which acquires a depth image and correction information, and corrects the depth values of the depth image based on the correction information and generates a corrected depth image. The apparatus acquires, as the correction information, first confidence indicating reliability in the depth values, and second confidence indicating reliability in position in an in-plane direction vertical to the depth direction. The apparatus performs first correction processing of generating a first corrected depth image by correcting the depth image based on the first confidence and similarity of the depth values, and second correction processing of generating the corrected depth image by correcting the first corrected depth image based on the second confidence.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: March 3, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuya Nobayashi
  • Patent number: 10514248
    Abstract: A distance detecting apparatus includes an imaging unit that generates a first image signal and a second image signal and an arithmetic processing unit. The distance detecting apparatus detects the distance to a subject on the basis of an amount of defocus indicating the distance between an imaging plane of the imaging unit and an image forming plane of light fluxes. The arithmetic processing unit executes a first step of calculating an amount of temporary defocus on the basis of the first image signal and the second image signal, a second step of calculating a conversion factor used to convert an amount of image displacement between a first image and a second image into the amount of defocus on the basis of the amount of temporary defocus, and a third step of calculating the amount of defocus by using the conversion factor.
    Type: Grant
    Filed: July 17, 2013
    Date of Patent: December 24, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Kazuya Nobayashi, Kiyokatsu Ikemoto
  • Patent number: 10477100
    Abstract: A distance calculation apparatus calculates distance information based on a first image, which is generated based on luminous flux that passed through a first pupil region, and a second image, which is generated based on luminous flux that passed through a second pupil region. The distance calculation apparatus includes a distance calculation unit to calculate the distance information by comparing a local region of the first image and a local region of the second image and a confidence calculation unit to calculate confidence of the distance information based on a contrast evaluation value, which is a value indicating a magnitude of a contrast change amount in the local region of the first image, in the local region of the second image, or in a local region of a composite image of the first image and the second image.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: November 12, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuya Nobayashi
  • Publication number: 20190301852
    Abstract: A distance measuring device includes an imaging optical system having an optical filter and an imaging element in which a plurality of pixel portions is arranged. The optical filter is divided into three regions, the first region has a first spectral transmittance characteristic, and the second region and the third region a second spectral transmittance characteristic in which light having a longer wavelength compared to the first spectral transmittance characteristic is transmitted. The first pixel portion that configures the imaging element includes a first photoelectric conversion unit and receives light that has passing through the first region. The second pixel portion that configures the imaging element includes second and third photoelectric conversion units, and receives light that has passed through each of the second region and the third region.
    Type: Application
    Filed: March 14, 2019
    Publication date: October 3, 2019
    Inventor: Kazuya Nobayashi
  • Publication number: 20190253610
    Abstract: A distance calculation apparatus calculates distance information based on a first image, which is generated based on luminous flux that passed through a first pupil region, and a second image, which is generated based on luminous flux that passed through a second pupil region. The distance calculation apparatus includes a distance calculation unit to calculate the distance information by comparing a local region of the first image and a local region of the second image and a confidence calculation unit to calculate confidence of the distance information based on a contrast evaluation value, which is a value indicating a magnitude of a contrast change amount in the local region of the first image, in the local region of the second image, or in a local region of a composite image of the first image and the second image.
    Type: Application
    Filed: April 26, 2019
    Publication date: August 15, 2019
    Inventor: Kazuya Nobayashi
  • Publication number: 20190204073
    Abstract: A distance information processing apparatus includes: a distance calculator configured to calculate object distances, which are distances to an object in ae depth direction, for a plurality of pixel positions on the basis of a first image signal and a second image signal, so as to calculate a distance image signal constituted by a plurality of object distances; a first confidence calculator configured to calculate a first confidence representing certainty of an object distance value in the distance image signal; and a range calculator configured to calculate a distance range, which is a range of an object distance, on the basis of the distance image signal and the first confidence.
    Type: Application
    Filed: March 6, 2019
    Publication date: July 4, 2019
    Inventor: Kazuya Nobayashi
  • Patent number: 10339665
    Abstract: A positional shift amount calculation apparatus that calculates a positional shift amount, which is a relative positional shift amount between a first image, based on a luminous flux that has passed through a first imaging optical system, and a second image. A calculation unit calculates a positional shift amount based on data within a predetermined area out of first image data representing first and second image data. A setting unit sets a relative size of the area to the first and second image data. The calculation unit calculates a first positional shift amount using the first and second image data in the area having a first size that is preset. The setting unit sets a second size of the area based on the size of the first positional shift amount and an optical characteristic of the first imaging optical system. The calculation unit then calculates a second positional shift amount.
    Type: Grant
    Filed: September 3, 2015
    Date of Patent: July 2, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuya Nobayashi
  • Patent number: 10306132
    Abstract: A distance calculation apparatus calculates distance information based on a first image, which is generated based on luminous flux that passed through a first pupil region, and a second image, which is generated based on luminous flux that passed through a second pupil region. The distance calculation apparatus includes a distance calculation unit to calculate the distance information by comparing a local region of the first image and a local region of the second image and a confidence calculation unit to calculate confidence of the distance information based on a contrast evaluation value, which is a value indicating a magnitude of a contrast change amount in the local region of the first image, in the local region of the second image, or in a local region of a composite image of the first image and the second image.
    Type: Grant
    Filed: May 3, 2016
    Date of Patent: May 28, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuya Nobayashi
  • Publication number: 20190128669
    Abstract: A distance measurement device includes a first acquisition unit configured to acquire distance information on the basis of a plurality of images captured at different viewpoints, a second acquisition configured to acquire correction information of the distance information on the basis of a plurality of images captured at a timing different from the plurality of images used by the first acquisition unit, and a correction unit configured to correct the distance information on the basis of the correction information.
    Type: Application
    Filed: October 18, 2018
    Publication date: May 2, 2019
    Inventor: Kazuya Nobayashi
  • Patent number: 10267623
    Abstract: A distance information processing apparatus includes: a distance calculator configured to calculate object distances, which are distances to an object in ae depth direction, for a plurality of pixel positions on the basis of a first image signal and a second image signal, so as to calculate a distance image signal constituted by a plurality of object distances; a first confidence calculator configured to calculate a first confidence representing certainty of an object distance value in the distance image signal; and a range calculator configured to calculate a distance range, which is a range of an object distance, on the basis of the distance image signal and the first confidence.
    Type: Grant
    Filed: March 8, 2016
    Date of Patent: April 23, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuya Nobayashi
  • Patent number: 10263027
    Abstract: A solid-state imaging device includes a plurality of pixels, wherein one or more of the plurality of pixels have a pupil dividing portion and a light receiving portion, the light receiving portion includes a plurality of photoelectric conversion regions, an element isolation region is provided between adjacent ones of the plurality of photoelectric conversion regions, and wherein a scatterer is provided within the pupil dividing portion and above the element isolation region, and the scatterer is formed from a material of a refractive index smaller than a refractive index of a material of the pupil dividing portion peripheral to the scatterer.
    Type: Grant
    Filed: January 9, 2017
    Date of Patent: April 16, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kazuya Nobayashi
  • Publication number: 20180367772
    Abstract: The distance information generating apparatus includes a generating unit configured to generate the distance information, based on the parallax between the first image signal and the second image signal; an acquiring unit configured to acquire chromatic aberration information indicative of chromatic aberration of an image-forming optical system used in photographing of the first image signal and the second image signal; and a correction unit configured to correct the distance information generated in the generating unit, based on a contrast evaluation value generated for each of the plurality of pieces of color information from the third image signal, and the chromatic aberration information
    Type: Application
    Filed: June 15, 2018
    Publication date: December 20, 2018
    Inventor: Kazuya Nobayashi
  • Publication number: 20170270688
    Abstract: A positional shift amount calculation apparatus that calculates a positional shift amount, which is a relative positional shift amount between a first image based on a luminous flux that has passed through a first imaging optical system, and a second image. A calculation unit calculates a positional shift amount based on data within a predetermined area out of first image data representing first and second image data. A setting unit sets a relative size of the area to the first and second image data. The calculation unit calculates a first positional shift amount using the first and second image data in the area having a first size that is preset. The setting unit sets a second size of the area based on the size of the first positional shift amount and an optical characteristic of the first imaging optical system. The calculation unit then calculates a second positional shift amount.
    Type: Application
    Filed: September 3, 2015
    Publication date: September 21, 2017
    Inventor: Kazuya Nobayashi
  • Publication number: 20170261318
    Abstract: A ranging apparatus capable of suppressing reduction of ranging accuracy at a long distance end of a distance measurement range, thereby making it possible to perform high-accuracy ranging over a wide distance range. An image pickup device receives light fluxes from a fixed focus optical system. A distance information acquisition unit acquires distance information of an object based on image signals from the image pickup device. This section acquires the distance information based on parallax between a first image based on a light flux having passed a first region of an exit pupil, and a second image based on a light flux having passed a second region of the exit pupil. The optical system is configured such that parallax of an object existing at a predetermined distance is smaller than parallax of an object existing at a shorter distance than the predetermined distance.
    Type: Application
    Filed: March 6, 2017
    Publication date: September 14, 2017
    Inventors: Akinari Takagi, Kazuya Nobayashi
  • Patent number: 9759549
    Abstract: A distance detecting device includes computing unit for detecting a distance to a subject on the basis of a first signal due to a light flux that has passed through a first pupil area of an imaging optical system and a second signal due to a light flux that has passed through a second pupil area of the imaging optical system, the first signal and the second signal being generated by image pickup member formed by arranging a plurality of pixels.
    Type: Grant
    Filed: September 6, 2013
    Date of Patent: September 12, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuya Nobayashi
  • Publication number: 20170223334
    Abstract: Provided is a depth image correction apparatus to correct depth information in a depth image, which acquires a depth image and correction information, and corrects the depth values of the depth image based on the correction information and generates a corrected depth image. The apparatus acquires, as the correction information, first confidence indicating reliability in the depth values, and second confidence indicating reliability in position in an in-plane direction vertical to the depth direction. The apparatus performs first correction processing of generating a first corrected depth image by correcting the depth image based on the first confidence and similarity of the depth values, and second correction processing of generating the corrected depth image by correcting the first corrected depth image based on the second confidence.
    Type: Application
    Filed: January 26, 2017
    Publication date: August 3, 2017
    Inventor: Kazuya Nobayashi
  • Publication number: 20170127048
    Abstract: Provided is a confidence generation apparatus including: an acquisition unit configured to acquire a depth image signal which includes depth information representing a depth to an object in each of a plurality of pixels; and a generation unit configured to generate global confidence which represents confidence in a global region of the depth image signal. The generation unit includes: a first generation processing unit configured to generate local confidence which represents the confidence in the depth information in each of the plurality of pixels; a region division processing unit configured to divide the depth image signal into a plurality of regions based on the depth information; and a second generation processing unit configured to generate the global confidence in each of the plurality of regions based on the local confidence.
    Type: Application
    Filed: October 18, 2016
    Publication date: May 4, 2017
    Inventors: Kazuya Nobayashi, Takashi Sasaki
  • Publication number: 20170117314
    Abstract: A solid-state imaging device includes a plurality of pixels, wherein one or more of the plurality of pixels have a pupil dividing portion and a light receiving portion, the light receiving portion includes a plurality of photoelectric conversion regions, an element isolation region is provided between adjacent ones of the plurality of photoelectric conversion regions, and wherein a scatterer is provided within the pupil dividing portion and above the element isolation region, and the scatterer is formed from a material of a refractive index smaller than a refractive index of a material of the pupil dividing portion peripheral to the scatterer.
    Type: Application
    Filed: January 9, 2017
    Publication date: April 27, 2017
    Inventor: Kazuya Nobayashi
  • Patent number: 9635243
    Abstract: A ranging apparatus includes: an output ratio data calculation unit for calculating an output ratio data of first and second image data; a correction function calculation unit for calculating a correction function approximating the output ratio data by an N-order function (N being an integer equal to or greater than 1) having a pixel position as a variable; a correction unit for correcting at least one of the first and second image data on the basis of the correction function; and a ranging unit for calculating the defocus amount by using the picture image data corrected by the correction unit.
    Type: Grant
    Filed: January 28, 2016
    Date of Patent: April 25, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuya Nobayashi