Patents by Inventor Shun Kaizu

Shun Kaizu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210217191
    Abstract: A local match processing section 361 of a parallax detecting section 36 generates a cost volume indicating a cost indicating, for each pixel and each parallax, the similarity between images acquired by imaging sections 21 and 22 that are different in viewpoint positions. A cost volume processing section 363 performs cost adjustment processing on a cost volume on the basis of a polarization image acquired by the imaging section 21, by using normal line information generated for each pixel by a normal line information generating section 31. A minimum value search processing section 365 detects, from the cost volume having undergone the cost adjustment processing, a parallax at which the similarity becomes maximum, by using the parallax-based costs of a parallax detection target pixel. A depth calculating section 37 generates depth information indicating depths of respective pixels on the basis of parallaxes detected, for the respective pixels, by the parallax detecting section 36.
    Type: Application
    Filed: October 12, 2018
    Publication date: July 15, 2021
    Inventors: SHUN KAIZU, YASUTAKA HIRASAWA, TEPPEI KURITA
  • Publication number: 20210211619
    Abstract: An information generation unit 30 acquires, from a polarization imaging unit 20, observation values in which polarization directions are at least three or more directions (m?3). A noise amount calculation unit 35-1 calculates an amount of noise on the basis of an observation value in a first polarization direction. Similarly, noise amount calculation units 35-2 to 35-m calculate amounts of noise on the basis of observation values in second to m-th polarization directions. A polarization model estimation unit 36 estimates a polarization model by using the observation values for the respective polarization directions and the amounts of noise calculated by the noise amount calculation units 35-1 to 35-m. Thus, it is possible to calculate a polarization model that is robust against noise.
    Type: Application
    Filed: March 13, 2019
    Publication date: July 8, 2021
    Applicant: SONY CORPORATION
    Inventors: Hajime MIHARA, Shun KAIZU, Teppei KURITA, Yasutaka HIRASAWA
  • Publication number: 20210201450
    Abstract: A polarization imaging unit 20 generates, as polarization information, a polarization image including pixels in a plurality of polarization directions. An interpolation processing unit 31 of an information processor 30 performs interpolation processing using the polarization image obtained from the polarization imaging unit 20, and generates a polarization image for each polarization method. A polarization degree calculation unit 32 calculates, for example, a polarization degree for each pixel as object surface information on the basis of the polarization image for each polarization method. A noise amount calculation unit 33 calculates a noise amount for each pixel on the basis of the polarization image for each polarization method and the like.
    Type: Application
    Filed: January 31, 2019
    Publication date: July 1, 2021
    Inventors: TEPPEI KURITA, SHUN KAIZU, YASUTAKA HIRASAWA, YUHI KONDO
  • Publication number: 20210174127
    Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness ? of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude ? of the polarization model on the basis of the calculated average brightness ?, pre-stored information regarding the zenith angle ? of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection.
    Type: Application
    Filed: October 12, 2018
    Publication date: June 10, 2021
    Inventors: HAJIME MIHARA, SHUN KAIZU, TEPPEI KURITA, YUHI KONDO, YASUTAKA HIRASAWA
  • Publication number: 20210152749
    Abstract: The polarization imaging unit 20 acquires a polarization image of a subject, and outputs the polarization image to the image processing unit 30. An interpolation processing unit 31 of the image processing apparatus 30 performs interpolation processing by using the polarization image acquired by the polarization imaging unit 20 to generate an image signal for each polarization component and each color component. A component image generation unit 32 calculates a specular reflection component and a diffuse reflection component for each pixel and for each color component, and generates, as component images, a specular reflection image representing the specular reflection components and a diffuse reflection image representing the diffuse reflection components. A target image generation unit 33 sets gain for each pixel of the component images by using a learned model on the basis of the component images.
    Type: Application
    Filed: January 31, 2019
    Publication date: May 20, 2021
    Inventors: TEPPEI KURITA, SHUN KAIZU
  • Patent number: 10904503
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: January 26, 2021
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Shun Kaizu, Teppei Kurita, Tuo Zhuang, Yasutaka Hirasawa, Ying Lu
  • Publication number: 20200390926
    Abstract: Provided is an information processing apparatus that is worn on a user's body for use. The information processing apparatus includes a sensor, a communication section, a control section, a power supply section, a housing section, a sticking section, and a sticking sensor. The control section controls the sensor and the communication section. The housing section accommodates the sensor, the communication section, the control section, and the power supply section. The sticking section fastens the housing section to the user. The sticking sensor detects a state of sticking between the user and the housing on the sticking section. The control section wirelessly sends a given signal to external equipment via the communication section in response to detection, by the sticking sensor, of the fact that the sticking section has peeled off from the user or is just about to peel off from the user.
    Type: Application
    Filed: September 7, 2018
    Publication date: December 17, 2020
    Inventors: GO IGARASHI, JUNYA SUZUKI, SHUN KAIZU, YUSUKE OTANI, YUTO ISHIZU
  • Patent number: 10848727
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Grant
    Filed: June 13, 2017
    Date of Patent: November 24, 2020
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Shun Kaizu, Teppei Kurita, Tuo Zhuang, Yasutaka Hirasawa, Ying Lu
  • Patent number: 10812735
    Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: October 20, 2020
    Assignee: SONY CORPORATION
    Inventors: Yasutaka Hirasawa, Yuhi Kondo, Hideki Oyaizu, Shun Kaizu, Teppei Kurita, Tuo Zhuang, Ying Lu, Hajime Mihara
  • Patent number: 10750136
    Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light.
    Type: Grant
    Filed: August 28, 2017
    Date of Patent: August 18, 2020
    Assignee: SONY CORPORATION
    Inventors: Shun Kaizu, Yasutaka Hirasawa, Yuhi Kondo, Teppei Kurita, Ying Lu
  • Publication number: 20200204729
    Abstract: In an image capturing unit 20, an imaging element has a 4X4-pixel area in which: pixels including at least one pixel of every color component of a plurality of color components are polarization pixels of the same polarization direction; and pixels which are not the polarization pixels constitute a majority of the 4X4-pixel area, and are non-polarization pixels. The unpolarized component calculating unit 31 of the image processing unit 30 calculates unpolarized components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20. The diffuse reflection component calculating unit 32 calculates diffuse reflection components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20.
    Type: Application
    Filed: April 9, 2018
    Publication date: June 25, 2020
    Inventors: TEPPEI KURITA, SHUN KAIZU, YASUTAKA HIRASAWA
  • Patent number: 10638065
    Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times. [Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: April 28, 2020
    Assignee: Sony Corporation
    Inventors: Tomoo Mitsunaga, Shun Kaizu, Teppei Kurita, Toru Nishi
  • Publication number: 20200068182
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Application
    Filed: October 31, 2019
    Publication date: February 27, 2020
    Applicant: SONY CORPORATION
    Inventors: Yuhi KONDO, Shun KAIZU, Teppei KURITA, Tuo ZHUANG, Yasutaka HIRASAWA, Ying LU
  • Patent number: 10460422
    Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.
    Type: Grant
    Filed: September 9, 2016
    Date of Patent: October 29, 2019
    Assignee: SONY CORPORATION
    Inventors: Teppei Kurita, Shun Kaizu, Yuhi Kondo, Yasutaka Hirasawa, Ying Lu
  • Patent number: 10432875
    Abstract: An image processing apparatus includes: a row integration ratio calculation unit that divides a first row integration value by a second row integration value for each row, to calculate a row integration ratio; a reference value generation unit that generates a reference value for each row; a reference value integration unit that multiplies the integration ratio by the reference value for each row and integrates multiplication results corresponding to all rows, to calculate a sum of the multiplication results of the integration ratios and the reference values; a flicker parameter estimation unit that estimates a flicker parameter of flicker generated in the first exposure image on the basis of the sum; and a flicker correction unit that corrects the flicker generated in the first exposure image on the basis of the estimated flicker parameter. The present disclosure can be applied to an image sensor.
    Type: Grant
    Filed: July 17, 2015
    Date of Patent: October 1, 2019
    Assignee: SONY CORPORATION
    Inventors: Shigeki Nakamura, Shun Kaizu
  • Publication number: 20190273856
    Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided.
    Type: Application
    Filed: October 26, 2017
    Publication date: September 5, 2019
    Inventors: YASUTAKA HIRASAWA, YUHI KONDO, HIDEKI OYAIZU, SHUN KAIZU, TEPPEI KURITA, TUO ZHUANG, YING LU, HAJIME MIHARA
  • Publication number: 20190260974
    Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light.
    Type: Application
    Filed: August 28, 2017
    Publication date: August 22, 2019
    Applicant: SONY CORPORATION
    Inventors: Shun KAIZU, Yasutaka HIRASAWA, Yuhi KONDO, Teppei KURITA, Ying LU
  • Publication number: 20190166342
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Application
    Filed: June 13, 2017
    Publication date: May 30, 2019
    Applicant: SONY CORPORATION
    Inventors: Yuhi KONDO, Shun KAIZU, Teppei KURITA, Tuo ZHUANG, Yasutaka HIRASAWA, Ying LU
  • Publication number: 20190124281
    Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times. [Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities.
    Type: Application
    Filed: December 19, 2018
    Publication date: April 25, 2019
    Applicant: Sony Corporation
    Inventors: Tomoo Mitsunaga, Shun Kaizu, Teppei Kurita, Toru Nishi
  • Patent number: 10200664
    Abstract: There are provided an apparatus and a method which generate an RGB image having less color noise and fewer false colors by inputting an RGBW image. The apparatus has an image sensor having an RGBW array, and an image processing unit which performs image processing by inputting a sensor image formed of an RGBW pixel signal output from the image sensor. The image sensor has a periodic array of a unit composition formed of each RGBW pixel, and has an array in which composition ratios of each RGB pixel within the unit composition are adapted to be the same as each other. The image processing unit converts a pixel array of the sensor image formed of the RGBW pixel signal, and performs at least either array conversion processing for generating an RGB array image or signal processing for generating each RGB image signal in which all RGB pixel values are set for each pixel position of the sensor image.
    Type: Grant
    Filed: May 17, 2017
    Date of Patent: February 5, 2019
    Assignee: Sony Corporation
    Inventor: Shun Kaizu