Patents by Inventor Yuhi Kondo

Yuhi Kondo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230003583
    Abstract: A quantization range setting unit (31) of an encoder (30) sets a quantization range for each Stokes parameter of a Stokes vector acquired from a Stokes vector calculation unit (20). The quantization range is set for the Stokes parameter indicating intensity, and is then set for the other Stokes parameters. A quantization unit (32) calculates the Stokes parameter indicating intensity as a predetermined quantization bit number, and calculates the quantization bit numbers of the other Stokes parameters on the basis of the predetermined quantization bit number and the quantization ranges set for the respective Stokes parameters. The quantization unit (32) performs a quantization process on the Stokes parameters on the basis of the quantization ranges and the quantization bit numbers, to generate quantized polarization information. A decoder (40) performs inverse quantization compatible with the encoder 30 on the quantized polarization information, and generates the Stokes vectors before quantization.
    Type: Application
    Filed: November 30, 2020
    Publication date: January 5, 2023
    Inventors: LEGONG SUN, YASUTAKA HIRASAWA, YUHI KONDO, TAISHI ONO
  • Patent number: 11405603
    Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit. A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
    Type: Grant
    Filed: July 29, 2020
    Date of Patent: August 2, 2022
    Assignee: SONY CORPORATION
    Inventors: Yasutaka Hirasawa, Yuhi Kondo, Ying Lu, Ayaka Nakatani
  • Publication number: 20220210322
    Abstract: An imaging apparatus (10) includes an imaging unit (11) that has a first pixel block and a second pixel block provided in a pixel region, the first pixel block including polarization pixels with two different polarization directions and a non-polarization pixel, the second pixel block including polarization pixels with a plurality of polarization directions including a different polarization direction from the first pixel block. An image processing apparatus (20) acquires a captured image generated by the imaging apparatus (10), and a correction coefficient calculation unit (40) calculates a correction coefficient that absorbs a sensitivity difference between polarization pixels and non-polarization pixels, on the basis of an image of the second pixel block.
    Type: Application
    Filed: February 7, 2020
    Publication date: June 30, 2022
    Inventors: YASUTAKA HIRASAWA, YUHI KONDO, LEGONG SUN, TAISHI ONO
  • Patent number: 11336849
    Abstract: A polarization imaging section 20 includes polarized pixels in each of a plurality of polarization directions. The polarization imaging section 20 includes a polarizer. The polarization imaging section 20 outputs image signals of a polarized image to a defect detecting section 35 of an image processing section 30. In a case where a difference between a pixel value of a target polarized pixel generated by the polarization imaging section and a pixel value of the target polarized pixel estimated from polarization characteristics corresponding to pixel values of peripheral pixels in a polarization direction different from a polarization direction of the target polarized pixel is greater than a predetermined allowable range, the defect detecting section 35 determines that the target polarized pixel is a defective pixel. Therefore, it is possible to detect a defect of a pixel in the polarization imaging section that generates the polarized image.
    Type: Grant
    Filed: June 13, 2017
    Date of Patent: May 17, 2022
    Assignee: SONY CORPORATION
    Inventors: Teppei Kurita, Shun Kaizu, Yuhi Kondo, Yasutaka Hirasawa
  • Publication number: 20220146434
    Abstract: A determination environment information acquisition unit 31 acquires incident polarized light information of a light source in a material determination environment. A determination target information acquisition unit 32 acquires emitted polarized light information from a polarized image obtained by capturing an image of a material determination target in the material determination environment.
    Type: Application
    Filed: January 15, 2020
    Publication date: May 12, 2022
    Inventors: LEGONG SUN, YASUTAKA HIRASAWA, YUHI KONDO, TAISHI ONO
  • Publication number: 20220126821
    Abstract: A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.
    Type: Application
    Filed: January 6, 2022
    Publication date: April 28, 2022
    Applicant: Sony Group Corporation
    Inventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
  • Patent number: 11254307
    Abstract: A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.
    Type: Grant
    Filed: October 11, 2019
    Date of Patent: February 22, 2022
    Assignee: Sony Corporation
    Inventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
  • Patent number: 11206388
    Abstract: A depth map generation unit generates a depth map from images obtained by picking up a subject at a plurality of viewpoint positions by an image pickup unit. On the basis of the depth map generated by the depth map generation unit, an alignment unit aligns polarized images obtained by the image pickup unit picking up the subject at the plurality of viewpoint positions through polarizing filters in different polarization direction at the different viewpoint positions. A polarization characteristic acquisition unit acquires a polarization characteristic of the subject from a desired viewpoint position by using the polarized images aligned by the alignment unit to obtain the high-precision polarization characteristic with little degradation in temporal resolution and spatial resolution. It becomes possible to acquire the polarization characteristic of the subject at the desired viewpoint position.
    Type: Grant
    Filed: October 28, 2015
    Date of Patent: December 21, 2021
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Yasutaka Hirasawa, Kengo Hayasaka
  • Publication number: 20210374906
    Abstract: A normal candidate information generation unit 31 of an information processor 30 generates normal candidate information for each pixel indicating, for example, a zenith angle, or an azimuth angle, or a zenith angle and an azimuth angle, on the basis of a polarization image in a plurality of polarization directions obtained by a polarization imaging unit 20. The in-plane pixel selection unit 32 selects a plurality of pixels indicating the plane to be observed in the polarization image. A normal calculation unit 33 calculates a normal of the plane to be observed on the basis of the normal candidate information of the pixels selected by the in-plane pixel selection unit 32.
    Type: Application
    Filed: February 18, 2019
    Publication date: December 2, 2021
    Inventors: LEGONG SUN, YASUTAKA HIRASAWA, YUHI KONDO, YING LU, TUO ZHUANG
  • Publication number: 20210281786
    Abstract: A polarization imaging section 20 includes polarized pixels in each of a plurality of polarization directions. The polarization imaging section 20 includes a polarizer. The polarization imaging section 20 outputs image signals of a polarized image to a defect detecting section 35 of an image processing section 30. In a case where a difference between a pixel value of a target polarized pixel generated by the polarization imaging section and a pixel value of the target polarized pixel estimated from polarization characteristics corresponding to pixel values of peripheral pixels in a polarization direction different from a polarization direction of the target polarized pixel is greater than a predetermined allowable range, the defect detecting section 35 determines that the target polarized pixel is a defective pixel. Therefore, it is possible to detect a defect of a pixel in the polarization imaging section that generates the polarized image.
    Type: Application
    Filed: June 13, 2017
    Publication date: September 9, 2021
    Inventors: TEPPEI KURITA, SHUN KAIZU, YUHI KONDO, YASUTAKA HIRASAWA
  • Publication number: 20210243437
    Abstract: A polarization imaging unit 20 acquires a polarized image including polarization pixels with a plurality of polarization directions. An information compression unit 40 sets reference image information based on polarized image information of reference polarization pixels with at least a plurality of polarization directions in the polarized image and generates difference information between the polarized image information of each of polarization pixels different from the reference polarization pixels in the polarized image and the reference image information. In addition, the information compression unit 40 reduces the amount of information of the difference information generated for each of the polarization pixels with the plurality of polarization directions to generate compressed image information including the reference image information and the difference information with the reduced amount of information.
    Type: Application
    Filed: June 6, 2019
    Publication date: August 5, 2021
    Applicant: SONY CORPORATION
    Inventors: Yuhi KONDO, Yasutaka HIRASAWA, Takefumi NAGUMO, Toshinori IHARA, Teppei KURITA, Legong SUN
  • Publication number: 20210201450
    Abstract: A polarization imaging unit 20 generates, as polarization information, a polarization image including pixels in a plurality of polarization directions. An interpolation processing unit 31 of an information processor 30 performs interpolation processing using the polarization image obtained from the polarization imaging unit 20, and generates a polarization image for each polarization method. A polarization degree calculation unit 32 calculates, for example, a polarization degree for each pixel as object surface information on the basis of the polarization image for each polarization method. A noise amount calculation unit 33 calculates a noise amount for each pixel on the basis of the polarization image for each polarization method and the like.
    Type: Application
    Filed: January 31, 2019
    Publication date: July 1, 2021
    Inventors: TEPPEI KURITA, SHUN KAIZU, YASUTAKA HIRASAWA, YUHI KONDO
  • Publication number: 20210174127
    Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness ? of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude ? of the polarization model on the basis of the calculated average brightness ?, pre-stored information regarding the zenith angle ? of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection.
    Type: Application
    Filed: October 12, 2018
    Publication date: June 10, 2021
    Inventors: HAJIME MIHARA, SHUN KAIZU, TEPPEI KURITA, YUHI KONDO, YASUTAKA HIRASAWA
  • Publication number: 20210166007
    Abstract: An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a prediction unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The prediction unit predicts an action of the target object on a basis of the estimated posture.
    Type: Application
    Filed: February 10, 2021
    Publication date: June 3, 2021
    Inventors: SUGURU AOKI, TAKETO AKAMA, HIDEKI OYAIZU, YASUTAKA HIRASAWA, YUHI KONDO
  • Publication number: 20210152748
    Abstract: A polarization imaging unit 20 acquires a polarization image using a lens. In a parameter storage unit 32 of an information processing unit 30, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit 33 of the information processing unit 30 corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit 32.
    Type: Application
    Filed: January 15, 2019
    Publication date: May 20, 2021
    Inventors: YING LU, YASUTAKA HIRASAWA, YUHI KONDO, TUO ZHUANG, LEGONG SUN
  • Patent number: 10949656
    Abstract: An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a prediction unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The prediction unit predicts an action of the target object on a basis of the estimated posture.
    Type: Grant
    Filed: August 25, 2016
    Date of Patent: March 16, 2021
    Assignee: SONY CORPORATION
    Inventors: Suguru Aoki, Taketo Akama, Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
  • Patent number: 10904503
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: January 26, 2021
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Shun Kaizu, Teppei Kurita, Tuo Zhuang, Yasutaka Hirasawa, Ying Lu
  • Patent number: 10848727
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Grant
    Filed: June 13, 2017
    Date of Patent: November 24, 2020
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Shun Kaizu, Teppei Kurita, Tuo Zhuang, Yasutaka Hirasawa, Ying Lu
  • Patent number: 10839248
    Abstract: A polarized image acquisition unit 20 acquires polarized images in a plurality of polarization directions. A reflection information generation unit 30 generates reflection information indicating reflection components from the polarized images in the plurality of polarization directions acquired by the polarized image acquisition unit 20. A reflection information using unit 40 uses the reflection information generated by the reflection information generation unit 30 to acquire an image of a viewed object appearing in the polarized images. A depth estimation unit estimates a depth value of a reflective surface area and acquires a position of the viewed object on the basis of an image of the viewed object appearing in the reflective surface area and the estimated depth value. Therefore, the viewed object positioned in, for example, an area of a blind spot can be easily checked.
    Type: Grant
    Filed: August 30, 2016
    Date of Patent: November 17, 2020
    Assignee: Sony Corporation
    Inventors: Yuhi Kondo, Yasutaka Hirasawa, Hideki Oyaizu, Taketo Akama, Suguru Aoki
  • Publication number: 20200359005
    Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit. A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
    Type: Application
    Filed: July 29, 2020
    Publication date: November 12, 2020
    Applicant: SONY CORPORATION
    Inventors: Yasutaka HIRASAWA, Yuhi KONDO, Ying LU, Ayaka NAKATANI