Patents by Inventor Yuhi Kondo

Yuhi Kondo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10798367
    Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
    Type: Grant
    Filed: December 8, 2015
    Date of Patent: October 6, 2020
    Assignee: SONY CORPORATION
    Inventors: Yasutaka Hirasawa, Yuhi Kondo, Ying Lu, Ayaka Nakatani
  • Patent number: 10769951
    Abstract: An image acquisition unit 341-1 acquires a polarization image and a non-polarization image indicating a peripheral area of a moving body, such as the peripheral area of a vehicle. A discrimination information generation unit 342-1 uses the polarization image acquired by the image acquisition unit 341-1 and generates analysis object discrimination information indicating a road surface or the like. An image analysis unit 344-1 uses an image of an image analysis area set on the basis of the analysis object discrimination information generated by the discrimination information generation unit 342-1 with respect to the non-polarization image acquired by the image acquisition unit 341-1, and performs a discrimination of an object, such as an obstacle on the road surface. It is possible to efficiently perform a determination of the presence of the object from the non-polarization image of the peripheral area of the moving body.
    Type: Grant
    Filed: August 30, 2016
    Date of Patent: September 8, 2020
    Assignee: Sony Corporation
    Inventors: Yasutaka Hirasawa, Hideki Oyaizu, Yuhi Kondo, Suguru Aoki, Taketo Akama
  • Patent number: 10750136
    Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light.
    Type: Grant
    Filed: August 28, 2017
    Date of Patent: August 18, 2020
    Assignee: SONY CORPORATION
    Inventors: Shun Kaizu, Yasutaka Hirasawa, Yuhi Kondo, Teppei Kurita, Ying Lu
  • Patent number: 10692379
    Abstract: An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a judgment unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The judgment unit judges a possibility of the target object slipping on the basis of the estimated posture.
    Type: Grant
    Filed: August 26, 2016
    Date of Patent: June 23, 2020
    Assignee: SONY CORPORATION
    Inventors: Suguru Aoki, Taketo Akama, Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
  • Publication number: 20200068182
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Application
    Filed: October 31, 2019
    Publication date: February 27, 2020
    Applicant: SONY CORPORATION
    Inventors: Yuhi KONDO, Shun KAIZU, Teppei KURITA, Tuo ZHUANG, Yasutaka HIRASAWA, Ying LU
  • Publication number: 20200039509
    Abstract: [Abstract] A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.
    Type: Application
    Filed: October 11, 2019
    Publication date: February 6, 2020
    Applicant: Sony Corporation
    Inventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
  • Patent number: 10529076
    Abstract: A normal-line information generation block 30 generates normal-line information for a frame subject to detection. A data storage block 50 stores normal-line information and the like of a key frame. A motion amount detection block 40 detects a motion amount of an imaging position of the frame subject to detection relative to an imaging position of the key frame on the basis of the normal-line information of the key frame stored in the data storage block 50 and the normal-line information of the frame subject to detection generated by the normal-line information generation block 30. Even if a positional difference of a same point is small or a luminance difference occurs between a taken image of the key frame and a taken image of a current frame, a motion amount of the imaging position of the frame subject to detection relative to the imaging position of the key frame can be accurately detected on the basis of normal-line information. Therefore, an observation position can be accurately detected.
    Type: Grant
    Filed: March 1, 2016
    Date of Patent: January 7, 2020
    Assignee: SONY CORPORATION
    Inventors: Ying Lu, Yasutaka Hirasawa, Yuhi Kondo, Ayaka Nakatani, Akihiko Kaino
  • Patent number: 10523873
    Abstract: The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image.
    Type: Grant
    Filed: September 9, 2016
    Date of Patent: December 31, 2019
    Assignee: SONY CORPORATION
    Inventors: Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
  • Patent number: 10464559
    Abstract: A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.
    Type: Grant
    Filed: August 18, 2016
    Date of Patent: November 5, 2019
    Assignee: Sony Corporation
    Inventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
  • Patent number: 10460422
    Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.
    Type: Grant
    Filed: September 9, 2016
    Date of Patent: October 29, 2019
    Assignee: SONY CORPORATION
    Inventors: Teppei Kurita, Shun Kaizu, Yuhi Kondo, Yasutaka Hirasawa, Ying Lu
  • Patent number: 10444617
    Abstract: A polarized image acquisition section 20 acquires a plurality of polarized images having different polarization directions. The polarized images show, for example, an input indicator for a user interface as a recognition target object. A normal line calculation section 30 calculates normal lines for individual pixels of the recognition target object in accordance with the polarized images acquired by the polarized image acquisition section 20. The normal lines represent information based on the three-dimensional shape of the recognition target object. A recognition section 40 recognizes the object by using the normal lines calculated by the normal line calculation section 30, determines, for example, the type, position, and posture of the input indicator, and outputs the result of determination as input information on the user interface. The object can be recognized easily and with high accuracy.
    Type: Grant
    Filed: March 1, 2016
    Date of Patent: October 15, 2019
    Assignee: SONY CORPORATION
    Inventors: Ayaka Nakatani, Yasutaka Hirasawa, Yuhi Kondo, Ying Lu
  • Patent number: 10413177
    Abstract: There is provided an eyeball observation device, which can stably detect a line of sight, the eyeball observation device including: at least one infrared light source configured to radiate polarized infrared light onto an eyeball of a user; and at least one imaging device configured to capture an image of the eyeball irradiated with the polarized infrared light and to be capable of simultaneously capturing a polarization image with at least three directions.
    Type: Grant
    Filed: July 14, 2016
    Date of Patent: September 17, 2019
    Assignee: SONY CORPORATION
    Inventors: Sayaka Watanabe, Yuhi Kondo
  • Publication number: 20190273856
    Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided.
    Type: Application
    Filed: October 26, 2017
    Publication date: September 5, 2019
    Inventors: YASUTAKA HIRASAWA, YUHI KONDO, HIDEKI OYAIZU, SHUN KAIZU, TEPPEI KURITA, TUO ZHUANG, YING LU, HAJIME MIHARA
  • Publication number: 20190260974
    Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light.
    Type: Application
    Filed: August 28, 2017
    Publication date: August 22, 2019
    Applicant: SONY CORPORATION
    Inventors: Shun KAIZU, Yasutaka HIRASAWA, Yuhi KONDO, Teppei KURITA, Ying LU
  • Patent number: 10366303
    Abstract: A polarization image acquisition unit (11) acquires polarization images of three or more polarization directions. A feature quantity computation unit (15) computes image feature quantities on the basis of the acquired polarization images. For example, the luminance of each polarization image is normalized for each pixel, and the normalized luminance of the polarization image is used as the image feature quantity. The luminance of the polarization image changes according to the surface shape of an object. Thus, the image feature quantities computed on the basis of the polarization images are feature quantities corresponding to the surface shape of the object. Image processing, for example, image recognition, feature point detection, feature point matching, or the like, can be performed on the basis of the surface shape of the object using such image feature quantities.
    Type: Grant
    Filed: November 17, 2014
    Date of Patent: July 30, 2019
    Assignee: SONY CORPORATION
    Inventor: Yuhi Kondo
  • Patent number: 10362280
    Abstract: An imaging unit 20 has a configuration in which an identical polarization pixel block made up of a plurality of pixels with an identical polarization direction is provided for each of a plurality of polarization directions and pixels of respective predetermined colors are provided in the identical polarization pixel block. A correction processing unit 31 performs correction processing such as white balance correction on a polarized image generated by the imaging unit 20. A polarized image processing unit 32 separates or extracts a reflection component using the polarized image after the correction processing. By using a polarized image of the separated or extracted reflection component, for example, it is possible to generate normal line information with high accuracy.
    Type: Grant
    Filed: December 8, 2015
    Date of Patent: July 23, 2019
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Yasutaka Hirasawa, Ying Lu, Ayaka Nakatani
  • Publication number: 20190166342
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Application
    Filed: June 13, 2017
    Publication date: May 30, 2019
    Applicant: SONY CORPORATION
    Inventors: Yuhi KONDO, Shun KAIZU, Teppei KURITA, Tuo ZHUANG, Yasutaka HIRASAWA, Ying LU
  • Publication number: 20180359401
    Abstract: The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image.
    Type: Application
    Filed: September 9, 2016
    Publication date: December 13, 2018
    Applicant: SONY CORPORATION
    Inventors: HIDEKI OYAIZU, YASUTAKA HIRASAWA, YUHI KONDO
  • Publication number: 20180308217
    Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.
    Type: Application
    Filed: September 9, 2016
    Publication date: October 25, 2018
    Applicant: SONY CORPORATION
    Inventors: Teppei KURITA, Shun KAIZU, Yuhi KONDO, Yasutaka HIRASAWA, Ying LU
  • Publication number: 20180301032
    Abstract: An image acquisition unit 341-1 acquires a polarization image and a non-polarization image indicating a peripheral area of a moving body, such as the peripheral area of a vehicle. A discrimination information generation unit 342-1 uses the polarization image acquired by the image acquisition unit 341-1 and generates analysis object discrimination information indicating a road surface or the like. An image analysis unit 344-1 uses an image of an image analysis area set on the basis of the analysis object discrimination information generated by the discrimination information generation unit 342-1 with respect to the non-polarization image acquired by the image acquisition unit 341-1, and performs a discrimination of an object, such as an obstacle on the road surface. It is possible to efficiently perform a determination of the presence of the object from the non-polarization image of the peripheral area of the moving body.
    Type: Application
    Filed: August 30, 2016
    Publication date: October 18, 2018
    Applicant: Sony Corporation
    Inventors: Yasutaka Hirasawa, Hideki Oyaizu, Yuhi Kondo, Suguru Aoki, Taketo Akama