Patents by Inventor Yasutaka Hirasawa

Yasutaka Hirasawa has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10904503
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: January 26, 2021
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Shun Kaizu, Teppei Kurita, Tuo Zhuang, Yasutaka Hirasawa, Ying Lu
  • Patent number: 10848727
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Grant
    Filed: June 13, 2017
    Date of Patent: November 24, 2020
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Shun Kaizu, Teppei Kurita, Tuo Zhuang, Yasutaka Hirasawa, Ying Lu
  • Patent number: 10839248
    Abstract: A polarized image acquisition unit 20 acquires polarized images in a plurality of polarization directions. A reflection information generation unit 30 generates reflection information indicating reflection components from the polarized images in the plurality of polarization directions acquired by the polarized image acquisition unit 20. A reflection information using unit 40 uses the reflection information generated by the reflection information generation unit 30 to acquire an image of a viewed object appearing in the polarized images. A depth estimation unit estimates a depth value of a reflective surface area and acquires a position of the viewed object on the basis of an image of the viewed object appearing in the reflective surface area and the estimated depth value. Therefore, the viewed object positioned in, for example, an area of a blind spot can be easily checked.
    Type: Grant
    Filed: August 30, 2016
    Date of Patent: November 17, 2020
    Assignee: Sony Corporation
    Inventors: Yuhi Kondo, Yasutaka Hirasawa, Hideki Oyaizu, Taketo Akama, Suguru Aoki
  • Publication number: 20200359005
    Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit. A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
    Type: Application
    Filed: July 29, 2020
    Publication date: November 12, 2020
    Applicant: SONY CORPORATION
    Inventors: Yasutaka HIRASAWA, Yuhi KONDO, Ying LU, Ayaka NAKATANI
  • Publication number: 20200350353
    Abstract: An unpolarized component image generating section 32-1 generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section 33-1 generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section 34-1 detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions.
    Type: Application
    Filed: September 18, 2018
    Publication date: November 5, 2020
    Inventors: TEPPEI KURITA, YING LU, YUHI KONDO, YASUTAKA HIRASAWA
  • Patent number: 10812735
    Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: October 20, 2020
    Assignee: SONY CORPORATION
    Inventors: Yasutaka Hirasawa, Yuhi Kondo, Hideki Oyaizu, Shun Kaizu, Teppei Kurita, Tuo Zhuang, Ying Lu, Hajime Mihara
  • Patent number: 10798367
    Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
    Type: Grant
    Filed: December 8, 2015
    Date of Patent: October 6, 2020
    Assignee: SONY CORPORATION
    Inventors: Yasutaka Hirasawa, Yuhi Kondo, Ying Lu, Ayaka Nakatani
  • Patent number: 10793149
    Abstract: A control apparatus includes an input unit and a control unit. To the input unit, a pickup image of a camera provided to an own vehicle is input. The control unit detects a mirror provided to a different vehicle that exists in front of the own vehicle from the input pickup image, detects a person from a mirror image of the detected mirror, and recognizes a state of the person from an image of the detected person. Further, the control unit performs an alerting process or a control process for the own vehicle to prevent an accident of the own vehicle or the different vehicle in accordance with the recognized state of the person.
    Type: Grant
    Filed: September 5, 2016
    Date of Patent: October 6, 2020
    Assignee: Sony Corporation
    Inventors: Taketo Akama, Suguru Aoki, Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
  • Patent number: 10769951
    Abstract: An image acquisition unit 341-1 acquires a polarization image and a non-polarization image indicating a peripheral area of a moving body, such as the peripheral area of a vehicle. A discrimination information generation unit 342-1 uses the polarization image acquired by the image acquisition unit 341-1 and generates analysis object discrimination information indicating a road surface or the like. An image analysis unit 344-1 uses an image of an image analysis area set on the basis of the analysis object discrimination information generated by the discrimination information generation unit 342-1 with respect to the non-polarization image acquired by the image acquisition unit 341-1, and performs a discrimination of an object, such as an obstacle on the road surface. It is possible to efficiently perform a determination of the presence of the object from the non-polarization image of the peripheral area of the moving body.
    Type: Grant
    Filed: August 30, 2016
    Date of Patent: September 8, 2020
    Assignee: Sony Corporation
    Inventors: Yasutaka Hirasawa, Hideki Oyaizu, Yuhi Kondo, Suguru Aoki, Taketo Akama
  • Patent number: 10750136
    Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light.
    Type: Grant
    Filed: August 28, 2017
    Date of Patent: August 18, 2020
    Assignee: SONY CORPORATION
    Inventors: Shun Kaizu, Yasutaka Hirasawa, Yuhi Kondo, Teppei Kurita, Ying Lu
  • Publication number: 20200204729
    Abstract: In an image capturing unit 20, an imaging element has a 4X4-pixel area in which: pixels including at least one pixel of every color component of a plurality of color components are polarization pixels of the same polarization direction; and pixels which are not the polarization pixels constitute a majority of the 4X4-pixel area, and are non-polarization pixels. The unpolarized component calculating unit 31 of the image processing unit 30 calculates unpolarized components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20. The diffuse reflection component calculating unit 32 calculates diffuse reflection components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20.
    Type: Application
    Filed: April 9, 2018
    Publication date: June 25, 2020
    Inventors: TEPPEI KURITA, SHUN KAIZU, YASUTAKA HIRASAWA
  • Publication number: 20200204766
    Abstract: An image projection apparatus 20 performs spatial light modulation on unpolarized light indicating a projected image, generates projection light set into a polarization state based on a superimposed image, and projects the projection light onto a surface of projection 50. An image processing apparatus 40 calculates each direction of polarization in units of pixels using polarization images in at least three or more directions of polarization acquired by imaging the surface of projection 50 onto which the projection light is projected. Furthermore, the image processing apparatus 40 converts the calculated direction of polarization into a pixel value, and generates a reconstructed image. It is, therefore, possible to generate the projection light indicating the superimposed image invisibly superimposed on the projected image, and to visibly reconstruct the superimposed image from a captured image of the surface of projection onto which the projection light is projected.
    Type: Application
    Filed: April 9, 2018
    Publication date: June 25, 2020
    Inventor: YASUTAKA HIRASAWA
  • Patent number: 10692379
    Abstract: An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a judgment unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The judgment unit judges a possibility of the target object slipping on the basis of the estimated posture.
    Type: Grant
    Filed: August 26, 2016
    Date of Patent: June 23, 2020
    Assignee: SONY CORPORATION
    Inventors: Suguru Aoki, Taketo Akama, Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
  • Publication number: 20200068182
    Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.
    Type: Application
    Filed: October 31, 2019
    Publication date: February 27, 2020
    Applicant: SONY CORPORATION
    Inventors: Yuhi KONDO, Shun KAIZU, Teppei KURITA, Tuo ZHUANG, Yasutaka HIRASAWA, Ying LU
  • Patent number: 10574972
    Abstract: A depth map generation unit (15) generates a depth map through a matching process using a first image generated by a first imaging unit which has a pixel configuration including pixels having different polarization directions and a second image generated by a second imaging unit which has a different pixel configuration from the pixel configuration of the first imaging unit. A normal-line map generation unit (17) generates a normal-line map based on a polarization state of a polarized image of at least one of the first and second images. A map unifying unit (19) performs a process of unifying the generated depth map and the generated normal-line map and acquires an image in which the number of pixels is not reduced while generating the depth map with precision equal to or greater than the generated depth map. The image in which the number of pixels is not reduced can be acquired while generating the highly precise depth map.
    Type: Grant
    Filed: November 17, 2014
    Date of Patent: February 25, 2020
    Assignee: SONY CORPORATION
    Inventor: Yasutaka Hirasawa
  • Publication number: 20200039509
    Abstract: [Abstract] A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.
    Type: Application
    Filed: October 11, 2019
    Publication date: February 6, 2020
    Applicant: Sony Corporation
    Inventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
  • Patent number: 10529076
    Abstract: A normal-line information generation block 30 generates normal-line information for a frame subject to detection. A data storage block 50 stores normal-line information and the like of a key frame. A motion amount detection block 40 detects a motion amount of an imaging position of the frame subject to detection relative to an imaging position of the key frame on the basis of the normal-line information of the key frame stored in the data storage block 50 and the normal-line information of the frame subject to detection generated by the normal-line information generation block 30. Even if a positional difference of a same point is small or a luminance difference occurs between a taken image of the key frame and a taken image of a current frame, a motion amount of the imaging position of the frame subject to detection relative to the imaging position of the key frame can be accurately detected on the basis of normal-line information. Therefore, an observation position can be accurately detected.
    Type: Grant
    Filed: March 1, 2016
    Date of Patent: January 7, 2020
    Assignee: SONY CORPORATION
    Inventors: Ying Lu, Yasutaka Hirasawa, Yuhi Kondo, Ayaka Nakatani, Akihiko Kaino
  • Patent number: 10523873
    Abstract: The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image.
    Type: Grant
    Filed: September 9, 2016
    Date of Patent: December 31, 2019
    Assignee: SONY CORPORATION
    Inventors: Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
  • Patent number: 10464559
    Abstract: A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.
    Type: Grant
    Filed: August 18, 2016
    Date of Patent: November 5, 2019
    Assignee: Sony Corporation
    Inventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
  • Patent number: 10460422
    Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.
    Type: Grant
    Filed: September 9, 2016
    Date of Patent: October 29, 2019
    Assignee: SONY CORPORATION
    Inventors: Teppei Kurita, Shun Kaizu, Yuhi Kondo, Yasutaka Hirasawa, Ying Lu