Patents by Inventor Yuhi Kondo
Yuhi Kondo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10798367Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.Type: GrantFiled: December 8, 2015Date of Patent: October 6, 2020Assignee: SONY CORPORATIONInventors: Yasutaka Hirasawa, Yuhi Kondo, Ying Lu, Ayaka Nakatani
-
Patent number: 10769951Abstract: An image acquisition unit 341-1 acquires a polarization image and a non-polarization image indicating a peripheral area of a moving body, such as the peripheral area of a vehicle. A discrimination information generation unit 342-1 uses the polarization image acquired by the image acquisition unit 341-1 and generates analysis object discrimination information indicating a road surface or the like. An image analysis unit 344-1 uses an image of an image analysis area set on the basis of the analysis object discrimination information generated by the discrimination information generation unit 342-1 with respect to the non-polarization image acquired by the image acquisition unit 341-1, and performs a discrimination of an object, such as an obstacle on the road surface. It is possible to efficiently perform a determination of the presence of the object from the non-polarization image of the peripheral area of the moving body.Type: GrantFiled: August 30, 2016Date of Patent: September 8, 2020Assignee: Sony CorporationInventors: Yasutaka Hirasawa, Hideki Oyaizu, Yuhi Kondo, Suguru Aoki, Taketo Akama
-
Patent number: 10750136Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light.Type: GrantFiled: August 28, 2017Date of Patent: August 18, 2020Assignee: SONY CORPORATIONInventors: Shun Kaizu, Yasutaka Hirasawa, Yuhi Kondo, Teppei Kurita, Ying Lu
-
Patent number: 10692379Abstract: An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a judgment unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The judgment unit judges a possibility of the target object slipping on the basis of the estimated posture.Type: GrantFiled: August 26, 2016Date of Patent: June 23, 2020Assignee: SONY CORPORATIONInventors: Suguru Aoki, Taketo Akama, Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
-
Publication number: 20200068182Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.Type: ApplicationFiled: October 31, 2019Publication date: February 27, 2020Applicant: SONY CORPORATIONInventors: Yuhi KONDO, Shun KAIZU, Teppei KURITA, Tuo ZHUANG, Yasutaka HIRASAWA, Ying LU
-
Publication number: 20200039509Abstract: [Abstract] A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.Type: ApplicationFiled: October 11, 2019Publication date: February 6, 2020Applicant: Sony CorporationInventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
-
Patent number: 10529076Abstract: A normal-line information generation block 30 generates normal-line information for a frame subject to detection. A data storage block 50 stores normal-line information and the like of a key frame. A motion amount detection block 40 detects a motion amount of an imaging position of the frame subject to detection relative to an imaging position of the key frame on the basis of the normal-line information of the key frame stored in the data storage block 50 and the normal-line information of the frame subject to detection generated by the normal-line information generation block 30. Even if a positional difference of a same point is small or a luminance difference occurs between a taken image of the key frame and a taken image of a current frame, a motion amount of the imaging position of the frame subject to detection relative to the imaging position of the key frame can be accurately detected on the basis of normal-line information. Therefore, an observation position can be accurately detected.Type: GrantFiled: March 1, 2016Date of Patent: January 7, 2020Assignee: SONY CORPORATIONInventors: Ying Lu, Yasutaka Hirasawa, Yuhi Kondo, Ayaka Nakatani, Akihiko Kaino
-
Patent number: 10523873Abstract: The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image.Type: GrantFiled: September 9, 2016Date of Patent: December 31, 2019Assignee: SONY CORPORATIONInventors: Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
-
Patent number: 10464559Abstract: A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.Type: GrantFiled: August 18, 2016Date of Patent: November 5, 2019Assignee: Sony CorporationInventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
-
Patent number: 10460422Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.Type: GrantFiled: September 9, 2016Date of Patent: October 29, 2019Assignee: SONY CORPORATIONInventors: Teppei Kurita, Shun Kaizu, Yuhi Kondo, Yasutaka Hirasawa, Ying Lu
-
Patent number: 10444617Abstract: A polarized image acquisition section 20 acquires a plurality of polarized images having different polarization directions. The polarized images show, for example, an input indicator for a user interface as a recognition target object. A normal line calculation section 30 calculates normal lines for individual pixels of the recognition target object in accordance with the polarized images acquired by the polarized image acquisition section 20. The normal lines represent information based on the three-dimensional shape of the recognition target object. A recognition section 40 recognizes the object by using the normal lines calculated by the normal line calculation section 30, determines, for example, the type, position, and posture of the input indicator, and outputs the result of determination as input information on the user interface. The object can be recognized easily and with high accuracy.Type: GrantFiled: March 1, 2016Date of Patent: October 15, 2019Assignee: SONY CORPORATIONInventors: Ayaka Nakatani, Yasutaka Hirasawa, Yuhi Kondo, Ying Lu
-
Patent number: 10413177Abstract: There is provided an eyeball observation device, which can stably detect a line of sight, the eyeball observation device including: at least one infrared light source configured to radiate polarized infrared light onto an eyeball of a user; and at least one imaging device configured to capture an image of the eyeball irradiated with the polarized infrared light and to be capable of simultaneously capturing a polarization image with at least three directions.Type: GrantFiled: July 14, 2016Date of Patent: September 17, 2019Assignee: SONY CORPORATIONInventors: Sayaka Watanabe, Yuhi Kondo
-
Publication number: 20190273856Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided.Type: ApplicationFiled: October 26, 2017Publication date: September 5, 2019Inventors: YASUTAKA HIRASAWA, YUHI KONDO, HIDEKI OYAIZU, SHUN KAIZU, TEPPEI KURITA, TUO ZHUANG, YING LU, HAJIME MIHARA
-
Publication number: 20190260974Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light.Type: ApplicationFiled: August 28, 2017Publication date: August 22, 2019Applicant: SONY CORPORATIONInventors: Shun KAIZU, Yasutaka HIRASAWA, Yuhi KONDO, Teppei KURITA, Ying LU
-
Patent number: 10366303Abstract: A polarization image acquisition unit (11) acquires polarization images of three or more polarization directions. A feature quantity computation unit (15) computes image feature quantities on the basis of the acquired polarization images. For example, the luminance of each polarization image is normalized for each pixel, and the normalized luminance of the polarization image is used as the image feature quantity. The luminance of the polarization image changes according to the surface shape of an object. Thus, the image feature quantities computed on the basis of the polarization images are feature quantities corresponding to the surface shape of the object. Image processing, for example, image recognition, feature point detection, feature point matching, or the like, can be performed on the basis of the surface shape of the object using such image feature quantities.Type: GrantFiled: November 17, 2014Date of Patent: July 30, 2019Assignee: SONY CORPORATIONInventor: Yuhi Kondo
-
Patent number: 10362280Abstract: An imaging unit 20 has a configuration in which an identical polarization pixel block made up of a plurality of pixels with an identical polarization direction is provided for each of a plurality of polarization directions and pixels of respective predetermined colors are provided in the identical polarization pixel block. A correction processing unit 31 performs correction processing such as white balance correction on a polarized image generated by the imaging unit 20. A polarized image processing unit 32 separates or extracts a reflection component using the polarized image after the correction processing. By using a polarized image of the separated or extracted reflection component, for example, it is possible to generate normal line information with high accuracy.Type: GrantFiled: December 8, 2015Date of Patent: July 23, 2019Assignee: SONY CORPORATIONInventors: Yuhi Kondo, Yasutaka Hirasawa, Ying Lu, Ayaka Nakatani
-
Publication number: 20190166342Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30.Type: ApplicationFiled: June 13, 2017Publication date: May 30, 2019Applicant: SONY CORPORATIONInventors: Yuhi KONDO, Shun KAIZU, Teppei KURITA, Tuo ZHUANG, Yasutaka HIRASAWA, Ying LU
-
Publication number: 20180359401Abstract: The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image.Type: ApplicationFiled: September 9, 2016Publication date: December 13, 2018Applicant: SONY CORPORATIONInventors: HIDEKI OYAIZU, YASUTAKA HIRASAWA, YUHI KONDO
-
Publication number: 20180308217Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.Type: ApplicationFiled: September 9, 2016Publication date: October 25, 2018Applicant: SONY CORPORATIONInventors: Teppei KURITA, Shun KAIZU, Yuhi KONDO, Yasutaka HIRASAWA, Ying LU
-
Publication number: 20180301032Abstract: An image acquisition unit 341-1 acquires a polarization image and a non-polarization image indicating a peripheral area of a moving body, such as the peripheral area of a vehicle. A discrimination information generation unit 342-1 uses the polarization image acquired by the image acquisition unit 341-1 and generates analysis object discrimination information indicating a road surface or the like. An image analysis unit 344-1 uses an image of an image analysis area set on the basis of the analysis object discrimination information generated by the discrimination information generation unit 342-1 with respect to the non-polarization image acquired by the image acquisition unit 341-1, and performs a discrimination of an object, such as an obstacle on the road surface. It is possible to efficiently perform a determination of the presence of the object from the non-polarization image of the peripheral area of the moving body.Type: ApplicationFiled: August 30, 2016Publication date: October 18, 2018Applicant: Sony CorporationInventors: Yasutaka Hirasawa, Hideki Oyaizu, Yuhi Kondo, Suguru Aoki, Taketo Akama