Patents by Inventor Yuhi Kondo

Yuhi Kondo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240129642
    Abstract: The achromatic region extraction unit calculates achromatic determination information for each color component of the color polarized image using the polarization information acquired from the color polarized image, and extracts a region satisfying a condition that the achromatic determination information is achromatic as an achromatic region. The gain setting unit sets the white balance gain used in the white balance adjustment of the color polarized image on the basis of the white balance gain with which the achromatic region extracted by the achromatic region extraction unit becomes achromatic. For example, the gain setting unit sets the white balance gain for the entire color polarized image on the basis of the white balance gain of the achromatic region, or sets the white balance gain of a region different from the achromatic region on the basis of the white balance gains of a plurality of achromatic regions.
    Type: Application
    Filed: January 4, 2022
    Publication date: April 18, 2024
    Applicant: Sony Group Corporation
    Inventors: Taishi ONO, Yuhi KONDO, Legong SUN
  • Patent number: 11930160
    Abstract: A polarization imaging unit 20 acquires a polarized image including polarization pixels with a plurality of polarization directions. An information compression unit 40 sets reference image information based on polarized image information of reference polarization pixels with at least a plurality of polarization directions in the polarized image and generates difference information between the polarized image information of each of polarization pixels different from the reference polarization pixels in the polarized image and the reference image information. In addition, the information compression unit 40 reduces the amount of information of the difference information generated for each of the polarization pixels with the plurality of polarization directions to generate compressed image information including the reference image information and the difference information with the reduced amount of information.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: March 12, 2024
    Assignee: SONY CORPORATION
    Inventors: Yuhi Kondo, Yasutaka Hirasawa, Takefumi Nagumo, Toshinori Ihara, Teppei Kurita, Legong Sun
  • Patent number: 11915522
    Abstract: An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a prediction unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The prediction unit predicts an action of the target object on a basis of the estimated posture.
    Type: Grant
    Filed: February 10, 2021
    Date of Patent: February 27, 2024
    Assignee: SONY CORPORATION
    Inventors: Suguru Aoki, Taketo Akama, Hideki Oyaizu, Yasutaka Hirasawa, Yuhi Kondo
  • Publication number: 20230410457
    Abstract: A polarized imaging unit 20 captures time-series polarized images of an object. A polarization information calculating unit 30 calculates polarization information for each polarized image from the time-series polarized images captured by the polarized imaging unit 20. An object specifying unit 50 specifies the image region of the object on the basis of, for example, a non-polarized image generated by a non-polarized image generating unit 40 on the basis of the polarized image. A state-change detecting unit 60 detects a state change of the object on the basis of a time series change of the polarization information in the image region of the object specified by the object specifying unit 50. An output unit 70 outputs the detection result of a state change such that the detection result is associated with the non-polarized image generated by the non-polarized image generating unit 40, the detection result being obtained by the state-change detecting unit 60. A state change of the object can be easily detected.
    Type: Application
    Filed: September 16, 2021
    Publication date: December 21, 2023
    Inventors: YUHI KONDO, TAISHI ONO, LEGONG SUN
  • Publication number: 20230410464
    Abstract: A black-and-white polarized image acquirer 21 of an image acquirer 20 acquires a black-and-white polarized image, and a color image acquirer 22 acquires a color image. A reflection-removed image generator 40 calculates characteristic information related to black-and-white reflection removal results generated based on a black-and-white polarized image. For example, the reflection-removed image generator calculates information indicating a relationship between the black-and-white polarized image and an average luminance calculated from an image for each polarization direction in the black-and-white polarized image, or information used for obtaining the black-and-white reflection removal results from the black-and-white polarized image. The reflection-removed image generator 40 generates a reflection-removed color image in which specular reflection is removed from the color image using the calculated characteristic information or the optimized characteristic information.
    Type: Application
    Filed: October 19, 2021
    Publication date: December 21, 2023
    Inventors: TAISHI ONO, YUHI KONDO, LEGONG SUN
  • Patent number: 11847762
    Abstract: A polarization imaging unit generates, as polarization information, a polarization image including pixels in a plurality of polarization directions. An interpolation processing unit of an information processor performs interpolation processing using the polarization image obtained from the polarization imaging unit, and generates a polarization image for each polarization method. A polarization degree calculation unit calculates, for example, a polarization degree for each pixel as object surface information on the basis of the polarization image for each polarization method. A noise amount calculation unit calculates a noise amount for each pixel on the basis of the polarization image for each polarization method and the like.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: December 19, 2023
    Assignee: SONY CORPORATION
    Inventors: Teppei Kurita, Shun Kaizu, Yasutaka Hirasawa, Yuhi Kondo
  • Publication number: 20230316708
    Abstract: A birefringence imaging unit 20 has a birefringent material and a polarized imaging unit, and the polarized imaging unit generates polarized images based on subject light incident through a birefringent material. The parallax image generator 30 separates images with different polarization angles using the polarized images generated by the polarized imaging unit of the birefringence imaging unit 20, and generates an ordinary ray image and an extraordinary ray image as parallax images. The distance measuring unit 40 calculates a distance to a distance measurement position based on a parallax of the distance measurement position of the subject in the ordinary ray image and the extraordinary ray image generated by the parallax image generator 30. By using polarized images, it is possible to measure distances in portions other than edges, and distance information with high resolution can be obtained more easily than when measuring distances by matching corresponding points in edge images.
    Type: Application
    Filed: October 19, 2021
    Publication date: October 5, 2023
    Inventors: LEGONG SUN, YUHI KONDO, TAISHI ONO
  • Patent number: 11772644
    Abstract: A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.
    Type: Grant
    Filed: January 6, 2022
    Date of Patent: October 3, 2023
    Assignee: Sony Group Corporation
    Inventors: Hideki Oyaizu, Yuhi Kondo, Yasutaka Hirasawa, Suguru Aoki, Taketo Akama
  • Patent number: 11758290
    Abstract: The invalid pixel detection unit 32 detects an invalid pixel from a non-polarized image and a plurality of polarized images for different polarization directions obtained by performing image pickup using the polarization image pickup unit 20. For example, the invalid pixel detection unit 32 detects a saturated pixel having a pixel value larger than a preset saturation detection threshold and a black-crushed pixel having a pixel value smaller than a preset black crushing detection threshold as invalid pixels from a non-polarized image. The polarization information generation unit 33 performs processing of generating polarization information on the basis of the non-polarized image and polarized images and switches the processing of generating the polarization information depending on the detection result of the invalid pixels in the invalid pixel detection unit 32, so as to generate the polarization information without using the invalid pixels. Correct polarization information can be acquired.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: September 12, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Yasutaka Hirasawa, Yuhi Kondo, Legong Sun, Taishi Ono
  • Publication number: 20230244929
    Abstract: The present technology relates to a learning device, a generation method, an inference device, an inference method, and a program that enable learning data suitable for learning to be selected without a manual operation and enable learning of an inference model to be efficiently performed by using the selected learning data. In a learning device according to one aspect of the present technology, on the basis of a learning data group including learning data having a correct answer and a processing target data group including processing target data for learning, the processing target data for learning having no correct answer and corresponding to data to be processed at the time of inference, the learning device selects, from the learning data group, the learning data suitable for learning of an inference model used at the time of inference, and outputs the selected learning data together with the inference model obtained by performing learning using the selected learning data.
    Type: Application
    Filed: May 7, 2021
    Publication date: August 3, 2023
    Inventors: YUHI KONDO, LEGONG SUN, TAISHI ONO, YASUTAKA HIRASAWA
  • Publication number: 20230239580
    Abstract: A same region detector detects a same region of a processing target for each of a plurality of different viewpoints from polarization images in a plurality of polarization directions acquired for each of the viewpoints. The polarization images in the plurality of polarization directions acquired for each of the plurality of different viewpoints are, for example, polarization images acquired by imaging over a period of a plurality of frames in which a positional relationship between the processing target and a polarization image acquisition unit that acquires the polarization images changes. A polarization degree calculation unit calculates a polarization degree of the same region for each of the viewpoints on the basis of the polarization images in the plurality of polarization directions.
    Type: Application
    Filed: May 13, 2021
    Publication date: July 27, 2023
    Inventors: YASUTAKA HIRASAWA, YUHI KONDO, LEGONG SUN, TAISHI ONO
  • Publication number: 20230196534
    Abstract: A polarization rendering setting unit 30 sets a plurality of parameters to be used for generating a polarized rendered image of an abnormality detection target. A polarized rendered image generation unit 40 generates the polarized rendered image of the abnormality detection target on the basis of the parameters set by the polarization rendering setting unit 30. An abnormality detection unit 50 detects an abnormal region of the abnormality detection target on the basis of a difference between a polarized captured image acquired by imaging the abnormality detection target and the polarized rendered image generated by the polarized rendered image generation unit 40. Abnormalities that are difficult to detect on the basis of luminance information and color information becomes able to be detected on the basis of polarized images.
    Type: Application
    Filed: March 30, 2021
    Publication date: June 22, 2023
    Inventors: LEGONG SUN, YASUTAKA HIRASAWA, YUHI KONDO, TAISHI ONO
  • Patent number: 11676245
    Abstract: A normal candidate information generation unit of an information processor generates normal candidate information for each pixel indicating, for example, a zenith angle, or an azimuth angle, or a zenith angle and an azimuth angle, on the basis of a polarization image in a plurality of polarization directions obtained by a polarization imaging unit. The in-plane pixel selection unit selects a plurality of pixels indicating the plane to be observed in the polarization image. A normal calculation unit calculates a normal of the plane to be observed on the basis of the normal candidate information of the pixels selected by the in-plane pixel selection unit.
    Type: Grant
    Filed: February 18, 2019
    Date of Patent: June 13, 2023
    Assignee: SONY CORPORATION
    Inventors: Legong Sun, Yasutaka Hirasawa, Yuhi Kondo, Ying Lu, Tuo Zhuang
  • Patent number: 11663831
    Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness ? of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude ? of the polarization model on the basis of the calculated average brightness ?, pre-stored information regarding the zenith angle ? of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection.
    Type: Grant
    Filed: October 12, 2018
    Date of Patent: May 30, 2023
    Assignee: SONY CORPORATION
    Inventors: Hajime Mihara, Shun Kaizu, Teppei Kurita, Yuhi Kondo, Yasutaka Hirasawa
  • Patent number: 11637967
    Abstract: Provided is a polarization imaging unit that acquires a polarization image using a lens. In a parameter storage unit of an information processing unit, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit of the information processing unit corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit.
    Type: Grant
    Filed: January 15, 2019
    Date of Patent: April 25, 2023
    Assignee: SONY CORPORATION
    Inventors: Ying Lu, Yasutaka Hirasawa, Yuhi Kondo, Tuo Zhuang, Legong Sun
  • Patent number: 11605661
    Abstract: An unpolarized component image generating section generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions.
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: March 14, 2023
    Assignee: SONY CORPORATION
    Inventors: Teppei Kurita, Ying Lu, Yuhi Kondo, Yasutaka Hirasawa
  • Publication number: 20230053038
    Abstract: The invalid pixel detection unit 32 detects an invalid pixel from a non-polarized image and a plurality of polarized images for different polarization directions obtained by performing image pickup using the polarization image pickup unit 20. For example, the invalid pixel detection unit 32 detects a saturated pixel having a pixel value larger than a preset saturation detection threshold and a black-crushed pixel having a pixel value smaller than a preset black crushing detection threshold as invalid pixels from a non-polarized image. The polarization information generation unit 33 performs processing of generating polarization information on the basis of the non-polarized image and polarized images and switches the processing of generating the polarization information depending on the detection result of the invalid pixels in the invalid pixel detection unit 32, so as to generate the polarization information without using the invalid pixels. Correct polarization information can be acquired.
    Type: Application
    Filed: December 18, 2020
    Publication date: February 16, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Yasutaka HIRASAWA, Yuhi KONDO, Legong SUN, Taishi ONO
  • Publication number: 20230003583
    Abstract: A quantization range setting unit (31) of an encoder (30) sets a quantization range for each Stokes parameter of a Stokes vector acquired from a Stokes vector calculation unit (20). The quantization range is set for the Stokes parameter indicating intensity, and is then set for the other Stokes parameters. A quantization unit (32) calculates the Stokes parameter indicating intensity as a predetermined quantization bit number, and calculates the quantization bit numbers of the other Stokes parameters on the basis of the predetermined quantization bit number and the quantization ranges set for the respective Stokes parameters. The quantization unit (32) performs a quantization process on the Stokes parameters on the basis of the quantization ranges and the quantization bit numbers, to generate quantized polarization information. A decoder (40) performs inverse quantization compatible with the encoder 30 on the quantized polarization information, and generates the Stokes vectors before quantization.
    Type: Application
    Filed: November 30, 2020
    Publication date: January 5, 2023
    Inventors: LEGONG SUN, YASUTAKA HIRASAWA, YUHI KONDO, TAISHI ONO
  • Patent number: 11405603
    Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit. A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
    Type: Grant
    Filed: July 29, 2020
    Date of Patent: August 2, 2022
    Assignee: SONY CORPORATION
    Inventors: Yasutaka Hirasawa, Yuhi Kondo, Ying Lu, Ayaka Nakatani
  • Publication number: 20220210322
    Abstract: An imaging apparatus (10) includes an imaging unit (11) that has a first pixel block and a second pixel block provided in a pixel region, the first pixel block including polarization pixels with two different polarization directions and a non-polarization pixel, the second pixel block including polarization pixels with a plurality of polarization directions including a different polarization direction from the first pixel block. An image processing apparatus (20) acquires a captured image generated by the imaging apparatus (10), and a correction coefficient calculation unit (40) calculates a correction coefficient that absorbs a sensitivity difference between polarization pixels and non-polarization pixels, on the basis of an image of the second pixel block.
    Type: Application
    Filed: February 7, 2020
    Publication date: June 30, 2022
    Inventors: YASUTAKA HIRASAWA, YUHI KONDO, LEGONG SUN, TAISHI ONO