Patents by Inventor Legong Sun
Legong Sun has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250016460Abstract: White balance gain calculation processing and white balance adjustment are executed using polarization information acquired from a color polarized image. There are provided a polarization information acquisition unit configured to acquire polarization information from a color polarized image, a white balance gain calculation unit configured to calculate a white balance gain by using the acquired polarization information, and a white balance adjustment unit configured to execute white balance adjustment processing to which the calculated white balance gain is applied.Type: ApplicationFiled: October 25, 2022Publication date: January 9, 2025Inventors: TAISHI ONO, YUHI KONDO, LEGONG SUN, TEPPEI KURITA
-
Publication number: 20250005843Abstract: An information processing device (100) includes a control unit (130). The control unit (130) sets the number of samples of a light ray used in a case where a rendered image is generated by utilization of ray tracing. The control unit (130) uses the number of samples and generates the rendered image used as training data of machine learning. The control unit (130) adjusts the number of samples according to accuracy of a machine learning model of a case where the rendered image is learned as the training data and the number of samples used in generation of the rendered image.Type: ApplicationFiled: October 31, 2022Publication date: January 2, 2025Inventors: LEGONG SUN, YUHI KONDO, TAISHI ONO, TEPPEI KURITA
-
Publication number: 20240406577Abstract: A high-frequency image can be acquired at low computational cost at high speed. A polarization optical unit 20 separates incident light into first polarized light and second polarized light to perform optical low-pass filter processing on the first polarized light and combines the first polarized light subjected to the optical low-pass filter processing and the second polarized light not subjected to the optical low-pass filter processing to generate combined light. A polarization image acquisition unit 30 includes a first polarizing pixel that generates pixel information on the first polarization image and a second polarizing pixel that generates pixel information on the second polarization image on the basis of the combined light. An image processing unit 40 performs a difference computation between the first polarization image and the second polarization image acquired by the polarization image acquisition unit 30 to generates the high-frequency image.Type: ApplicationFiled: September 26, 2022Publication date: December 5, 2024Applicant: Sony Group CorporationInventors: Yuhi KONDO, Shun KAIZU, Eiji HIRATA, Teppei KURITA, Taishi ONO, Legong SUN
-
Patent number: 12088929Abstract: A same region detector detects a same region of a processing target for each of a plurality of different viewpoints from polarization images in a plurality of polarization directions acquired for each of the viewpoints. The polarization images in the plurality of polarization directions acquired for each of the plurality of different viewpoints are, for example, polarization images acquired by imaging over a period of a plurality of frames in which a positional relationship between the processing target and a polarization image acquisition unit that acquires the polarization images changes. A polarization degree calculation unit calculates a polarization degree of the same region for each of the viewpoints on the basis of the polarization images in the plurality of polarization directions.Type: GrantFiled: May 13, 2021Date of Patent: September 10, 2024Assignee: SONY GROUP CORPORATIONInventors: Yasutaka Hirasawa, Yuhi Kondo, Legong Sun, Taishi Ono
-
Patent number: 11997398Abstract: An imaging apparatus (10) includes an imaging unit (11) that has a first pixel block and a second pixel block provided in a pixel region, the first pixel block including polarization pixels with two different polarization directions and a non-polarization pixel, the second pixel block including polarization pixels with a plurality of polarization directions including a different polarization direction from the first pixel block. An image processing apparatus (20) acquires a captured image generated by the imaging apparatus (10), and a correction coefficient calculation unit (40) calculates a correction coefficient that absorbs a sensitivity difference between polarization pixels and non-polarization pixels, on the basis of an image of the second pixel block.Type: GrantFiled: February 7, 2020Date of Patent: May 28, 2024Assignee: SONY GROUP CORPORATIONInventors: Yasutaka Hirasawa, Yuhi Kondo, Legong Sun, Taishi Ono
-
Publication number: 20240129642Abstract: The achromatic region extraction unit calculates achromatic determination information for each color component of the color polarized image using the polarization information acquired from the color polarized image, and extracts a region satisfying a condition that the achromatic determination information is achromatic as an achromatic region. The gain setting unit sets the white balance gain used in the white balance adjustment of the color polarized image on the basis of the white balance gain with which the achromatic region extracted by the achromatic region extraction unit becomes achromatic. For example, the gain setting unit sets the white balance gain for the entire color polarized image on the basis of the white balance gain of the achromatic region, or sets the white balance gain of a region different from the achromatic region on the basis of the white balance gains of a plurality of achromatic regions.Type: ApplicationFiled: January 4, 2022Publication date: April 18, 2024Applicant: Sony Group CorporationInventors: Taishi ONO, Yuhi KONDO, Legong SUN
-
Patent number: 11930160Abstract: A polarization imaging unit 20 acquires a polarized image including polarization pixels with a plurality of polarization directions. An information compression unit 40 sets reference image information based on polarized image information of reference polarization pixels with at least a plurality of polarization directions in the polarized image and generates difference information between the polarized image information of each of polarization pixels different from the reference polarization pixels in the polarized image and the reference image information. In addition, the information compression unit 40 reduces the amount of information of the difference information generated for each of the polarization pixels with the plurality of polarization directions to generate compressed image information including the reference image information and the difference information with the reduced amount of information.Type: GrantFiled: June 6, 2019Date of Patent: March 12, 2024Assignee: SONY CORPORATIONInventors: Yuhi Kondo, Yasutaka Hirasawa, Takefumi Nagumo, Toshinori Ihara, Teppei Kurita, Legong Sun
-
Publication number: 20230410457Abstract: A polarized imaging unit 20 captures time-series polarized images of an object. A polarization information calculating unit 30 calculates polarization information for each polarized image from the time-series polarized images captured by the polarized imaging unit 20. An object specifying unit 50 specifies the image region of the object on the basis of, for example, a non-polarized image generated by a non-polarized image generating unit 40 on the basis of the polarized image. A state-change detecting unit 60 detects a state change of the object on the basis of a time series change of the polarization information in the image region of the object specified by the object specifying unit 50. An output unit 70 outputs the detection result of a state change such that the detection result is associated with the non-polarized image generated by the non-polarized image generating unit 40, the detection result being obtained by the state-change detecting unit 60. A state change of the object can be easily detected.Type: ApplicationFiled: September 16, 2021Publication date: December 21, 2023Inventors: YUHI KONDO, TAISHI ONO, LEGONG SUN
-
Publication number: 20230410464Abstract: A black-and-white polarized image acquirer 21 of an image acquirer 20 acquires a black-and-white polarized image, and a color image acquirer 22 acquires a color image. A reflection-removed image generator 40 calculates characteristic information related to black-and-white reflection removal results generated based on a black-and-white polarized image. For example, the reflection-removed image generator calculates information indicating a relationship between the black-and-white polarized image and an average luminance calculated from an image for each polarization direction in the black-and-white polarized image, or information used for obtaining the black-and-white reflection removal results from the black-and-white polarized image. The reflection-removed image generator 40 generates a reflection-removed color image in which specular reflection is removed from the color image using the calculated characteristic information or the optimized characteristic information.Type: ApplicationFiled: October 19, 2021Publication date: December 21, 2023Inventors: TAISHI ONO, YUHI KONDO, LEGONG SUN
-
Publication number: 20230316708Abstract: A birefringence imaging unit 20 has a birefringent material and a polarized imaging unit, and the polarized imaging unit generates polarized images based on subject light incident through a birefringent material. The parallax image generator 30 separates images with different polarization angles using the polarized images generated by the polarized imaging unit of the birefringence imaging unit 20, and generates an ordinary ray image and an extraordinary ray image as parallax images. The distance measuring unit 40 calculates a distance to a distance measurement position based on a parallax of the distance measurement position of the subject in the ordinary ray image and the extraordinary ray image generated by the parallax image generator 30. By using polarized images, it is possible to measure distances in portions other than edges, and distance information with high resolution can be obtained more easily than when measuring distances by matching corresponding points in edge images.Type: ApplicationFiled: October 19, 2021Publication date: October 5, 2023Inventors: LEGONG SUN, YUHI KONDO, TAISHI ONO
-
Patent number: 11758290Abstract: The invalid pixel detection unit 32 detects an invalid pixel from a non-polarized image and a plurality of polarized images for different polarization directions obtained by performing image pickup using the polarization image pickup unit 20. For example, the invalid pixel detection unit 32 detects a saturated pixel having a pixel value larger than a preset saturation detection threshold and a black-crushed pixel having a pixel value smaller than a preset black crushing detection threshold as invalid pixels from a non-polarized image. The polarization information generation unit 33 performs processing of generating polarization information on the basis of the non-polarized image and polarized images and switches the processing of generating the polarization information depending on the detection result of the invalid pixels in the invalid pixel detection unit 32, so as to generate the polarization information without using the invalid pixels. Correct polarization information can be acquired.Type: GrantFiled: December 18, 2020Date of Patent: September 12, 2023Assignee: SONY GROUP CORPORATIONInventors: Yasutaka Hirasawa, Yuhi Kondo, Legong Sun, Taishi Ono
-
Publication number: 20230244929Abstract: The present technology relates to a learning device, a generation method, an inference device, an inference method, and a program that enable learning data suitable for learning to be selected without a manual operation and enable learning of an inference model to be efficiently performed by using the selected learning data. In a learning device according to one aspect of the present technology, on the basis of a learning data group including learning data having a correct answer and a processing target data group including processing target data for learning, the processing target data for learning having no correct answer and corresponding to data to be processed at the time of inference, the learning device selects, from the learning data group, the learning data suitable for learning of an inference model used at the time of inference, and outputs the selected learning data together with the inference model obtained by performing learning using the selected learning data.Type: ApplicationFiled: May 7, 2021Publication date: August 3, 2023Inventors: YUHI KONDO, LEGONG SUN, TAISHI ONO, YASUTAKA HIRASAWA
-
Publication number: 20230239580Abstract: A same region detector detects a same region of a processing target for each of a plurality of different viewpoints from polarization images in a plurality of polarization directions acquired for each of the viewpoints. The polarization images in the plurality of polarization directions acquired for each of the plurality of different viewpoints are, for example, polarization images acquired by imaging over a period of a plurality of frames in which a positional relationship between the processing target and a polarization image acquisition unit that acquires the polarization images changes. A polarization degree calculation unit calculates a polarization degree of the same region for each of the viewpoints on the basis of the polarization images in the plurality of polarization directions.Type: ApplicationFiled: May 13, 2021Publication date: July 27, 2023Inventors: YASUTAKA HIRASAWA, YUHI KONDO, LEGONG SUN, TAISHI ONO
-
Publication number: 20230196534Abstract: A polarization rendering setting unit 30 sets a plurality of parameters to be used for generating a polarized rendered image of an abnormality detection target. A polarized rendered image generation unit 40 generates the polarized rendered image of the abnormality detection target on the basis of the parameters set by the polarization rendering setting unit 30. An abnormality detection unit 50 detects an abnormal region of the abnormality detection target on the basis of a difference between a polarized captured image acquired by imaging the abnormality detection target and the polarized rendered image generated by the polarized rendered image generation unit 40. Abnormalities that are difficult to detect on the basis of luminance information and color information becomes able to be detected on the basis of polarized images.Type: ApplicationFiled: March 30, 2021Publication date: June 22, 2023Inventors: LEGONG SUN, YASUTAKA HIRASAWA, YUHI KONDO, TAISHI ONO
-
Patent number: 11676245Abstract: A normal candidate information generation unit of an information processor generates normal candidate information for each pixel indicating, for example, a zenith angle, or an azimuth angle, or a zenith angle and an azimuth angle, on the basis of a polarization image in a plurality of polarization directions obtained by a polarization imaging unit. The in-plane pixel selection unit selects a plurality of pixels indicating the plane to be observed in the polarization image. A normal calculation unit calculates a normal of the plane to be observed on the basis of the normal candidate information of the pixels selected by the in-plane pixel selection unit.Type: GrantFiled: February 18, 2019Date of Patent: June 13, 2023Assignee: SONY CORPORATIONInventors: Legong Sun, Yasutaka Hirasawa, Yuhi Kondo, Ying Lu, Tuo Zhuang
-
Patent number: 11637967Abstract: Provided is a polarization imaging unit that acquires a polarization image using a lens. In a parameter storage unit of an information processing unit, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit of the information processing unit corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit.Type: GrantFiled: January 15, 2019Date of Patent: April 25, 2023Assignee: SONY CORPORATIONInventors: Ying Lu, Yasutaka Hirasawa, Yuhi Kondo, Tuo Zhuang, Legong Sun
-
Publication number: 20230053038Abstract: The invalid pixel detection unit 32 detects an invalid pixel from a non-polarized image and a plurality of polarized images for different polarization directions obtained by performing image pickup using the polarization image pickup unit 20. For example, the invalid pixel detection unit 32 detects a saturated pixel having a pixel value larger than a preset saturation detection threshold and a black-crushed pixel having a pixel value smaller than a preset black crushing detection threshold as invalid pixels from a non-polarized image. The polarization information generation unit 33 performs processing of generating polarization information on the basis of the non-polarized image and polarized images and switches the processing of generating the polarization information depending on the detection result of the invalid pixels in the invalid pixel detection unit 32, so as to generate the polarization information without using the invalid pixels. Correct polarization information can be acquired.Type: ApplicationFiled: December 18, 2020Publication date: February 16, 2023Applicant: SONY GROUP CORPORATIONInventors: Yasutaka HIRASAWA, Yuhi KONDO, Legong SUN, Taishi ONO
-
Publication number: 20230003583Abstract: A quantization range setting unit (31) of an encoder (30) sets a quantization range for each Stokes parameter of a Stokes vector acquired from a Stokes vector calculation unit (20). The quantization range is set for the Stokes parameter indicating intensity, and is then set for the other Stokes parameters. A quantization unit (32) calculates the Stokes parameter indicating intensity as a predetermined quantization bit number, and calculates the quantization bit numbers of the other Stokes parameters on the basis of the predetermined quantization bit number and the quantization ranges set for the respective Stokes parameters. The quantization unit (32) performs a quantization process on the Stokes parameters on the basis of the quantization ranges and the quantization bit numbers, to generate quantized polarization information. A decoder (40) performs inverse quantization compatible with the encoder 30 on the quantized polarization information, and generates the Stokes vectors before quantization.Type: ApplicationFiled: November 30, 2020Publication date: January 5, 2023Inventors: LEGONG SUN, YASUTAKA HIRASAWA, YUHI KONDO, TAISHI ONO
-
Publication number: 20220210322Abstract: An imaging apparatus (10) includes an imaging unit (11) that has a first pixel block and a second pixel block provided in a pixel region, the first pixel block including polarization pixels with two different polarization directions and a non-polarization pixel, the second pixel block including polarization pixels with a plurality of polarization directions including a different polarization direction from the first pixel block. An image processing apparatus (20) acquires a captured image generated by the imaging apparatus (10), and a correction coefficient calculation unit (40) calculates a correction coefficient that absorbs a sensitivity difference between polarization pixels and non-polarization pixels, on the basis of an image of the second pixel block.Type: ApplicationFiled: February 7, 2020Publication date: June 30, 2022Inventors: YASUTAKA HIRASAWA, YUHI KONDO, LEGONG SUN, TAISHI ONO
-
Publication number: 20220146434Abstract: A determination environment information acquisition unit 31 acquires incident polarized light information of a light source in a material determination environment. A determination target information acquisition unit 32 acquires emitted polarized light information from a polarized image obtained by capturing an image of a material determination target in the material determination environment.Type: ApplicationFiled: January 15, 2020Publication date: May 12, 2022Inventors: LEGONG SUN, YASUTAKA HIRASAWA, YUHI KONDO, TAISHI ONO