Patents by Inventor Yining Deng
Yining Deng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20260164102Abstract: In various examples, a technique for removing residual IR estimated locally at a pixel in an image and performing corresponding color correction operations locally at the same pixel is disclosed. The technique includes receiving a first image captured using an image sensor. The technique also includes removing, from a first pixel in the first image, a contribution of infrared radiation to a color channel of the first pixel based at least on an estimated amount of residual infrared radiation. The technique also includes performing a first part of local color correction for the color channel of the first pixel based at least on the estimated amount of residual infrared radiation. The technique also includes performing global color correction for a plurality of pixels in a second image that is reconstructed from the first image, where the global color correction includes a second part of the local color correction.Type: ApplicationFiled: December 10, 2024Publication date: June 11, 2026Inventors: Animesh KHEMKA, Gopal Triplicane VENKATESAN, Yining DENG, Robin Brian JENKIN, Du-Yong NG
-
Patent number: 12651424Abstract: In various examples, metadata-based image harmonization for image stitching systems and applications are disclosed. Systems and methods are disclosed that preprocess images with respect to rendering parameters, with the effect of blending those parameters at a border between images to facilitate a smooth rendering when those images are stitched together. An image signal processing (ISP) parameter harmonization function may input metadata parameters associated with a set of images to match and blend one or more of the rendering parameters across an overlapping border between images prior to applying those images to a stitching algorithm. A scaling of the metadata parameter may be performed using a parameter gain function. Pixels in both images located along the border are adjusted to the same boundary metadata parameter value, and smoothed based on the parameter gain function. A discontinuity in rendering parameters is avoided, substantially avoiding corresponding artifacts in the resulting stitched image.Type: GrantFiled: November 13, 2023Date of Patent: June 9, 2026Assignee: NVIDIA CorporationInventors: Yuzhuo Ren, Yining Deng, Dawid Stanislaw Pajak, Robin Jenkin, Niranjan Avadhanam
-
Publication number: 20250157170Abstract: In various examples, metadata-based image harmonization for image stitching systems and applications are disclosed. Systems and methods are disclosed that preprocess images with respect to rendering parameters, with the effect of blending those parameters at a border between images to facilitate a smooth rendering when those images are stitched together. An image signal processing (ISP) parameter harmonization function may input metadata parameters associated with a set of images to match and blend one or more of the rendering parameters across an overlapping border between images prior to applying those images to a stitching algorithm. A scaling of the metadata parameter may be performed using a parameter gain function. Pixels in both images located along the border are adjusted to the same boundary metadata parameter value, and smoothed based on the parameter gain function. A discontinuity in rendering parameters is avoided, substantially avoiding corresponding artifacts in the resulting stitched image.Type: ApplicationFiled: November 13, 2023Publication date: May 15, 2025Inventors: Yuzhuo REN, Yining DENG, Dawid Stanislaw PAJAK, Robin JENKIN, Niranjan AVADHANAM
-
Publication number: 20250142207Abstract: In various examples, an image processing pipeline may toggle between IR and RGB imaging modes in response to different thresholds of detected light intensity that depend on the toggling direction (e.g., a lower intensity threshold to switch from RGB to IR imaging and a higher intensity threshold to switch from IR to RGB imaging). For example, the image processing pipeline may switch from RGB to IR imaging in response to detecting an amount of light intensity (e.g., average intensity in a green channel) below a first threshold, and the image processing pipeline may switch from IR to RGB imaging in response to: (i) detecting an amount of light intensity (e.g., average intensity in a green channel) that exceeds a second threshold, and/or (ii) detecting a ratio of detected light intensities (e.g., IR to green) below a third threshold.Type: ApplicationFiled: October 25, 2023Publication date: May 1, 2025Inventors: Animesh KHEMKA, Yining DENG, Richard RUSSELL
-
Patent number: 12272040Abstract: Apparatuses, systems, and techniques to perform effective tone management for image data. In an embodiment, a set of contrast gain curves are generated corresponding to a set of tonal ranges of an input image. An output image may then be generated by at least applying corresponding contrast gain curves to tonal ranges of the input image.Type: GrantFiled: September 15, 2023Date of Patent: April 8, 2025Assignee: NVIDIA CorporationInventors: Sung Hyun Hwang, Eric Dujardin, Yining Deng
-
Patent number: 12236564Abstract: In various examples, apparatuses, systems, and techniques to perform offline image signal processing of source image data to generate target image data. In at least one embodiment, data collection using exposure and calibration setting of an image sensor is performed to generate source image data, which is then processed by using offline image signal processing to generate target data.Type: GrantFiled: May 5, 2021Date of Patent: February 25, 2025Assignee: NVIDIA CorporationInventors: Yining Deng, Eric Dujardin, Sean Midthun Pieper, Minwoo Park
-
Patent number: 11908104Abstract: In order to more accurately white balance an image, weightings can be determined for pixels of an image when computing an illuminant color value of the image and/or a scene. The weightings can be based at least in part on the Signal-to-Noise Ratio (SNR) of the pixels. The SNR may be actual SNR or SNR estimated from brightness levels of the pixels. SNR weighting (e.g., SNR adjustment) may reduce the effect of pixels with high noise on the computed illuminant color value. For example, one or more channel values of the illuminant color value can be determined based on the weightings and color values of the pixels. One or more color gain values can be determined based on the one or more channel values of the illuminant color value and used to white balance the image.Type: GrantFiled: September 6, 2022Date of Patent: February 20, 2024Assignee: NVIDIA CorporationInventors: Hamidreza Mirzaei Domabi, Eric Dujardin, Animesh Khemka, Yining Deng
-
Publication number: 20240005462Abstract: Apparatuses, systems, and techniques to perform effective tone management for image data. In an embodiment, a set of contrast gain curves are generated corresponding to a set of tonal ranges of an input image. An output image may then be generated by at least applying corresponding contrast gain curves to tonal ranges of the input image.Type: ApplicationFiled: September 15, 2023Publication date: January 4, 2024Inventors: SUNG HYUN HWANG, ERIC DUJARDIN, YINING DENG
-
Patent number: 11810274Abstract: Apparatuses, systems, and techniques to perform effective tone management for image data. In an embodiment, a set of contrast gain curves are generated corresponding to a set of tonal ranges of an input image. An output image may then be generated by at least applying corresponding contrast gain curves to tonal ranges of the input image.Type: GrantFiled: March 4, 2021Date of Patent: November 7, 2023Assignee: NVIDIA CORPORATIONInventors: Sung Hyun Hwang, Eric Dujardin, Yining Deng
-
Patent number: 11704781Abstract: The various embodiments of the present disclosure are directed towards methods for tone mapping High-Dynamic-Range (HDR) image data, as well as controlling the brightness of the image encoded by HDR the image data and/or the tone-mapped image data. HDR image is captured. A tone mapping function for the HDR image data is generated. To generate the tone mapping function, control points are dynamically determined based on an analysis of the HDR image data. The tone mapping function is fit to the control points. The tone mapping function is a non-linear function, and is described by a curve in a plane. The shape of the curve is constrained by a line generated from a portion of the control points. The tone mapping function is applied to the HDR image data. A color-compression is applied to the tone mapped image data to generate Standard Dynamic Range or Low Dynamic Range image data.Type: GrantFiled: October 13, 2021Date of Patent: July 18, 2023Assignee: NVIDIA CorporationInventors: Yining Deng, Eric Dujardin, Hamidreza Mirzaei Domabi, Sung Hyun Hwang
-
Publication number: 20220414831Abstract: In order to more accurately white balance an image, weightings can be determined for pixels of an image when computing an illuminant color value of the image and/or a scene. The weightings can be based at least in part on the Signal-to-Noise Ratio (SNR) of the pixels. The SNR may be actual SNR or SNR estimated from brightness levels of the pixels. SNR weighting (e.g., SNR adjustment) may reduce the effect of pixels with high noise on the computed illuminant color value. For example, one or more channel values of the illuminant color value can be determined based on the weightings and color values of the pixels. One or more color gain values can be determined based on the one or more channel values of the illuminant color value and used to white balance the image.Type: ApplicationFiled: September 6, 2022Publication date: December 29, 2022Inventors: Hamidreza Mirzaei Domabi, Eric Dujardin, Animesh Khemka, Yining Deng
-
Publication number: 20220358627Abstract: In various examples, apparatuses, systems, and techniques to perform offline image signal processing of source image data to generate target image data. In at least one embodiment, data collection using exposure and calibration setting of an image sensor is performed to generate source image data, which is then processed by using offline image signal processing to generate target data.Type: ApplicationFiled: May 5, 2021Publication date: November 10, 2022Inventors: Yining Deng, Eric Dujardin, Sean Midthun Pieper, Minwoo Park
-
Publication number: 20220284553Abstract: Apparatuses, systems, and techniques to perform effective tone management for image data. In an embodiment, a set of contrast gain curves are generated corresponding to a set of tonal ranges of an input image. An output image may then be generated by at least applying corresponding contrast gain curves to tonal ranges of the input image.Type: ApplicationFiled: March 4, 2021Publication date: September 8, 2022Inventors: SUNG HYUN HWANG, ERIC DUJARDIN, YINING DENG
-
Patent number: 11436704Abstract: In order to more accurately white balance an image, weightings can be determined for pixels of an image when computing an illuminant color value of the image and/or a scene. The weightings can be based at least in part on the Signal-to-Noise Ratio (SNR) of the pixels. The SNR may be actual SNR or SNR estimated from brightness levels of the pixels. SNR weighting (e.g., SNR adjustment) may reduce the effect of pixels with high noise on the computed illuminant color value. For example, one or more channel values of the illuminant color value can be determined based on the weightings and color values of the pixels. One or more color gain values can be determined based on the one or more channel values of the illuminant color value and used to white balance the image.Type: GrantFiled: January 14, 2020Date of Patent: September 6, 2022Assignee: NVIDIA CorporationInventors: Hamidreza Mirzaei Domabi, Eric Dujardin, Animesh Khemka, Yining Deng
-
Patent number: 11359825Abstract: An energy storage device includes a phase-change energy storage tank, a first liquid inlet pipe, a first liquid outlet pipe, a second liquid inlet pipe, a second liquid outlet pipe, and a pipeline. The phase-change energy storage tank includes a first housing and a second housing disposed in the first housing. The second housing includes a liquid inlet, a liquid outlet, a feeding hole, and a discharge hole. The first housing includes a thermal insulation material. The second housing includes a phase change material. The liquid inlet and the liquid outlet are disposed on two ends of the second housing, respectively. The phase change material is introduced to and discharged out of the second housing via the feeding hole and the discharge hole, respectively. The first liquid inlet pipe, the phase-change energy storage tank, and the first liquid outlet pipe are connected sequentially to form an energy storage unit.Type: GrantFiled: December 2, 2020Date of Patent: June 14, 2022Assignee: GUANGXI BANSHIDA GREEN BUILDING ENERGY SAVING TECHNOLOGY CO., LTD.Inventor: Yining Deng
-
Publication number: 20220036524Abstract: The various embodiments of the present disclosure are directed towards methods for tone mapping High-Dynamic-Range (HDR) image data, as well as controlling the brightness of the image encoded by HDR the image data and/or the tone-mapped image data. HDR image is captured. A tone mapping function for the HDR image data is generated. To generate the tone mapping function, control points are dynamically determined based on an analysis of the HDR image data. The tone mapping function is fit to the control points. The tone mapping function is a non-linear function, and is described by a curve in a plane. The shape of the curve is constrained by a line generated from a portion of the control points. The tone mapping function is applied to the HDR image data. A color-compression is applied to the tone mapped image data to generate Standard Dynamic Range or Low Dynamic Range image data.Type: ApplicationFiled: October 13, 2021Publication date: February 3, 2022Inventors: Yining Deng, Eric Dujardin, Hamidreza Mirzaei Domabi, Sung Hyun Hwang
-
Patent number: 11182884Abstract: The various embodiments of the present disclosure are directed towards methods for tone mapping High-Dynamic-Range (HDR) image data, as well as controlling the brightness of the image encoded by HDR the image data and/or the tone-mapped image data. HDR image is captured. A tone mapping function for the HDR image data is generated. To generate the tone mapping function, control points are dynamically determined based on an analysis of the HDR image data. The tone mapping function is fit to the control points. The tone mapping function is a non-linear function, and is described by a curve in a plane. The shape of the curve is constrained by a line generated from a portion of the control points. The tone mapping function is applied to the HDR image data. A color-compression is applied to the tone mapped image data to generate Standard Dynamic Range or Low Dynamic Range image data.Type: GrantFiled: July 30, 2019Date of Patent: November 23, 2021Assignee: NVIDIA CorporationInventors: Yining Deng, Eric Dujardin, Hamidreza Mirzaei Domabi, Sung Hyun Hwang
-
Publication number: 20210080133Abstract: An energy storage device includes a phase-change energy storage tank, a first liquid inlet pipe, a first liquid outlet pipe, a second liquid inlet pipe, a second liquid outlet pipe, and a pipeline. The phase-change energy storage tank includes a first housing and a second housing disposed in the first housing. The second housing includes a liquid inlet, a liquid outlet, a feeding hole, and a discharge hole. The first housing includes a thermal insulation material. The second housing includes a phase change material. The liquid inlet and the liquid outlet are disposed on two ends of the second housing, respectively. The phase change material is introduced to and discharged out of the second housing via the feeding hole and the discharge hole, respectively. The first liquid inlet pipe, the phase-change energy storage tank, and the first liquid outlet pipe are connected sequentially to form an energy storage unit.Type: ApplicationFiled: December 2, 2020Publication date: March 18, 2021Inventor: Yining DENG
-
Publication number: 20210035273Abstract: The various embodiments of the present disclosure are directed towards methods for tone mapping High-Dynamic-Range (HDR) image data, as well as controlling the brightness of the image encoded by HDR the image data and/or the tone-mapped image data. HDR image is captured. A tone mapping function for the HDR image data is generated. To generate the tone mapping function, control points are dynamically determined based on an analysis of the HDR image data. The tone mapping function is fit to the control points. The tone mapping function is a non-linear function, and is described by a curve in a plane. The shape of the curve is constrained by a line generated from a portion of the control points. The tone mapping function is applied to the HDR image data. A color-compression is applied to the tone mapped image data to generate Standard Dynamic Range or Low Dynamic Range image data.Type: ApplicationFiled: July 30, 2019Publication date: February 4, 2021Inventors: Yining Deng, Eric Dujardin, Hamidreza Mirzaei Domabi, Sung Hyun Hwang
-
Publication number: 20200226720Abstract: In order to more accurately white balance an image, weightings can be determined for pixels of an image when computing an illuminant color value of the image and/or a scene. The weightings can be based at least in part on the Signal-to-Noise Ratio (SNR) of the pixels. The SNR may be actual SNR or SNR estimated from brightness levels of the pixels. SNR weighting (e.g., SNR adjustment) may reduce the effect of pixels with high noise on the computed illuminant color value. For example, one or more channel values of the illuminant color value can be determined based on the weightings and color values of the pixels. One or more color gain values can be determined based on the one or more channel values of the illuminant color value and used to white balance the image.Type: ApplicationFiled: January 14, 2020Publication date: July 16, 2020Inventors: Hamidreza Mirzaei Domabi, Eric Dujardin, Animesh Khemka, Yining Deng