Patents by Inventor Huai Dong Li

Huai Dong Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10979688
    Abstract: A system includes one or more memories and a control module. The one or more memories stores first pixel data corresponding to a first image frame and second pixel data corresponding to a second image frame. The control module performs stereo vision matching including: accessing the first pixel data and the second pixel data; determining initial disparity values, where the initial disparity values indicate differences between the first pixel data and the second pixel data; determining cost aggregation values based on the initial disparity values; determining matching merit values for the first pixel data based on the cost aggregation values; based on the matching merit values, determining first histogram aggregation values for first pixels of the first image frame; and refining the initial disparity values based on the first aggregation values. The control module also estimates a depth of a feature or an object based on the refined disparity values.
    Type: Grant
    Filed: January 23, 2020
    Date of Patent: April 13, 2021
    Assignee: Marvell Asia Pte, Ltd.
    Inventor: Huai Dong Li
  • Patent number: 10554947
    Abstract: A system is provided and includes a memory and a control module. The memory stores first and second pixel data corresponding to first and second image frames. The control module performs stereo vision matching including: accessing the first and second pixel data; determining initial disparity values that indicate differences between positions of the first and second pixel data; determining matching merit values for the first pixel data, where each of the matching merit values is indicative of a reliability level of a corresponding one of the initial disparity values; determining weights based on (i) the initial disparity values, (ii) differences between intensity values of the first and second pixel data, and (iii) the matching merit values; and refining the initial disparity values, based on the weights, to provide refined disparity values. The control module estimates a depth of a feature or an object based on the refined disparity values.
    Type: Grant
    Filed: December 12, 2016
    Date of Patent: February 4, 2020
    Assignee: Marvell International Ltd.
    Inventor: Huai Dong Li
  • Patent number: 9883125
    Abstract: Electronic devices may include image sensors. Image sensors may be used to capture images having rows of long-exposure image pixel values that are interleaved with rows of short-exposure image pixel values. The long-exposure and short-exposure values in each interleaved image frame may be interpolated to form interpolated values. A combined long-exposure image and a combined short-exposure image may be generated using the long-exposure and the short-exposure values from the interleaved image frames and the interpolated values from a selected one of the interleaved image frames. The combined long-exposure and short-exposure images may each include image pixel values from either of the interleaved image frames in a non-motion edge region and image pixel values based only on the image pixel values or the interpolated values from the selected one of the interleaved images in a motion or non-edge region. High-dynamic-range images may be generated using the combined long-exposure and short-exposure images.
    Type: Grant
    Filed: December 8, 2014
    Date of Patent: January 30, 2018
    Assignee: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
    Inventors: Huai Dong Li, Peng Lin
  • Patent number: 9818047
    Abstract: Apparatus, methods, and other embodiments associated with image processing operations are disclosed that provide image color enhancement. According to one embodiment, an apparatus includes zone classifier logic to map base chrominance components of pixels of color data to zones within a color space, where each zone is assigned a gain value. Saturation detection logic generates saturation values from the base chrominance components for each pixel of the color data. Saturation transformation logic transforms the saturation values to sigmoidal output values based on a sigmoidal transformation model. Chrominance enhancement logic generates enhanced chrominance components for each pixel of the color data based on the base chrominance components, the saturation values, the sigmoidal output values, and gain values assigned to the zones to which the base chrominance components are mapped.
    Type: Grant
    Filed: December 14, 2015
    Date of Patent: November 14, 2017
    Assignee: MARVELL INTERNATIONAL LTD.
    Inventors: Huai Dong Li, Samson Huang
  • Patent number: 9613396
    Abstract: Embodiments include a method comprising: receiving a source image comprising a plurality of pixels, wherein individual pixels of the plurality of pixels of the source image comprise a corresponding pixel value that is associated with a corresponding color of a plurality of colors, and wherein a first pixel of the plurality of pixels of the source image comprises a first pixel value that is associated with a first color of the plurality of colors; and for the first pixel of the plurality of pixels of the source image, estimating (i) a second pixel value that is associated with a second color of the plurality of colors and (iii) a third pixel value that is associated with a third color of the plurality of colors.
    Type: Grant
    Filed: November 12, 2014
    Date of Patent: April 4, 2017
    Assignee: Marvell World Trade Ltd.
    Inventor: Huai Dong Li
  • Patent number: 9578320
    Abstract: Apparatus, methods, and other embodiments associated with correcting defects in an image sensor output are described. According to one embodiment, an imaging device includes image sensor array logic, calibrated noise logic, and defect logic. The image sensor array logic is configured to generate an image array of output pixels in a Bayer pattern. The calibrated noise logic is configured to generate a noise estimate for each pixel. The defect logic is configured to detect a potential defect in a pixel-under-test of the image array of output pixels based on the noise estimate.
    Type: Grant
    Filed: December 15, 2014
    Date of Patent: February 21, 2017
    Assignee: Marvell International Ltd.
    Inventor: Huai Dong Li
  • Patent number: 9479746
    Abstract: The present disclosure describes systems and techniques relating to demosaicking artifact suppression. According to an aspect of the described systems and techniques, a device includes: demosaicking circuitry configured to generate interpolated data from raw data received from an image sensor in a three color data format; first circuitry configured to filter a chrominance component of a luminance-chrominance data format version of the interpolated data to suppress false color; and second circuitry configured to filter a luminance component of the luminance-chrominance data format version of the interpolated data to suppress isolated dots.
    Type: Grant
    Filed: December 31, 2014
    Date of Patent: October 25, 2016
    Assignee: Marvell World Trade Ltd.
    Inventor: Huai Dong Li
  • Patent number: 9438827
    Abstract: Electronic devices may include image sensors that capture interleaved images having rows of long-exposure pixel values interleaved with rows of short-exposure pixel values. Processing circuitry in the electronic device may (spatially) partition the interleaved images into multiple bins. The processing circuitry may generate a weighted long-exposure pixel value for each bin and a weighted short-exposure pixel value for each bin. The weighted long and short exposure values in each bin may be combined to generate a binned high-dynamic-range (HDR) pixel value for that bin. The processing circuitry may output a binned HDR image formed from the binned HDR pixel values to additional circuitry such as video processing circuitry for performing additional image processing operations. If desired, the image sensor and processing circuitry may be combined into an integrated structure that generates a single binned HDR pixel value and multiple integrated structures may be used.
    Type: Grant
    Filed: August 13, 2014
    Date of Patent: September 6, 2016
    Assignee: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
    Inventor: Huai Dong Li
  • Patent number: 9420145
    Abstract: A method and imaging device are provided. An image is divided into N zones, and a histogram is generated for each of the N zones. A tone curve is determined for each of the N zones, where tone curve parameters including the controlling of shape and transition point of the curve are based on the histogram of each zone. A tone-mapped value for each pixel of the image is determined based on a sum of M weighted values determined by applying tone curves of M zones to a value of the pixel.
    Type: Grant
    Filed: December 16, 2014
    Date of Patent: August 16, 2016
    Assignee: MARVELL WORLD TRADE LTD.
    Inventor: Huai Dong Li
  • Patent number: 9374478
    Abstract: Some of the embodiments of the present disclosure provide a method comprising receiving image data generated by an imaging device. The image data represents an image captured by the imaging device and the image includes image edges. The method further comprises receiving sensor data related to sensor gain used by the imaging device for capturing the image, and adjusting the image data to modify sharpness of the image edges of the image. The adjusting is based, at least in part, on the sensor data.
    Type: Grant
    Filed: October 23, 2014
    Date of Patent: June 21, 2016
    Assignee: Marvell International Ltd.
    Inventor: Huai Dong Li
  • Patent number: 9357193
    Abstract: A method of correcting color imbalance in a captured image includes deriving gradient data from a group of pixels in the captured image, determining a compensation value based on the gradient data, and applying that value to at least one pixel. Apparatus for correcting color imbalance includes a digital image processor that corrects color imbalance, in an image that is output by an image detector, according to the method. Each pixel may represent a color from a set of colors, with one particular color being a selected color, and each pixel to which the compensation value is applied representing the selected color. Where the group of pixels forms a rectangular shape, the gradient data may include horizontal and vertical gradients. The classifying may be performed according to a visual characteristic of a portion of the image, where determining the compensation value is based also on the visual characteristic.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: May 31, 2016
    Assignee: Marvell World Trade Ltd.
    Inventor: Huai Dong Li
  • Patent number: 9172889
    Abstract: Electronic devices may have camera modules that include an image sensor and processing circuitry. The image sensor may capture an image from a scene. The processing circuitry may extract image statistics and exposure levels from the image. The processing circuitry may use the image statistics and the exposure levels to generate a first exposure time, a second exposure time, and gain settings for the image sensor. The image sensor may capture additional images from the scene having long-exposure image pixel values that are captured using the first exposure time and short-exposure image pixel values that are captured using the second exposure time. The processing circuitry may generate a long-exposure image and a short-exposure image from the second image. The processing circuitry may generate auto-exposed high-dynamic-range images of the scene using the long-exposure image and the short-exposure image.
    Type: Grant
    Filed: January 31, 2013
    Date of Patent: October 27, 2015
    Assignee: Semiconductor Components Industries, LLC
    Inventors: Huai Dong Li, Peng Lin
  • Publication number: 20150201109
    Abstract: A method and imaging device are provided. An image is divided into N zones, and a histogram is generated for each of the N zones. A tone curve is determined for each of the N zones, where tone curve parameters including the controlling of shape and transition point of the curve are based on the histogram of each zone. A tone-mapped value for each pixel of the image is determined based on a sum of M weighted values determined by applying tone curves of M zones to a value of the pixel.
    Type: Application
    Filed: December 16, 2014
    Publication date: July 16, 2015
    Inventor: Huai Dong Li
  • Publication number: 20150195501
    Abstract: A method of correcting color imbalance in a captured image includes deriving gradient data from a group of pixels in the captured image, determining a compensation value based on the gradient data, and applying that value to at least one pixel. Apparatus for correcting color imbalance includes a digital image processor that corrects color imbalance, in an image that is output by an image detector, according to the method. Each pixel may represent a color from a set of colors, with one particular color being a selected color, and each pixel to which the compensation value is applied representing the selected color. Where the group of pixels forms a rectangular shape, the gradient data may include horizontal and vertical gradients. The classifying may be performed according to a visual characteristic of a portion of the image, where determining the compensation value is based also on the visual characteristic.
    Type: Application
    Filed: December 23, 2014
    Publication date: July 9, 2015
    Inventor: Huai Dong Li
  • Publication number: 20150195497
    Abstract: The present disclosure describes systems and techniques relating to demosaicking artifact suppression. According to an aspect of the described systems and techniques, a device includes: demosaicking circuitry configured to generate interpolated data from raw data received from an image sensor in a three color data format; first circuitry configured to filter a chrominance component of a luminance-chrominance data format version of the interpolated data to suppress false color; and second circuitry configured to filter a luminance component of the luminance-chrominance data format version of the interpolated data to suppress isolated dots.
    Type: Application
    Filed: December 31, 2014
    Publication date: July 9, 2015
    Inventor: Huai Dong Li
  • Publication number: 20150163465
    Abstract: Embodiments include a method comprising: receiving a source image comprising a plurality of pixels, wherein individual pixels of the plurality of pixels of the source image comprise a corresponding pixel value that is associated with a corresponding color of a plurality of colors, and wherein a first pixel of the plurality of pixels of the source image comprises a first pixel value that is associated with a first color of the plurality of colors; and for the first pixel of the plurality of pixels of the source image, estimating (i) a second pixel value that is associated with a second color of the plurality of colors and (iii) a third pixel value that is associated with a third color of the plurality of colors.
    Type: Application
    Filed: November 12, 2014
    Publication date: June 11, 2015
    Inventor: Huai Dong Li
  • Patent number: 9007488
    Abstract: Electronic devices may have camera modules that include an image sensor and processing circuitry. The image sensor may capture an interleaved image having rows of long-exposure pixel values that are interleaved with rows of short-exposure pixel values. The image sensor may separate the interleaved image into first and second images each having empty image pixel values. The processing circuitry may generate interpolated long-exposure and interpolated short-exposure images by generating chroma-filtered interpolated pixel values for the empty pixel values in the first and second images. The processing circuitry may perform interpolation operations along one or more directions for the empty image pixels based on whether the empty image pixels are within a texture area or on a dominant edge of the captured image. The processing circuitry may combine the interpolated long-exposure image and the interpolated short-exposure image to generate a high-dynamic-range image.
    Type: Grant
    Filed: March 5, 2013
    Date of Patent: April 14, 2015
    Assignee: Semiconductor Components Industries, LLC
    Inventor: Huai Dong Li
  • Publication number: 20150092079
    Abstract: Electronic devices may include image sensors. Image sensors may be used to capture images having rows of long-exposure image pixel values that are interleaved with rows of short-exposure image pixel values. The long-exposure and short-exposure values in each interleaved image frame may be interpolated to form interpolated values. A combined long-exposure image and a combined short-exposure image may be generated using the long-exposure and the short-exposure values from the interleaved image frames and the interpolated values from a selected one of the interleaved image frames. The combined long-exposure and short-exposure images may each include image pixel values from either of the interleaved image frames in a non-motion edge region and image pixel values based only on the image pixel values or the interpolated values from the selected one of the interleaved images in a motion or non-edge region. High-dynamic-range images may be generated using the combined long-exposure and short-exposure images.
    Type: Application
    Filed: December 8, 2014
    Publication date: April 2, 2015
    Applicant: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
    Inventors: Huai Dong Li, Peng Lin
  • Publication number: 20150062368
    Abstract: Electronic devices may include image sensors that capture interleaved images having rows of long-exposure pixel values interleaved with rows of short-exposure pixel values. Processing circuitry in the electronic device may (spatially) partition the interleaved images into multiple bins. The processing circuitry may generate a weighted long-exposure pixel value for each bin and a weighted short-exposure pixel value for each bin. The weighted long and short exposure values in each bin may be combined to generate a binned high-dynamic-range (HDR) pixel value for that bin. The processing circuitry may output a binned HDR image formed from the binned HDR pixel values to additional circuitry such as video processing circuitry for performing additional image processing operations. If desired, the image sensor and processing circuitry may be combined into an integrated structure that generates a single binned HDR pixel value and multiple integrated structures may be used.
    Type: Application
    Filed: August 13, 2014
    Publication date: March 5, 2015
    Inventor: Huai Dong Li
  • Patent number: 8913153
    Abstract: Electronic devices may include image sensors. Image sensors may be used to capture images having rows of long-exposure image pixel values that are interleaved with rows of short-exposure image pixel values. The long-exposure and short-exposure values in each interleaved image frame may be interpolated to form interpolated values. A combined long-exposure image and a combined short-exposure image may be generated using the long-exposure and the short-exposure values from the interleaved image frames and the interpolated values from a selected one of the interleaved image frames. The combined long-exposure and short-exposure images may each include image pixel values from either of the interleaved image frames in a non-motion edge region and image pixel values based only on the image pixel values or the interpolated values from the selected one of the interleaved images in a motion or non-edge region. High-dynamic-range images may be generated using the combined long-exposure and short-exposure images.
    Type: Grant
    Filed: October 5, 2012
    Date of Patent: December 16, 2014
    Assignee: Aptina Imaging Corporation
    Inventors: Huai Dong Li, Peng Lin