Patents by Inventor Huai Dong Li
Huai Dong Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10979688Abstract: A system includes one or more memories and a control module. The one or more memories stores first pixel data corresponding to a first image frame and second pixel data corresponding to a second image frame. The control module performs stereo vision matching including: accessing the first pixel data and the second pixel data; determining initial disparity values, where the initial disparity values indicate differences between the first pixel data and the second pixel data; determining cost aggregation values based on the initial disparity values; determining matching merit values for the first pixel data based on the cost aggregation values; based on the matching merit values, determining first histogram aggregation values for first pixels of the first image frame; and refining the initial disparity values based on the first aggregation values. The control module also estimates a depth of a feature or an object based on the refined disparity values.Type: GrantFiled: January 23, 2020Date of Patent: April 13, 2021Assignee: Marvell Asia Pte, Ltd.Inventor: Huai Dong Li
-
Patent number: 10554947Abstract: A system is provided and includes a memory and a control module. The memory stores first and second pixel data corresponding to first and second image frames. The control module performs stereo vision matching including: accessing the first and second pixel data; determining initial disparity values that indicate differences between positions of the first and second pixel data; determining matching merit values for the first pixel data, where each of the matching merit values is indicative of a reliability level of a corresponding one of the initial disparity values; determining weights based on (i) the initial disparity values, (ii) differences between intensity values of the first and second pixel data, and (iii) the matching merit values; and refining the initial disparity values, based on the weights, to provide refined disparity values. The control module estimates a depth of a feature or an object based on the refined disparity values.Type: GrantFiled: December 12, 2016Date of Patent: February 4, 2020Assignee: Marvell International Ltd.Inventor: Huai Dong Li
-
Patent number: 9883125Abstract: Electronic devices may include image sensors. Image sensors may be used to capture images having rows of long-exposure image pixel values that are interleaved with rows of short-exposure image pixel values. The long-exposure and short-exposure values in each interleaved image frame may be interpolated to form interpolated values. A combined long-exposure image and a combined short-exposure image may be generated using the long-exposure and the short-exposure values from the interleaved image frames and the interpolated values from a selected one of the interleaved image frames. The combined long-exposure and short-exposure images may each include image pixel values from either of the interleaved image frames in a non-motion edge region and image pixel values based only on the image pixel values or the interpolated values from the selected one of the interleaved images in a motion or non-edge region. High-dynamic-range images may be generated using the combined long-exposure and short-exposure images.Type: GrantFiled: December 8, 2014Date of Patent: January 30, 2018Assignee: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLCInventors: Huai Dong Li, Peng Lin
-
Patent number: 9818047Abstract: Apparatus, methods, and other embodiments associated with image processing operations are disclosed that provide image color enhancement. According to one embodiment, an apparatus includes zone classifier logic to map base chrominance components of pixels of color data to zones within a color space, where each zone is assigned a gain value. Saturation detection logic generates saturation values from the base chrominance components for each pixel of the color data. Saturation transformation logic transforms the saturation values to sigmoidal output values based on a sigmoidal transformation model. Chrominance enhancement logic generates enhanced chrominance components for each pixel of the color data based on the base chrominance components, the saturation values, the sigmoidal output values, and gain values assigned to the zones to which the base chrominance components are mapped.Type: GrantFiled: December 14, 2015Date of Patent: November 14, 2017Assignee: MARVELL INTERNATIONAL LTD.Inventors: Huai Dong Li, Samson Huang
-
Patent number: 9613396Abstract: Embodiments include a method comprising: receiving a source image comprising a plurality of pixels, wherein individual pixels of the plurality of pixels of the source image comprise a corresponding pixel value that is associated with a corresponding color of a plurality of colors, and wherein a first pixel of the plurality of pixels of the source image comprises a first pixel value that is associated with a first color of the plurality of colors; and for the first pixel of the plurality of pixels of the source image, estimating (i) a second pixel value that is associated with a second color of the plurality of colors and (iii) a third pixel value that is associated with a third color of the plurality of colors.Type: GrantFiled: November 12, 2014Date of Patent: April 4, 2017Assignee: Marvell World Trade Ltd.Inventor: Huai Dong Li
-
Patent number: 9578320Abstract: Apparatus, methods, and other embodiments associated with correcting defects in an image sensor output are described. According to one embodiment, an imaging device includes image sensor array logic, calibrated noise logic, and defect logic. The image sensor array logic is configured to generate an image array of output pixels in a Bayer pattern. The calibrated noise logic is configured to generate a noise estimate for each pixel. The defect logic is configured to detect a potential defect in a pixel-under-test of the image array of output pixels based on the noise estimate.Type: GrantFiled: December 15, 2014Date of Patent: February 21, 2017Assignee: Marvell International Ltd.Inventor: Huai Dong Li
-
Patent number: 9479746Abstract: The present disclosure describes systems and techniques relating to demosaicking artifact suppression. According to an aspect of the described systems and techniques, a device includes: demosaicking circuitry configured to generate interpolated data from raw data received from an image sensor in a three color data format; first circuitry configured to filter a chrominance component of a luminance-chrominance data format version of the interpolated data to suppress false color; and second circuitry configured to filter a luminance component of the luminance-chrominance data format version of the interpolated data to suppress isolated dots.Type: GrantFiled: December 31, 2014Date of Patent: October 25, 2016Assignee: Marvell World Trade Ltd.Inventor: Huai Dong Li
-
Patent number: 9438827Abstract: Electronic devices may include image sensors that capture interleaved images having rows of long-exposure pixel values interleaved with rows of short-exposure pixel values. Processing circuitry in the electronic device may (spatially) partition the interleaved images into multiple bins. The processing circuitry may generate a weighted long-exposure pixel value for each bin and a weighted short-exposure pixel value for each bin. The weighted long and short exposure values in each bin may be combined to generate a binned high-dynamic-range (HDR) pixel value for that bin. The processing circuitry may output a binned HDR image formed from the binned HDR pixel values to additional circuitry such as video processing circuitry for performing additional image processing operations. If desired, the image sensor and processing circuitry may be combined into an integrated structure that generates a single binned HDR pixel value and multiple integrated structures may be used.Type: GrantFiled: August 13, 2014Date of Patent: September 6, 2016Assignee: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLCInventor: Huai Dong Li
-
Patent number: 9420145Abstract: A method and imaging device are provided. An image is divided into N zones, and a histogram is generated for each of the N zones. A tone curve is determined for each of the N zones, where tone curve parameters including the controlling of shape and transition point of the curve are based on the histogram of each zone. A tone-mapped value for each pixel of the image is determined based on a sum of M weighted values determined by applying tone curves of M zones to a value of the pixel.Type: GrantFiled: December 16, 2014Date of Patent: August 16, 2016Assignee: MARVELL WORLD TRADE LTD.Inventor: Huai Dong Li
-
Patent number: 9374478Abstract: Some of the embodiments of the present disclosure provide a method comprising receiving image data generated by an imaging device. The image data represents an image captured by the imaging device and the image includes image edges. The method further comprises receiving sensor data related to sensor gain used by the imaging device for capturing the image, and adjusting the image data to modify sharpness of the image edges of the image. The adjusting is based, at least in part, on the sensor data.Type: GrantFiled: October 23, 2014Date of Patent: June 21, 2016Assignee: Marvell International Ltd.Inventor: Huai Dong Li
-
Patent number: 9357193Abstract: A method of correcting color imbalance in a captured image includes deriving gradient data from a group of pixels in the captured image, determining a compensation value based on the gradient data, and applying that value to at least one pixel. Apparatus for correcting color imbalance includes a digital image processor that corrects color imbalance, in an image that is output by an image detector, according to the method. Each pixel may represent a color from a set of colors, with one particular color being a selected color, and each pixel to which the compensation value is applied representing the selected color. Where the group of pixels forms a rectangular shape, the gradient data may include horizontal and vertical gradients. The classifying may be performed according to a visual characteristic of a portion of the image, where determining the compensation value is based also on the visual characteristic.Type: GrantFiled: December 23, 2014Date of Patent: May 31, 2016Assignee: Marvell World Trade Ltd.Inventor: Huai Dong Li
-
Patent number: 9172889Abstract: Electronic devices may have camera modules that include an image sensor and processing circuitry. The image sensor may capture an image from a scene. The processing circuitry may extract image statistics and exposure levels from the image. The processing circuitry may use the image statistics and the exposure levels to generate a first exposure time, a second exposure time, and gain settings for the image sensor. The image sensor may capture additional images from the scene having long-exposure image pixel values that are captured using the first exposure time and short-exposure image pixel values that are captured using the second exposure time. The processing circuitry may generate a long-exposure image and a short-exposure image from the second image. The processing circuitry may generate auto-exposed high-dynamic-range images of the scene using the long-exposure image and the short-exposure image.Type: GrantFiled: January 31, 2013Date of Patent: October 27, 2015Assignee: Semiconductor Components Industries, LLCInventors: Huai Dong Li, Peng Lin
-
Publication number: 20150201109Abstract: A method and imaging device are provided. An image is divided into N zones, and a histogram is generated for each of the N zones. A tone curve is determined for each of the N zones, where tone curve parameters including the controlling of shape and transition point of the curve are based on the histogram of each zone. A tone-mapped value for each pixel of the image is determined based on a sum of M weighted values determined by applying tone curves of M zones to a value of the pixel.Type: ApplicationFiled: December 16, 2014Publication date: July 16, 2015Inventor: Huai Dong Li
-
Publication number: 20150195501Abstract: A method of correcting color imbalance in a captured image includes deriving gradient data from a group of pixels in the captured image, determining a compensation value based on the gradient data, and applying that value to at least one pixel. Apparatus for correcting color imbalance includes a digital image processor that corrects color imbalance, in an image that is output by an image detector, according to the method. Each pixel may represent a color from a set of colors, with one particular color being a selected color, and each pixel to which the compensation value is applied representing the selected color. Where the group of pixels forms a rectangular shape, the gradient data may include horizontal and vertical gradients. The classifying may be performed according to a visual characteristic of a portion of the image, where determining the compensation value is based also on the visual characteristic.Type: ApplicationFiled: December 23, 2014Publication date: July 9, 2015Inventor: Huai Dong Li
-
Publication number: 20150195497Abstract: The present disclosure describes systems and techniques relating to demosaicking artifact suppression. According to an aspect of the described systems and techniques, a device includes: demosaicking circuitry configured to generate interpolated data from raw data received from an image sensor in a three color data format; first circuitry configured to filter a chrominance component of a luminance-chrominance data format version of the interpolated data to suppress false color; and second circuitry configured to filter a luminance component of the luminance-chrominance data format version of the interpolated data to suppress isolated dots.Type: ApplicationFiled: December 31, 2014Publication date: July 9, 2015Inventor: Huai Dong Li
-
Publication number: 20150163465Abstract: Embodiments include a method comprising: receiving a source image comprising a plurality of pixels, wherein individual pixels of the plurality of pixels of the source image comprise a corresponding pixel value that is associated with a corresponding color of a plurality of colors, and wherein a first pixel of the plurality of pixels of the source image comprises a first pixel value that is associated with a first color of the plurality of colors; and for the first pixel of the plurality of pixels of the source image, estimating (i) a second pixel value that is associated with a second color of the plurality of colors and (iii) a third pixel value that is associated with a third color of the plurality of colors.Type: ApplicationFiled: November 12, 2014Publication date: June 11, 2015Inventor: Huai Dong Li
-
Patent number: 9007488Abstract: Electronic devices may have camera modules that include an image sensor and processing circuitry. The image sensor may capture an interleaved image having rows of long-exposure pixel values that are interleaved with rows of short-exposure pixel values. The image sensor may separate the interleaved image into first and second images each having empty image pixel values. The processing circuitry may generate interpolated long-exposure and interpolated short-exposure images by generating chroma-filtered interpolated pixel values for the empty pixel values in the first and second images. The processing circuitry may perform interpolation operations along one or more directions for the empty image pixels based on whether the empty image pixels are within a texture area or on a dominant edge of the captured image. The processing circuitry may combine the interpolated long-exposure image and the interpolated short-exposure image to generate a high-dynamic-range image.Type: GrantFiled: March 5, 2013Date of Patent: April 14, 2015Assignee: Semiconductor Components Industries, LLCInventor: Huai Dong Li
-
Publication number: 20150092079Abstract: Electronic devices may include image sensors. Image sensors may be used to capture images having rows of long-exposure image pixel values that are interleaved with rows of short-exposure image pixel values. The long-exposure and short-exposure values in each interleaved image frame may be interpolated to form interpolated values. A combined long-exposure image and a combined short-exposure image may be generated using the long-exposure and the short-exposure values from the interleaved image frames and the interpolated values from a selected one of the interleaved image frames. The combined long-exposure and short-exposure images may each include image pixel values from either of the interleaved image frames in a non-motion edge region and image pixel values based only on the image pixel values or the interpolated values from the selected one of the interleaved images in a motion or non-edge region. High-dynamic-range images may be generated using the combined long-exposure and short-exposure images.Type: ApplicationFiled: December 8, 2014Publication date: April 2, 2015Applicant: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLCInventors: Huai Dong Li, Peng Lin
-
Publication number: 20150062368Abstract: Electronic devices may include image sensors that capture interleaved images having rows of long-exposure pixel values interleaved with rows of short-exposure pixel values. Processing circuitry in the electronic device may (spatially) partition the interleaved images into multiple bins. The processing circuitry may generate a weighted long-exposure pixel value for each bin and a weighted short-exposure pixel value for each bin. The weighted long and short exposure values in each bin may be combined to generate a binned high-dynamic-range (HDR) pixel value for that bin. The processing circuitry may output a binned HDR image formed from the binned HDR pixel values to additional circuitry such as video processing circuitry for performing additional image processing operations. If desired, the image sensor and processing circuitry may be combined into an integrated structure that generates a single binned HDR pixel value and multiple integrated structures may be used.Type: ApplicationFiled: August 13, 2014Publication date: March 5, 2015Inventor: Huai Dong Li
-
Patent number: 8913153Abstract: Electronic devices may include image sensors. Image sensors may be used to capture images having rows of long-exposure image pixel values that are interleaved with rows of short-exposure image pixel values. The long-exposure and short-exposure values in each interleaved image frame may be interpolated to form interpolated values. A combined long-exposure image and a combined short-exposure image may be generated using the long-exposure and the short-exposure values from the interleaved image frames and the interpolated values from a selected one of the interleaved image frames. The combined long-exposure and short-exposure images may each include image pixel values from either of the interleaved image frames in a non-motion edge region and image pixel values based only on the image pixel values or the interpolated values from the selected one of the interleaved images in a motion or non-edge region. High-dynamic-range images may be generated using the combined long-exposure and short-exposure images.Type: GrantFiled: October 5, 2012Date of Patent: December 16, 2014Assignee: Aptina Imaging CorporationInventors: Huai Dong Li, Peng Lin