Patents by Inventor Qiang Hu

Qiang Hu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210174482
    Abstract: Methods, systems and computer program products for providing improved visualization of inspection results are provided. Aspects include receiving an image from a connected camera by a computing device and processing the image by a graphics processing unit to divide the image into a plurality of image blocks. Responsive to inputting the processed image into a trained model, a plurality of image areas within the processed image is identified. Each image area is associated with an importance level and includes a unique set of image blocks. A sequence of image blocks is determined based on an importance level associated with each of the plurality of image blocks, wherein the sequence includes a list of image blocks in descending order by the importance level of each image block. The image blocks are stored in order of the sequence of image blocks by the server.
    Type: Application
    Filed: December 9, 2019
    Publication date: June 10, 2021
    Inventors: PENG JI, GUO QIANG HU, JINGCHANG HUANG, FAN LI
  • Patent number: 11030738
    Abstract: A method, a device and a computer program product for image processing are proposed. In the method, whether a first image indicates a defect associated with a target object is determined. In response to determining that the first image indicates the defect, a second image absent from the defect is obtained based on the first image. The defect is identified by comparing the first image with the second image. In this way, the defect associated with the target object in the image can be accurately and efficiently identified or segmented.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: June 8, 2021
    Assignee: International Business Machines Corporation
    Inventors: Fan Li, Guo Qiang Hu, Sheng Nan Zhu, Jun Zhu, Jing Chang Huang, Peng Ji, Yuan Yuan Ding
  • Publication number: 20210158094
    Abstract: The present disclosure relates to training a machine learning model to classify images. An example method generally includes receiving a training data set including images in a first category and images in a second category. A convolutional neural network (CNN) is trained using the training data set, and a feature map is generated from layers of the CNN based on features of images in the training data set. A first area in the feature map including images in the first category and a second area in the feature map where images in the first category overlap with images in the second category are identified. The first category is split into a first subcategory corresponding to the first area and a second subcategory corresponding to the second area. The CNN is retrained based on the images in the first subcategory, images in the second subcategory, and images in the second category.
    Type: Application
    Filed: November 22, 2019
    Publication date: May 27, 2021
    Inventors: Peng JI, Guo Qiang Hu, Yuan Yuan Ding, Jun Zhu, Jing Chang Huang, Sheng Nan Zhu
  • Publication number: 20210158503
    Abstract: Aspects described herein include a computer-implemented method and associated system and computer program product. The method includes training a model using a plurality of defect images. Each defect image corresponds to a respective first feature combination of encoded textual features of a predefined set of textual features. The method further includes generating a first synthetic image using the model. The first synthetic image corresponds to a second feature combination of encoded textual features of the predefined set that is distinct from the first feature combinations.
    Type: Application
    Filed: November 21, 2019
    Publication date: May 27, 2021
    Inventors: Jinfeng Li, GUO QIANG HU, Fan Li, Wei Zhao, Jian Xu, Jun Zhu
  • Patent number: 11010888
    Abstract: A computer-implemented method is provided for image-based defect detection. The method includes performing, by a processor device, template matching and subtraction on a set of training images and at least one template image to obtain a set of difference images. The difference images have defects, if any, highlighted therein. The method further includes generating, by the hardware processor applying a binary classification model to each of the training images in the set, activation heatmaps. The method also includes identifying, by the hardware processor, rough defect areas of interest in the activation heatmaps. The method additionally includes super-imposing, by the hardware processor, the activation heatmaps onto the difference images to obtain a set of super-imposed images, and highlight, as true defect areas, any areas in the super-imposed images having the defects from the difference images that overlap with the rough defect areas of interest from the activation heatmaps.
    Type: Grant
    Filed: October 29, 2018
    Date of Patent: May 18, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Guo Qiang Hu, Jun Zhu, Peng Ji, Jing Chang Huang
  • Publication number: 20210131634
    Abstract: Provided are a light distribution member, a lighting or signaling device having the same, and a motor vehicle.
    Type: Application
    Filed: June 24, 2019
    Publication date: May 6, 2021
    Applicant: VALEO VISION
    Inventors: Piao ZHANG, Qiang HU
  • Publication number: 20210118113
    Abstract: A method, a device and a computer program product for image processing are proposed. In the method, a first training image and region information are obtained. The region information indicates a region of a defect in the first training image. A second training image with the defect at least partially removed is generated using an image generator based on the first training image and the region information. The image generator is trained to recover the first training image by replacing pixels included in the region indicated by the region information. The image generator is updated based on the second training image. In this way, the image including the defect can be accurately and efficiently recovered.
    Type: Application
    Filed: October 16, 2019
    Publication date: April 22, 2021
    Inventors: Fan Li, Guo Qiang Hu, Jun Zhu, Sheng Nan Zhu, JingChang Huang, Yuan Yuan Ding, Peng Ji
  • Publication number: 20210110525
    Abstract: Embodiments of the present invention facilitate product defect detection. A computer-implemented method comprises: receiving, by a device operatively coupled to one or more processors, a template image of a normal product; generating, by the device, one or more geometric training parameters for transforming the template image; and transforming, by the device, the template image using the one or more geometric training parameters to generate a transformed image for training a data model, wherein the trained data model being used for aligning the template image and an image under inspection of a product.
    Type: Application
    Filed: December 23, 2020
    Publication date: April 15, 2021
    Inventors: Guo Qiang Hu, Jun Chi Yan, Jun Zhu, Jing Chang Huang, Peng Ji
  • Patent number: 10964015
    Abstract: Embodiments of the present invention facilitate product defect detection. A computer-implemented method comprises: receiving, by a device operatively coupled to one or more processors, a template image of a normal product; generating, by the device, one or more geometric training parameters for transforming the template image; and transforming, by the device, the template image using the one or more geometric training parameters to generate a transformed image for training a data model, wherein the trained data model being used for aligning the template image and an image under inspection of a product.
    Type: Grant
    Filed: January 15, 2019
    Date of Patent: March 30, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Guo Qiang Hu, Jun Chi Yan, Jun Zhu, Jing Chang Huang, Peng Ji
  • Patent number: 10956796
    Abstract: A computer-implemented method is provided for image-based, self-guided object detection. The method includes receiving, by a processor device, a set of images. Each of the images has a respective grid thereon that is labeled regarding a respective object to be detected using grid level label data. The method further includes training, by the processor device, a grid-based object detector using the grid level label data. The method also includes determining, by the processor device, a respective bounding box for the respective object in each of the images, by applying local segmentation to each of the images. The method additionally includes training, by the processor device, a Region-based Convolutional Neural Network (RCNN) for joint object localization and object classification using the respective bounding box for the respective object in each of the images as an input to the RCNN.
    Type: Grant
    Filed: October 11, 2018
    Date of Patent: March 23, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Jun Chi Yan, Jun Zhu, Guo Qiang Hu, Jing Chang Huang, Chang Chun Liu, Zhi Hu Wang, Peng Ji
  • Patent number: 10957032
    Abstract: Scheduling automated visual inspection tasks includes capturing an image of a component to be inspected. A visual inspection model is formed with a model engine as a composite model of utility modules and functional modules to perform visual inspection of the image of the component. An abstract processing workflow of the visual inspection model is derived with a scheduler including dependencies between the utility modules and the functional modules. Performance of each of the functional modules is profiled with the scheduler by testing performance with available hardware resources to produce a performance profile. Parallel instances of each of the functional modules in a branch of the abstract processing workflow are scheduled with the scheduler according to the dependencies and the performance profiles. An indication of defects in the component is produced by processing the visual inspection model according to the scheduled functional modules.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: March 23, 2021
    Assignee: International Business Machines Corporation
    Inventors: Guo Qiang Hu, Jun Zhu, Peng Ji, Bo Wen Wei, Zhe Yan, Lei He
  • Publication number: 20210073686
    Abstract: Techniques for generating machine learning architectures are provided. A data set is received for training one or more machine learning (ML) models, where the data set comprises labeled exemplars for a plurality of classes. The data set is partitioned into a training set and a testing set. A first ML model is trained using the training set, and a quality of the first ML model with respect to each class of the plurality of classes is evaluated using the testing set. Upon determining that the quality of the first ML model is below a predefined threshold with respect to a first class and a second class of the plurality of classes, a subset of the training set is identified, where each exemplar in the subset corresponds to either the first class or the second class. A second ML model is trained using the subset of the training set.
    Type: Application
    Filed: September 6, 2019
    Publication date: March 11, 2021
    Inventors: Yuan Yuan Ding, GUO QIANG HU, Jun Zhu, Jing Chang Huang, Sheng Nan Zhu, Fan LI, Peng Ji
  • Patent number: 10896341
    Abstract: A computer implemented method for surface defect inspection that includes recording an optical image of a surface including a defect; converting the optical image including the defect into a heat map; extracting a region of interest including the defect from the heat map; and comparing the region of interest including the defect from the heat map to a binary classification model using a sliding window based voting mechanism to determine if the defect is greater than or less than a threshold failure value.
    Type: Grant
    Filed: November 15, 2018
    Date of Patent: January 19, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Sheng Nan Zhu, Guo Qiang Hu, Jun Zhu, Jing Chang Huang, Peng Ji
  • Publication number: 20210012474
    Abstract: Embodiments of the present disclosure relate to object defect detection. In an embodiment, a computer-implemented method is disclosed. According to the method, for a test image of at least one part of a target object, a reference image is generated by repeating a periodic pattern detected in the test image, the target object consisting of elements. A differential image is determined by comparing the test image and the reference image. The differential image is superimposed on a predefined grid image to obtain a superimposed image. The grid image comprises grids corresponding to elements of a reference object associated with the target object. The number of defective elements is determined in the at least one part of the target object based on the superimposed image. In other embodiments, a system and a computer program product are disclosed.
    Type: Application
    Filed: July 10, 2019
    Publication date: January 14, 2021
    Inventors: JING CHANG HUANG, GUO QIANG HU, Peng JI, JUN ZHU, YUAN YUAN DING
  • Publication number: 20210004945
    Abstract: A method, a device and a computer program product for image processing are proposed. In the method, whether a first image indicates a defect associated with a target object is determined. In response to determining that the first image indicates the defect, a second image absent from the defect is obtained based on the first image. The defect is identified by comparing the first image with the second image. In this way, the defect associated with the target object in the image can be accurately and efficiently identified or segmented.
    Type: Application
    Filed: July 5, 2019
    Publication date: January 7, 2021
    Inventors: FAN LI, GUO QIANG HU, Sheng Nan Zhu, JUN ZHU, Jing Chang Huang, Peng Ji, Yuan Yuan Ding
  • Patent number: 10879397
    Abstract: Semiconductor structures are provided. An exemplary semiconductor structure includes a semiconductor substrate having a first region and a second region and a plurality of first fins on the semiconductor substrate in the first region and a plurality of second fins on the semiconductor substrate in the second region. A first oxide layer is on side surfaces of the plurality of first fins; and a second oxide layer is on side surfaces of the second fins. A corner between a top surface and a side surface of each first fin is a first rounded corner. A corner between a top surface and a side surface of each second fin is a second rounded corner. A radius of curvature of the first rounded corner is different from a radius of curvature of the second corner.
    Type: Grant
    Filed: October 8, 2019
    Date of Patent: December 29, 2020
    Assignees: Semiconductor Manufacturing International (Shanghai) Corporation, Semiconductor Manufacturing International (Beijing) Corporation
    Inventor: Jian Qiang Hu
  • Patent number: 10849260
    Abstract: An apparatus for disassembling an electronic component from a circuit board includes a base, a controller, a positioning assembly, and a heating and suction assembly. The controller is fixed to the base. The positioning assembly is arranged on the base and coupled to the controller. The positioning assembly is configured to be controlled by the controller to position the circuit board at a first predetermined position. The heating and suction assembly is movably arranged on the base and coupled to the controller. The heating and suction assembly is moved to a second predetermined position to heat the electronic component and moved to a third predetermined position to attract and hold the heated electronic component by suction, whereby the electronic component is disassembled from the circuit board.
    Type: Grant
    Filed: June 5, 2018
    Date of Patent: November 24, 2020
    Assignees: Fu Tai Hua Industry (Shenzhen) Co., Ltd., HON HAI PRECISION INDUSTRY CO., LTD.
    Inventors: Jin-Song Zheng, Jing-Bin Liang, Hai-Gui Huang, Jun-Xi Liu, Ming-Jun Yi, Er-Hui Guo, Zhou Chen, Xi-Qiang Hu
  • Patent number: 10832399
    Abstract: Methods and systems for detecting abnormal connectivity on a product are provided. The methods receive an inspection image of the product including a defect, match the inspection image with a template image of the product to locate a corresponding normal region in the template image and obtain a differential image between the inspection image and the normal region. The method further includes forming a regional mask image from component masks. Each of the component masks includes a binary image of the template image with only one kind of components of the product remaining. The regional mask image is a region in its corresponding component mask that corresponds to the normal region. The method further includes determining, based on a calculation using the differential image and the at least one regional mask image, at least one of: connectivity relationship, connectivity type and connectivity scale of abnormal connectivity on the product.
    Type: Grant
    Filed: October 23, 2018
    Date of Patent: November 10, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Jing Chang Huang, Jun Zhu, Guo Qiang Hu, Peng Ji
  • Publication number: 20200296419
    Abstract: A method of perceptual video coding based on face detection is provided. The method includes calculating a bit allocation scheme for coding a light field video based on a saliency map of the face, calculating an LCU level Lagrange multiplier for coding a light field video based on a saliency map of the face and calculating an LCU level quantization parameter for coding a light field video based on a saliency map of the face.
    Type: Application
    Filed: June 3, 2020
    Publication date: September 17, 2020
    Inventors: Zhiru SHI, Qiang HU
  • Patent number: 10748554
    Abstract: Embodiments facilitating audio source identification are provided. A computer-implemented method comprises: receiving, by a device operatively coupled to one or more processors, an audio signal under inspection; generating, by the device, an image of time-frequency spectrum of low frequency component and high frequency component of the audio signal; and identifying, by the device, a source of the audio signal based on the generated image and one or more patterns of time-frequency spectrum, wherein each of the one or more patterns is corresponding to low frequency feature and high frequency feature of a specific audio source.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: August 18, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Jing Chang Huang, Guo Qiang Hu, Peng Ji, Jun Zhu