Patents by Inventor Yaohai Huang

Yaohai Huang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11809990
    Abstract: The present disclosure includes a method, apparatus and system for generating a neural network and a non-transitory computer readable storage medium storing instructions. The method comprises: recognizing at least an attribute of an object in a sample image according to a feature extracted from the sample image, using the neural network; determining a loss function value at least according to a margin value determined based on a semantic relationship between attributes, wherein the semantic relationship is obtained from a predefined table at least according to a real attribute and the recognized attribute of the object, wherein the predefined table is composed of the attributes and the semantic relationship between the attributes; updating a parameter in the neural network according to the determined loss function value. When using the neural network generated according the present disclosure, the accuracy of object attribute recognition can be improved.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: November 7, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yaohai Huang, Xingyi Huang, Yan Li
  • Patent number: 11727592
    Abstract: A detection apparatus to extract features from an image; determine the number of candidate regions of the object in the image based on the extracted features, wherein the determined number of the candidate regions is decided by a position and shape of the candidate regions; and to detect the object from the image based on at least the extracted features and the determined number, position and shape of the candidate regions.
    Type: Grant
    Filed: November 22, 2019
    Date of Patent: August 15, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yaohai Huang, Yan Zhang, Zhiyuan Zhang
  • Patent number: 11393186
    Abstract: The present disclosure provides a detection apparatus and method, and image processing apparatus and system. The detection apparatus extracts features from an image, detects objects in the image based on the extracted features; and detects key points of the detected objects based on the extracted features, the detected objects and a pre-obtained key point sets. According to the present disclosure, the whole detection speed can be ensured not to be influenced by the number of objects in the image to be detected while the objects and key points thereof are detected, so as to better meet the requirements of timeliness and practicability of the detection by the actual computer vision task.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: July 19, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yaohai Huang, Zhiyuan Zhang
  • Patent number: 11386702
    Abstract: A recognition apparatus for extracting first features of an object from a region of the object; obtaining second features of the object at least based on confidence information for first attribute of the object; determining sample information from pre-determined sample information based on the obtained second features; and recognizing the first attribute of the object based on the determined sample information.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: July 12, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Xudong Zhao, Yaohai Huang, Chunlei Wu
  • Patent number: 11308152
    Abstract: Embodiments of the present disclosure provide a quantization method of feature vector, search method, apparatus and storage medium, wherein the quantization method comprises: setting quantization codewords; selecting, from the set quantization codewords, at least one quantization codeword of which distance from an original feature vector is smaller than first predetermined distance as a quantization codeword subset; determining quantization feature vectors corresponding to the original feature vector by using at least two quantization codewords, wherein at least one quantization codeword from the at least two quantization codewords are in the quantization codeword subset. The search method is a method of performing a search among quantization feature vectors after a quantization using the quantization method.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: April 19, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yaohai Huang, Cheng Tan, Yuanda Deng
  • Patent number: 11200451
    Abstract: A template determining apparatus including an attribute distribution determination unit configured to determine a distribution of a specific attribute in a plurality of images; and a template determination unit configured to adaptatively determine a template set from the plurality of images according to the determined distribution of the specific attribute of the plurality of images. Where the determined template set will be used for image normalization.
    Type: Grant
    Filed: November 11, 2019
    Date of Patent: December 14, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yaohai Huang, Jianteng Peng, Weihong Deng, Jiani Hu
  • Patent number: 11170512
    Abstract: An image processing apparatus for extracting features from video frames of a video; and determining, for non-initial video frames, reference information of an object detected in a previous video frame thereof in a corresponding non-initial video frame with respect to object information of the object; and detecting an object from an initial video frame based on the features and detects an object from non-initial video frames based on the features and the determined reference information. The processing time of the object detection processing can be reduced, and the real-time requirements of object detection in the video can be better satisfied.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: November 9, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Zhiyuan Zhang, Yaohai Huang, Deyu Wang
  • Patent number: 11157697
    Abstract: This invention provides a method for extracting a diagnosis object from a medical document comprises: extracting, from an input medical document, body part entities and at least one type of non-body-part entities and the relations between the body part entities and the non-body-part entities; obtaining, for each pair of all possible pairs of the non-body-part entities, a relevance score between two non-body-part entities within one pair, wherein the relevance score is obtained by using the relations between the two non-body-part entities within one pair and one or more body part entities in a plurality of historical medical documents; clustering the non-body-part entities in the input medical document into one or more clusters based on the relevance scores of the all possible pairs; and outputting one or more body part entities related to one or more non-body-part entities clustered in each of the clusters as one diagnosis object.
    Type: Grant
    Filed: March 22, 2017
    Date of Patent: October 26, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Qinan Hu, Yaohai Huang, Ruishan Guo
  • Publication number: 20210073590
    Abstract: The present disclosure includes a method, apparatus and system for generating a neural network and a non-transitory computer readable storage medium storing instructions. The method comprises: recognizing at least an attribute of an object in a sample image according to a feature extracted from the sample image, using the neural network; determining a loss function value at least according to a margin value determined based on a semantic relationship between attributes, wherein the semantic relationship is obtained from a predefined table at least according to a real attribute and the recognized attribute of the object, wherein the predefined table is composed of the attributes and the semantic relationship between the attributes; updating a parameter in the neural network according to the determined loss function value. When using the neural network generated according the present disclosure, the accuracy of object attribute recognition can be improved.
    Type: Application
    Filed: September 2, 2020
    Publication date: March 11, 2021
    Inventors: Yaohai Huang, Xingyi Huang, Yan Li
  • Patent number: 10915735
    Abstract: One of the aspects of the present invention discloses a feature point detection method. The method comprises: acquiring a face region in an input image; acquiring first positions of first feature points and second feature points according to a pre-generated first model; estimating second positions of the first feature points according to the first positions of the first feature points and pre-generated second models; detecting third positions of the first feature points and the second feature points according to the second positions of the first feature points, the first positions of the second feature points and pre-generated third models. According to the present invention, the final detected face shape could approach to the actual face shape much more.
    Type: Grant
    Filed: February 22, 2017
    Date of Patent: February 9, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Dongyue Zhao, Yaohai Huang, Xian Li
  • Publication number: 20200302117
    Abstract: This invention provides a method for extracting a diagnosis object from a medical document comprises: extracting, from an input medical document, body part entities and at least one type of non-body-part entities and the relations between the body part entities and the non-body-part entities; obtaining, for each pair of all possible pairs of the non-body-part entities, a relevance score between two non-body-part entities within one pair, wherein the relevance score is obtained by using the relations between the two non-body-part entities within one pair and one or more body part entities in a plurality of historical medical documents; clustering the non-body-part entities in the input medical document into one or more clusters based on the relevance scores of the all possible pairs; and outputting one or more body part entities related to one or more non-body-part entities clustered in each of the clusters as one diagnosis object.
    Type: Application
    Filed: March 22, 2017
    Publication date: September 24, 2020
    Inventors: Qinan Hu, Yaohai Huang, Ruishan Guo
  • Publication number: 20200279124
    Abstract: The present disclosure provides a detection apparatus and method, and image processing apparatus and system. The detection apparatus extracts features from an image, detects objects in the image based on the extracted features; and detects key points of the detected objects based on the extracted features, the detected objects and a pre-obtained key point sets. According to the present disclosure, the whole detection speed can be ensured not to be influenced by the number of objects in the image to be detected while the objects and key points thereof are detected, so as to better meet the requirements of timeliness and practicability of the detection by the actual computer vision task.
    Type: Application
    Filed: February 24, 2020
    Publication date: September 3, 2020
    Inventors: Yaohai Huang, Zhiyuan Zhang
  • Publication number: 20200242345
    Abstract: A detection method including extracting features from an image, detecting a human in the image based on the extracted features, detecting an object in a surrounding region of the detected human based on the extracted features and determining human-object interaction information in the image based on the extracted features, the detected human and the detected object. The detection speed and detection precision of detecting the human, object and human-object interaction relationship from the video/image can be enhanced, and therefore the timeliness and accuracy of offering help to the human in need of help can be better met.
    Type: Application
    Filed: January 27, 2020
    Publication date: July 30, 2020
    Inventors: Yaohai Huang, Xin Ji
  • Publication number: 20200219269
    Abstract: An image processing apparatus for extracting features from video frames of a video; and determining, for non-initial video frames, reference information of an object detected in a previous video frame thereof in a corresponding non-initial video frame with respect to object information of the object; and detecting an object from an initial video frame based on the features and detects an object from non-initial video frames based on the features and the determined reference information. The processing time of the object detection processing can be reduced, and the real-time requirements of object detection in the video can be better satisfied.
    Type: Application
    Filed: January 3, 2020
    Publication date: July 9, 2020
    Inventors: Zhiyuan Zhang, Yaohai Huang, Deyu Wang
  • Publication number: 20200167587
    Abstract: A detection apparatus to extract features from an image; determine the number of candidate regions of the object in the image based on the extracted features, wherein the determined number of the candidate regions is decided by a position and shape of the candidate regions; and to detect the object from the image based on at least the extracted features and the determined number, position and shape of the candidate regions.
    Type: Application
    Filed: November 22, 2019
    Publication date: May 28, 2020
    Inventors: Yaohai Huang, Yan Zhang, Zhiyuan Zhang
  • Publication number: 20200151502
    Abstract: A template determining apparatus including an attribute distribution determination unit configured to determine a distribution of a specific attribute in a plurality of images; and a template determination unit configured to adaptatively determine a template set from the plurality of images according to the determined distribution of the specific attribute of the plurality of images. Where the determined template set will be used for image normalization.
    Type: Application
    Filed: November 11, 2019
    Publication date: May 14, 2020
    Inventors: Yaohai Huang, Jianteng Peng, Weihong Deng, Jiani Hu
  • Publication number: 20200012887
    Abstract: An attribute recognition apparatus including a unit for extracting a first feature from an image by using a feature extraction neural network; a unit for recognizing a first attribute of an object in the image based on the first feature by using a first recognition neural network; a unit for determining a second recognition neural network from a plurality of second recognition neural network candidates based on the first attribute; and a unit for recognizing at least one second attribute of the object based on the first feature by using a second recognition neural network.
    Type: Application
    Filed: July 1, 2019
    Publication date: January 9, 2020
    Inventors: Yan Li, Yaohai Huang, Xingyi Huang
  • Publication number: 20190377751
    Abstract: Embodiments of the present disclosure provide a quantization method of feature vector, search method, apparatus and storage medium, wherein the quantization method comprises: setting quantization codewords; selecting, from the set quantization codewords, at least one quantization codeword of which distance from an original feature vector is smaller than first predetermined distance as a quantization codeword subset; determining quantization feature vectors corresponding to the original feature vector by using at least two quantization codewords, wherein at least one quantization codeword from the at least two quantization codewords are in the quantization codeword subset. The search method is a method of performing a search among quantization feature vectors after a quantization using the quantization method.
    Type: Application
    Filed: June 4, 2019
    Publication date: December 12, 2019
    Inventors: Yaohai Huang, Cheng Tan, Yuanda Deng
  • Publication number: 20190354886
    Abstract: This invention provides methods and apparatuses for segmenting text. A method for segmenting a text including a plurality of sentences comprises: extracting a plurality of evidences and a plurality of inferences from the text; for each of said inferences, determining a preferred position for each of said evidences based on the text and/or segmentation histories, wherein the preferred position represents the position that the evidence is the most likely to take in a sequence of evidences which are used to make the inference; and segmenting the text into a plurality of sections by determining one or more of boundaries between every two consecutive sentences in the text as section boundaries based on the preferred positions for the evidences. By virtue of the present invention, the segmentation will be more accurate.
    Type: Application
    Filed: March 22, 2017
    Publication date: November 21, 2019
    Inventors: Yaohai Huang, Qinan Hu, Ruishan Guo
  • Patent number: 10482109
    Abstract: One or more embodiments relate to an object indexing method, object indexing device and object indexing system. An object indexing method may include an initializing step of dividing at least one first data container and at least one second data container, and initializing respectively the first and the second data containers by using a first data indexer and a second data indexer; a first indexing step of adding the input feature vector of a specific object into a first data container currently being filled by using the first data indexer; and a second indexing step, when the data size in the first data container being filled has reached a threshold, selecting another first data container as the first data container currently being filled, and in the case of executing the first indexing step, converting bulk data in the first data container previously being filled into one available second data container.
    Type: Grant
    Filed: September 26, 2016
    Date of Patent: November 19, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Cheng Tan, Yaohai Huang, Rongjun Li, Sen Na, Hirotaka Shiiyama, Masahiro Matsushita