Patents by Inventor Haibing Ren

Haibing Ren has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11526704
    Abstract: A system, article, and method of neural network object recognition for image processing includes customizing a training database and adapting an instance segmentation neural network used to perform the customization.
    Type: Grant
    Filed: October 26, 2018
    Date of Patent: December 13, 2022
    Assignee: Intel Corporation
    Inventors: Ping Guo, Lidan Zhang, Haibing Ren, Yimin Zhang
  • Patent number: 11494641
    Abstract: A system and method of teaching a neural network through reinforcement learning methodology. The system includes a machine-readable medium having one or more processors that perform a motion task to produce a first result corresponding to navigating a device during a first episode and performing an interaction task during that same episode. After completion of the first episode a processor calculates a Q value change based on the first task result and the second task result. The processor then modifies parameters based on the Q value change such that during subsequent episode iterations the motion task and interactive task are improved and a smooth and continuous transition occurs between these two tasks.
    Type: Grant
    Filed: December 27, 2017
    Date of Patent: November 8, 2022
    Assignee: Intel Corporation
    Inventors: Hu Tiger Chen, Zhongxuan Liu, Yimin Zhang, Haibing Ren, Jiankun Hu
  • Patent number: 11423508
    Abstract: A system, article, and method of point cloud registration using overlap regions for image processing.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: August 23, 2022
    Assignee: Intel Corporation
    Inventors: Yimin Zhang, Haibing Ren, Wei Hu, Ping Guo
  • Patent number: 11341736
    Abstract: Methods and apparatus to match images using semantic features are disclosed. An example apparatus includes a semantic labeler to determine a semantic label for each of a first set of points of a first image and each of a second set of points of a second image; a binary robust independent element features (BRIEF) determiner to determine semantic BRIEF descriptors for a first subset of the first set of points and a second subset of the second set of points based on the semantic labels; and a point matcher to match first points of the first subset of points to second points of the second subset of points based on the semantic BRIEF descriptors.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: May 24, 2022
    Assignee: INTEL CORPORATION
    Inventors: Yimin Zhang, Haibing Ren, Wei Hu, Ping Guo
  • Patent number: 11164327
    Abstract: Techniques are provided for estimation of human orientation and facial pose, in images that include depth information. A methodology embodying the techniques includes detecting a human in an image generated by a depth camera and estimating an orientation category associated with the detected human. The estimation is based on application of a random forest classifier, with leaf node template matching, to the image. The orientation category defines a range of angular offsets relative to an angle corresponding to the human facing the depth camera. The method also includes performing a three dimensional (3D) facial pose estimation of the detected human, based on detected facial landmarks, in response to a determination that the estimated orientation category includes the angle corresponding to the human facing the depth camera.
    Type: Grant
    Filed: June 2, 2016
    Date of Patent: November 2, 2021
    Assignee: Intel Corporation
    Inventors: Haibing Ren, Yimin Zhang, Xiaobo Hu, Fei Duan
  • Publication number: 20210312642
    Abstract: A long-term object tracker employs a continuous learning framework to overcome drift in the tracking position of a tracked object. The continuous learning framework consists of a continuous learning module that accumulates samples of the tracked object to improve the accuracy of object tracking over extended periods of time. The continuous learning module can include a sample pre-processor to refine a location of a candidate object found during object tracking, and a cropper to crop a portion of a frame containing a tracked object as a sample and to insert the sample into a continuous learning database to support future tracking.
    Type: Application
    Filed: January 3, 2019
    Publication date: October 7, 2021
    Inventors: Lidan ZHANG, Ping GUO, Haibing REN, Yimin ZHANG
  • Publication number: 20210248427
    Abstract: A system, article, and method of neural network object recognition for image processing includes customizing a training database and adapting an instance segmentation neural network used to perform the customization.
    Type: Application
    Filed: October 26, 2018
    Publication date: August 12, 2021
    Applicant: Intel Corporation
    Inventors: Ping GUO, Lidan ZHANG, Haibing REN, Yimin ZHANG
  • Publication number: 20210174134
    Abstract: Methods and apparatus to match images using semantic features are disclosed. An example apparatus includes a semantic labeler to determine a semantic label for each of a first set of points of a first image and each of a second set of points of a second image; a binary robust independent element features (BRIEF) determiner to determine semantic BRIEF descriptors for a first subset of the first set of points and a second subset of the second set of points based on the semantic labels; and a point matcher to match first points of the first subset of points to second points of the second subset of points based on the semantic BRIEF descriptors.
    Type: Application
    Filed: March 1, 2018
    Publication date: June 10, 2021
    Inventors: Yimin ZHANG, Haibing REN, Wei HU, Ping GUO
  • Publication number: 20200388004
    Abstract: A system, article, and method of point cloud registration using overlap regions for image processing.
    Type: Application
    Filed: February 26, 2018
    Publication date: December 10, 2020
    Applicant: INTEL CORPORATION
    Inventors: Yimin Zhang, Haibing Ren, Wei Hu, Ping Guo
  • Patent number: 10740912
    Abstract: Techniques are provided for detection of humans in images that include depth information. A methodology embodying the techniques includes segmenting an image into multiple windows and estimating the distance to a subject in each window based on depth pixel values in that window, and filtering to reject windows with sizes that are outside of a desired window size range. The desired window size range is based on the estimated subject distance and the focal length of the depth camera that produced the image. The method further includes generating classifier features for each remaining windows (post-filtering) for use by a cascade classifier. The cascade classifier creates candidate windows for further consideration based on a preliminary detection of a human in any of the remaining windows. The method further includes merging neighboring candidate windows and executing a linear classifier on the merged candidate windows to verify the detection of a human.
    Type: Grant
    Filed: May 19, 2016
    Date of Patent: August 11, 2020
    Assignee: Intel Corporation
    Inventors: Haibing Ren, Yimin Zhang, Fei Duan
  • Publication number: 20200226463
    Abstract: A system and method of teaching a neural network through reinforcement learning methodology. The system includes a machine-readable medium having one or more processors that perform a motion task to produce a first result corresponding to navigating a device during a first episode and performing an interaction task during that same episode. After completion of the first episode a processor calculates a Q value change based on the first task result and the second task result. The processor then modifies parameters based on the Q value change such that during subsequent episode iterations the motion task and interactive task are improved and a smooth and continuous transition occurs between these two tasks.
    Type: Application
    Filed: December 27, 2017
    Publication date: July 16, 2020
    Inventors: Hu Tiger Chen, Zhongxuan Liu, Yimin Zhang, Haibing Ren, Jianhun Hu
  • Patent number: 10685214
    Abstract: The present disclosure is directed to face detection window refinement using depth. Existing face detection systems may perform face detection by analyzing portions of visual data such as an image, video, etc. identified by sub-windows. These sub-windows are now determined only based on pixels, and thus may number in the millions. Consistent with the present disclosure, at least depth data may be utilized to refine the size and appropriateness of sub-windows that identify portions of the visual data to analyze during face detection, which may substantially reduce the number of sub-windows to be analyzed, the total data processing burden, etc. For example, at least one device may comprise user interface circuitry including capture circuitry to capture both visual data and depth data. Face detection circuitry in the at least one device may refine face detection by determining criteria for configuring the sub-windows that will be used in face detection.
    Type: Grant
    Filed: September 25, 2015
    Date of Patent: June 16, 2020
    Assignee: Intel Corporation
    Inventors: Haibing Ren, Yimin Zhang, Sirui Yang, Wei Hu
  • Patent number: 10607070
    Abstract: Systems, apparatuses and methods may generate a map of a search environment based on a probability of a target human being present within the search environment, capture a red, green, blue, depth (RGBD) image of one or more potential target humans in the search environment based on the map, and cause a robot apparatus to obtain a frontal view position with respect to at least one of the one or more potential target humans based on the RGBD images.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: March 31, 2020
    Assignee: Intel Corporation
    Inventors: Haibing Ren, Fei Duan, Yimin Zhang, Xiaobo Hu
  • Publication number: 20190156499
    Abstract: Techniques are provided for detection of humans in images that include depth information. A methodology embodying the techniques includes segmenting an image into multiple windows and estimating the distance to a subject in each window based on depth pixel values in that window, and filtering to reject windows with sizes that are outside of a desired window size range. The desired window size range is based on the estimated subject distance and the focal length of the depth camera that produced the image. The method further includes generating classifier features for each remaining windows (post-filtering) for use by a cascade classifier. The cascade classifier creates candidate windows for further consideration based on a preliminary detection of a human in any of the remaining windows. The method further includes merging neighboring candidate windows and executing a linear classifier on the merged candidate windows to verify the detection of a human.
    Type: Application
    Filed: May 19, 2016
    Publication date: May 23, 2019
    Applicant: INTEL CORPORATION
    Inventors: HAIBING REN, YIMIN ZHANG, FEI DUAN
  • Publication number: 20190147613
    Abstract: Techniques are provided for estimation of human orientation and facial pose, in images that include depth information. A methodology embodying the techniques includes detecting a human in an image generated by a depth camera and estimating an orientation category associated with the detected human. The estimation is based on application of a random forest classifier, with leaf node template matching, to the image. The orientation category defines a range of angular offsets relative to an angle corresponding to the human facing the depth camera. The method also includes performing a three dimensional (3D) facial pose estimation of the detected human, based on detected facial landmarks, in response to a determination that the estimated orientation category includes the angle corresponding to the human facing the depth camera.
    Type: Application
    Filed: June 2, 2016
    Publication date: May 16, 2019
    Applicant: INTEL CORPORATION
    Inventors: HAIBING REN, YIMIN ZHANG, XIAOBO HU, FEI DUAN
  • Publication number: 20180247110
    Abstract: The present disclosure is directed to face detection window refinement using depth. Existing face detection systems may perform face detection by analyzing portions of visual data such as an image, video, etc. identified by sub-windows. These sub-windows are now determined only based on pixels, and thus may number in the millions. Consistent with the present disclosure, at least depth data may be utilized to refine the size and appropriateness of sub-windows that identify portions of the visual data to analyze during face detection, which may substantially reduce the number of sub-windows to be analyzed, the total data processing burden, etc. For example, at least one device may comprise user interface circuitry including capture circuitry to capture both visual data and depth data. Face detection circuitry in the at least one device may refine face detection by determining criteria for configuring the sub-windows that will be used in face detection.
    Type: Application
    Filed: September 25, 2015
    Publication date: August 30, 2018
    Applicant: INTEL CORPORATION
    Inventors: HAIBING REN, YIMIN ZHANG, SIRUI YANG, WEI HU
  • Publication number: 20180247117
    Abstract: Systems, apparatuses and methods may generate a map of a search environment based on a probability of a target human being present within the search environment, capture a red, green, blue, depth (RGBD) image of one or more potential target humans in the search environment based on the map, and cause a robot apparatus to obtain a frontal view position with respect to at least one of the one or more potential target humans based on the RGBD images.
    Type: Application
    Filed: September 30, 2016
    Publication date: August 30, 2018
    Inventors: Haibing Ren, Fei Duan, Yimin Zhang, Xiaobo Hu
  • Patent number: 9876791
    Abstract: A method and apparatus for authenticating a user are provided. An authentication apparatus includes a data set generator configured to generate an authentication data set by extracting waveforms from a biosignal of a user, a similarity calculator configured to match each of the extracted waveforms to registered waveforms included in a registration data set, and calculate a similarity between each of the extracted waveforms and the registered waveforms, and an auxiliary similarity calculator configured to extract a representative authentication waveform indicating a representative waveform of the extracted waveforms and a representative registration waveform indicating a representative waveform of the registered waveforms, and calculate a similarity between the representative authentication waveform and the representative registration waveform.
    Type: Grant
    Filed: December 29, 2015
    Date of Patent: January 23, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Chisung Bae, HaiBing Ren, YongNan Ji, Xuetao Feng, Biao Wang, Sangjoon Kim
  • Publication number: 20160191517
    Abstract: A method and apparatus for authenticating a user are provided. An authentication apparatus includes a data set generator configured to generate an authentication data set by extracting waveforms from a biosignal of a user, a similarity calculator configured to match each of the extracted waveforms to registered waveforms included in a registration data set, and calculate a similarity between each of the extracted waveforms and the registered waveforms, and an auxiliary similarity calculator configured to extract a representative authentication waveform indicating a representative waveform of the extracted waveforms and a representative registration waveform indicating a representative waveform of the registered waveforms, and calculate a similarity between the representative authentication waveform and the representative registration waveform.
    Type: Application
    Filed: December 29, 2015
    Publication date: June 30, 2016
    Applicant: Samsung Electronics Co., Ltd.
    Inventors: Chisung BAE, HaiBing REN, YongNan JI, Xuetao FENG, Biao WANG, Sangjoon KIM
  • Patent number: 8803950
    Abstract: Disclosed is a 3D face capturing apparatus, method and computer-readable medium. As an example, the 3D face capturing method includes obtaining a face color image, obtaining a face depth image, aligning, by a computer, the face color image and the face depth image, obtaining, by the computer, a 3D face model by 2D modeling of the face color image and covering a modeled 2D face area on an image output by an image alignment module, removing by the computer, depth noise of the 3D face model, and obtaining, by the computer, an accurate 3D face model by aligning the 3D face model and a 3D face template, and removing residual noise based on a registration between the 3D face model and the 3D face template.
    Type: Grant
    Filed: August 24, 2010
    Date of Patent: August 12, 2014
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Haibing Ren, Xiangsheng Huang, Hwa Sup Lim