Patents by Inventor Jingmin LUO

Jingmin LUO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12223658
    Abstract: This application discloses a foreground data generation method performed at a computer device. The method includes: obtaining a target image, the target image containing a target object and a background; removing the background from the target image to obtain initial foreground data of the target object in the target image; expanding the initial foreground data and eroding the expanded foreground data; blurring the eroded foreground data to obtain certain foreground data and uncertain data from the initial foreground data; and segmenting the certain foreground data from the uncertain data, to obtain target foreground data of the target object in the target image.
    Type: Grant
    Filed: March 11, 2024
    Date of Patent: February 11, 2025
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Jingmin Luo, Xiaolong Zhu
  • Publication number: 20240212161
    Abstract: This application discloses a foreground data generation method performed at a computer device. The method includes: obtaining a target image, the target image containing a target object and a background; removing the background from the target image to obtain initial foreground data of the target object in the target image; expanding the initial foreground data and eroding the expanded foreground data; blurring the eroded foreground data to obtain certain foreground data and uncertain data from the initial foreground data; and segmenting the certain foreground data from the uncertain data, to obtain target foreground data of the target object in the target image.
    Type: Application
    Filed: March 11, 2024
    Publication date: June 27, 2024
    Inventors: Jingmin LUO, Xiaolong ZHU
  • Patent number: 12020142
    Abstract: Embodiments of this application provide a neural network model deployment method, a prediction method and a device. The described features can implement deployment of a neural network model to improve the universality of the deployment of the neural network model to the terminal device by obtaining a layer definition and an operation parameter of each network layer of an initial neural network model, executing a target network layer corresponding to the network layers, applying relational connections amongst the target network layers using a net class, converting the operation parameters into a preset format, obtaining a target operation parameter based on the preset format, loading a corresponding target operation parameter in the target network layer, and obtaining a target neural network model based on the target operation parameter.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: June 25, 2024
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xiao Long Zhu, Yi Tong Wang, Kai Ning Huang, Lijian Mei, Shenghui Huang, Jingmin Luo
  • Patent number: 11961237
    Abstract: Embodiments of this application disclose a foreground data generation method performed at a computer device. The method includes: obtaining a background image and a target image, the target image containing a target object and a background; removing the background from the target image according to the background image and the target image, to obtain initial foreground data of the target object in the target image; obtaining certain foreground data and uncertain data from the initial foreground data, wherein the uncertain data represents data whose value is between the certain foreground data and background data corresponding to the background; and segmenting the certain foreground data from the uncertain data, to obtain target foreground data of the target object in the target image.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: April 16, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Jingmin Luo, Xiaolong Zhu
  • Patent number: 11907848
    Abstract: This application provides a method for training a pose recognition model performed at a computer device. The method includes: inputting a sample image labeled with human body key points into a feature map model included in a pose recognition model, to output a feature map of the sample image; inputting the feature map into a two-dimensional (2D) model included in the pose recognition model, to output 2D key point parameters used for representing a 2D human body pose; input a target human body feature map cropped from the feature map and the 2D key point parameter into a three-dimensional (3D) model included in the pose recognition model, to output 3D pose parameters used for representing a 3D human body pose; constructing a target loss function based on the 2D key point parameters and the 3D pose parameters; and updating the pose recognition model based on the target loss function.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: February 20, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Jingmin Luo, Xiaolong Zhu, Yitong Wang, Xing Ji
  • Patent number: 11710351
    Abstract: A computer device extracts a plurality of target windows from a target video. Each of the target windows comprises a respective plurality of consecutive video frames. For each of the target windows, the device performs action recognition on the respective plurality of consecutive video frames corresponding to the target window to obtain respective first action feature information of the target window. The device obtains a similarity between the first action feature information of the target window and preset feature information. The device determines, from the respective obtained similarities corresponding to the plurality of target windows, a highest first similarity and a first target window corresponding to the highest first similarity. The device also determines a dynamic action corresponding to the highest first similarity as the preset dynamic action in accordance with threshold settings.
    Type: Grant
    Filed: May 14, 2021
    Date of Patent: July 25, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Jingmin Luo, Liang Qiao, Xiaolong Zhu
  • Patent number: 11501574
    Abstract: In a multi-person pose recognition method, a to-be-recognized image is obtained, and a circuitous pyramid network is constructed. The circuitous network pyramid includes parallel phases, and each phase includes downsampling network layers, upsampling network layers, and a first residual connection layer to connect the downsampling and upsampling network layers. The phases are interconnected by a second residual connection layer. The circuitous pyramid network is traversed, by extracting a feature map for each phase, and the feature map of the last phase is determined to be the feature map of the to-be-recognized image. Multi-pose recognition is then performed on the to-be-recognized image according to the feature map to obtain a pose recognition result for the to-be-recognized image.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: November 15, 2022
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Haozhi Huang, Xinyu Gong, Jingmin Luo, Xiaolong Zhu, Wei Liu
  • Patent number: 11417095
    Abstract: An image recognition method is provided. The method includes obtaining predicted locations of joints of a target person in a to-be-recognized image based on a joint prediction model, where the joint prediction model is pre-constructed by: obtaining a plurality of sample images; inputting training features of the sample images and a body model feature to a neural network and obtaining predicted locations of joints in the sample images outputted by the neural network; updating a body extraction parameter and an alignment parameter; and inputting the training features of the sample images and the body model feature to the neural network to obtain the joint prediction model.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: August 16, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiaolong Zhu, Kaining Huang, Jingmin Luo, Lijian Mei, Shenghui Huang, Yongsen Zheng, Yitong Wang, Haozhi Huang
  • Patent number: 11200680
    Abstract: An image processing method and a related apparatus are provided. The method is applied to an image processing device, and includes: obtaining an original image, the original image including a foreground object; extracting a foreground region from the original image through a deep neural network; identifying pixels of the foreground object from the foreground region; forming a mask according to the pixels of the foreground object, the mask including mask values corresponding to the pixels of the foreground object; and extracting the foreground object from the original image according to the mask.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: December 14, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiaolong Zhu, Kaining Huang, Jingmin Luo, Lijian Mei, Shenghui Huang, Yongsen Zheng, Yitong Wang, Haozhi Huang
  • Publication number: 20210279888
    Abstract: Embodiments of this application disclose a foreground data generation method performed at a computer device. The method includes: obtaining a background image and a target image, the target image containing a target object and a background; removing the background from the target image according to the background image and the target image, to obtain initial foreground data of the target object in the target image; obtaining certain foreground data and uncertain data from the initial foreground data, wherein the uncertain data represents data whose value is between the certain foreground data and background data corresponding to the background; and segmenting the certain foreground data from the uncertain data, to obtain target foreground data of the target object in the target image.
    Type: Application
    Filed: May 25, 2021
    Publication date: September 9, 2021
    Inventors: Jingmin LUO, Xiaolong Zhu
  • Publication number: 20210279456
    Abstract: This application provides a method for training a pose recognition model performed at a computer device. The method includes: inputting a sample image labeled with human body key points into a feature map model included in a pose recognition model, to output a feature map of the sample image; inputting the feature map into a two-dimensional (2D) model included in the pose recognition model, to output 2D key point parameters used for representing a 2D human body pose; input a target human body feature map cropped from the feature map and the 2D key point parameter into a three-dimensional (3D) model included in the pose recognition model, to output 3D pose parameters used for representing a 3D human body pose; constructing a target loss function based on the 2D key point parameters and the 3D pose parameters; and updating the pose recognition model based on the target loss function.
    Type: Application
    Filed: May 25, 2021
    Publication date: September 9, 2021
    Inventors: Jingmin LUO, Xiaolong Zhu, Yitong Wang, Xing Ji
  • Publication number: 20210271892
    Abstract: A computer device extracts a plurality of target windows from a target video. Each of the target windows comprises a respective plurality of consecutive video frames. For each of the target windows, the device performs action recognition on the respective plurality of consecutive video frames corresponding to the target window to obtain respective first action feature information of the target window. The device obtains a similarity between the first action feature information of the target window and preset feature information. The device determines, from the respective obtained similarities corresponding to the plurality of target windows, a highest first similarity and a first target window corresponding to the highest first similarity. The device also determines a dynamic action corresponding to the highest first similarity as the preset dynamic action in accordance with threshold settings.
    Type: Application
    Filed: May 14, 2021
    Publication date: September 2, 2021
    Inventors: Jingmin Luo, Liang Qiao, Xiaolong Zhu
  • Publication number: 20210073527
    Abstract: In a multi-person pose recognition method, a to-be-recognized image is obtained, and a circuitous pyramid network is constructed. The circuitous network pyramid includes parallel phases, and each phase includes downsampling network layers, upsampling network layers, and a first residual connection layer to connect the downsampling and upsampling network layers. The phases are interconnected by a second residual connection layer. The circuitous pyramid network is traversed, by extracting a feature map for each phase, and the feature map of the last phase is determined to be the feature map of the to-be-recognized image. Multi-pose recognition is then performed on the to-be-recognized image according to the feature map to obtain a pose recognition result for the to-be-recognized image.
    Type: Application
    Filed: October 19, 2020
    Publication date: March 11, 2021
    Applicant: Tencent Technology (Shenzhen) Company Limited
    Inventors: Haozhi HUANG, Xinyu GONG, Jingmin LUO, Xiaolong ZHU, Wei LIU
  • Patent number: 10891799
    Abstract: An augmented reality processing method is provided for a terminal. The method includes: obtaining a plurality of frames of images, comprising a first image and a second image, which is a frame of an image immediately following the first image; obtaining a key point set of a first object in the first image; obtaining, through a neural network model, first pose key point sets respectively corresponding to a plurality of objects in the second image; determining a second pose key point set of the first object in the second image according to the key point set and a motion trend of the first object; using a target first pose key point set as a key point set of the first object in the second image; and generating an augmented information image according to the key point set of the first object in the second image.
    Type: Grant
    Filed: November 11, 2019
    Date of Patent: January 12, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiaolong Zhu, Yitong Wang, Kaining Huang, Lijian Mei, Shenghui Huang, Jingmin Luo
  • Patent number: 10880458
    Abstract: A video image processing method and apparatus is described. The method includes obtaining a first key point of an Mth frame image in a video. The method further includes performing weighted smoothing on the first key point of the Mth frame image according to first key points in a historical key point queue and weights in a first target weight queue, to obtain a target key point. The historical key point queue includes a first key point corresponds to each frame image in N frame images. The N frame images are images before the Mth frame image, N>0. The weights in the first target weight queue corresponding to the first key points in the historical key point queue, A weight corresponding to a first key point of an (M-a)th frame image being greater than or equal to a weight corresponding to a first key point of an (M-b)th frame image, and a<b. The method further includes adjusting the Mth frame image according to the target key point.
    Type: Grant
    Filed: November 7, 2019
    Date of Patent: December 29, 2020
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xiaolong Zhu, Yitong Wang, Kaining Huang, Lijian Mei, Shenghui Huang, Jingmin Luo
  • Publication number: 20200089958
    Abstract: Embodiments of the present disclosure provide an image recognition method and apparatus, an electronic device, and a readable storage medium. The method for image recognition includes the steps of obtaining a to-be-recognized feature of a to-be-recognized image, the to-be-recognized image comprising a target person; obtaining a preset body model feature of a body frame image, the body model feature comprising locations of joints in the body frame image; inputting the to-be-recognized feature and the body model feature to a pre-constructed joint prediction model, the joint prediction model being obtained through training a neural network by using minimum respective differences between real locations of joints in a sample image and predicted locations of the corresponding joints as a training objective; and obtaining predicted locations of joints of the target person in the to-be-recognized image based on the joint prediction model.
    Type: Application
    Filed: November 15, 2019
    Publication date: March 19, 2020
    Inventors: Xiaolong ZHU, Kaining HUANG, Jingmin LUO, Lijian MEI, Shenghui HUANG, Yongsen ZHENG, Yitong WANG, Haozhi HUANG
  • Publication number: 20200082635
    Abstract: An augmented reality processing method is provided for a terminal. The method includes: obtaining a plurality of frames of images, comprising a first image and a second image, which is a frame of an image immediately following the first image; obtaining a key point set of a first object in the first image; obtaining, through a neural network model, first pose key point sets respectively corresponding to a plurality of objects in the second image; determining a second pose key point set of the first object in the second image according to the key point set and a motion trend of the first object; using a target first pose key point set as a key point set of the first object in the second image; and generating an augmented information image according to the key point set of the first object in the second image.
    Type: Application
    Filed: November 11, 2019
    Publication date: March 12, 2020
    Inventors: Xiaolong ZHU, Yitong WANG, Kaining HUANG, Lijian MEI, Shenghui HUANG, Jingmin LUO
  • Publication number: 20200082542
    Abstract: An image processing method and a related apparatus are provided. The method is applied to an image processing device, and includes: obtaining an original image, the original image including a foreground object; extracting a foreground region from the original image through a deep neural network; identifying pixels of the foreground object from the foreground region; forming a mask according to the pixels of the foreground object, the mask including mask values corresponding to the pixels of the foreground object; and extracting the foreground object from the original image according to the mask.
    Type: Application
    Filed: November 1, 2019
    Publication date: March 12, 2020
    Inventors: Xiaolong ZHU, Kaining HUANG, Jingmin LUO, Lijian MEI, Shenghui HUANG, Yongsen ZHENG, Yitong WANG, Haozhi HUANG
  • Publication number: 20200076990
    Abstract: A video image processing method and apparatus is described. The method includes obtaining a first key point of an Mth frame image in a video. The method further includes performing weighted smoothing on the first key point of the Mth frame image according to first key points in a historical key point queue and weights in a first target weight queue, to obtain a target key point. The historical key point queue includes a first key point corresponds to each frame image in N frame images. The N frame images are images before the Mth frame image, N>0. The weights in the first target weight queue corresponding to the first key points in the historical key point queue, A weight corresponding to a first key point of an (M-a)th frame image being greater than or equal to a weight corresponding to a first key point of an (M-b)th frame image, and a<b. The method further includes adjusting the Mth frame image according to the target key point.
    Type: Application
    Filed: November 7, 2019
    Publication date: March 5, 2020
    Applicant: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xiaolong ZHU, Yitong WANG, Kaining HUANG, Lijian MEI, Shenghui HUANG, Jingmin LUO
  • Publication number: 20200050939
    Abstract: Embodiments of this application provide a neural network model deployment method, a prediction method and a device. The described features can implement deployment of a neural network model to improve the universality of the deployment of the neural network model to the terminal device by obtaining a layer definition and an operation parameter of each network layer of an initial neural network model, executing a target network layer corresponding to the network layers, applying relational connections amongst the target network layers using a net class, converting the operation parameters into a preset format, obtaining a target operation parameter based on the preset format, loading a corresponding target operation parameter in the target network layer, and obtaining a target neural network model based on the target operation parameter.
    Type: Application
    Filed: October 22, 2019
    Publication date: February 13, 2020
    Applicant: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xiao Long ZHU, Yi Tong WANG, Kai Ning HUANG, Lijian MEI, Shenghui HUANG, Jingmin LUO