Patents by Inventor Jingmin LUO
Jingmin LUO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12223658Abstract: This application discloses a foreground data generation method performed at a computer device. The method includes: obtaining a target image, the target image containing a target object and a background; removing the background from the target image to obtain initial foreground data of the target object in the target image; expanding the initial foreground data and eroding the expanded foreground data; blurring the eroded foreground data to obtain certain foreground data and uncertain data from the initial foreground data; and segmenting the certain foreground data from the uncertain data, to obtain target foreground data of the target object in the target image.Type: GrantFiled: March 11, 2024Date of Patent: February 11, 2025Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Jingmin Luo, Xiaolong Zhu
-
Publication number: 20240212161Abstract: This application discloses a foreground data generation method performed at a computer device. The method includes: obtaining a target image, the target image containing a target object and a background; removing the background from the target image to obtain initial foreground data of the target object in the target image; expanding the initial foreground data and eroding the expanded foreground data; blurring the eroded foreground data to obtain certain foreground data and uncertain data from the initial foreground data; and segmenting the certain foreground data from the uncertain data, to obtain target foreground data of the target object in the target image.Type: ApplicationFiled: March 11, 2024Publication date: June 27, 2024Inventors: Jingmin LUO, Xiaolong ZHU
-
Patent number: 12020142Abstract: Embodiments of this application provide a neural network model deployment method, a prediction method and a device. The described features can implement deployment of a neural network model to improve the universality of the deployment of the neural network model to the terminal device by obtaining a layer definition and an operation parameter of each network layer of an initial neural network model, executing a target network layer corresponding to the network layers, applying relational connections amongst the target network layers using a net class, converting the operation parameters into a preset format, obtaining a target operation parameter based on the preset format, loading a corresponding target operation parameter in the target network layer, and obtaining a target neural network model based on the target operation parameter.Type: GrantFiled: October 22, 2019Date of Patent: June 25, 2024Assignee: Tencent Technology (Shenzhen) Company LimitedInventors: Xiao Long Zhu, Yi Tong Wang, Kai Ning Huang, Lijian Mei, Shenghui Huang, Jingmin Luo
-
Patent number: 11961237Abstract: Embodiments of this application disclose a foreground data generation method performed at a computer device. The method includes: obtaining a background image and a target image, the target image containing a target object and a background; removing the background from the target image according to the background image and the target image, to obtain initial foreground data of the target object in the target image; obtaining certain foreground data and uncertain data from the initial foreground data, wherein the uncertain data represents data whose value is between the certain foreground data and background data corresponding to the background; and segmenting the certain foreground data from the uncertain data, to obtain target foreground data of the target object in the target image.Type: GrantFiled: May 25, 2021Date of Patent: April 16, 2024Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Jingmin Luo, Xiaolong Zhu
-
Patent number: 11907848Abstract: This application provides a method for training a pose recognition model performed at a computer device. The method includes: inputting a sample image labeled with human body key points into a feature map model included in a pose recognition model, to output a feature map of the sample image; inputting the feature map into a two-dimensional (2D) model included in the pose recognition model, to output 2D key point parameters used for representing a 2D human body pose; input a target human body feature map cropped from the feature map and the 2D key point parameter into a three-dimensional (3D) model included in the pose recognition model, to output 3D pose parameters used for representing a 3D human body pose; constructing a target loss function based on the 2D key point parameters and the 3D pose parameters; and updating the pose recognition model based on the target loss function.Type: GrantFiled: May 25, 2021Date of Patent: February 20, 2024Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Jingmin Luo, Xiaolong Zhu, Yitong Wang, Xing Ji
-
Patent number: 11710351Abstract: A computer device extracts a plurality of target windows from a target video. Each of the target windows comprises a respective plurality of consecutive video frames. For each of the target windows, the device performs action recognition on the respective plurality of consecutive video frames corresponding to the target window to obtain respective first action feature information of the target window. The device obtains a similarity between the first action feature information of the target window and preset feature information. The device determines, from the respective obtained similarities corresponding to the plurality of target windows, a highest first similarity and a first target window corresponding to the highest first similarity. The device also determines a dynamic action corresponding to the highest first similarity as the preset dynamic action in accordance with threshold settings.Type: GrantFiled: May 14, 2021Date of Patent: July 25, 2023Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Jingmin Luo, Liang Qiao, Xiaolong Zhu
-
Patent number: 11501574Abstract: In a multi-person pose recognition method, a to-be-recognized image is obtained, and a circuitous pyramid network is constructed. The circuitous network pyramid includes parallel phases, and each phase includes downsampling network layers, upsampling network layers, and a first residual connection layer to connect the downsampling and upsampling network layers. The phases are interconnected by a second residual connection layer. The circuitous pyramid network is traversed, by extracting a feature map for each phase, and the feature map of the last phase is determined to be the feature map of the to-be-recognized image. Multi-pose recognition is then performed on the to-be-recognized image according to the feature map to obtain a pose recognition result for the to-be-recognized image.Type: GrantFiled: October 19, 2020Date of Patent: November 15, 2022Assignee: Tencent Technology (Shenzhen) Company LimitedInventors: Haozhi Huang, Xinyu Gong, Jingmin Luo, Xiaolong Zhu, Wei Liu
-
Patent number: 11417095Abstract: An image recognition method is provided. The method includes obtaining predicted locations of joints of a target person in a to-be-recognized image based on a joint prediction model, where the joint prediction model is pre-constructed by: obtaining a plurality of sample images; inputting training features of the sample images and a body model feature to a neural network and obtaining predicted locations of joints in the sample images outputted by the neural network; updating a body extraction parameter and an alignment parameter; and inputting the training features of the sample images and the body model feature to the neural network to obtain the joint prediction model.Type: GrantFiled: November 15, 2019Date of Patent: August 16, 2022Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Xiaolong Zhu, Kaining Huang, Jingmin Luo, Lijian Mei, Shenghui Huang, Yongsen Zheng, Yitong Wang, Haozhi Huang
-
Patent number: 11200680Abstract: An image processing method and a related apparatus are provided. The method is applied to an image processing device, and includes: obtaining an original image, the original image including a foreground object; extracting a foreground region from the original image through a deep neural network; identifying pixels of the foreground object from the foreground region; forming a mask according to the pixels of the foreground object, the mask including mask values corresponding to the pixels of the foreground object; and extracting the foreground object from the original image according to the mask.Type: GrantFiled: November 1, 2019Date of Patent: December 14, 2021Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Xiaolong Zhu, Kaining Huang, Jingmin Luo, Lijian Mei, Shenghui Huang, Yongsen Zheng, Yitong Wang, Haozhi Huang
-
Publication number: 20210279888Abstract: Embodiments of this application disclose a foreground data generation method performed at a computer device. The method includes: obtaining a background image and a target image, the target image containing a target object and a background; removing the background from the target image according to the background image and the target image, to obtain initial foreground data of the target object in the target image; obtaining certain foreground data and uncertain data from the initial foreground data, wherein the uncertain data represents data whose value is between the certain foreground data and background data corresponding to the background; and segmenting the certain foreground data from the uncertain data, to obtain target foreground data of the target object in the target image.Type: ApplicationFiled: May 25, 2021Publication date: September 9, 2021Inventors: Jingmin LUO, Xiaolong Zhu
-
Publication number: 20210279456Abstract: This application provides a method for training a pose recognition model performed at a computer device. The method includes: inputting a sample image labeled with human body key points into a feature map model included in a pose recognition model, to output a feature map of the sample image; inputting the feature map into a two-dimensional (2D) model included in the pose recognition model, to output 2D key point parameters used for representing a 2D human body pose; input a target human body feature map cropped from the feature map and the 2D key point parameter into a three-dimensional (3D) model included in the pose recognition model, to output 3D pose parameters used for representing a 3D human body pose; constructing a target loss function based on the 2D key point parameters and the 3D pose parameters; and updating the pose recognition model based on the target loss function.Type: ApplicationFiled: May 25, 2021Publication date: September 9, 2021Inventors: Jingmin LUO, Xiaolong Zhu, Yitong Wang, Xing Ji
-
Publication number: 20210271892Abstract: A computer device extracts a plurality of target windows from a target video. Each of the target windows comprises a respective plurality of consecutive video frames. For each of the target windows, the device performs action recognition on the respective plurality of consecutive video frames corresponding to the target window to obtain respective first action feature information of the target window. The device obtains a similarity between the first action feature information of the target window and preset feature information. The device determines, from the respective obtained similarities corresponding to the plurality of target windows, a highest first similarity and a first target window corresponding to the highest first similarity. The device also determines a dynamic action corresponding to the highest first similarity as the preset dynamic action in accordance with threshold settings.Type: ApplicationFiled: May 14, 2021Publication date: September 2, 2021Inventors: Jingmin Luo, Liang Qiao, Xiaolong Zhu
-
Publication number: 20210073527Abstract: In a multi-person pose recognition method, a to-be-recognized image is obtained, and a circuitous pyramid network is constructed. The circuitous network pyramid includes parallel phases, and each phase includes downsampling network layers, upsampling network layers, and a first residual connection layer to connect the downsampling and upsampling network layers. The phases are interconnected by a second residual connection layer. The circuitous pyramid network is traversed, by extracting a feature map for each phase, and the feature map of the last phase is determined to be the feature map of the to-be-recognized image. Multi-pose recognition is then performed on the to-be-recognized image according to the feature map to obtain a pose recognition result for the to-be-recognized image.Type: ApplicationFiled: October 19, 2020Publication date: March 11, 2021Applicant: Tencent Technology (Shenzhen) Company LimitedInventors: Haozhi HUANG, Xinyu GONG, Jingmin LUO, Xiaolong ZHU, Wei LIU
-
Patent number: 10891799Abstract: An augmented reality processing method is provided for a terminal. The method includes: obtaining a plurality of frames of images, comprising a first image and a second image, which is a frame of an image immediately following the first image; obtaining a key point set of a first object in the first image; obtaining, through a neural network model, first pose key point sets respectively corresponding to a plurality of objects in the second image; determining a second pose key point set of the first object in the second image according to the key point set and a motion trend of the first object; using a target first pose key point set as a key point set of the first object in the second image; and generating an augmented information image according to the key point set of the first object in the second image.Type: GrantFiled: November 11, 2019Date of Patent: January 12, 2021Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Xiaolong Zhu, Yitong Wang, Kaining Huang, Lijian Mei, Shenghui Huang, Jingmin Luo
-
Patent number: 10880458Abstract: A video image processing method and apparatus is described. The method includes obtaining a first key point of an Mth frame image in a video. The method further includes performing weighted smoothing on the first key point of the Mth frame image according to first key points in a historical key point queue and weights in a first target weight queue, to obtain a target key point. The historical key point queue includes a first key point corresponds to each frame image in N frame images. The N frame images are images before the Mth frame image, N>0. The weights in the first target weight queue corresponding to the first key points in the historical key point queue, A weight corresponding to a first key point of an (M-a)th frame image being greater than or equal to a weight corresponding to a first key point of an (M-b)th frame image, and a<b. The method further includes adjusting the Mth frame image according to the target key point.Type: GrantFiled: November 7, 2019Date of Patent: December 29, 2020Assignee: Tencent Technology (Shenzhen) Company LimitedInventors: Xiaolong Zhu, Yitong Wang, Kaining Huang, Lijian Mei, Shenghui Huang, Jingmin Luo
-
Publication number: 20200089958Abstract: Embodiments of the present disclosure provide an image recognition method and apparatus, an electronic device, and a readable storage medium. The method for image recognition includes the steps of obtaining a to-be-recognized feature of a to-be-recognized image, the to-be-recognized image comprising a target person; obtaining a preset body model feature of a body frame image, the body model feature comprising locations of joints in the body frame image; inputting the to-be-recognized feature and the body model feature to a pre-constructed joint prediction model, the joint prediction model being obtained through training a neural network by using minimum respective differences between real locations of joints in a sample image and predicted locations of the corresponding joints as a training objective; and obtaining predicted locations of joints of the target person in the to-be-recognized image based on the joint prediction model.Type: ApplicationFiled: November 15, 2019Publication date: March 19, 2020Inventors: Xiaolong ZHU, Kaining HUANG, Jingmin LUO, Lijian MEI, Shenghui HUANG, Yongsen ZHENG, Yitong WANG, Haozhi HUANG
-
Publication number: 20200082635Abstract: An augmented reality processing method is provided for a terminal. The method includes: obtaining a plurality of frames of images, comprising a first image and a second image, which is a frame of an image immediately following the first image; obtaining a key point set of a first object in the first image; obtaining, through a neural network model, first pose key point sets respectively corresponding to a plurality of objects in the second image; determining a second pose key point set of the first object in the second image according to the key point set and a motion trend of the first object; using a target first pose key point set as a key point set of the first object in the second image; and generating an augmented information image according to the key point set of the first object in the second image.Type: ApplicationFiled: November 11, 2019Publication date: March 12, 2020Inventors: Xiaolong ZHU, Yitong WANG, Kaining HUANG, Lijian MEI, Shenghui HUANG, Jingmin LUO
-
Publication number: 20200082542Abstract: An image processing method and a related apparatus are provided. The method is applied to an image processing device, and includes: obtaining an original image, the original image including a foreground object; extracting a foreground region from the original image through a deep neural network; identifying pixels of the foreground object from the foreground region; forming a mask according to the pixels of the foreground object, the mask including mask values corresponding to the pixels of the foreground object; and extracting the foreground object from the original image according to the mask.Type: ApplicationFiled: November 1, 2019Publication date: March 12, 2020Inventors: Xiaolong ZHU, Kaining HUANG, Jingmin LUO, Lijian MEI, Shenghui HUANG, Yongsen ZHENG, Yitong WANG, Haozhi HUANG
-
Publication number: 20200076990Abstract: A video image processing method and apparatus is described. The method includes obtaining a first key point of an Mth frame image in a video. The method further includes performing weighted smoothing on the first key point of the Mth frame image according to first key points in a historical key point queue and weights in a first target weight queue, to obtain a target key point. The historical key point queue includes a first key point corresponds to each frame image in N frame images. The N frame images are images before the Mth frame image, N>0. The weights in the first target weight queue corresponding to the first key points in the historical key point queue, A weight corresponding to a first key point of an (M-a)th frame image being greater than or equal to a weight corresponding to a first key point of an (M-b)th frame image, and a<b. The method further includes adjusting the Mth frame image according to the target key point.Type: ApplicationFiled: November 7, 2019Publication date: March 5, 2020Applicant: Tencent Technology (Shenzhen) Company LimitedInventors: Xiaolong ZHU, Yitong WANG, Kaining HUANG, Lijian MEI, Shenghui HUANG, Jingmin LUO
-
Publication number: 20200050939Abstract: Embodiments of this application provide a neural network model deployment method, a prediction method and a device. The described features can implement deployment of a neural network model to improve the universality of the deployment of the neural network model to the terminal device by obtaining a layer definition and an operation parameter of each network layer of an initial neural network model, executing a target network layer corresponding to the network layers, applying relational connections amongst the target network layers using a net class, converting the operation parameters into a preset format, obtaining a target operation parameter based on the preset format, loading a corresponding target operation parameter in the target network layer, and obtaining a target neural network model based on the target operation parameter.Type: ApplicationFiled: October 22, 2019Publication date: February 13, 2020Applicant: Tencent Technology (Shenzhen) Company LimitedInventors: Xiao Long ZHU, Yi Tong WANG, Kai Ning HUANG, Lijian MEI, Shenghui HUANG, Jingmin LUO