Patents by Inventor Jilin Li

Jilin Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11928893
    Abstract: An action recognition method includes: obtaining original feature submaps of each of temporal frames on a plurality of convolutional channels by using a multi-channel convolutional layer; calculating, by using each of the temporal frames as a target temporal frame, motion information weights of the target temporal frame on the convolutional channels according to original feature submaps of the target temporal frame and original feature submaps of a next temporal frame, and obtaining motion information feature maps of the target temporal frame on the convolutional channels according to the motion information weights; performing temporal convolution on the motion information feature maps of the target temporal frame to obtain temporal motion feature maps of the target temporal frame; and recognizing an action type of a moving object in image data of the target temporal frame according to the temporal motion feature maps of the target temporal frame on the convolutional channels.
    Type: Grant
    Filed: November 18, 2021
    Date of Patent: March 12, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Donghao Luo, Yabiao Wang, Chenyang Guo, Boyuan Deng, Chengjie Wang, Jilin Li, Feiyue Huang, Yongjian Wu
  • Publication number: 20230401672
    Abstract: A video processing method includes: obtaining a first video frame and a second video frame in a target video, the first video frame being a previous frame of the second video frame; inputting the first video frame and the second video frame to a target neural network, and obtaining a target intermediate video frame output by the target neural network, the target neural network being trained based on an optical flow distillation constraint and a feature consistency constraint; and interpolating the target intermediate video frame between the first video frame and the second video frame.
    Type: Application
    Filed: August 25, 2023
    Publication date: December 14, 2023
    Inventors: Boyuan JIANG, Lingtong KONG, Donghao LUO, Ying TAI, Chengjie WANG, Xiaoming HUANG, Jilin LI, Feiyue HUANG, Yongjian WU
  • Publication number: 20230290187
    Abstract: A liveness detection method includes: obtaining a reflected audio signal and video data of a object in response to receiving a liveness detection request; performing signal processing and time-frequency analysis on the reflected audio signal to obtain time-frequency information of a processed audio signal, and extracting motion trajectory information of the object from the video data; respectively extract features from the time-frequency information and the motion trajectory information to obtain an audio feature and a motion feature of the object; calculating first global attention information of the object according to the audio feature, and calculating second global attention information of the object according to the motion feature; and fusing the first global attention information with the second global attention information to obtain fused global information, and determining a liveness detection result of the object based on the fused global information.
    Type: Application
    Filed: May 17, 2023
    Publication date: September 14, 2023
    Inventors: Jia MENG, Dongheng ZHANG, Jian ZHANG, Mingwei BI, Xinzhe DENG, Shouhong DING, Jilin LI
  • Publication number: 20230281833
    Abstract: A facial image processing method includes: obtaining first optical flow information; obtaining, based on the first optical flow information, second optical flow information through an optical flow information prediction sub-model of an image processing model; generating, based on the first facial sample image and the second optical flow information, a predicted image of the first facial sample image through a generator of the image processing model; discriminating the predicted image and the second facial sample image through a discriminator of the image processing model to obtain a first discrimination result and a second discrimination result; and training the image processing model based on the first discrimination result, the second discrimination result, the predicted image, the second facial sample image, the first optical flow information, and the second optical flow information.
    Type: Application
    Filed: May 10, 2023
    Publication date: September 7, 2023
    Inventors: Feida ZHU, Junwei ZHU, Yun CAO, Ying TAI, Chengjie WANG, Jilin LI
  • Publication number: 20230259739
    Abstract: Disclosed herein are an image detection method and apparatus, a computer-readable storage medium, and a computer device. The method includes iteratively training a plurality of neural network models to obtain a plurality of trained neural network model; and performing detection on an image to be detected using the trained plurality of neural network models to obtain a detection result. Each iteration of training includes: for each of a plurality of sample images, separately inputting the sample image into the neural network models to obtain a fuzzy probability value set, and calculating, based on the fuzzy probability value set and preset label information of the sample image, a loss parameter of the sample image; selecting target sample images based on a distribution of loss parameters of the plurality of sample images; and updating the plurality of neural network models based on the target sample images.
    Type: Application
    Filed: April 18, 2023
    Publication date: August 17, 2023
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Boshen ZHANG, Yabiao Wang, Chengjie Wang, Jilin Li, Feiyue Huang
  • Publication number: 20230237326
    Abstract: The present disclosure relates to data processing method and apparatus. The method includes: acquiring local model parameters respectively corresponding to N local recognition models; acquiring M parameter fusion modes associated with a local model parameter set, and performing parameter fusion on the local model parameter set respectively according to each parameter fusion mode, so as to obtain M alternative global models; and acquiring evaluation indexes of the M alternative global models respectively in a multimedia verification data set, determining a target global model in the M alternative global models according to the evaluation indexes, and transmitting the target global model to N clients, the N clients updating parameters of a local recognition model associated with the target global model according to the target global model respectively, so as to obtain an object recognition model.
    Type: Application
    Filed: March 30, 2023
    Publication date: July 27, 2023
    Applicant: Tencent Cloud Computing (Beijing) Co., Ltd.
    Inventors: Jiaxiang WU, Fan BAI, Pengcheng SHEN, Shaoxin LI, Jilin LI
  • Publication number: 20230237630
    Abstract: This disclosure relates to image processing method and apparatus. The method includes: processing, with a first generator in an image processing model, a first sample image in a first sample set to obtain a first predicted image; processing, with the first generator, a second sample image in a second sample set to obtain a second predicted image; and training the image processing model according to a difference between the target avatar in the first sample image and the first predicted avatar and a difference between a first type attribute of the sample avatar in the second sample image and a first type attribute of the second predicted avatar.
    Type: Application
    Filed: March 31, 2023
    Publication date: July 27, 2023
    Applicant: Tencent Cloud Computing (Beijing) Co., Ltd.
    Inventors: Feida ZHU, Ying TAI, Chengjie WANG, Jilin LI
  • Publication number: 20230237633
    Abstract: An image processing method and apparatus that includes: performing feature extraction processing on N image regions of a to-be-processed image respectively to obtain feature data corresponding to the N image regions respectively, N being an integer greater than or equal to 1, performing defect detection on the N image regions respectively according to the feature data corresponding to the N image regions respectively to obtain a prediction probability of a defect in each of the N image regions, obtaining attention for each image region, adjusting the prediction probability of the defect in each image region according to the attention for each image region, and generating a prediction result of the to-be-processed image according to the adjusted prediction probability of each image region.
    Type: Application
    Filed: April 3, 2023
    Publication date: July 27, 2023
    Applicant: Tencent Cloud Computing (Beijing) Co., Ltd.
    Inventors: Boshen ZHANG, Yabiao WANG, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Patent number: 11710335
    Abstract: The present disclosure describes human body attribute recognition methods and apparatus, electronic devices, and a storage medium. The method includes acquiring a sample image containing a plurality of to-be-detected areas being labeled with true values of human body attributes; generating, through a recognition model, a heat map of the sample image and heat maps of the to-be-detected areas to obtain a global heat map and local heat maps; fusing the global and the local heat maps to obtain a fused image, and performing human body attribute recognition on the fused image to obtain predicted values; determining a focus area of each type of human body attribute according to the global and the local heat maps; correcting the recognition model by using the focus area, the true values, and the predicted values; and performing, based on the corrected recognition model, human body attribute recognition on a to-be-recognized image.
    Type: Grant
    Filed: October 19, 2021
    Date of Patent: July 25, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Keke He, Jing Liu, Yanhao Ge, Chengjie Wang, Jilin Li
  • Publication number: 20230116801
    Abstract: An image authenticity detection method includes: obtaining a target image; inputting the target image into a generator of a generative adversarial network, and outputting an artifact image corresponding to the target image through the generator, where the artifact image is used for representing a difference between the target image and a real image; the generator is configured to output a prediction artifact image corresponding to a sample image and generate a fitting image based on the prediction artifact image; and the generative adversarial network further comprises a discriminator in a training stage, and the discriminator is configured to discriminate the authenticity of the fitting image, to assist the generator to learn a difference feature between a false image and a real image; and determining an authenticity detection result of the target image based on the artifact image.
    Type: Application
    Filed: December 6, 2022
    Publication date: April 13, 2023
    Inventors: Taiping YAO, Xinyao WANG, Shouhong DING, Jilin LI, Yunsheng WU
  • Publication number: 20230104345
    Abstract: An image attack detection method includes: acquiring an image-to-be-detected, and performing global classification recognition based on the image-to-be-detected to obtain a global classification recognition result; performing local image extraction randomly based on the image-to-be-detected to obtain a target number of local images, the target number being obtained by calculation according to a defensive rate of a reference image corresponding to the image-to-be-detected; performing local classification recognition based on the target number of local images respectively to obtain respective local classification recognition results, and fusing the respective local classification recognition results to obtain a target classification recognition result; and detecting a similarity between the target classification recognition result and the global recognition result, and determining the image-to-be-detected as an attack image when the target classification recognition result and the global classification recognit
    Type: Application
    Filed: November 30, 2022
    Publication date: April 6, 2023
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Bo LI, Jianghe XU, Shuang WU, Shouhong DING, Jilin LI
  • Publication number: 20230100427
    Abstract: This application discloses a face image processing method performed by an electronic device. The method includes: acquiring a face image of a source face and a face template image of a template face; performing three-dimensional face modeling on the face image and the face template image to obtain a three-dimensional face image feature of the face image and a three-dimensional face template image feature of the face template image; fusing the three-dimensional face image feature and the three-dimensional face template image feature to obtain a three-dimensional fusion feature; performing face replacement feature extraction on the face image based on the face template image to obtain an initial face replacement feature; transforming the initial face replacement feature based on the three-dimensional fusion feature to obtain a target face replacement feature; and replacing the template face with the source face based on the target face replacement feature to obtain a target face image.
    Type: Application
    Filed: November 28, 2022
    Publication date: March 30, 2023
    Inventors: Keke HE, Junwei ZHU, Yandan ZHAO, Xu CHEN, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Publication number: 20230095182
    Abstract: A method and apparatus for extracting biological features, a device, a medium, and a program product, relating to the field of image processing. The method includes generating an image sequence according to a biological feature image, the image sequence including the biological feature image and n local image blocks, the local image blocks being obtained by segmenting the biological feature image, n being a positive integer, generating a feature vector group based on the image sequence, feature vectors in the feature vector group being generated based on a feature information interaction result between the biological feature image and the local image blocks and a feature information interaction result between the local image blocks, and taking a feature vector corresponding to the biological feature image in the feature vector group as biological feature information of the biological feature image.
    Type: Application
    Filed: November 30, 2022
    Publication date: March 30, 2023
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Taiping Yao, Keyue Zhang, Shuang Wu, Jia Meng, Shouhong Ding, Jilin Li
  • Publication number: 20230098548
    Abstract: A computing device acquires an original image sequence. The device performs image preprocessing on the original image sequence to obtain a feature map sequence and a confidence map sequence that are corresponding to the original image sequence. The device performs feature fusion on the feature map sequence based on the confidence map sequence, to obtain a target fused feature map corresponding to a target original image frame in the original image sequence. The device reconstructs the target original image frame based on the target fused feature map to obtain a target reconstructed image frame. Credibility supervision at the pixel level is performed on features in the feature fusion process to guide the fusion of image features with high credibility, thereby improving the image quality of a reconstructed image.
    Type: Application
    Filed: November 28, 2022
    Publication date: March 30, 2023
    Inventors: Xinyi ZHANG, Junwei ZHU, Wenqing CHU, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Publication number: 20230086552
    Abstract: An image processing method, including: obtaining an original image, the original image including biological features of a to-be-detected object, fusing a global frequency domain map corresponding to the original image with the original image to obtain a global fusion image, performing living body detection on the global fusion image to obtain a first detection result, determining that the original image does not pass the living body detection when the first detection result indicates that the original image belongs to a screen reproduced image, obtaining, when the original image does not belong to the screen reproduced image, a biological feature image based on the biological features, fusing a local frequency domain map with the biological feature image to obtain a local fusion image, performing living body detection on the local fusion image to obtain a second detection result, and determining a living body detection result corresponding to the original image.
    Type: Application
    Filed: November 17, 2022
    Publication date: March 23, 2023
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Bangjie YIN, Taiping YAO, Shuang WU, Jia MENG, Shouhong DING, Jilin LI
  • Publication number: 20230087489
    Abstract: An image processing method and apparatus are provided. During image matting on an original image, a plurality of segmented images including different regions are first obtained through semantic segmentation. Further, according to the segmented images, lines of different widths are drawn on a contour line of a foreground region to obtain a target trimap. Finally, a target image is generated based on the target trimap. For the target trimap, because lines of different widths are drawn on the contour line of the foreground region, pertinent image matting may be implemented for different regions, so that image matting precision may be improved for a region requiring fine image matting, and image matting precision of another region can also be ensured. In this way, a final image obtained through image matting is fine and natural.
    Type: Application
    Filed: November 17, 2022
    Publication date: March 23, 2023
    Inventors: Yunlong FENG, Xu Chen, Ying Tai, Chengjie Wang, Jilin Li
  • Publication number: 20230082906
    Abstract: A liveness detection method is provided. In the method, image features are extracted from an image of a user. Convolution processing is performed on the image features through an estimation network to obtain a predicted mean value and a predicted variance of the image features. Standardization processing is performed on the image features based on the predicted mean value, the predicted variance, and predetermined network parameters of the standardization processing to obtain standardized features. Whether the image of the user includes a living body image is determined according to a liveness classification probability of a classification performed on the image of the user based on the standardized features. Apparatus and non-transitory computer-readable storage medium counterpart embodiments are also contemplated.
    Type: Application
    Filed: November 23, 2022
    Publication date: March 16, 2023
    Applicant: Tencent Technology (Shenzhen) Company Limited
    Inventors: Taiping YAO, Keyue ZHANG, Shouhong DING, Jilin LI
  • Publication number: 20230081982
    Abstract: An image processing method includes performing additional image feature extraction on a training source face image to obtain a source additional image feature, performing identity feature extraction on the training source face image to obtain a source identity feature, inputting a training template face image into an encoder in a to-be-trained face swapping model to obtain a face attribute feature, inputting the source additional image feature, the source identity feature, and the face attribute feature into a decoder in the face swapping model for decoding to obtain a decoded face image, obtaining a target model loss value based on an additional image difference between the decoded face image and a comparative face image, and adjusting the model parameters of the encoder and the decoder based on the target model loss value to obtain the trained face swapping model.
    Type: Application
    Filed: October 31, 2022
    Publication date: March 16, 2023
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Keke HE, Junwei ZHU, Hui NI, Yun CAO, Xu CHEN, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Publication number: 20230081645
    Abstract: An image detection method includes obtaining a facial image, and obtaining a frequency-domain image of the facial image and a spatial-domain feature of the facial image, the frequency-domain image being obtained by performing frequency-domain transformation on the facial image. The spatial-domain feature is obtained by performing feature extraction on the facial image. The method further includes performing feature extraction based on the frequency-domain image, to obtain a frequency-domain feature of the facial image, and fusing the spatial-domain feature and the frequency-domain feature by using an attention fusion network of a facial image detection model, to obtain a fused feature of the facial image. The method further includes obtaining a detection result of the facial image based on the fused feature, the detection result indicating whether the facial image is a forged facial image.
    Type: Application
    Filed: November 21, 2022
    Publication date: March 16, 2023
    Applicant: Tencent Technology (Shenzhen) Company Limited
    Inventors: Taiping YAO, Shen CHEN, Yang CHEN, Shouhong DING, Jilin LI, Feiyue HUANG
  • Publication number: 20230072627
    Abstract: In the field of artificial intelligence technologies, a gaze correction method and apparatus for a face image, a device, a computer-readable storage medium, and a computer program product are provided. The method includes: acquiring an eye image from a face image; determining an eye movement flow field based on the eye image and a target gaze direction, the target gaze direction being a gaze direction to which an eye gaze in the eye image is to be corrected; adjusting a pixel position in the eye image based on the eye movement flow field, to obtain a corrected eye image; and generating a face image with a corrected gaze based on the corrected eye image.
    Type: Application
    Filed: October 31, 2022
    Publication date: March 9, 2023
    Applicant: Tencent Technology (Shenzhen) Company Limited
    Inventors: Zhengkai JIANG, Jinlong PENG, Keke HE, Xiaoming YU, Yang YI, Juanhui TU, Yi ZHOU, Chenghao LIU, Yabiao WANG, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG