Patents by Inventor Keke He

Keke He has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250054108
    Abstract: A method for training a face swap model includes concatenating an expression feature of a template image and an identity feature of a source face image to obtain a combined feature; performing encoding based on the source face image and the template image to obtain an encoding feature required for face swap; fusing the encoding feature and the combined feature to obtain a fused feature; performing decoding based on the fused feature to obtain a swapped face image; respectively predicting image attribute discrimination results of the swapped face image and a reference image by using a discriminator network of the face swap model; and calculating a difference between an expression feature of the swapped face image and the template image, calculating a difference between an identity feature of the swapped face image and the source face image, and updating the generator network and the discriminator network.
    Type: Application
    Filed: August 23, 2024
    Publication date: February 13, 2025
    Inventors: Keke HE, Junwei ZHU, Ying TAI, Chengjie WANG
  • Patent number: 12197640
    Abstract: An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product related to the field of artificial intelligence technologies are provided. The image gaze correction method includes: acquiring an eye image from an image; performing feature extraction processing on the eye image to obtain feature information of the eye image; performing, based on the feature information and a target gaze direction, gaze correction processing on the eye image to obtain an initially corrected eye image and an eye contour mask; performing, by using the eye contour mask, adjustment processing on the initially corrected eye image to obtain a corrected eye image; and generating a gaze corrected image based on the corrected eye image.
    Type: Grant
    Filed: October 31, 2022
    Date of Patent: January 14, 2025
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Keke He, Zhengkai Jiang, Jinlong Peng, Yang Yi, Xiaoming Yu, Juanhui Tu, Yi Zhou, Yabiao Wang, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang
  • Publication number: 20250014149
    Abstract: An image synthesis method includes: obtaining a source image including source image identity information for synthesis and a template image including template image background information for synthesis; performing a target synthesis operation on the source image and the template image to obtain an initial synthesized image, the initial synthesized image including the source image identity information, the template image background information, and a partial region to be corrected; performing a target correction operation on the source image, the template image, and the initial synthesized image to obtain a target residual image; and synthesizing the initial synthesized image with the target residual image to generate a target synthesized image.
    Type: Application
    Filed: September 20, 2024
    Publication date: January 9, 2025
    Inventors: Keke HE, Junwei ZHU, Ying TAI, Chengjie WANG
  • Publication number: 20240420288
    Abstract: A model training method includes obtaining a training sample set including a triplet training sample that includes a source image, a template image, and a true value image, performing face swapping on the source image and the template image through a first image processing model having a re-parameterization structure to obtain a face-swapped image, obtaining a second image processing model corresponding to the first image processing model and being a pre-trained image processing model, calculating a fusion loss function of the first image processing model according to the second image processing model, the first face-swapped image, and the true value image, training the first image processing model according to the fusion loss function, and determining a model parameter of the first image processing model in response to a training convergence condition of the first image processing model being reached.
    Type: Application
    Filed: August 23, 2024
    Publication date: December 19, 2024
    Inventors: Keke HE, Junwei ZHU, Ying TAI, Chengjie WANG
  • Publication number: 20240206438
    Abstract: The present invention provides a simple and rapid construction of an animal model of constipation and use thereof. The construction method comprises: irritating a rat via tail-clamping and then gavaging the rat with 3.5-7 mg/kg of loperamide the next day, wherein the tail-clamping irritation treatment is as follows: clamping a tail 2-4 times every day for 25-35 min each time continuously for 3-5 days. The present invention obtains a method for constructing a rat model of constipation caused by liver depression and spleen deficiency by combining the tail-clamping irritation treatment and loperamide gavage treatment. The method has a short modeling period, is simple to operate, has a low cost, and effectively overcomes stress reaction of a rat. Besides, the constructed rat model of constipation caused by liver depression and spleen deficiency has various mechanisms, being stable, reliable and high in repeatability.
    Type: Application
    Filed: April 17, 2023
    Publication date: June 27, 2024
    Applicant: INFINITUS (CHINA) COMPANY LTD.
    Inventors: Yaqian GAO, Huiqiong ZENG, Jian TANG, Yunlin ZENG, Keke HE, Yiting YANG, Hongying LI, Xiaoli WEI, Ya CAI
  • Publication number: 20240161465
    Abstract: An image processing method including obtaining a fake template sample group comprising a first source image, a real labeled image, and a fake template image, inputting the fake template image into an identity swapping model to obtain a first identity swapping image of the fake template image, obtaining a fake labeled sample group comprising a second source image, a real template image, and a fake labeled image, the fake labeled image being based on identity swapping processing of the real template image, inputting the real template image into the identity swapping model to obtain a second identity swapping image of the real template image, and training the identity swapping model based on the fake template sample group, the first identity swapping image, the fake labeled sample group, and the second identity swapping image to generate a trained identity swapping model.
    Type: Application
    Filed: January 18, 2024
    Publication date: May 16, 2024
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED.
    Inventors: Keke HE, Junwei ZHU, Ying TAI, Chengjie WANG
  • Publication number: 20240153041
    Abstract: This application discloses a method for generating an image processing model performed by a computer device. The method includes: performing training by using a first source image sample, a first template image sample, and a first standard synthesized image, to obtain a first parameter adjustment model, and combining the first parameter adjustment model and a first resolution update layer into a first update model; adjusting the first update model into a second parameter adjustment model using a second source image sample and a second template image sample and a second standard synthesized image; combining the second parameter adjustment model and a second resolution update layer into a second update model; and adjusting the second update model into a target image fusion model using a third source image sample, a third template image sample and a third standard synthesized image.
    Type: Application
    Filed: January 19, 2024
    Publication date: May 9, 2024
    Inventors: Keke HE, Junwei ZHU, Wenqing CHU, Ying TAI, Chengjie WANG
  • Publication number: 20230394633
    Abstract: This application provides an image processing method and apparatus. The method includes acquiring an identity feature of a source image and an initial attribute feature of at least one measure of a target image in response to receiving a face change request; inputting the identity feature and the initial attribute feature of the at least one measure into a face change model; iteratively performing feature fusion on the identity feature and the initial attribute feature of the at least one measure by using the face change model to obtain a fusion feature; and generating a target face change image based on the fusion feature by using the face change model, and outputting the target face change image, a face in the target face change image being fused with an identity feature of the source face and a target attribute feature of the target face.
    Type: Application
    Filed: November 11, 2022
    Publication date: December 7, 2023
    Inventors: Yuchen LUO, Junwei ZHU, Keke HE, Wenqing CHU, Ying TAI, Chengjie WANG
  • Publication number: 20230316607
    Abstract: This application provides an image processing method performed by a computer device. The image processing method includes: receiving a face swapping request; acquiring an attribute parameter of the image, an attribute parameter of the target face, and a face feature of the target face, the attribute parameter of the image indicating a three-dimensional attribute of the face in the image; determining a target attribute parameter based on the attribute parameter of the image and the attribute parameter of the target face; determining a target comprehensive feature based on the target attribute parameter and the face feature of the target face; encoding the image to obtain an image encoding feature of the image; migrating the target comprehensive feature to the image encoding feature of the image by normalization to obtain a fusion encoding feature; and decoding the fusion encoding feature to obtain a target face-swapped image including a fusion face.
    Type: Application
    Filed: November 9, 2022
    Publication date: October 5, 2023
    Inventors: Keke HE, Junwei ZHU, Xinyi ZHANG, Ying TAI, Chengjie WANG
  • Publication number: 20230290128
    Abstract: An de-identification method includes: performing sampling on a target space of a projector in a target network model to obtain N virtual identity vectors, N being a positive integer; extracting, by using an attribute extractor in the target network model, M attribute vectors from a target image, M being a positive integer; and generating, by using a generator in the target network model, a de-identified image of the target image based on the N virtual identity vectors and the M attribute vectors.
    Type: Application
    Filed: December 6, 2022
    Publication date: September 14, 2023
    Inventors: Yuchen LUO, Junwei ZHU, Keke HE, Wenqing CHU, Ying TAI, Chengjie WANG
  • Patent number: 11710335
    Abstract: The present disclosure describes human body attribute recognition methods and apparatus, electronic devices, and a storage medium. The method includes acquiring a sample image containing a plurality of to-be-detected areas being labeled with true values of human body attributes; generating, through a recognition model, a heat map of the sample image and heat maps of the to-be-detected areas to obtain a global heat map and local heat maps; fusing the global and the local heat maps to obtain a fused image, and performing human body attribute recognition on the fused image to obtain predicted values; determining a focus area of each type of human body attribute according to the global and the local heat maps; correcting the recognition model by using the focus area, the true values, and the predicted values; and performing, based on the corrected recognition model, human body attribute recognition on a to-be-recognized image.
    Type: Grant
    Filed: October 19, 2021
    Date of Patent: July 25, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Keke He, Jing Liu, Yanhao Ge, Chengjie Wang, Jilin Li
  • Publication number: 20230100427
    Abstract: This application discloses a face image processing method performed by an electronic device. The method includes: acquiring a face image of a source face and a face template image of a template face; performing three-dimensional face modeling on the face image and the face template image to obtain a three-dimensional face image feature of the face image and a three-dimensional face template image feature of the face template image; fusing the three-dimensional face image feature and the three-dimensional face template image feature to obtain a three-dimensional fusion feature; performing face replacement feature extraction on the face image based on the face template image to obtain an initial face replacement feature; transforming the initial face replacement feature based on the three-dimensional fusion feature to obtain a target face replacement feature; and replacing the template face with the source face based on the target face replacement feature to obtain a target face image.
    Type: Application
    Filed: November 28, 2022
    Publication date: March 30, 2023
    Inventors: Keke HE, Junwei ZHU, Yandan ZHAO, Xu CHEN, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Publication number: 20230081982
    Abstract: An image processing method includes performing additional image feature extraction on a training source face image to obtain a source additional image feature, performing identity feature extraction on the training source face image to obtain a source identity feature, inputting a training template face image into an encoder in a to-be-trained face swapping model to obtain a face attribute feature, inputting the source additional image feature, the source identity feature, and the face attribute feature into a decoder in the face swapping model for decoding to obtain a decoded face image, obtaining a target model loss value based on an additional image difference between the decoded face image and a comparative face image, and adjusting the model parameters of the encoder and the decoder based on the target model loss value to obtain the trained face swapping model.
    Type: Application
    Filed: October 31, 2022
    Publication date: March 16, 2023
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Keke HE, Junwei ZHU, Hui NI, Yun CAO, Xu CHEN, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Publication number: 20230072627
    Abstract: In the field of artificial intelligence technologies, a gaze correction method and apparatus for a face image, a device, a computer-readable storage medium, and a computer program product are provided. The method includes: acquiring an eye image from a face image; determining an eye movement flow field based on the eye image and a target gaze direction, the target gaze direction being a gaze direction to which an eye gaze in the eye image is to be corrected; adjusting a pixel position in the eye image based on the eye movement flow field, to obtain a corrected eye image; and generating a face image with a corrected gaze based on the corrected eye image.
    Type: Application
    Filed: October 31, 2022
    Publication date: March 9, 2023
    Applicant: Tencent Technology (Shenzhen) Company Limited
    Inventors: Zhengkai JIANG, Jinlong PENG, Keke HE, Xiaoming YU, Yang YI, Juanhui TU, Yi ZHOU, Chenghao LIU, Yabiao WANG, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Publication number: 20230054515
    Abstract: An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product. The image gaze correction method includes: acquiring a to-be-corrected eye image from a to-be-corrected image, generating, based on the to-be-corrected eye image, an eye motion flow field and an eye contour mask, the eye motion flow field being used for adjusting a pixel position in the to-be-corrected eye image, and the eye contour mask being used for indicating a probability that the pixel position in the to-be-corrected eye image belongs to an eye region, performing, based on the eye motion flow field and the eye contour mask, gaze correction processing on the to-be-corrected eye image to obtain a corrected eye image, and generating a gaze corrected image based on the corrected eye image.
    Type: Application
    Filed: October 31, 2022
    Publication date: February 23, 2023
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Jinlong PENG, Keke HE, Zhengkai JIANG, Yang YI, Xiaoming YU, Juanhui TU, Yi ZHOU, Chenghao LIU, Yabiao WANG, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Publication number: 20230049533
    Abstract: An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product related to the field of artificial intelligence technologies are provided. The image gaze correction method includes: acquiring an eye image from an image; performing feature extraction processing on the eye image to obtain feature information of the eye image; performing, based on the feature information and a target gaze direction, gaze correction processing on the eye image to obtain an initially corrected eye image and an eye contour mask; performing, by using the eye contour mask, adjustment processing on the initially corrected eye image to obtain a corrected eye image; and generating a gaze corrected image based on the corrected eye image.
    Type: Application
    Filed: October 31, 2022
    Publication date: February 16, 2023
    Applicant: Tencent Technology (Shenzhen) Company Limited
    Inventors: Keke HE, Zhengkai JIANG, Jinlong PENG, Yang YI, Xiaoming YU, Juanhui TU, Yi ZHOU, Yabiao WANG, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
  • Patent number: 11275932
    Abstract: This application discloses a human attribute recognition method performed at a computing device. The method includes: determining a human body region image in a surveillance image; inputting the human body region image into a multi-attribute convolutional neural network model, to obtain, for each of a plurality of human attributes in the human body region image, a probability that the human attribute corresponds to a respective predefined attribute value, the multi-attribute convolutional neural network model being obtained by performing multi-attribute recognition and training on a set of pre-obtained training images by using a multi-attribute convolutional neural network; determining, for each of the plurality of human attributes in the human body region image, the attribute value of the human attribute based on the corresponding probability; and displaying the attribute values of the plurality of human attributes next to the human body region image.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: March 15, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Siqian Yang, Jilin Li, Yongjian Wu, Yichao Yan, Keke He, Yanhao Ge, Feiyue Huang, Chengjie Wang
  • Publication number: 20220036059
    Abstract: The present disclosure describes human body attribute recognition methods and apparatus, electronic devices, and a storage medium. The method includes acquiring a sample image containing a plurality of to-be-detected areas being labeled with true values of human body attributes; generating, through a recognition model, a heat map of the sample image and heat maps of the to-be-detected areas to obtain a global heat map and local heat maps; fusing the global and the local heat maps to obtain a fused image, and performing human body attribute recognition on the fused image to obtain predicted values; determining a focus area of each type of human body attribute according to the global and the local heat maps; correcting the recognition model by using the focus area, the true values, and the predicted values; and performing, based on the corrected recognition model, human body attribute recognition on a to-be-recognized image.
    Type: Application
    Filed: October 19, 2021
    Publication date: February 3, 2022
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Keke HE, Jing LIU, Yanhao GE, Chengjie WANG, Jilin LI
  • Publication number: 20200356767
    Abstract: This application discloses a human attribute recognition method performed at a computing device. The method includes: determining a human body region image in a surveillance image; inputting the human body region image into a multi-attribute convolutional neural network model, to obtain, for each of a plurality of human attributes in the human body region image, a probability that the human attribute corresponds to a respective predefined attribute value, the multi-attribute convolutional neural network model being obtained by performing multi-attribute recognition and training on a set of pre-obtained training images by using a multi-attribute convolutional neural network; determining, for each of the plurality of human attributes in the human body region image, the attribute value of the human attribute based on the corresponding probability; and displaying the attribute values of the plurality of human attributes next to the human body region image.
    Type: Application
    Filed: July 24, 2020
    Publication date: November 12, 2020
    Inventors: Siqian YANG, Jilin Li, Yongjian Wu, Yichao Yan, Keke He, Yanhano Ge, Feiyue Huang, Chengjie Wang