Patents by Inventor Keke He
Keke He has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250054108Abstract: A method for training a face swap model includes concatenating an expression feature of a template image and an identity feature of a source face image to obtain a combined feature; performing encoding based on the source face image and the template image to obtain an encoding feature required for face swap; fusing the encoding feature and the combined feature to obtain a fused feature; performing decoding based on the fused feature to obtain a swapped face image; respectively predicting image attribute discrimination results of the swapped face image and a reference image by using a discriminator network of the face swap model; and calculating a difference between an expression feature of the swapped face image and the template image, calculating a difference between an identity feature of the swapped face image and the source face image, and updating the generator network and the discriminator network.Type: ApplicationFiled: August 23, 2024Publication date: February 13, 2025Inventors: Keke HE, Junwei ZHU, Ying TAI, Chengjie WANG
-
Patent number: 12197640Abstract: An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product related to the field of artificial intelligence technologies are provided. The image gaze correction method includes: acquiring an eye image from an image; performing feature extraction processing on the eye image to obtain feature information of the eye image; performing, based on the feature information and a target gaze direction, gaze correction processing on the eye image to obtain an initially corrected eye image and an eye contour mask; performing, by using the eye contour mask, adjustment processing on the initially corrected eye image to obtain a corrected eye image; and generating a gaze corrected image based on the corrected eye image.Type: GrantFiled: October 31, 2022Date of Patent: January 14, 2025Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Keke He, Zhengkai Jiang, Jinlong Peng, Yang Yi, Xiaoming Yu, Juanhui Tu, Yi Zhou, Yabiao Wang, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang
-
Publication number: 20250014149Abstract: An image synthesis method includes: obtaining a source image including source image identity information for synthesis and a template image including template image background information for synthesis; performing a target synthesis operation on the source image and the template image to obtain an initial synthesized image, the initial synthesized image including the source image identity information, the template image background information, and a partial region to be corrected; performing a target correction operation on the source image, the template image, and the initial synthesized image to obtain a target residual image; and synthesizing the initial synthesized image with the target residual image to generate a target synthesized image.Type: ApplicationFiled: September 20, 2024Publication date: January 9, 2025Inventors: Keke HE, Junwei ZHU, Ying TAI, Chengjie WANG
-
Publication number: 20240420288Abstract: A model training method includes obtaining a training sample set including a triplet training sample that includes a source image, a template image, and a true value image, performing face swapping on the source image and the template image through a first image processing model having a re-parameterization structure to obtain a face-swapped image, obtaining a second image processing model corresponding to the first image processing model and being a pre-trained image processing model, calculating a fusion loss function of the first image processing model according to the second image processing model, the first face-swapped image, and the true value image, training the first image processing model according to the fusion loss function, and determining a model parameter of the first image processing model in response to a training convergence condition of the first image processing model being reached.Type: ApplicationFiled: August 23, 2024Publication date: December 19, 2024Inventors: Keke HE, Junwei ZHU, Ying TAI, Chengjie WANG
-
Publication number: 20240206438Abstract: The present invention provides a simple and rapid construction of an animal model of constipation and use thereof. The construction method comprises: irritating a rat via tail-clamping and then gavaging the rat with 3.5-7 mg/kg of loperamide the next day, wherein the tail-clamping irritation treatment is as follows: clamping a tail 2-4 times every day for 25-35 min each time continuously for 3-5 days. The present invention obtains a method for constructing a rat model of constipation caused by liver depression and spleen deficiency by combining the tail-clamping irritation treatment and loperamide gavage treatment. The method has a short modeling period, is simple to operate, has a low cost, and effectively overcomes stress reaction of a rat. Besides, the constructed rat model of constipation caused by liver depression and spleen deficiency has various mechanisms, being stable, reliable and high in repeatability.Type: ApplicationFiled: April 17, 2023Publication date: June 27, 2024Applicant: INFINITUS (CHINA) COMPANY LTD.Inventors: Yaqian GAO, Huiqiong ZENG, Jian TANG, Yunlin ZENG, Keke HE, Yiting YANG, Hongying LI, Xiaoli WEI, Ya CAI
-
Publication number: 20240161465Abstract: An image processing method including obtaining a fake template sample group comprising a first source image, a real labeled image, and a fake template image, inputting the fake template image into an identity swapping model to obtain a first identity swapping image of the fake template image, obtaining a fake labeled sample group comprising a second source image, a real template image, and a fake labeled image, the fake labeled image being based on identity swapping processing of the real template image, inputting the real template image into the identity swapping model to obtain a second identity swapping image of the real template image, and training the identity swapping model based on the fake template sample group, the first identity swapping image, the fake labeled sample group, and the second identity swapping image to generate a trained identity swapping model.Type: ApplicationFiled: January 18, 2024Publication date: May 16, 2024Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED.Inventors: Keke HE, Junwei ZHU, Ying TAI, Chengjie WANG
-
Publication number: 20240153041Abstract: This application discloses a method for generating an image processing model performed by a computer device. The method includes: performing training by using a first source image sample, a first template image sample, and a first standard synthesized image, to obtain a first parameter adjustment model, and combining the first parameter adjustment model and a first resolution update layer into a first update model; adjusting the first update model into a second parameter adjustment model using a second source image sample and a second template image sample and a second standard synthesized image; combining the second parameter adjustment model and a second resolution update layer into a second update model; and adjusting the second update model into a target image fusion model using a third source image sample, a third template image sample and a third standard synthesized image.Type: ApplicationFiled: January 19, 2024Publication date: May 9, 2024Inventors: Keke HE, Junwei ZHU, Wenqing CHU, Ying TAI, Chengjie WANG
-
Publication number: 20230394633Abstract: This application provides an image processing method and apparatus. The method includes acquiring an identity feature of a source image and an initial attribute feature of at least one measure of a target image in response to receiving a face change request; inputting the identity feature and the initial attribute feature of the at least one measure into a face change model; iteratively performing feature fusion on the identity feature and the initial attribute feature of the at least one measure by using the face change model to obtain a fusion feature; and generating a target face change image based on the fusion feature by using the face change model, and outputting the target face change image, a face in the target face change image being fused with an identity feature of the source face and a target attribute feature of the target face.Type: ApplicationFiled: November 11, 2022Publication date: December 7, 2023Inventors: Yuchen LUO, Junwei ZHU, Keke HE, Wenqing CHU, Ying TAI, Chengjie WANG
-
Publication number: 20230316607Abstract: This application provides an image processing method performed by a computer device. The image processing method includes: receiving a face swapping request; acquiring an attribute parameter of the image, an attribute parameter of the target face, and a face feature of the target face, the attribute parameter of the image indicating a three-dimensional attribute of the face in the image; determining a target attribute parameter based on the attribute parameter of the image and the attribute parameter of the target face; determining a target comprehensive feature based on the target attribute parameter and the face feature of the target face; encoding the image to obtain an image encoding feature of the image; migrating the target comprehensive feature to the image encoding feature of the image by normalization to obtain a fusion encoding feature; and decoding the fusion encoding feature to obtain a target face-swapped image including a fusion face.Type: ApplicationFiled: November 9, 2022Publication date: October 5, 2023Inventors: Keke HE, Junwei ZHU, Xinyi ZHANG, Ying TAI, Chengjie WANG
-
Publication number: 20230290128Abstract: An de-identification method includes: performing sampling on a target space of a projector in a target network model to obtain N virtual identity vectors, N being a positive integer; extracting, by using an attribute extractor in the target network model, M attribute vectors from a target image, M being a positive integer; and generating, by using a generator in the target network model, a de-identified image of the target image based on the N virtual identity vectors and the M attribute vectors.Type: ApplicationFiled: December 6, 2022Publication date: September 14, 2023Inventors: Yuchen LUO, Junwei ZHU, Keke HE, Wenqing CHU, Ying TAI, Chengjie WANG
-
Patent number: 11710335Abstract: The present disclosure describes human body attribute recognition methods and apparatus, electronic devices, and a storage medium. The method includes acquiring a sample image containing a plurality of to-be-detected areas being labeled with true values of human body attributes; generating, through a recognition model, a heat map of the sample image and heat maps of the to-be-detected areas to obtain a global heat map and local heat maps; fusing the global and the local heat maps to obtain a fused image, and performing human body attribute recognition on the fused image to obtain predicted values; determining a focus area of each type of human body attribute according to the global and the local heat maps; correcting the recognition model by using the focus area, the true values, and the predicted values; and performing, based on the corrected recognition model, human body attribute recognition on a to-be-recognized image.Type: GrantFiled: October 19, 2021Date of Patent: July 25, 2023Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Keke He, Jing Liu, Yanhao Ge, Chengjie Wang, Jilin Li
-
Publication number: 20230100427Abstract: This application discloses a face image processing method performed by an electronic device. The method includes: acquiring a face image of a source face and a face template image of a template face; performing three-dimensional face modeling on the face image and the face template image to obtain a three-dimensional face image feature of the face image and a three-dimensional face template image feature of the face template image; fusing the three-dimensional face image feature and the three-dimensional face template image feature to obtain a three-dimensional fusion feature; performing face replacement feature extraction on the face image based on the face template image to obtain an initial face replacement feature; transforming the initial face replacement feature based on the three-dimensional fusion feature to obtain a target face replacement feature; and replacing the template face with the source face based on the target face replacement feature to obtain a target face image.Type: ApplicationFiled: November 28, 2022Publication date: March 30, 2023Inventors: Keke HE, Junwei ZHU, Yandan ZHAO, Xu CHEN, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
-
IMAGE PROCESSING METHOD AND APPARATUS, COMPUTER DEVICE, STORAGE MEDIUM, AND COMPUTER PROGRAM PRODUCT
Publication number: 20230081982Abstract: An image processing method includes performing additional image feature extraction on a training source face image to obtain a source additional image feature, performing identity feature extraction on the training source face image to obtain a source identity feature, inputting a training template face image into an encoder in a to-be-trained face swapping model to obtain a face attribute feature, inputting the source additional image feature, the source identity feature, and the face attribute feature into a decoder in the face swapping model for decoding to obtain a decoded face image, obtaining a target model loss value based on an additional image difference between the decoded face image and a comparative face image, and adjusting the model parameters of the encoder and the decoder based on the target model loss value to obtain the trained face swapping model.Type: ApplicationFiled: October 31, 2022Publication date: March 16, 2023Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Keke HE, Junwei ZHU, Hui NI, Yun CAO, Xu CHEN, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG -
Publication number: 20230072627Abstract: In the field of artificial intelligence technologies, a gaze correction method and apparatus for a face image, a device, a computer-readable storage medium, and a computer program product are provided. The method includes: acquiring an eye image from a face image; determining an eye movement flow field based on the eye image and a target gaze direction, the target gaze direction being a gaze direction to which an eye gaze in the eye image is to be corrected; adjusting a pixel position in the eye image based on the eye movement flow field, to obtain a corrected eye image; and generating a face image with a corrected gaze based on the corrected eye image.Type: ApplicationFiled: October 31, 2022Publication date: March 9, 2023Applicant: Tencent Technology (Shenzhen) Company LimitedInventors: Zhengkai JIANG, Jinlong PENG, Keke HE, Xiaoming YU, Yang YI, Juanhui TU, Yi ZHOU, Chenghao LIU, Yabiao WANG, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
-
Publication number: 20230054515Abstract: An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product. The image gaze correction method includes: acquiring a to-be-corrected eye image from a to-be-corrected image, generating, based on the to-be-corrected eye image, an eye motion flow field and an eye contour mask, the eye motion flow field being used for adjusting a pixel position in the to-be-corrected eye image, and the eye contour mask being used for indicating a probability that the pixel position in the to-be-corrected eye image belongs to an eye region, performing, based on the eye motion flow field and the eye contour mask, gaze correction processing on the to-be-corrected eye image to obtain a corrected eye image, and generating a gaze corrected image based on the corrected eye image.Type: ApplicationFiled: October 31, 2022Publication date: February 23, 2023Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Jinlong PENG, Keke HE, Zhengkai JIANG, Yang YI, Xiaoming YU, Juanhui TU, Yi ZHOU, Chenghao LIU, Yabiao WANG, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
-
Publication number: 20230049533Abstract: An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product related to the field of artificial intelligence technologies are provided. The image gaze correction method includes: acquiring an eye image from an image; performing feature extraction processing on the eye image to obtain feature information of the eye image; performing, based on the feature information and a target gaze direction, gaze correction processing on the eye image to obtain an initially corrected eye image and an eye contour mask; performing, by using the eye contour mask, adjustment processing on the initially corrected eye image to obtain a corrected eye image; and generating a gaze corrected image based on the corrected eye image.Type: ApplicationFiled: October 31, 2022Publication date: February 16, 2023Applicant: Tencent Technology (Shenzhen) Company LimitedInventors: Keke HE, Zhengkai JIANG, Jinlong PENG, Yang YI, Xiaoming YU, Juanhui TU, Yi ZHOU, Yabiao WANG, Ying TAI, Chengjie WANG, Jilin LI, Feiyue HUANG
-
Patent number: 11275932Abstract: This application discloses a human attribute recognition method performed at a computing device. The method includes: determining a human body region image in a surveillance image; inputting the human body region image into a multi-attribute convolutional neural network model, to obtain, for each of a plurality of human attributes in the human body region image, a probability that the human attribute corresponds to a respective predefined attribute value, the multi-attribute convolutional neural network model being obtained by performing multi-attribute recognition and training on a set of pre-obtained training images by using a multi-attribute convolutional neural network; determining, for each of the plurality of human attributes in the human body region image, the attribute value of the human attribute based on the corresponding probability; and displaying the attribute values of the plurality of human attributes next to the human body region image.Type: GrantFiled: July 24, 2020Date of Patent: March 15, 2022Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Siqian Yang, Jilin Li, Yongjian Wu, Yichao Yan, Keke He, Yanhao Ge, Feiyue Huang, Chengjie Wang
-
Publication number: 20220036059Abstract: The present disclosure describes human body attribute recognition methods and apparatus, electronic devices, and a storage medium. The method includes acquiring a sample image containing a plurality of to-be-detected areas being labeled with true values of human body attributes; generating, through a recognition model, a heat map of the sample image and heat maps of the to-be-detected areas to obtain a global heat map and local heat maps; fusing the global and the local heat maps to obtain a fused image, and performing human body attribute recognition on the fused image to obtain predicted values; determining a focus area of each type of human body attribute according to the global and the local heat maps; correcting the recognition model by using the focus area, the true values, and the predicted values; and performing, based on the corrected recognition model, human body attribute recognition on a to-be-recognized image.Type: ApplicationFiled: October 19, 2021Publication date: February 3, 2022Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Keke HE, Jing LIU, Yanhao GE, Chengjie WANG, Jilin LI
-
Publication number: 20200356767Abstract: This application discloses a human attribute recognition method performed at a computing device. The method includes: determining a human body region image in a surveillance image; inputting the human body region image into a multi-attribute convolutional neural network model, to obtain, for each of a plurality of human attributes in the human body region image, a probability that the human attribute corresponds to a respective predefined attribute value, the multi-attribute convolutional neural network model being obtained by performing multi-attribute recognition and training on a set of pre-obtained training images by using a multi-attribute convolutional neural network; determining, for each of the plurality of human attributes in the human body region image, the attribute value of the human attribute based on the corresponding probability; and displaying the attribute values of the plurality of human attributes next to the human body region image.Type: ApplicationFiled: July 24, 2020Publication date: November 12, 2020Inventors: Siqian YANG, Jilin Li, Yongjian Wu, Yichao Yan, Keke He, Yanhano Ge, Feiyue Huang, Chengjie Wang