Patents by Inventor Linchao BAO

Linchao BAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11961325
    Abstract: An image processing method and apparatus, a computer-readable medium, and an electronic device are provided. The image processing method includes: respectively projecting, according to a plurality of view angle parameters corresponding to a plurality of view angles, a face model of a target object onto a plurality of face images of the target object acquired from the plurality of view angles, to determine correspondences between regions on the face model and regions on the face image; respectively extracting, based on the correspondences and a target region in the face model that need to generate a texture image, images corresponding to the target region from the plurality of face images; and fusing the images that correspond to the target region and that are respectively extracted from the plurality of face images, to generate the texture image.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: April 16, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiangkai Lin, Linchao Bao, Yonggen Ling, Yibing Song, Wei Liu
  • Patent number: 11941737
    Abstract: Embodiments of this application disclose an artificial intelligence-based (AI-based) animation character control method. When one animation character has a corresponding face customization base, and one animation character has no corresponding face customization base, the animation character having the face customization base may be used as a driving character, and the animation character having no face customization base may be used as a driven character.
    Type: Grant
    Filed: September 27, 2021
    Date of Patent: March 26, 2024
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Sheng Wang, Xing Ji, Zhantu Zhu, Xiangkai Lin, Linchao Bao
  • Patent number: 11900557
    Abstract: A three-dimensional face model generation method is provided. The method includes: obtaining an inputted three-dimensional face mesh of a target object; aligning the three-dimensional face mesh with a first three-dimensional face model of a standard object according to face keypoints; performing fitting on the three-dimensional face mesh and a local area of the first three-dimensional face model, to obtain a second three-dimensional face model after local fitting; and performing fitting on the three-dimensional face mesh and a global area of the second three-dimensional face model, to obtain a three-dimensional face model of the target object after global fitting.
    Type: Grant
    Filed: October 22, 2021
    Date of Patent: February 13, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiangkai Lin, Linchao Bao
  • Patent number: 11798190
    Abstract: Embodiments of this application disclose a method for displaying a virtual character in a plurality of real-world images captured by a camera is performed at an electronic device. The method includes: capturing an initial real-world image using the camera; simulating a display of the virtual character in the initial real-world image; capturing a subsequent real-world image using the camera after a movement of the camera; determining position and pose updates of the camera associated with the movement of the camera from tracking one or more feature points in the initial real-world image and the subsequent real-world image; and adjusting the display of the virtual character in the subsequent real-world image in accordance with the position and pose updates of the camera associated with the movement of the camera.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: October 24, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiangkai Lin, Liang Qiao, Fengming Zhu, Yu Zuo, Zeyu Yang, Yonggen Ling, Linchao Bao
  • Patent number: 11763487
    Abstract: A method for an image capturing device includes: acquiring a first image of a target object; extracting coordinate information of a first 2D key point corresponding to the target object; acquiring a second image of the target object; acquiring coordinate information of a second 2D key point in the second image according to the coordinate information of the first 2D key point, the first 2D key point and the second 2D key point being the same key point in the target object; acquiring coordinate information of a 3D key point corresponding to the target object, the 3D key point being a key point obtained after a triangulation operation; and determining camera posture information of the second image according to the coordinate information of the first 2D key point, the coordinate information of the second 2D key point, the coordinate information of the 3D key point, and a 3D-2D projection.
    Type: Grant
    Filed: December 1, 2021
    Date of Patent: September 19, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Linchao Bao, Wei Liu
  • Patent number: 11748934
    Abstract: This application provides a three-dimensional (3D) expression base generation method performed by a computer device. The method includes: obtaining image pairs of a target object in n types of head postures, each image pair including a color feature image and a depth image in a head posture; constructing a 3D human face model of the target object according to then image pairs; and generating a set of expression bases of the target object according to the 3D human face model of the target object. According to this application, based on a reconstructed 3D human face model, a set of expression bases of a target object is further generated, so that more diversified product functions may be expanded based on the set of expression bases.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: September 5, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiangkai Lin, Linchao Bao
  • Patent number: 11636613
    Abstract: A computer application method for generating a three-dimensional (3D) face model is provided, performed by a face model generation model running on a computer device, the method including: obtaining a two-dimensional (2D) face image as input to the face model generation model; extracting global features and local features of the 2D face image; obtaining a 3D face model parameter based on the global features and the local features; and outputting a 3D face model corresponding to the 2D face image based on the 3D face model parameter.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: April 25, 2023
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Yajing Chen, Yibing Song, Yonggen Ling, Linchao Bao, Wei Liu
  • Publication number: 20230123433
    Abstract: This application discloses an artificial intelligence (AI) based animation character drive method. A first expression base of a first animation character corresponding to a speaker is determined by acquiring media data including a facial expression change when the speaker says a speech, and the first expression base may reflect different expressions of the first animation character. After target text information is obtained, an acoustic feature and a target expression parameter corresponding to the target text information are determined according to the target text information, the foregoing acquired media data, and the first expression base. A second animation character having a second expression base may be driven according to the acoustic feature and the target expression parameter, so that the second animation character may simulate the speaker's sound and facial expression when saying the target text information, thereby improving experience of interaction between the user and the animation character.
    Type: Application
    Filed: December 13, 2022
    Publication date: April 20, 2023
    Inventors: Linchao BAO, Shiyin KANG, Sheng WANG, Xiangkai LIN, Xing JI, Zhantu ZHU, Kuongchi LEI, Deyi TUO, Peng LIU
  • Patent number: 11605193
    Abstract: This application disclose an artificial intelligence (AI) based animation character drive method. A first expression base of a first animation character corresponding to a speaker is determined by acquiring media data including a facial expression change when the speaker says a speech, and the first expression base may reflect different expressions of the first animation character. After target text information is obtained, an acoustic feature and a target expression parameter corresponding to the target text information are determined according to the target text information, the foregoing acquired media data, and the first expression base. A second animation character having a second expression base may be driven according to the acoustic feature and the target expression parameter, so that the second animation character may simulate the speaker's sound and facial expression when saying the target text information, thereby improving experience of interaction between the user and the animation character.
    Type: Grant
    Filed: August 18, 2021
    Date of Patent: March 14, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Linchao Bao, Shiyin Kang, Sheng Wang, Xiangkai Lin, Xing Ji, Zhantu Zhu, Kuongchi Lei, Deyi Tuo, Peng Liu
  • Patent number: 11605214
    Abstract: Embodiments of this application disclose a method for determining camera pose information of a camera of a mobile terminal. The method includes: obtaining a first image, a second image, and a template image, the first image being a previous frame of image of the second image, the first image and the second image being images including a respective instance of the template image captured by the mobile terminal using the camera at a corresponding spatial position; determining a first homography between the template image and the second image; determining a second homography between the first image and the second image; and performing complementary filtering processing on the first homography and the second homography, to obtain camera pose information of the camera, wherein the camera pose information of the camera represents a spatial position of the mobile terminal when the mobile terminal captures the second image using the camera.
    Type: Grant
    Filed: February 23, 2021
    Date of Patent: March 14, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiangkai Lin, Linchao Bao, Wei Liu
  • Publication number: 20220415076
    Abstract: This application discloses a three-dimensional human pose estimation method performed by a computer device. An initialization pose estimation result of a single video frame in a video frame sequence of n views is extracted based on a neural network model. Single-frame and single-view human pose estimation is performed on the initialization pose estimation result for each video frame, to obtain n single-view pose estimation sequences respectively corresponding to the n views. Single-frame and multi-view human pose estimation is performed according to single-view pose estimation results with the same timestamp in the n single-view pose estimation sequences, to obtain a multi-view pose estimation sequence. Multi-frame and multi-view human pose estimation is performed on a multi-view pose estimation result in the multi-view pose estimation sequence, to obtain a multi-view and multi-frame pose estimation result. Therefore, accuracy of human pose estimation is improved.
    Type: Application
    Filed: September 1, 2022
    Publication date: December 29, 2022
    Inventors: Weidong CHEN, Wei ZHANG, Di KANG, Linchao BAO
  • Patent number: 11481923
    Abstract: This application discloses a repositioning method and apparatus in a camera pose tracking process, a device, and a storage medium, belonging to the field of augmented reality (AR).
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: October 25, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiangkai Lin, Yonggen Ling, Linchao Bao, Wei Liu
  • Publication number: 20220292752
    Abstract: A method, device, and apparatus for synthesizing a motion sequence of a virtual object and a non-transitory computer-readable storage medium are disclosed. The method can include obtaining description information of a motion sequence of a virtual object, and determining a continuous motion clip set similar to at least some motions in the motion sequence based on the description information and a continuous motion clip library constructed with video materials. The method can further include synthesizing the motion sequence of the virtual object based on the continuous motion clip set, where each continuous motion clip in the continuous motion clip library includes a unique identifier of the continuous motion clip, motion information of the continuous motion clip, and a representation vector corresponding to the each continuous motion clip.
    Type: Application
    Filed: February 25, 2022
    Publication date: September 15, 2022
    Applicant: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Di KANG, Jing LI, Weidong CHEN, Wei ZHANG, Liang QIAO, Linchao BAO
  • Publication number: 20220222893
    Abstract: Embodiments of this application disclose a method and an apparatus for generating a three-dimensional face model. The method includes obtaining a plurality of target face images and a plurality of depth images corresponding to the plurality of target face images, the plurality of target face images comprising a same face; obtaining, according to an image type of each target face image, a regional face image that is in each target face image and that corresponds to the image type of each target face image, the image type comprising a front face type, a left face type, a right face type, or a head-up type; obtaining a regional depth image in a corresponding depth image according to the regional face image; and performing image fusion based on the plurality of obtained regional face images and the plurality of obtained regional depth images, to generate a three-dimensional face model.
    Type: Application
    Filed: March 29, 2022
    Publication date: July 14, 2022
    Inventors: Wenpan LI, Linchao BAO, Xiangkai LIN
  • Patent number: 11373384
    Abstract: This application provides a method for configuring parameters of a three-dimensional face model. The method includes: obtaining a reference face image; identifying a key facial point on the reference face image to obtain key point coordinates as reference coordinates; and determining a recommended parameter set in a face parameter value space according to the reference coordinates. The first projected coordinates are projected coordinates of the key facial point obtained by projecting a three-dimensional face model corresponding to the recommended parameter set onto a coordinate system. The proximity of the first projected coordinates to the reference coordinates meets a preset condition.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: June 28, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Mu Hu, Sirui Gao, Yonggen Ling, Yitong Wang, Linchao Bao, Wei Liu
  • Patent number: 11336837
    Abstract: A system for supporting imaging includes an imaging device configured to capture a plurality of images for a substantially same scene using respective imaging configurations, a stabilization device configured to stabilize the imaging device on a mobile platform during the capturing of the plurality of images, and a controller communicating with at least one of the imaging device or the stabilization device and configured to control an operation of the mobile platform.
    Type: Grant
    Filed: June 22, 2018
    Date of Patent: May 17, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Linchao Bao, Lifu Yu, Zisheng Cao, Mingyu Wang
  • Patent number: 11321870
    Abstract: Embodiments of this application disclose a camera attitude tracking method and apparatus, a device, and a system in the field of augmented reality (AR). The method includes receiving, by a second device with a camera, an initial image and an initial attitude parameter that are transmitted by a first device; obtaining, by the second device, a second image acquired by the camera; obtaining, by the second device, a camera attitude variation of the second image relative to the initial image; and obtaining, by the second device, according to the initial attitude parameter and the camera attitude variation, a second camera attitude parameter, the second camera attitude parameter corresponding to the second image.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: May 3, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiangkai Lin, Yonggen Ling, Linchao Bao, Xiaolong Zhu, Liang Qiao, Wei Liu
  • Patent number: 11302118
    Abstract: This application discloses a method of generating a negative sample for face recognition performed at a computer device. The method includes: obtaining a positive sample of a face from a training sample library required for machine learning of face recognition; embedding the obtained positive sample in a selected negative sample template, to obtain an intermediate sample of the face that simulates displaying of the positive sample in a display region of the negative sample template; and fusing the intermediate sample in a selected scenario sample, to obtain a negative sample of the face required for machine learning of face recognition.
    Type: Grant
    Filed: September 9, 2020
    Date of Patent: April 12, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Wenhan Luo, Linchao Bao, Yuan Gao, Wei Liu
  • Publication number: 20220092813
    Abstract: Embodiments of this application disclose a method for displaying a virtual character in a plurality of real-world images captured by a camera is performed at an electronic device. The method includes: capturing an initial real-world image using the camera; simulating a display of the virtual character in the initial real-world image; capturing a subsequent real-world image using the camera after a movement of the camera; determining position and pose updates of the camera associated with the movement of the camera from tracking one or more feature points in the initial real-world image and the subsequent real-world image; and adjusting the display of the virtual character in the subsequent real-world image in accordance with the position and pose updates of the camera associated with the movement of the camera.
    Type: Application
    Filed: December 6, 2021
    Publication date: March 24, 2022
    Inventors: Xiangkai LIN, Liang QIAO, Fengming ZHU, Yu ZUO, Zeyu YANG, Yonggen LING, Linchao BAO
  • Publication number: 20220092817
    Abstract: A method for an image capturing device includes: acquiring a first image of a target object; extracting coordinate information of a first 2D key point corresponding to the target object; acquiring a second image of the target object; acquiring coordinate information of a second 2D key point in the second image according to the coordinate information of the first 2D key point, the first 2D key point and the second 2D key point being the same key point in the target object; acquiring coordinate information of a 3D key point corresponding to the target object, the 3D key point being a key point obtained after a triangulation operation; and determining camera posture information of the second image according to the coordinate information of the first 2D key point, the coordinate information of the second 2D key point, the coordinate information of the 3D key point, and a 3D-2D projection.
    Type: Application
    Filed: December 1, 2021
    Publication date: March 24, 2022
    Inventors: Linchao BAO, Wei LIU