Patents by Inventor Tong RAO

Tong RAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11812154
    Abstract: A method for video processing is provided. The method comprises obtaining an image of a scene, obtaining a video that records an area included in the scene, determining one or more frames from the plurality of frames of the video, determining pairs of matched features, generating a plurality of composite frames by combining each of the selected one or more frames with the image of the scene based on the pairs of matched features, and generating a composite video based on the plurality of composite frames. Each of the pairs of matched features is related to an object that is in both the image and the one or more frames. Each of the pairs of matched features is associated with one or more pixels of the image of the scene and one or more pixels of a selected frame of the one or more frames.
    Type: Grant
    Filed: June 16, 2022
    Date of Patent: November 7, 2023
    Assignee: Realsee (Beijing) Technology Co., Ltd.
    Inventors: Tong Rao, Yi Zhu, Chengfeng Huang
  • Publication number: 20230209205
    Abstract: Embodiments of the present disclosure disclose a method and device for vertical correction of a panoramic image, an electronic apparatus and a storage medium. The method includes extracting a set of straight line segments from the panoramic image, where an included angle between each straight line segment in the set of straight line segments and a current vertical direction of the panoramic image is less than a preset angle. The method further includes determining a set of target points by mapping the set of straight line segments on a unit sphere of the panoramic image. The method also includes determining an equatorial plane based on the set of target points and the center of the unit sphere and determining a vertical correction matrix based on the equatorial plane and a unit vector of the current vertical direction. The method additionally includes performing the vertical correction on the panoramic image using the vertical correction matrix.
    Type: Application
    Filed: December 20, 2022
    Publication date: June 29, 2023
    Applicant: Realsee (Beijing) Technology Co., Ltd.
    Inventors: Yang HU, Tong RAO, Jie ZHOU, Wei LI
  • Patent number: 11620730
    Abstract: A method for combining multiple images is disclosed herein. A target mapping matrix is determined based on a first image and a second image. The target mapping matrix is associated with a target correspondence between the first image and the second image. The first image and the second image are combined into a combined image based on the first target mapping matrix. The combined image is output by implementing the disclosed method.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: April 4, 2023
    Assignee: Realsee (Beijing) Technology Co., Ltd.
    Inventors: Tong Rao, Cihui Pan, Mingyuan Wang, Xiaodong Gu, Chenglin Liu
  • Publication number: 20230056036
    Abstract: A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.
    Type: Application
    Filed: November 4, 2022
    Publication date: February 23, 2023
    Inventors: Tong RAO, Yonglin YANG, Mingyuan WANG, Yutong CHEN
  • Publication number: 20230033267
    Abstract: A method for video processing is provided. The method comprises obtaining an image of a scene, obtaining a video that records an area included in the scene, determining one or more frames from the plurality of frames of the video, determining pairs of matched features, generating a plurality of composite frames by combining each of the selected one or more frames with the image of the scene based on the pairs of matched features, and generating a composite video based on the plurality of composite frames. Each of the pairs of matched features is related to an object that is in both the image and the one or more frames. Each of the pairs of matched features is associated with one or more pixels of the image of the scene and one or more pixels of a selected frame of the one or more frames.
    Type: Application
    Filed: June 16, 2022
    Publication date: February 2, 2023
    Inventors: Tong RAO, Yi ZHU, Chengfeng HUANG
  • Publication number: 20220405968
    Abstract: A method for image processing is disclosed herein. A computer system obtains a first image and a second image acquired by an imaging device. The computer system determines a matrix relating a first set of image points in the first image to a second set of image points in the second image. Based on the matrix, the computer system determines a set of parameters of the imaging device and a rotational relationship between the first image and the second image corresponding to poses of the imaging device. In response to determining that the first image and the second image are aligned based on the set of parameters of the imaging device and the rotational relationship between the first image and the second image, the computer system generates a composite image of the first image and the second image and causes display of the composite image.
    Type: Application
    Filed: April 19, 2022
    Publication date: December 22, 2022
    Inventors: Tong RAO, Yang HU, Jie ZHOU, Wei LI
  • Patent number: 11533431
    Abstract: A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: December 20, 2022
    Assignee: Realsee (Beijing) Technology Co., Ltd.
    Inventors: Tong Rao, Yonglin Yang, Mingyuan Wang, Yutong Chen
  • Publication number: 20210352210
    Abstract: A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.
    Type: Application
    Filed: July 22, 2021
    Publication date: November 11, 2021
    Inventors: Tong RAO, Yonglin YANG, Mingyuan WANG, Yutong CHEN
  • Patent number: 11146727
    Abstract: A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: October 12, 2021
    Assignee: Ke.com (Beijing) Technology Co., Ltd.
    Inventors: Tong Rao, Yonglin Yang, Mingyuan Wang, Yutong Chen
  • Publication number: 20210295467
    Abstract: A method for combining multiple images is disclosed herein. A target mapping matrix is determined based on a first image and a second image. The target mapping matrix is associated with a target correspondence between the first image and the second image. The first image and the second image are combined into a combined image based on the first target mapping matrix. The combined image is output by implementing the disclosed method.
    Type: Application
    Filed: March 23, 2021
    Publication date: September 23, 2021
    Inventors: Tong Rao, Cihui Pan, Mingyuan Wang, Xiaodong Gu, Chenglin Liu
  • Publication number: 20210289135
    Abstract: A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.
    Type: Application
    Filed: March 12, 2021
    Publication date: September 16, 2021
    Inventors: Tong RAO, Yonglin YANG, Mingyuan WANG, Yutong CHEN