Patents by Inventor Xiaojie Sheng

Xiaojie Sheng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11521347
    Abstract: Methods, apparatuses, mediums, and devices for generating multi-angle free-respective image data are provided. The method for generating multi-angle free-perspective image data includes: acquiring multiple synchronized images, where the multiple images have different shooting angles; determining the depth data of each image based on the multiple images; and for each of the images, storing pixel data of the image in a first field and storing depth data in a second field associated with the first field. Technical solutions in the example embodiments of the present invention may improve the user experience.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: December 6, 2022
    Assignee: Alibaba Group Holding Limited
    Inventor: Xiaojie Sheng
  • Patent number: 11341715
    Abstract: A method, a system, a device, and a computer readable storage medium for video reconstruction are disclosed. The method includes: obtaining an image combination of multi-angle free-perspective video frames, parameter data corresponding to the image combinations of the video frames, and position information of a virtual viewpoint based on a user interaction; selecting texture images and depth maps of corresponding groups in the image combinations of the video frames at a time moment of the user interaction according to a preset rule and based on the position information of the virtual viewpoint and the parameter data corresponding to the image combinations of the video frames; and combining and rendering the texture images and the depth maps of the corresponding groups based on the position information of the virtual viewpoint and parameter data corresponding to the depth maps and the texture images of the corresponding groups to obtain a reconstructed image.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: May 24, 2022
    Assignee: Alibaba Group Holding Limited
    Inventor: Xiaojie Sheng
  • Patent number: 11270502
    Abstract: The disclosed embodiments relate to image processing methods and apparatuses. In one embodiment, a method includes: mapping an inputted three-dimensional (3D) model map into an asymmetric cubemap, the asymmetric cubemap located at a different place than the mapping center of the inputted 3D model map; and stretching the asymmetric cubemap mapped for the inputted 3D model map into a two-dimensional (2D) stretched plane map.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: March 8, 2022
    Assignee: ALIBABA GROUP HOLDING LIMITED
    Inventor: Xiaojie Sheng
  • Patent number: 11272154
    Abstract: Disclosed are video playback and data providing methods in a virtual scene, and a client and server implementing the same. The video playback method comprises: receiving current video segment data sent from a server, wherein the current video segment data represents a video segment, and the current video segment data comprises at least one specified viewing angle and a data identifier representing video segment data to which the specified viewing angle is directed; playing the video segment represented by the current video segment data, and acquiring a current viewing angle of a user during playback; and determining a target specified viewing angle matching the current viewing angle from the at least one specified viewing angle, wherein a video segment represented by video segment data to which the target specified viewing angle is directed is played at the end of the playback of the video segment represented by the current video segment data.
    Type: Grant
    Filed: January 5, 2018
    Date of Patent: March 8, 2022
    Assignee: YOUKU INFORMATION TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Yuxing Wu, Xiaojie Sheng, Wuping Du, Wei Li, Ji Wang
  • Patent number: 11257283
    Abstract: Image reconstruction methods, systems, devices, and computer-readable storage media are provided.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: February 22, 2022
    Assignee: Alibaba Group Holding Limited
    Inventor: Xiaojie Sheng
  • Patent number: 11153584
    Abstract: Panoramic video transcoding methods, devices, and apparatuses are provided. The method involves a central processing unit (CPU) and a graphics processing unit (GPU) and includes decoding a panoramic video; mapping, at least partly using the GPU, the decoded video data to N visual angles, to obtain N channels of video data, in which N is more than 1; encoding the N channels of video data respectively to obtain N channels of video streams; and slicing and packing the N channels of video streams respectively.
    Type: Grant
    Filed: July 9, 2019
    Date of Patent: October 19, 2021
    Assignee: ALIBABA GROUP HOLDING LIMITED
    Inventors: Xiaojie Sheng, Yuxing Wu
  • Patent number: 11055901
    Abstract: Methods, apparatuses, media, and devices for generating multi-angle free-perspective video data are provided. The method for generating multi-angle free-perspective video data includes: acquiring multiple frame-synchronized videos, wherein shooting angles of the multiple frame-synchronized videos are different; parsing a respective video of the multiple frame-synchronized videos to obtain an image combination at a respective frame moment of multiple frame moments, wherein the image combination includes multiple frame-synchronized frame images; determining depth data of a respective frame image in the image combination based on the image combination at the respective frame moment; and generating a stitched image corresponding to the respective frame moment, wherein the stitched image includes a first field storing pixel data of the respective frame image in the image combination, and a second field storing the depth data of the respective frame image in the image combination.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: July 6, 2021
    Assignee: Alibaba Group Holding Limited
    Inventor: Xiaojie Sheng
  • Patent number: 11037365
    Abstract: A method, an apparatus, a medium, a terminal, and a device for processing multi-angle free-perspective data are disclosed. The method includes: acquiring a data header file; determining a defined format of a data file according to a parsing result of the data header file; reading and obtaining a data combination from the data file based on the defined format, where the data combination includes pixel data and depth data of multiple synchronized images, and the multiple synchronized images have different perspectives with respect a to-be-viewed area, and pixel data and depth data of each image of the multiple synchronized images has an association relationship; and performing image or video reconstruction of a virtual viewpoint according to the read data combination, where the virtual viewpoint is selected from a multi-angle free-perspective range, and the multi-angle free-perspective range is a range supporting virtual viewpoint switching viewing of the to-be-viewed area.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: June 15, 2021
    Inventor: Xiaojie Sheng
  • Patent number: 11025881
    Abstract: A method, a computer storage medium, and a client for switching scenes of a panoramic video are provided. The method includes playing a first primary video stream in a first video stream group associated with a first perspective of a user; determining a video stream switching time when a perspective of the user is switched from the first perspective to a second perspective, the video stream switching time being associated with a time length of a video slice in a second backup video stream; and switching from the first primary video stream to the second backup video stream when a play time of the first primary video stream reaches the video stream switching time, so that content of the second backup video stream starting from the video stream switching time is played. The present application can improve the effects of switching between scenes of the panoramic video.
    Type: Grant
    Filed: April 3, 2019
    Date of Patent: June 1, 2021
    Assignee: Alibaba Group Holding Limited
    Inventor: Xiaojie Sheng
  • Patent number: 10846823
    Abstract: Embodiments of the present application provide a method and an apparatus, and a machine readable media for image processing. The method includes obtaining a panoramic video image, where the panoramic video image is determined based on a perspective mapping, and the panoramic video image includes a primary perspective region and at least one secondary perspective region; dividing the secondary perspective region into at least two sub-regions based on distribution information of high-frequency components in the secondary perspective region; determining respective filter templates of the sub-regions, and filtering the sub-regions using the respective filter templates; and determining a filtered panoramic video image.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: November 24, 2020
    Assignee: Alibaba Group Holding Limited
    Inventor: Xiaojie Sheng
  • Publication number: 20200288104
    Abstract: Methods, apparatuses, mediums, and devices for generating multi-angle free-respective image data are provided. The method for generating multi-angle free-perspective image data includes: acquiring multiple synchronized images, where the multiple images have different shooting angles; determining the depth data of each image based on the multiple images; and for each of the images, storing pixel data of the image in a first field and storing depth data in a second field associated with the first field. Technical solutions in the example embodiments of the present invention may improve the user experience.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200288111
    Abstract: A method, a system, a device, and a computer readable storage medium for video reconstruction are disclosed. The method includes: obtaining an image combination of multi-angle free-perspective video frames, parameter data corresponding to the image combinations of the video frames, and position information of a virtual viewpoint based on a user interaction; selecting texture images and depth maps of corresponding groups in the image combinations of the video frames at a time moment of the user interaction according to a preset rule and based on the position information of the virtual viewpoint and the parameter data corresponding to the image combinations of the video frames; and combining and rendering the texture images and the depth maps of the corresponding groups based on the position information of the virtual viewpoint and parameter data corresponding to the depth maps and the texture images of the corresponding groups to obtain a reconstructed image.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200288108
    Abstract: A method, an apparatus, a medium, a terminal, a capturing system, and a device for setting capturing devices are disclosed. The method includes: determining a multi-angle free-perspective range, where switching a viewpoint for viewing in a to-be-viewed area is supported within the multi-angle free-perspective range; and determining setting positions of capturing devices according to at least the multi-angle free-perspective range, where the setting positions are suitable for setting the capturing devices to perform data capturing in the to-be-viewed area. The technical solutions in the embodiments of the present disclosure can improve user experience.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200288098
    Abstract: A multi-angle free-perspective interaction method and apparatus, a medium, a terminal, and a device are disclosed. The method includes: receiving a user instruction when a video is played; determining a virtual viewpoint according to the user instruction, the virtual viewpoint being selected from a multi-angle free-perspective range, and the multi-angle free-perspective range being a range that supports virtual viewpoint switching on a to-be-viewed area; and displaying an image of the to-be-viewed area according to the virtual viewpoint at a specified frame moment, wherein the specified frame moment is determined based on the user instruction, the image is generated based on a data combination and the virtual viewpoint, the data combination includes pixel data and depth data of multiple synchronized images at the specified frame moment, an association relationship between image data and depth data of each image, and the multiple synchronized images have different perspectives on the to-be-viewed area.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200288097
    Abstract: Methods, apparatuses, media, terminals, and devices for multi-angle free-perspective interaction are provided. The method for multi-angle free perspective interaction includes: receiving a user instruction; determining a virtual viewpoint according to the user instruction, where the virtual viewpoint is selected from a multi-angle free-perspective range, and the multi-angle free-perspective range is a range supporting virtual viewpoint switching viewing of a to-be-viewed area; and displaying content for viewing the to-be-viewed area based on the virtual viewpoint, where the content is generated based on a data combination and the virtual viewpoint, and the data combination includes pixel data and depth data of multiple synchronized images, and an association relationship exists between the image data and the depth data of each image, and the multiple synchronized images have different perspectives with respect to the to-be-viewed area.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200286279
    Abstract: Methods, apparatuses, media, and devices for processing multi-angle free-perspective image data are provided. The method for processing multi-angle free-perspective image data includes: acquiring a data combination stored in a picture format, wherein the data combination includes pixel data and depth data of multiple synchronized images, and an association relationship exists between the pixel data and the depth data of the respective image, and the multiple synchronized images have different perspectives with respect to a to-be-viewed area; and performing image reconstruction of a virtual viewpoint based on the data combination, wherein the virtual viewpoint is selected from a multi-angle free-perspective range, and the multi-angle free-perspective range is a range supporting viewpoint switching viewing of the to-be-viewed area.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200288109
    Abstract: Methods, apparatuses, media, and devices for generating multi-angle free-perspective video data are provided. The method for generating multi-angle free-perspective video data includes: acquiring multiple frame-synchronized videos, wherein shooting angles of the multiple frame-synchronized videos are different; parsing a respective video of the multiple frame-synchronized videos to obtain an image combination at a respective frame moment of multiple frame moments, wherein the image combination includes multiple frame-synchronized frame images; determining depth data of a respective frame image in the image combination based on the image combination at the respective frame moment; and generating a stitched image corresponding to the respective frame moment, wherein the stitched image includes a first field storing pixel data of the respective frame image in the image combination, and a second field storing the depth data of the respective frame image in the image combination.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200288112
    Abstract: A method, an apparatus, a medium, and a device for processing multi-angle free-perspective video data are disclosed. The method includes: parsing acquired video data to obtain multiple data combinations of different frame moments, the data combinations including pixel data and depth data of multiple synchronized images, and the multiple synchronized images having different perspectives on a to-be-viewed area; and reconstructing an image associated with a respective virtual viewpoint based on the respective data combination for each frame moment, the respective virtual viewpoint being selected from a multi-angle free-perspective range, and the multi-angle free-perspective range being a range that supports viewing and switching of viewpoints on the to-be-viewed area. The technical solutions in the embodiments of the present disclosure can support range being that supports viewing and switching of viewpoints within a multi-angle free-perspective range.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200288100
    Abstract: Image reconstruction methods, systems, devices, and computer-readable storage media are provided.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng
  • Publication number: 20200288099
    Abstract: Video generating methods, apparatuses, media, and terminals are provided. The video generating method includes: acquiring a virtual viewpoint trajectory in response to a recording instruction, where the virtual viewpoint trajectory is a set of virtual viewpoints arranged according to a chronological order, and the viewpoint is selected from a multi-angle free-perspective range, and the multi-angle free-perspective range is a range supporting viewpoint switching viewing in the to-be-viewed area; and recording a rendered picture under the viewpoint trajectory, where the rendered picture under the viewpoint trajectory is a picture for viewing the to-be-viewed area according to the virtual viewpoint trajectory. Technical solutions in the example embodiments of the present disclosure may provide the user with the multi-angle degrees of freedom interactive experience.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventor: Xiaojie Sheng