Patents by Inventor Shanshe WANG

Shanshe WANG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11949911
    Abstract: A video processing method includes obtaining motion information of a neighboring block of a current image block, dividing the current image block into a plurality of sub-blocks in response to the neighboring block satisfying a preset condition, determining, in a time-domain reference image of the current image block, related blocks of the plurality of sub-blocks according to a motion vector of the neighboring block, and performing prediction on the current image block according to motion vectors of the related blocks.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: April 2, 2024
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Suhong Wang, Shanshe Wang, Siwei Ma, Weiran Li
  • Patent number: 11949912
    Abstract: A video image processing method includes determining a related block of a current image block according to a motion vector of a target neighboring block, the current image block, and a collocated frame of the current image block, decoding the current image block according to a motion vector of the related block of the current image block, constructing motion vectors of part of control points of the current image block according to neighboring blocks of the part of the control points of the current image block, and adding the motion vectors of the part of the control points of the current image block to a motion vector candidate list of the current image block.
    Type: Grant
    Filed: June 20, 2022
    Date of Patent: April 2, 2024
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Tianliang Fu, Shanshe Wang, Siwei Ma, Weiran Li, Suhong Wang
  • Patent number: 11936847
    Abstract: A video processing method includes dividing a region of a current frame to obtain a plurality of image blocks, obtaining a historical motion information candidate list, and obtaining candidate historical motion information for the plurality of image blocks according to the historical motion information candidate list. The candidate historical motion information is a candidate in the historical motion information candidate list. The method further includes performing prediction for the plurality of image blocks according to the candidate historical motion information. A size of each of the plurality of image blocks is smaller than or equal to a preset size. The same historical motion information candidate list is used for the plurality of image blocks during the prediction. The historical motion information candidate list is not updated while the prediction is being performed for the plurality of image blocks.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: March 19, 2024
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Suhong Wang, Xiaozhen Zheng, Shanshe Wang, Siwei Ma
  • Patent number: 11871004
    Abstract: A video image processing method includes binarizing a chrominance prediction mode of the image block of a to-be-encoded/decoded image to obtain a bit string, the bit string including two adjacent bits, the to-be-encoded/decoded image being permitted to use a CCLM and/or a regular intra-frame chrominance prediction mode, and the CCLM including a first mode, a second mode, and a third mode, and using mutually independent probability models to encode/decode a first bit and a second bit. The first bit of the adjacent bits indicates whether the CCLM is used, the second bit indicates whether to use the first mode of the CCLM when the first bit indicates to use the CCLM, the third bit indicates whether the second mode or the third mode of the CCLM is used when the second bit indicates that the first mode of the CCLM is not used.
    Type: Grant
    Filed: December 23, 2021
    Date of Patent: January 9, 2024
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Siwei Ma, Jiaqi Zhang, Xiaozhen Zheng, Shanshe Wang
  • Publication number: 20230345036
    Abstract: A video image processing method including determining a current image block, constructing a motion information candidate list for the current image block, in response to a size of the current image block meeting a preset condition, turning off a temporal motion vector prediction (TMVP) operation so that a temporal candidate motion vector of the current image block is not determined according to the TMVP operation, and encoding the current image block. The TMVP operation includes determining a relevant block of the current image block in a temporal neighboring image, and determining the temporal candidate motion vector of the current image block according to a motion vector of the relevant block.
    Type: Application
    Filed: June 26, 2023
    Publication date: October 26, 2023
    Inventors: Xiaozhen ZHENG, Suhong WANG, Shanshe WANG, Siwei MA
  • Patent number: 11743482
    Abstract: A video image processing method includes determining a current image block; in response to a size of the current image block not meeting a first preset condition, skipping an advanced/alternative temporal motion vector prediction (ATMVP) operation so that a temporal candidate motion vector of the current image block is not determined according to the ATMVP operation; and encoding the current image block. The ATMVP operation includes determining a relevant block of the current image block in a temporal neighboring image; dividing the current image block into a plurality of sub-blocks; for each of the sub-blocks, determining a corresponding relevant sub-block in the relevant block; and determining temporal candidate motion vectors of the sub-blocks of the current image block according to motion vectors of the relevant sub-blocks corresponding to the sub-blocks.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: August 29, 2023
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Suhong Wang, Xiaozhen Zheng, Shanshe Wang, Siwei Ma
  • Patent number: 11689736
    Abstract: A video image processing method including determining a current image block, in response to a size of the current image block meeting a preset condition, skipping a temporal motion vector prediction (TMVP) operation so that a temporal candidate motion vector of the current image block is not determined according to the TMVP operation, and encoding the current image block. The TMVP operation includes determining a relevant block of the current image block in a temporal neighboring image, and determining the temporal candidate motion vector of the current image block according to a motion vector of the relevant block.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: June 27, 2023
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Suhong Wang, Shanshe Wang, Siwei Ma
  • Publication number: 20230120657
    Abstract: A video encoding method includes encoding images of an image sequence to generate a bitstream of the image sequence. Different identifiers are used for two chrominance components of one image in a syntax element of an image level in the bitstream to indicate whether the corresponding chrominance components are filtered by adaptive loop filtering (ALF).
    Type: Application
    Filed: September 30, 2022
    Publication date: April 20, 2023
    Inventors: Siwei MA, Xuewei MENG, Shanshe WANG, Xiaozhen ZHENG
  • Publication number: 20220345699
    Abstract: An in-loop filtering method includes determining a target filter for a chrominance component of a current block of an image from a plurality of cross-component ALF filters, determining target filter coefficients for the chrominance component according to the chrominance component after ALF and a luminance component of the current block without ALF, filtering the chrominance component after ALF according to the target filter and the target filter coefficients, determining a filtered chrominance component of the current block according to the chrominance component after being filtered with the target filter coefficients and the chrominance component after the ALF, encoding according to the filtered chrominance component of the current block, and encoding a total number of the plurality of cross-component ALF filters as a syntax element. A stream of the image includes only one syntax element for indicating the total number of the plurality of cross-component ALF filters.
    Type: Application
    Filed: June 29, 2022
    Publication date: October 27, 2022
    Inventors: Siwei MA, Xuewei MENG, Xiaozhen ZHENG, Shanshe WANG
  • Publication number: 20220321907
    Abstract: A video image processing method includes, in response to a specific neighboring block of a current image block satisfying a preset condition, determining a collocated block of the current image block according to a motion vector of the specific neighboring block, determining a specific candidate from a motion vector candidate list of the current image block according to the collocated block of the current image block for using in prediction for the current image block, scanning neighboring blocks of the current image block and determining a control point motion vector group of each of one or more neighboring blocks that use an affine transformation mode for prediction, and adding the control point motion vector group of each of the determined one or more neighboring blocks into the motion vector candidate list of the current image block as a candidate.
    Type: Application
    Filed: June 20, 2022
    Publication date: October 6, 2022
    Inventors: Xiaozhen ZHENG, Tianliang FU, Shanshe WANG, Siwei MA, Weiran LI, Suhong WANG
  • Publication number: 20220286706
    Abstract: A video processing method includes obtaining motion information of a neighboring block of a current image block, dividing the current image block into a plurality of sub-blocks in response to the neighboring block satisfying a preset condition, determining, in a time-domain reference image of the current image block, related blocks of the plurality of sub-blocks according to a motion vector of the neighboring block, and performing prediction on the current image block according to motion vectors of the related blocks.
    Type: Application
    Filed: May 23, 2022
    Publication date: September 8, 2022
    Inventors: Xiaozhen ZHENG, Suhong WANG, Shanshe WANG, Siwei MA, Weiran LI
  • Patent number: 11394966
    Abstract: A video encoding and decoding method includes determining an image block set based on one or more similar image blocks of an image block to be processed, generating an initial structure matrix of the image block set based on a pixel value of each image block in the image block set, and performing a filtering process on the initial structure matrix to obtain a reconstructed structure matrix. The reconstructed structure matrix corresponds to a reconstructed pixel value of the each image block. The filtering process includes one or more point-fixing processes. The method further includes reconstructing the each image block based on the reconstructed pixel value of the each image block.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: July 19, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Siwei Ma, Xuewei Meng, Shanshe Wang, Chuanmin Jia, Xiaozhen Zheng
  • Patent number: 11368714
    Abstract: A video image processing method includes dividing a coding unit into one or more sub-block, constructing first and second motion vector candidate lists, and performing prediction for the coding unit according to the first and second motion vector candidate lists. The first motion vector candidate list includes a motion vector of a sub-block of the coding unit, and the second motion vector candidate list includes a motion vector of the coding unit. Constructing the first motion vector candidate list includes determining a reference motion vector of the coding unit, determining a related reference block of the sub-block of the coding unit in a co-located reference image of the coding unit according to the reference motion vector, determining a scaling factor of the motion vector of the related reference block, adding the scaled motion vector into the first motion vector candidate list.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: June 21, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Tianliang Fu, Shanshe Wang, Siwei Ma, Weiran Li, Suhong Wang
  • Patent number: 11343534
    Abstract: A video processing method includes performing or skipping following processing based on whether a size of a coding unit is not smaller or is smaller than 8×8. The processing includes dividing the coding unit into sub-blocks each having a fixed size of 8×8, scanning a left neighboring block and determining a reference motion vector of the coding unit, determining a related reference block of a sub-block in the co-located reference image according to the reference motion vector, determining a scaling factor of a motion vector of the related reference block, scaling the motion vector of the related reference block using the scaling factor, determining motion information of the sub-block according to the scaled motion vector, and performing prediction for the coding unit according to the motion information.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: May 24, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Suhong Wang, Shanshe Wang, Siwei Ma, Weiran Li
  • Patent number: 11323742
    Abstract: A video processing method includes performing or skipping following processing based on whether a size of a coding unit is not smaller or is smaller than 8×8. The processing includes dividing the coding unit into sub-blocks each having a fixed size of 8×8, scanning a left neighboring block and determining a reference motion vector of the coding unit, determining a related reference block of a sub-block in the co-located reference image according to the reference motion vector, determining a scaling factor of a motion vector of the related reference block, scaling the motion vector of the related reference block using the scaling factor, determining motion information of the sub-block according to the scaled motion vector, and performing prediction for the coding unit according to the motion information.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: May 3, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Suhong Wang, Shanshe Wang, Siwei Ma, Weiran Li
  • Publication number: 20220124346
    Abstract: A video image processing method includes binarizing a chrominance prediction mode of the image block of a to-be-encoded/decoded image to obtain a bit string, the bit string including two adjacent bits, the to-be-encoded/decoded image being permitted to use a CCLM and/or a regular intra-frame chrominance prediction mode, and the CCLM including a first mode, a second mode, and a third mode, and using mutually independent probability models to encode/decode a first bit and a second bit. The first bit of the adjacent bits indicates whether the CCLM is used, the second bit indicates whether to use the first mode of the CCLM when the first bit indicates to use the CCLM, the third bit indicates whether the second mode or the third mode of the CCLM is used when the second bit indicates that the first mode of the CCLM is not used.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 21, 2022
    Inventors: Siwei MA, Jiaqi ZHANG, Xiaozhen ZHENG, Shanshe WANG
  • Publication number: 20220116644
    Abstract: A video image processing method including determining a current image block, in response to a size of the current image block meeting a preset condition, skipping a temporal motion vector prediction (TMVP) operation so that a temporal candidate motion vector of the current image block is not determined according to the TMVP operation, and encoding the current image block. The TMVP operation includes determining a relevant block of the current image block in a temporal neighboring image, and determining the temporal candidate motion vector of the current image block according to a motion vector of the relevant block.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Xiaozhen ZHENG, Suhong WANG, Shanshe WANG, Siwei MA
  • Publication number: 20220116664
    Abstract: The present disclosure provides a loop filtering method which includes determining a clip index parameter of a loop filter, and encoding the clip index parameter by using a non-exponential Golomb encoding method.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Siwei MA, Xuewei MENG, Xiaozhen ZHENG, Shanshe WANG
  • Publication number: 20220086483
    Abstract: A video encoding method including obtaining a motion vector candidate list of a current image block; determining a base motion vector according to motion vectors in the motion vector candidate list; in response to the base motion vector pointing to a short-term reference image, scaling a motion vector offset of the base motion vector using a scaling factor to obtain a scaled motion vector offset, and performing prediction for the current image block according to a motion vector determined by the scaled motion vector offset and the base motion vector; and in response to the base motion vector pointing to a long-term reference image, skipping scaling of the motion vector offset, and performing prediction for the current image block according to a motion vector determined by the motion vector offset that is not scaled and the base motion vector.
    Type: Application
    Filed: November 29, 2021
    Publication date: March 17, 2022
    Inventors: Xiaozhen ZHENG, Suhong WANG, Shanshe WANG, Siwei MA, Weiran LI
  • Publication number: 20220078466
    Abstract: A video image processing method includes determining a current image block; in response to a size of the current image block not meeting a first preset condition, skipping an advanced/alternative temporal motion vector prediction (ATMVP) operation so that a temporal candidate motion vector of the current image block is not determined according to the ATMVP operation; and encoding the current image block. The ATMVP operation includes determining a relevant block of the current image block in a temporal neighboring image; dividing the current image block into a plurality of sub-blocks; for each of the sub-blocks, determining a corresponding relevant sub-block in the relevant block; and determining temporal candidate motion vectors of the sub-blocks of the current image block according to motion vectors of the relevant sub-blocks corresponding to the sub-blocks.
    Type: Application
    Filed: November 15, 2021
    Publication date: March 10, 2022
    Inventors: Suhong WANG, Xiaozhen ZHENG, Shanshe WANG, Siwei MA