Patents by Inventor Xiaozhen ZHENG

Xiaozhen ZHENG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11394966
    Abstract: A video encoding and decoding method includes determining an image block set based on one or more similar image blocks of an image block to be processed, generating an initial structure matrix of the image block set based on a pixel value of each image block in the image block set, and performing a filtering process on the initial structure matrix to obtain a reconstructed structure matrix. The reconstructed structure matrix corresponds to a reconstructed pixel value of the each image block. The filtering process includes one or more point-fixing processes. The method further includes reconstructing the each image block based on the reconstructed pixel value of the each image block.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: July 19, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Siwei Ma, Xuewei Meng, Shanshe Wang, Chuanmin Jia, Xiaozhen Zheng
  • Publication number: 20220222861
    Abstract: A data encoding method includes obtaining an attribute residual of a current point cloud point, binarizing the attribute residual to obtain a binary code of the current point cloud point that includes a first binary code indicating a first flag bit and a second binary code indicating a second flag bit, selecting a first context model from a context model list according to a first condition, selecting a second context model from the context model list according to a second condition, encoding the first binary code using the first context model, and encoding the second binary code using the second context model. The first condition and the second condition are different for the first context model and the second context model corresponding to a same index in the context model list.
    Type: Application
    Filed: March 29, 2022
    Publication date: July 14, 2022
    Inventors: Lu YU, Jiafeng CHEN, Wenyi WANG, Pu LI, Xiaozhen ZHENG
  • Patent number: 11381839
    Abstract: A video processing method includes determining first and second initial motion vectors of a current image block having a size of 64×64 pixels. The first and second initial motion vectors point to first and second reference images, respectively, which are forward and backward frames, respectively, of a current image containing the current image block. Distances from the first and second reference images to the current image are same. The method further includes performing or not performing a specified operation according to whether both the first and second reference images are short-term reference images determined according to sequence parameter set. The specified operation includes performing weighted summation on first and second reference image blocks pointed to by the first and second initial motion vectors, respectively, to obtain a weighted image block, and performing prediction for the current image block according to the weighted image block.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: July 5, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Weiran Li
  • Patent number: 11368714
    Abstract: A video image processing method includes dividing a coding unit into one or more sub-block, constructing first and second motion vector candidate lists, and performing prediction for the coding unit according to the first and second motion vector candidate lists. The first motion vector candidate list includes a motion vector of a sub-block of the coding unit, and the second motion vector candidate list includes a motion vector of the coding unit. Constructing the first motion vector candidate list includes determining a reference motion vector of the coding unit, determining a related reference block of the sub-block of the coding unit in a co-located reference image of the coding unit according to the reference motion vector, determining a scaling factor of the motion vector of the related reference block, adding the scaled motion vector into the first motion vector candidate list.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: June 21, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Tianliang Fu, Shanshe Wang, Siwei Ma, Weiran Li, Suhong Wang
  • Patent number: 11368679
    Abstract: An encoding method includes encoding to-be-encoded images including one or more non-output images and a plurality of output images to generate a bitstream. A difference between picture order counts (POCs) of two neighboring output images having neighboring display orders is greater than 1. A ratio of a difference between POCs of two first output images of the plurality of output images to a photographing time interval of the two first output images is same as a ratio of a difference between POCs of two second output images of the plurality of output images to a photographing time interval of the two second output images. At least one of the two second output images is different from either of the two first output images. A POC of at least one of the one or more non-output images is between the POCs of the two neighboring output images.
    Type: Grant
    Filed: February 27, 2021
    Date of Patent: June 21, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Weiran Li
  • Patent number: 11363294
    Abstract: A video processing method includes determining an image before a current frame in time sequence as a long-term reference image according to an identifier, determining a motion vector candidate list of a current coding unit, receiving a plurality of indexes, and obtaining an initial motion vector of the current coding unit from the motion vector candidate list according to the indexes. If a reference image pointed to by the initial motion vector is a short-term reference image, the initial motion vector is corrected to obtain a corrected motion vector and prediction is performed for the current coding unit according to the corrected motion vector. If the reference image is a long-term reference image, prediction is performed for the current coding unit according to the initial motion vector without correcting the initial motion vector.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: June 14, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Weiran Li, Xiaozhen Zheng
  • Patent number: 11350124
    Abstract: A video processing method includes determining a reference image before a current frame in time sequence as a long-term reference image according to an identifier, determining a motion vector candidate list of a current coding unit, and obtaining first and second initial motion vectors of the current coding unit from the motion vector candidate list. The first and second initial motion vectors point to first and second reference images, respectively, that are forward and backward frames of the current frame, respectively. The method further includes performing or not performing a target operation according to whether the first and second reference images are short-term or long-term reference images.
    Type: Grant
    Filed: March 8, 2021
    Date of Patent: May 31, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Weiran Li, Xiaozhen Zheng
  • Patent number: 11343534
    Abstract: A video processing method includes performing or skipping following processing based on whether a size of a coding unit is not smaller or is smaller than 8×8. The processing includes dividing the coding unit into sub-blocks each having a fixed size of 8×8, scanning a left neighboring block and determining a reference motion vector of the coding unit, determining a related reference block of a sub-block in the co-located reference image according to the reference motion vector, determining a scaling factor of a motion vector of the related reference block, scaling the motion vector of the related reference block using the scaling factor, determining motion information of the sub-block according to the scaled motion vector, and performing prediction for the coding unit according to the motion information.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: May 24, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Suhong Wang, Shanshe Wang, Siwei Ma, Weiran Li
  • Patent number: 11330294
    Abstract: A video processing method includes determining a long-term reference image according to a frame identifier for a reference image obtained by analyzing a parameter set. The long-term reference image is updated according to a short-term reference image stored in a reference image buffer. The method further includes dividing a current image block into one or more sub-blocks and obtaining a candidate motion vector of one of the one or more sub-blocks. The method also includes, if the candidate motion vector of a sub-block points to the short-term reference image, scaling the candidate motion vector using a scaling factor not equal to 1, and, if the candidate motion vector of the sub-block points to the long-term reference image, scaling the candidate motion vector using a scaling factor set to 1. The method also includes performing prediction for the sub-block or the current image block according to the scaled candidate motion vector.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: May 10, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Weiran Li
  • Patent number: 11323742
    Abstract: A video processing method includes performing or skipping following processing based on whether a size of a coding unit is not smaller or is smaller than 8×8. The processing includes dividing the coding unit into sub-blocks each having a fixed size of 8×8, scanning a left neighboring block and determining a reference motion vector of the coding unit, determining a related reference block of a sub-block in the co-located reference image according to the reference motion vector, determining a scaling factor of a motion vector of the related reference block, scaling the motion vector of the related reference block using the scaling factor, determining motion information of the sub-block according to the scaled motion vector, and performing prediction for the coding unit according to the motion information.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: May 3, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xiaozhen Zheng, Suhong Wang, Shanshe Wang, Siwei Ma, Weiran Li
  • Publication number: 20220130074
    Abstract: A data encoding method includes determining a value of a syntax element of point cloud data of a point cloud. The point cloud data includes attribute values of the point cloud and the syntax element indicates a search range of the attribute values during prediction encoding. The method further includes performing prediction processing on the attribute values according to the search range to obtain residuals of the attribute values, and encoding the residuals and a difference between the value of the syntax element and a constant value to generate code stream data. The constant value is a positive number.
    Type: Application
    Filed: January 7, 2022
    Publication date: April 28, 2022
    Inventors: Xiaozhen ZHENG, Pu LI, Jiafeng CHEN, Wenyi WANG, Lu YU
  • Publication number: 20220124346
    Abstract: A video image processing method includes binarizing a chrominance prediction mode of the image block of a to-be-encoded/decoded image to obtain a bit string, the bit string including two adjacent bits, the to-be-encoded/decoded image being permitted to use a CCLM and/or a regular intra-frame chrominance prediction mode, and the CCLM including a first mode, a second mode, and a third mode, and using mutually independent probability models to encode/decode a first bit and a second bit. The first bit of the adjacent bits indicates whether the CCLM is used, the second bit indicates whether to use the first mode of the CCLM when the first bit indicates to use the CCLM, the third bit indicates whether the second mode or the third mode of the CCLM is used when the second bit indicates that the first mode of the CCLM is not used.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 21, 2022
    Inventors: Siwei MA, Jiaqi ZHANG, Xiaozhen ZHENG, Shanshe WANG
  • Publication number: 20220116664
    Abstract: The present disclosure provides a loop filtering method which includes determining a clip index parameter of a loop filter, and encoding the clip index parameter by using a non-exponential Golomb encoding method.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Siwei MA, Xuewei MENG, Xiaozhen ZHENG, Shanshe WANG
  • Publication number: 20220116644
    Abstract: A video image processing method including determining a current image block, in response to a size of the current image block meeting a preset condition, skipping a temporal motion vector prediction (TMVP) operation so that a temporal candidate motion vector of the current image block is not determined according to the TMVP operation, and encoding the current image block. The TMVP operation includes determining a relevant block of the current image block in a temporal neighboring image, and determining the temporal candidate motion vector of the current image block according to a motion vector of the relevant block.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Xiaozhen ZHENG, Suhong WANG, Shanshe WANG, Siwei MA
  • Publication number: 20220108494
    Abstract: A processing method includes encoding or decoding an N-th layer of a multi-tree using a breadth-first mode. The multi-tree is used for position division on a point cloud. The method further includes, in response to a number or a distribution of all point cloud points in a target node of the N-th layer meeting a preset condition, encoding or decoding the point cloud points in the target node using a depth-first mode to obtain a code stream of the target node. The code stream of the target node includes an identifier and indexes of nodes where the point cloud points of the target node are located at various layers of the multi-tree. The identifier indicates to switch from the breadth-first mode to the depth-first mode to encode or decode sub-nodes of the target node. N is an integer greater than or equal to 1.
    Type: Application
    Filed: December 14, 2021
    Publication date: April 7, 2022
    Inventors: Pu LI, Xiaozhen ZHENG
  • Publication number: 20220108493
    Abstract: An encoding method includes encoding first M layers of a multi-tree using a breadth-first mode, and switching to a depth-first mode to encode at least one node in the M-th layer of the multi-tree. The multi-tree is obtained by dividing a plurality of three-dimensional data points using a multi-tree division method. M is an integer larger than or equal to 2. Sub-nodes of each of the at least one node are encoded using the breadth-first mode, and the sub-nodes of one of the at least one node include all sub-nodes obtained by performing at least one multi-tree division on the one of the at least one node until a leaf sub-node is obtained.
    Type: Application
    Filed: December 13, 2021
    Publication date: April 7, 2022
    Inventors: Pu LI, Xiaozhen ZHENG
  • Publication number: 20220086483
    Abstract: A video encoding method including obtaining a motion vector candidate list of a current image block; determining a base motion vector according to motion vectors in the motion vector candidate list; in response to the base motion vector pointing to a short-term reference image, scaling a motion vector offset of the base motion vector using a scaling factor to obtain a scaled motion vector offset, and performing prediction for the current image block according to a motion vector determined by the scaled motion vector offset and the base motion vector; and in response to the base motion vector pointing to a long-term reference image, skipping scaling of the motion vector offset, and performing prediction for the current image block according to a motion vector determined by the motion vector offset that is not scaled and the base motion vector.
    Type: Application
    Filed: November 29, 2021
    Publication date: March 17, 2022
    Inventors: Xiaozhen ZHENG, Suhong WANG, Shanshe WANG, Siwei MA, Weiran LI
  • Publication number: 20220078466
    Abstract: A video image processing method includes determining a current image block; in response to a size of the current image block not meeting a first preset condition, skipping an advanced/alternative temporal motion vector prediction (ATMVP) operation so that a temporal candidate motion vector of the current image block is not determined according to the ATMVP operation; and encoding the current image block. The ATMVP operation includes determining a relevant block of the current image block in a temporal neighboring image; dividing the current image block into a plurality of sub-blocks; for each of the sub-blocks, determining a corresponding relevant sub-block in the relevant block; and determining temporal candidate motion vectors of the sub-blocks of the current image block according to motion vectors of the relevant sub-blocks corresponding to the sub-blocks.
    Type: Application
    Filed: November 15, 2021
    Publication date: March 10, 2022
    Inventors: Suhong WANG, Xiaozhen ZHENG, Shanshe WANG, Siwei MA
  • Patent number: 11272204
    Abstract: A motion compensation method includes determining one or more weighting coefficients of a predicted value of a target pixel to be processed according to at least one of a first parameter or a second parameter, and determining the predicted value of the target pixel according to the weighting coefficient. The target pixel is in a boundary pixel block of a current image block. The first parameter is a size of the current image block or a distance between the target pixel and a center position of the current image block. The second parameter is a size of an adjacent image block of the current image block or a distance between the target pixel and a center position of the adjacent image block.
    Type: Grant
    Filed: August 13, 2020
    Date of Patent: March 8, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Zhao Wang, Siwei Ma, Xiaozhen Zheng
  • Patent number: 11265547
    Abstract: Methods and apparatus for coding and decoding a MATRIX. A coding method includes: dividing a MATRIX into layers according to a preset quantity of layers, and grouping MATRIX elements into different layers; performing, according to a determined to-be-coded layer number and in an order of layers one by one, coding processing on MATRIX elements at each layer to be coded; for a layer having a layer number less than or equal to the to-be-coded layer number, writing residual data between an original MATRIX element value corresponding to the layer and a corresponding MATRIX element predicted value into a bit stream; for a layer having a layer number greater than the to-be-coded layer number, writing no coded data of the layer into the bit stream; and coding the to-be-coded layer number and writing the coded layer number of the coded layer into the bit stream.
    Type: Grant
    Filed: July 14, 2020
    Date of Patent: March 1, 2022
    Assignees: Huawei Technologies Co., Ltd., Tsinghua University
    Inventors: Yunfei Wang, Jianhua Zheng, Xiaozhen Zheng, Yun He