Patents by Inventor Jizheng Xu

Jizheng Xu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11863784
    Abstract: Sub-table for history-based affine mode is described. In an exemplary aspect, a method for video processing includes deriving, deriving, for a conversion between a current block of video and a bitstream representation of the current block, an affine model for the current block based on affine related information, wherein the affine related information is stored in at least one first affine history motion vector prediction (HMVP) buffer of M first affine HMVP buffers or at least one affine sub-buffer of M affine sub-buffers (HB0, HB1, . . . HBM-1) into which a second affine HMVP buffer is divided, wherein the first affine HMVP buffer or affine HMVP sub-buffer being used to store affine related information of blocks coded prior the current block, M being an integer larger than 1; and performing the conversion by using the derived affine model.
    Type: Grant
    Filed: August 19, 2021
    Date of Patent: January 2, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11863715
    Abstract: Methods, systems and devices for implementing adaptive color transform (ACT) and block based delta pulse code modulation (BDPCM) during image/video encoding or decoding are described. An example method of video processing includes determining, for a conversion between a current video unit of a video that is a chroma video unit and a bitstream representation of the video, whether a block-based delta pulse code modulation (BDPCM) mode is available based on a rule, and performing the conversion based on the determining, wherein the rule is based on whether an adaptive color transform (ACT) mode is used for coding the current video unit and/or whether the BDPCM mode is used for coding a luma video unit corresponding to the current video unit.
    Type: Grant
    Filed: June 16, 2022
    Date of Patent: January 2, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Weijia Zhu, Jizheng Xu, Li Zhang, Yue Wang
  • Patent number: 11856237
    Abstract: Systems, methods and apparatus for video processing are described. The video processing may include video encoding, video decoding, or video transcoding. One example method of video processing includes performing a conversion between a video and a bitstream of the video according to a format rule. The format rule specifies that constraints on values of one or more first syntax elements in an adaptation parameter set are defined based on semantics of second syntax elements in a picture header and/or a slice header if a picture or a slice referring to the adaptation parameter set.
    Type: Grant
    Filed: October 10, 2022
    Date of Patent: December 26, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Ye-kui Wang, Kai Zhang, Jizheng Xu
  • Patent number: 11856185
    Abstract: Techniques for video encoding and decoding are described. A method of video processing is disclosed. The method includes, determining, based on a video characteristic of a first video block, an enabling or disabling of a pruning process for a table updating process; updating one or multiple tables, based on the determination and motion information of the first video block, the one or multiple motion tables being History-based Motion Vector Prediction HMVP (HMVP) tables; and performing a conversion between a subsequent video block of the video and bitstream representation of the subsequent video block based on the updated tables.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: December 26, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11856195
    Abstract: An example method of video processing includes performing a conversion between a picture of a video and a bitstream representation of the video. The picture includes one or more sub-pictures, and the bitstream representation conforms to a format rule that specifies that a length of a syntax element is equal to Ceil(Log 2(SS)) bits. SS is greater than 0, and the syntax element indicating a horizontal or a vertical position of a top-left corner of a coding tree unit of a sub-picture of the picture.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: December 26, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • Patent number: 11856211
    Abstract: Usage for History-based affine parameters is described. In an exemplary aspect, a method for video processing includes deriving, for a conversion between a current block of video and a bitstream representation of the current block, affine related information associated with affine model for the current block based on affine parameters stored in a buffer for storing affine related information of blocks coded prior the current block; and performing the conversion by using the affine related information.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: December 26, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11849126
    Abstract: A method for video processing is provided to include: performing a conversion between a current video block of a video and a coded representation of current video block, wherein the conversion uses a coding mode in which the current video block is constructed based on a first domain and a second domain and/or chroma residue is scaled in a luma-dependent manner, and wherein information used for the coding mode is signaled in a parameter set that is different from a sequence parameter set (SPS), a video parameter set (VPS), a picture parameter set (PPS), or an adaptation parameter set (APS) used for carrying adaptive loop filtering (ALF) parameters.
    Type: Grant
    Filed: April 6, 2022
    Date of Patent: December 19, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11843798
    Abstract: A method for video processing is provided to include: determining a motion vector precision of one or more motion vectors related to a current video block of a video; selecting, based on the motion vector precision, a motion vector range; and performing, based on the motion vector range, a conversion between the current video block and a bitstream representation of the video.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: December 12, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11843725
    Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, whether a combined inter and intra prediction (CIIP) coding technique is to be applied to the current block based on a characteristic of the current block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: December 12, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Publication number: 20230396809
    Abstract: Systems, methods, and apparatus for video processing are described. The video processing may include video encoding, video decoding or video transcoding. One example method of video processing includes performing a conversion between a video including one or more video regions and a bitstream of the video according to a format rule. The format rule specifies that a variable X indicates whether B slice is allowed or used in a video region. The format rule further specifies that the variable X is based on values of a reference picture list information present flag and/or a field indicating a number of entries in a reference picture list syntax structure.
    Type: Application
    Filed: August 16, 2023
    Publication date: December 7, 2023
    Inventors: Zhipin Deng, Li Zhang, Ye-Kui Wang, Kai Zhang, Jizheng Xu
  • Publication number: 20230396759
    Abstract: An example method of video processing includes determining, for a conversion between a current picture of a video and a coded representation of the video, a position of a reference sample in a reference picture that is associated with the current picture based on a top-left position of a window of a picture. The picture includes at least the current picture or the reference picture, and the window is subject to a processing rule during the conversion. The method also includes performing the conversion based on the determining.
    Type: Application
    Filed: August 21, 2023
    Publication date: December 7, 2023
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Zhipin Deng, Jizheng Xu, Yue Wang
  • Patent number: 11838523
    Abstract: A method for implementing an adaptive color transform (ACT) during image/video encoding and decoding, comprises determining, for a conversion between a video comprising a block and a bitstream of the video, that a size of the block is greater than a maximum allowed size for an ACT mode, and performing, based on the determining, the conversion, wherein, in response to the size of the block being greater than the maximum allowed size for the ACT mode, the block is partitioned into multiple sub-blocks, and wherein each of the multiple sub-blocks share a same prediction mode, and the ACT mode is enabled at a sub-block level.
    Type: Grant
    Filed: July 5, 2022
    Date of Patent: December 5, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Weijia Zhu, Jizheng Xu, Li Zhang, Kai Zhang, Yue Wang
  • Publication number: 20230388548
    Abstract: Techniques for selectively transforming one or more coding units when coding video content are described herein. The techniques may include determining whether or not to transform a particular coding unit. The determination may be based on a difference in pixel values of the particular coding unit and/or one or more predefined rate-distortion constraints. When it is determined to not perform a transform, the particular coding unit may be coded without transforming the particular coding unit.
    Type: Application
    Filed: August 9, 2023
    Publication date: November 30, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Jizheng Xu, Cuiling Lan
  • Patent number: 11831876
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: November 28, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11831901
    Abstract: A method of video processing is provided. The method includes: determining, for a conversion between a current video block of a video and a coded representation of the video, a mode of operation of a generalized bi-prediction (GBi) coding tool in which a prediction of the current video block uses a final predictor corresponding to a non-uniformly weighted sum of predictors from two reference lists; and performing the conversion based on the determining, wherein a field in the coded representation corresponds to the mode of operation and a value of the field indicates whether the GBI coding tool is enabled or disabled for the current video block.
    Type: Grant
    Filed: May 10, 2021
    Date of Patent: November 28, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
  • Patent number: 11831877
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, where the performing the conversion includes deriving, according to a rule, boundary samples by applying a left bit shift operation or a right bit shift operation on a sum of at least one reference boundary sample, and where the rule determines whether to apply the left bit shift or the right bit shift operation.
    Type: Grant
    Filed: December 29, 2021
    Date of Patent: November 28, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11831899
    Abstract: Innovations in flexible reference picture management are described. For example, a video encoder and video decoder use a global reference picture set (“GRPS”) of reference pictures that remain in memory, and hence are available for use in video encoding/decoding, longer than conventional reference pictures. In particular, reference pictures of the GRPS remain available across random access boundaries. Or, as another example, a video encoder and video decoder clip a reference picture so that useful regions of the reference picture are retained in memory, while unhelpful or redundant regions of the reference picture are discarded. Reference picture clipping can reduce the amount of memory needed to store reference pictures or improve the utilization of available memory by providing better options for motion compensation. Or, as still another example, a video encoder and video decoder filter a reference picture to remove random noise (e.g., capture noise due to camera imperfections during capture).
    Type: Grant
    Filed: February 10, 2022
    Date of Patent: November 28, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Bin Li, Jizheng Xu
  • Patent number: 11825083
    Abstract: An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: November 21, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • Patent number: 11825030
    Abstract: The application relates to an intra block copy mode with dual tree partition. A method of video processing is disclosed. The method of video processing includes: determining, during a conversion between a current video block and a bitstream representation of the current video block, a block vector for the current video block; and performing, at least based on the block vector, the conversion, wherein when the current video block is coded with a coding mode using a reference block for prediction pointing to a same picture that the current video block is located in, and the current video block is a first type of block, the block vector is derived from at least one second type of block.
    Type: Grant
    Filed: June 21, 2021
    Date of Patent: November 21, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Jizheng Xu, Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11825123
    Abstract: A method includes performing a conversion between a video comprising a video unit and a bitstream of the video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies that a first syntax element indicating whether an in-loop filtering operation is performed across tile boundaries is selectively included in the bitstream based on whether or how the video unit is partitioned into tiles.
    Type: Grant
    Filed: August 15, 2022
    Date of Patent: November 21, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Yang Wang, Ye-kui Wang, Zhipin Deng, Jizheng Xu, Hongbin Liu