Patents by Inventor Jizheng Xu

Jizheng Xu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240121388
    Abstract: Systems, methods and apparatus for video processing are described. The video processing may include video encoding, video decoding, or video transcoding. One example method of video processing includes performing a conversion between a video and a bitstream of the video according to a format rule. The format rule specifies that a first field at a sequence level or a picture level or a slice level controls a value of a second field in an adaptation parameter set.
    Type: Application
    Filed: November 28, 2023
    Publication date: April 11, 2024
    Inventors: Zhipin Deng, Li Zhang, Ye-Kui Wang, Kai Zhang, Jizheng Xu
  • Publication number: 20240121381
    Abstract: Video coding and decoding methods are described. An example method includes performing a conversion between a current video block of a video and a bitstream representation of the current video block by determining a first intra coding mode to be stored which is associated with the current video block using a differential coding mode, where the first intra coding mode associated with the current video block is determined according to a second prediction mode used by the differential coding mode, and where, in the differential coding mode, a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual is represented in the bitstream representation for the current video block using a differential pulse coding modulation (DPCM) representation.
    Type: Application
    Filed: November 3, 2023
    Publication date: April 11, 2024
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
  • Patent number: 11956439
    Abstract: A method for visual media processing includes performing a conversion between a current video unit of a visual media data and a bitstream representation of the current video unit. The bitstream representation is configured according to a format rule. The format rule specifies a level of a video segment at which one or more syntax elements indicative of a scaling factor by which a chroma residual is scaled for coding the current video unit is selectively included in the bitstream representation.
    Type: Grant
    Filed: October 31, 2022
    Date of Patent: April 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang, Jizheng Xu
  • Patent number: 11956432
    Abstract: An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: April 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • Patent number: 11956449
    Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video coded using a combined inter and intra prediction (CIIP) coding technique and a bitstream representation of the video, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: November 29, 2022
    Date of Patent: April 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11956465
    Abstract: Difference calculation based on partial position is described. In a representative aspect, a method of video processing comprising: calculating, during a conversion between a current block of video and a bitstream representation of the current block, differences between two reference blocks associated with the current block or differences between two reference sub-blocks associated with a sub-block within the current block based on representative positions of the reference blocks or representative positions of the reference sub-blocks; and performing the conversion based on the differences.
    Type: Grant
    Filed: November 24, 2021
    Date of Patent: April 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
  • Patent number: 11956438
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: August 26, 2022
    Date of Patent: April 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Publication number: 20240114133
    Abstract: A method of video processing is provided to include: performing a conversion between a video including one or more video regions including one or more luma blocks and one or more chroma blocks and a coded representation of the video according to a rule; wherein the rule specifies that a chroma block from the one or more chroma blocks having a size M×N is disallowed to be represented in the coded representation using an intra mode or an intra block copy mode, wherein M and N are integers that indicate a width and a height of the chroma block, respectively; wherein the intra mode includes encoding the chroma block based on previously encoded or reconstructed video blocks, and wherein the intra block copy mode includes encoding the chroma block using at least a block vector pointing to a video frame containing a video region.
    Type: Application
    Filed: November 7, 2023
    Publication date: April 4, 2024
    Inventors: Jizheng Xu, Zhipin Deng, Li Zhang, Hongbin Liu
  • Publication number: 20240114156
    Abstract: A method for implementing an adaptive color transform (ACT) during image/video encoding and decoding, includes determining, for a conversion between a video including a block and a bitstream of the video, that a size of the block is greater than a maximum allowed size for an ACT mode, and performing, based on the determining, the conversion, wherein, in response to the size of the block being greater than the maximum allowed size for the ACT mode, the block is partitioned into multiple sub-blocks, and wherein each of the multiple sub-blocks share a same prediction mode, and the ACT mode is enabled at a sub-block level.
    Type: Application
    Filed: November 30, 2023
    Publication date: April 4, 2024
    Inventors: Weijia Zhu, Jizheng Xu, Li Zhang, Kai Zhang, Yue Wang
  • Patent number: 11949880
    Abstract: A method of video processing is described. The method includes determining, for a conversion between a current video block of a video and a coded representation of the video, whether a certain partitioning scheme is allowed for the current video block according to a rule that depends on a coding mode type used for representing the current video block in the coded representation and a dimension of the current video block; and performing the conversion based on the determining.
    Type: Grant
    Filed: March 2, 2022
    Date of Patent: April 2, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang
  • Publication number: 20240107036
    Abstract: A method of video processing is provided that includes performing a conversion between a block of a video and a bitstream of the video. The bitstream conforms to a formatting rule specifying that a size of a merge estimation region (MER) is indicated in the bitstream and the size of the MER is based on a dimension of a video unit. The MER comprises a region used for deriving a motion candidate for the conversion.
    Type: Application
    Filed: November 14, 2023
    Publication date: March 28, 2024
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu, Ye-kui Wang
  • Publication number: 20240107037
    Abstract: Video processing methods, systems and appratrus are described. One example method includes performing a conversion between a video block of a video and a bitstream of the video using a palette mode in which samples of the video block are represented using a palette of representive color values. A size of the palette of the video block is determined based on whether a local dual tree is applied for the conversion.
    Type: Application
    Filed: November 17, 2023
    Publication date: March 28, 2024
    Inventors: Jizheng Xu, Li Zhang, Ye-kui Wang, Kai Zhang, Weijia Zhu, Yue Wang, Yang Wang, Hongbin Liu
  • Publication number: 20240107007
    Abstract: Devices, systems and methods for digital video coding, which include sub-block based inter prediction methods, are described. An exemplary method for video processing includes determining, for a conversion between a current block of video and a bitstream representation of the video, a maximum number of candidates in a sub-block based merge candidate list and/or whether to add sub-block based temporal motion vector prediction (SbTMVP) candidates to the sub-block based merge candidate list based on whether temporal motion vector prediction (TMVP) is enabled for use during the conversion or whether a current picture referencing (CPR) coding mode is used for the conversion, and performing, based on the determining, the conversion.
    Type: Application
    Filed: November 30, 2023
    Publication date: March 28, 2024
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Publication number: 20240107035
    Abstract: A method for video processing is provided to include: performing a conversion between a current video block of a video and a coded representation of current video block, wherein the conversion uses a coding mode in which the current video block is constructed based on a first domain and a second domain and/or chroma residue is scaled in a luma-dependent manner, and wherein information used for the coding mode is signaled in a parameter set that is different from a sequence parameter set (SPS), a video parameter set (VPS), a picture parameter set (PPS), or an adaptation parameter set (APS) used for carrying adaptive loop filtering (ALF) parameters.
    Type: Application
    Filed: October 24, 2023
    Publication date: March 28, 2024
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Publication number: 20240107038
    Abstract: An example method of video processing includes determining, for a conversion between a chroma block of a video and a bitstream representation of the video, applicability of a deblocking filter process to at least some samples at an edge of the chroma block based on a mode of joint coding of chroma residuals for the chroma block. The method also includes performing the conversion based on the determining.
    Type: Application
    Filed: November 27, 2023
    Publication date: March 28, 2024
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Kai Zhang
  • Publication number: 20240107013
    Abstract: A method includes determining, for a conversion between a video block of a video and a bitstream of the video, a size of prediction block corresponding to the video block according to a rule. The method also includes performing the conversion based on the determining. The rule specifies that a first size of the prediction block is determined responsive to whether a prediction refinement using optical flow technique is used for coding the video block. The video block has a second size and is coded using an affine merge mode or an affine advanced motion vector prediction mode.
    Type: Application
    Filed: November 21, 2023
    Publication date: March 28, 2024
    Inventors: Zhipin Deng, Li Zhang, Ye-kui Wang, Kai Zhang, Jizheng Xu
  • Publication number: 20240107067
    Abstract: A video processing method is provided to include performing a conversion between a video and a bitstream of the video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies a condition that controls whether or how one or more syntax elements related to picture order counts for a long term reference picture are included in a reference picture list syntax structure in the bitstream.
    Type: Application
    Filed: October 30, 2023
    Publication date: March 28, 2024
    Inventors: Ye-kui Wang, Zhipin Deng, Li Zhang, Kai Zhang, Jizheng Xu
  • Publication number: 20240107055
    Abstract: A method of video processing is provided. The method includes: determining, for a conversion between a first video block of a video and a bitstream of the video, that a merge mode with motion vector differences is applied into the first video block; and performing the conversion based on the determining, where the merge mode includes motion vector expression to derive motion information of the first video block, where the motion vector expression includes a first parameter representing a motion vector difference and a second parameter indicating a base candidate from a base candidate list, where the first parameter includes a first motion magnitude and a first motion direction, and where the base candidate list is based on a first merge candidate list for a merge mode which is constructed for the first video block during the conversion.
    Type: Application
    Filed: November 21, 2023
    Publication date: March 28, 2024
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
  • Patent number: 11943481
    Abstract: Methods, systems, and devices for performing entropy coding for a palette escape symbol in palette mode coding and decoding are described. An example method for video processing includes performing a conversion between a video having one or more video regions including a current video block and a bitstream representation of the video, wherein the bitstream representation conforms to a format rule that the current video block is coded using a palette mode coding tool, wherein a binarization of an escape symbol for the current video block uses an exponential-Golomb (EG) code of order K, wherein K is a non-negative integer that is unequal to three, and wherein the palette mode coding tool represents the current video block using a palette of representative color values and wherein the escape symbol is used for a sample of the current video block coded without using the representative color values.
    Type: Grant
    Filed: October 13, 2022
    Date of Patent: March 26, 2024
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Jizheng Xu, Li Zhang, Hsiao Chiang Chuang
  • Patent number: 11943444
    Abstract: A method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode, where the conversion includes performing the upsampling operation in which the final prediction block is determined by using a reduced prediction block of the current video block and by using reconstructed neighboring samples of the current video block according to a rule, and where the reduced prediction block is obtained by performing the matrix vector multiplication operation on reduced boundary samples of the current video block.
    Type: Grant
    Filed: August 12, 2022
    Date of Patent: March 26, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu