Patents by Inventor Jizheng Xu

Jizheng Xu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Pruning method for history-based affine parameters
    Patent number: 11902550
    Abstract: Pruning method for History-based affine parameters is described. In an exemplary aspect, a method for video processing includes deriving, for a conversion between a current block of video and a bitstream representation of the current block, a first set of affine parameters associated with affine model for the current block; comparing the first set of affine parameters to one or more of sets of affine parameters stored in a buffer for storing affine parameters so as to determine whether the first set of affine parameters is same or similar to at least one set of affine parameters; and deciding whether or how to update the buffer for storing affine parameters based on the determination.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: February 13, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • CONTEXT CODING FOR MATRIX-BASED INTRA PREDICTION
    Publication number: 20240048762
    Abstract: Devices, systems, and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes encoding a current video block of a video using a matrix intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation; and adding, to a coded representation of the current video block, a syntax element indicative of applicability of the MIP mode to the current video block using arithmetic coding in which a context for the syntax element is derived based on a rule.
    Type: Application
    Filed: October 19, 2023
    Publication date: February 8, 2024
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • INTERPLAY BETWEEN SUBPICTURES AND IN-LOOP FILTERING
    Publication number: 20240048699
    Abstract: An example method of video processing includes: determining, for a conversion between a chroma block of a current processing unit of a current subpicture of a current picture of a video and a bitstream of the video, that a cross component adaptive loop filtering operation is applied to the chroma block, wherein the current picture comprises one or more subpictures; and performing the conversion based on the determining, wherein in the cross component adaptive loop filtering operation, a chroma sample of the chroma block is filtered based on information of luma samples, and wherein one or more luma samples located outside the current processing unit are excluded from the filtering of the chroma sample.
    Type: Application
    Filed: May 19, 2023
    Publication date: February 8, 2024
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • INDEPENDENT CODING OF PALETTE MODE USAGE INDICATION
    Publication number: 20240048710
    Abstract: Devices, systems, and methods for palette mode coding are described. An exemplary method for video processing includes performing a conversion between a block of a video region of a video and a bitstream representation of the video. The bitstream representation is processed according to a first format rule that specifies whether a first indication of usage of a palette mode is signaled for the block and a second format rule that specifies a position of the first indication relative to a second indication of usage of a prediction mode for the block.
    Type: Application
    Filed: January 3, 2023
    Publication date: February 8, 2024
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Kai Zhang, Hongbin Liu, Yue Wang
  • Encoder-side decisions for sample adaptive offset filtering
    Patent number: 11895295
    Abstract: Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures (e.g., slices, coding tree units, or coding units) and determining whether and how certain filtering operation should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for setting the sample adaptive offset (SAO) syntax elements in the H.265/HEVC standard are disclosed. Although these examples concern the H.265/HEVC standard and its SAO filter, the disclosed technology is more widely applicable to other video codecs that involve filtering operations (particularly multi-stage filtering operations) as part of their encoding and decoding processes.
    Type: Grant
    Filed: March 2, 2022
    Date of Patent: February 6, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Bin Li, You Zhou, Jizheng Xu, Chih-Lung Lin, Feng Wu
  • Direction-based prediction for intra block copy in video coding
    Patent number: 11882287
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: January 23, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Multi-parameters based intra prediction
    Patent number: 11882291
    Abstract: A method for video processing is provided. The method includes determining, for a conversion between a current video block of a video that is a chroma block and a coded representation of the video, multiple sets of parameters, wherein each set of parameters defines a cross-component linear model (CCLM) and is derived from a corresponding group of chroma samples at corresponding chroma sample positions; determining, based on the multiple sets of parameters, parameters for a final CCLM; and performing the conversion based on the final CCLM.
    Type: Grant
    Filed: May 3, 2021
    Date of Patent: January 23, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Palette Mode With Intra Block Copy Prediction
    Publication number: 20240022741
    Abstract: A video processing method is described. The method includes determining, for a conversion between a video unit of a video and a coded representation of the video, a maximum number of entries of a palette of representative values used during the conversion according to a rule; and performing the conversion using the palette, and wherein the rule specifies the maximum number of entries according to a characteristic of the video unit.
    Type: Application
    Filed: September 18, 2023
    Publication date: January 18, 2024
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu
  • INTRA BLOCK COPY BUFFER AND PALETTE PREDICTOR UPDATE
    Publication number: 20240022717
    Abstract: Methods and an apparatus for video processing are described. One example method includes determining, for a conversion between a video block of a video and a bitstream of the video, that the video block satisfies a condition. The video block is coded in the bitstream using an intra block copy mode. The method further includes performing the conversion based on the determining. Here, due to the video block satisfying the condition, a portion of an intra block copy buffer is reset during the conversion.
    Type: Application
    Filed: August 30, 2023
    Publication date: January 18, 2024
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu
  • TWO-STEP CROSS-COMPONENT PREDICTION MODE
    Publication number: 20240022754
    Abstract: A method for video bitstream processing includes generating, using a first video block derived from a third video block of a first component and having a first size, a prediction block for a second video block of a video related to a second component, where the first component is different from the second component, and where the second video block has a second size that is different from the first size. The method also includes performing, using the prediction block, a conversion between the second video block and a bitstream representation of the video according to a two-step cross-component prediction mode (TSCPM).
    Type: Application
    Filed: September 22, 2023
    Publication date: January 18, 2024
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Size selective application of decoder side refining tools
    Patent number: 11876932
    Abstract: One example method of video processing includes implementing, by a processor, a decoder-side motion vector derivation (DMVD) scheme for motion vector refinement during a conversion between a current video block and a bitstream representation of the current video block by deriving parameters based on a deriving rule. The conversion may include compressing the current video block into the bitstream representation or uncompressing the bitstream representation into pixel values of the current video block.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: January 16, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
  • Signaling of combined intra-inter prediction
    Patent number: 11876993
    Abstract: The present application relates to signaling of combined intra-inter prediction. A method for processing video includes: coding, during a conversion between a current video block in a video data and a bitstream representation of the current video block, a combined inter-intra prediction (CIIP) flag for the current video block by a context model based coding without referring to a CIIP flag of one or more neighboring video blocks to the current video block, and performing, at least by applying the combined inter-intra prediction (CIIP) flag of the current video block, the conversion.
    Type: Grant
    Filed: June 23, 2021
    Date of Patent: January 16, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang, Na Zhang
  • SELECTIVE USE OF ADAPTIVE IN-LOOP COLOR-SPACE TRANSFORM AND OTHER VIDEO CODING TOOLS
    Publication number: 20240015328
    Abstract: A method of video processing is provided. The method includes: determining, for a conversion between a current video unit of a video and a coded representation of the video, that applicability of a first coding tool and a second coding tool is mutually exclusive; and performing the conversion based on the determining, wherein the first coding tool corresponds to an adaptive color space transformation (ACT) tool; wherein use of the ACT tool comprises: converting, during encoding, a representation of a visual signal from a first color domain to a second color domain, or converting, during decoding, a representation of a visual signal from the second color domain to the first color domain.
    Type: Application
    Filed: September 21, 2023
    Publication date: January 11, 2024
    Inventors: Li Zhang, Jizheng Xu, Kai Zhang, Hongbin Liu, Weijia Zhu, Yue Wang
  • Motion precision in sub-block based inter prediction
    Patent number: 11871025
    Abstract: Devices, systems and methods for digital video coding, which include sub-block based inter prediction methods, are described. An exemplary method for video processing includes determining, for a conversion between a current block of video and a bitstream representation of the video, a maximum number of candidates in a sub-block based merge candidate list and/or whether to add sub-block based temporal motion vector prediction (SbTMVP) candidates to the sub-block based merge candidate list based on whether temporal motion vector prediction (TMVP) is enabled for use during the conversion or whether a current picture referencing (CPR) coding mode is used for the conversion, and performing, based on the determining, the conversion.
    Type: Grant
    Filed: December 17, 2021
    Date of Patent: January 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Transform skip residual coding
    Patent number: 11871039
    Abstract: Several techniques for video encoding and video decoding are described. One example method includes performing a conversion between a video including a video unit and a bitstream of the video according to a rule, wherein the rule specifies whether a transform skip residual coding operation is enabled for the video unit, and wherein one or more syntax elements are included in the bitstream at a video segment level indicative of whether the transform skip residual coding operation is enabled for the video unit.
    Type: Grant
    Filed: August 26, 2022
    Date of Patent: January 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Ye-kui Wang, Kai Zhang, Zhipin Deng
  • Blending method for inter prediction with geometry partition
    Patent number: 11870987
    Abstract: Devices, systems and methods for digital video coding, which includes using default motion candidates for video coding, are described. An exemplary method for video processing includes determining, for a conversion between a block of a video and a bitstream representation of the video, weights to use for a weighted average of prediction samples along an edge of two partitions of the block. The two partitions are generated according to a geometry partition mode, and the weights are selected from a first weighting factor group that at least one of the weights is equal to 0 or 1. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: May 11, 2021
    Date of Patent: January 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Transform bypass coded residual blocks in digital video
    Patent number: 11870996
    Abstract: A method for video processing includes determining that a size of a residual block of a video is larger than a maximum block size allowed for a transform skip mode, in which, during a decoding operation, residual coefficients are decoded without performing an inverse transform operation; splitting, based on the size of a residual block, the residual block into multiple regions, wherein each region represents a portion of the residual block of a difference between a portion of a current video block and a prediction block corresponding to the portion of the current video block; and determining a reconstructed current video block from the residual block based on selectively performing the inverse transform operation according to an indicator that indicates the transform skip mode.
    Type: Grant
    Filed: July 25, 2022
    Date of Patent: January 9, 2024
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu
  • Interplay between subpictures and in-loop filtering
    Patent number: 11870989
    Abstract: An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: January 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • Joint use of adaptive colour transform and differential coding of video
    Patent number: 11863715
    Abstract: Methods, systems and devices for implementing adaptive color transform (ACT) and block based delta pulse code modulation (BDPCM) during image/video encoding or decoding are described. An example method of video processing includes determining, for a conversion between a current video unit of a video that is a chroma video unit and a bitstream representation of the video, whether a block-based delta pulse code modulation (BDPCM) mode is available based on a rule, and performing the conversion based on the determining, wherein the rule is based on whether an adaptive color transform (ACT) mode is used for coding the current video unit and/or whether the BDPCM mode is used for coding a luma video unit corresponding to the current video unit.
    Type: Grant
    Filed: June 16, 2022
    Date of Patent: January 2, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Weijia Zhu, Jizheng Xu, Li Zhang, Yue Wang
  • Updating of history based motion vector prediction tables
    Patent number: 11863771
    Abstract: A method for processing a video includes maintaining one or more tables, wherein each table includes motion candidates derived from previously processed video blocks that are processed prior to a first video block of a video; deriving motion information for the first video block; applying refinement to the motion information when at least one decoder side motion vector derivation (DMVD) technologies is enabled; performing a conversion between a bitstream representation of the first video block and the first video block using the refined motion information; and determining, whether to use the refined motion information or un-refined motion information for updating one or more tables.
    Type: Grant
    Filed: August 10, 2021
    Date of Patent: January 2, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang