Patents by Inventor Hongbin Liu

Hongbin Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Prediction precision improvements in video coding
    Patent number: 11902535
    Abstract: Devices, systems and methods for digital video coding, which includes inter prediction with refinement, are described. An exemplary method of video processing includes determining to use, for a conversion between a current block of a video and a bitstream representation of the video, a first linear optimization model for the conversion using a first coding mode, the first linear optimization model being derived from a second linear optimization model that is used for the conversion using a second coding mode, and performing, based on the determining, the conversion. Another exemplary method of video processing includes determining to use, for a conversion between a current block of a video and a bitstream representation of the video, a gradient value computation algorithm for a bi-directional optical flow tool, and performing, based on the determining, the conversion.
    Type: Grant
    Filed: October 19, 2021
    Date of Patent: February 13, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Pruning method for history-based affine parameters
    Patent number: 11902550
    Abstract: Pruning method for History-based affine parameters is described. In an exemplary aspect, a method for video processing includes deriving, for a conversion between a current block of video and a bitstream representation of the current block, a first set of affine parameters associated with affine model for the current block; comparing the first set of affine parameters to one or more of sets of affine parameters stored in a buffer for storing affine parameters so as to determine whether the first set of affine parameters is same or similar to at least one set of affine parameters; and deciding whether or how to update the buffer for storing affine parameters based on the determination.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: February 13, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • CONTEXT CODING FOR MATRIX-BASED INTRA PREDICTION
    Publication number: 20240048762
    Abstract: Devices, systems, and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes encoding a current video block of a video using a matrix intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation; and adding, to a coded representation of the current video block, a syntax element indicative of applicability of the MIP mode to the current video block using arithmetic coding in which a context for the syntax element is derived based on a rule.
    Type: Application
    Filed: October 19, 2023
    Publication date: February 8, 2024
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • INDEPENDENT CODING OF PALETTE MODE USAGE INDICATION
    Publication number: 20240048710
    Abstract: Devices, systems, and methods for palette mode coding are described. An exemplary method for video processing includes performing a conversion between a block of a video region of a video and a bitstream representation of the video. The bitstream representation is processed according to a first format rule that specifies whether a first indication of usage of a palette mode is signaled for the block and a second format rule that specifies a position of the first indication relative to a second indication of usage of a prediction mode for the block.
    Type: Application
    Filed: January 3, 2023
    Publication date: February 8, 2024
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Kai Zhang, Hongbin Liu, Yue Wang
  • INTERPLAY BETWEEN SUBPICTURES AND IN-LOOP FILTERING
    Publication number: 20240048699
    Abstract: An example method of video processing includes: determining, for a conversion between a chroma block of a current processing unit of a current subpicture of a current picture of a video and a bitstream of the video, that a cross component adaptive loop filtering operation is applied to the chroma block, wherein the current picture comprises one or more subpictures; and performing the conversion based on the determining, wherein in the cross component adaptive loop filtering operation, a chroma sample of the chroma block is filtered based on information of luma samples, and wherein one or more luma samples located outside the current processing unit are excluded from the filtering of the chroma sample.
    Type: Application
    Filed: May 19, 2023
    Publication date: February 8, 2024
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • Component-dependent sub-block dividing
    Patent number: 11895306
    Abstract: Devices, systems and methods for sub-block based prediction are described. In a representative aspect, a method for video encoding includes partitioning, based on a first rule, a luma component of a block of video data into a first set of sub-blocks. The method also includes partitioning, based on a second rule, a first chroma component of the block of video data into a second set of sub-blocks. The first and the second set of sub-blocks include different numbers of sub-blocks. The method also includes performing a subsequent motion prediction based on the first and the second set of sub-blocks.
    Type: Grant
    Filed: April 29, 2022
    Date of Patent: February 6, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Overlapped block motion compensation
    Patent number: 11895328
    Abstract: The present disclosure relates to improvement on overlapped block motion compensation. A method for video processing comprises: determining, during a conversion between a current block and a bitstream representation of the current block, a motion vector for a first sub-block inside the current block; using overlapped block motion compensation (OBMC) mode to perform the conversion; wherein the OBMC mode uses intermediate prediction values of the first sub-block based on the motion vector of the first sub-block and prediction values of at least a second video unit that is neighboring the first sub-block to generate final prediction values for the first sub-block; wherein a sub-block size of the first sub-block is based on block size, block shape, motion information, or reference picture of the current block.
    Type: Grant
    Filed: April 23, 2021
    Date of Patent: February 6, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Yue Wang
  • Concept of using one or multiple look up tables to store motion information of previously coded in order and use them to code following blocks
    Patent number: 11895318
    Abstract: Devices, systems and methods for coding video using one or more tables to store motion information and process subsequent blocks are described. In one aspect, a video coding method is provided to include deriving motion information for a first video block which is coded using an intra block copy mode, wherein one or more candidates of one or more tables are selectively checked during a motion candidate list construction process which is used to derive the motion information for the first video block, wherein each table of the one or more tables includes motion candidates derived from previously coded video blocks that are coded prior to the first video block; and coding, based on the motion information, the first video block.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: February 6, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • GUIDED FILTER USAGE
    Publication number: 20240040116
    Abstract: A mechanism for processing video data is disclosed. A conversion is performed between a visual media data including a plurality of video units and a bitstream. A guided filter is applied to samples in the video units. The guided filter is applied at a post decoding stage, such as in an in-loop filtering process.
    Type: Application
    Filed: October 12, 2023
    Publication date: February 1, 2024
    Inventors: Wenbin Yin, Li Zhang, Kai Zhang, Yang Wang, Hongbin Liu
  • ROUNDING IN PAIRWISE AVERAGE CANDIDATE CALCULATIONS
    Publication number: 20240040144
    Abstract: Devices, systems, and methods for unified rounding in sub-block based prediction are described. In a representative aspect, a method of video processing includes generating, for a processing of a current block of video, a pairwise merge candidate based on a pair of motion candidates, and performing, based on the pairwise merge candidate, a conversion between the current block and a bitstream representation of the video. In another representative aspect, a method of video processing includes generating, for a current block of video coded using a geometry partition mode, a uni-prediction motion candidate based on a scaled motion vector and a ListO motion vector, and performing, based on the uni-prediction motion candidate, a conversion between the current block and a bitstream representation of the video.
    Type: Application
    Filed: October 11, 2023
    Publication date: February 1, 2024
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Techniques for decoding or coding images based on multiple intra-prediction modes
    Patent number: 11889097
    Abstract: Aspects include a method, apparatus and computer-readable medium of decoding video or blocks of an image, including receiving a bitstream of the image, deriving, for a block of the image in the bitstream, multiple intra-prediction modes (IPMs) to use in decoding the block, determining, based on the multiple IPMs, a final predictor to use in decoding the block, and decoding the block using the final predictor. Other aspects include method, apparatus and computer-readable medium for similarly encoding video or blocks of an image.
    Type: Grant
    Filed: February 16, 2022
    Date of Patent: January 30, 2024
    Assignee: LEMON INC.
    Inventors: Yang Wang, Kai Zhang, Li Zhang, Yuwen He, Hongbin Liu
  • Gradient computation in bi-directional optical flow
    Patent number: 11889108
    Abstract: Gradient computation in Bi-directional optical flow are described. In a representative aspect, a method of video processing including: modifying temporal gradients in a motion vectors refinement process of a video block or sub-blocks within the video block; and performing the motion vectors refinement process of the video block or the sub-blocks within the video block based on the modified temporal gradients.
    Type: Grant
    Filed: April 8, 2021
    Date of Patent: January 30, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Yue Wang
  • Direction-based prediction for intra block copy in video coding
    Patent number: 11882287
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: January 23, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Position based mode derivation in reduced secondary transforms for video
    Patent number: 11882274
    Abstract: A method of video processing is described. The method includes determining, for a conversion between a current video block of a video unit of a video and a coded representation of the video, a default intra prediction mode for the video unit coded using a certain intra prediction mode such that a prediction block of the current video block is generated without extrapolating neighboring pixels of the current video block along a direction; and performing the conversion based on the determining.
    Type: Grant
    Filed: January 27, 2022
    Date of Patent: January 23, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Multi-parameters based intra prediction
    Patent number: 11882291
    Abstract: A method for video processing is provided. The method includes determining, for a conversion between a current video block of a video that is a chroma block and a coded representation of the video, multiple sets of parameters, wherein each set of parameters defines a cross-component linear model (CCLM) and is derived from a corresponding group of chroma samples at corresponding chroma sample positions; determining, based on the multiple sets of parameters, parameters for a final CCLM; and performing the conversion based on the final CCLM.
    Type: Grant
    Filed: May 3, 2021
    Date of Patent: January 23, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • TWO-STEP CROSS-COMPONENT PREDICTION MODE
    Publication number: 20240022754
    Abstract: A method for video bitstream processing includes generating, using a first video block derived from a third video block of a first component and having a first size, a prediction block for a second video block of a video related to a second component, where the first component is different from the second component, and where the second video block has a second size that is different from the first size. The method also includes performing, using the prediction block, a conversion between the second video block and a bitstream representation of the video according to a two-step cross-component prediction mode (TSCPM).
    Type: Application
    Filed: September 22, 2023
    Publication date: January 18, 2024
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • INTRA BLOCK COPY BUFFER AND PALETTE PREDICTOR UPDATE
    Publication number: 20240022717
    Abstract: Methods and an apparatus for video processing are described. One example method includes determining, for a conversion between a video block of a video and a bitstream of the video, that the video block satisfies a condition. The video block is coded in the bitstream using an intra block copy mode. The method further includes performing the conversion based on the determining. Here, due to the video block satisfying the condition, a portion of an intra block copy buffer is reset during the conversion.
    Type: Application
    Filed: August 30, 2023
    Publication date: January 18, 2024
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu
  • Signaling of combined intra-inter prediction
    Patent number: 11876993
    Abstract: The present application relates to signaling of combined intra-inter prediction. A method for processing video includes: coding, during a conversion between a current video block in a video data and a bitstream representation of the current video block, a combined inter-intra prediction (CIIP) flag for the current video block by a context model based coding without referring to a CIIP flag of one or more neighboring video blocks to the current video block, and performing, at least by applying the combined inter-intra prediction (CIIP) flag of the current video block, the conversion.
    Type: Grant
    Filed: June 23, 2021
    Date of Patent: January 16, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang, Na Zhang
  • Interactions among multiple intra coding methods
    Patent number: 11876971
    Abstract: A video processing method includes determining, for a conversion between a block of a video and a bitstream representation of the video, a manner in which information for a Matrix-based Intra Prediction (MIP) coding technique is coded in the bitstream representation. A prediction block of the block is determined using the MIP coding technique based on performing a matrix vector multiplication operation on previously coded samples of the video. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: August 25, 2022
    Date of Patent: January 16, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Size selective application of decoder side refining tools
    Patent number: 11876932
    Abstract: One example method of video processing includes implementing, by a processor, a decoder-side motion vector derivation (DMVD) scheme for motion vector refinement during a conversion between a current video block and a bitstream representation of the current video block by deriving parameters based on a deriving rule. The conversion may include compressing the current video block into the bitstream representation or uncompressing the bitstream representation into pixel values of the current video block.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: January 16, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang