Patents by Inventor Lien-Fei CHEN

Lien-Fei CHEN has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11979592
    Abstract: A method of video decoding includes receiving a syntax element associated with a current coding block that is partitioned into a first part and a second part along a partition edge for prediction in a geometric partitioning mode. The method further includes determining a weight index at a sample position of the current coding block, and determining a stored motion vector type for a first motion storage unit in a motion field of the current coding block based on a motion index of the first motion storage unit. The method further includes storing the motion field of the current coding block based on the stored motion vector type determined for the first motion storage unit.
    Type: Grant
    Filed: October 27, 2022
    Date of Patent: May 7, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Lien-Fei Chen, Xiang Li, Guichun Li, Shan Liu
  • Publication number: 20240137552
    Abstract: The processing circuitry receives a coded video bitstream, the coded video bitstream includes coded information of a first block, the coded information indicates a use of a decoder side motion refinement (DMVR) on the first block. The first block has a first sample size. The processing circuitry applies an extended DMVR on the first block, the extended DMVR uses a second sample size for bilateral matching cost calculation, the second sample size is different from the first sample size of the first block. The processing circuitry calculates a plurality of bilateral matching costs respectively associated with a plurality of motion vector adjustments, at least a first bilateral matching cost in the plurality of bilateral matching costs is calculated based on the second sample size that is different from the first sample size of the first block. The processing circuitry determines a first refined motion vector and reconstructs accordingly.
    Type: Application
    Filed: October 9, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Guichun LI, Xin ZHAO, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240137520
    Abstract: Processing circuitry receives coded information of a motion vector difference (MVD). The processing circuitry calculates cost values associated with value combinations for a plurality of bits in coding bits of the MVD, at least one of the plurality of bits is a bit in a codeword for indicating a magnitude for the MVD. The processing circuitry determines a combination of prediction values for the plurality of bits from the value combinations, the combination of prediction values is associated with a lowest cost value in the cost values. The processing circuitry decodes the coded information of the MVD to obtain one or more indicators for the combination of prediction values, the one or more indicators indicates whether the plurality of bits is correctly predicted by the combination of prediction values. The processing circuitry determines the MVD based on the combination of prediction values and the one or more indicators.
    Type: Application
    Filed: October 17, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Guichun LI, Xin ZHAO, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240137487
    Abstract: Processing circuitry for video decoding receives coded information of a current block in a current picture from a coded video bitstream, the coded information is indicative of applying local illumination compensation (LIC) on the current block in the current picture. The processing circuitry derives, parameters of an LIC model, according to a first template of a current block and a second template of a reference block in a reference picture. The reference block is pointed based on a motion vector for the current block. The first template includes a subset of reconstructed neighboring samples that are above and left to the current block, and the second template includes collocated samples to the subset of the reconstructed neighboring samples. The processing circuitry applies the LIC model on the current block according to the reference block to generate compensated samples of the current block.
    Type: Application
    Filed: August 30, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Lien-Fei CHEN, Xin ZHAO, Guichun LI, Shan LIU
  • Publication number: 20240137539
    Abstract: Processing circuitry determines an initial affine model with bi-prediction for a current block in an affine motion inter prediction mode, the initial affine model predicts the current block based on a first reference picture and a second reference picture. The processing circuitry performs a multi-stage bilateral matching motion refinement with at least a first stage and a second stage on the initial affine model to derive a refined affine model, one of the first stage and the second stage applies a first bilateral matching motion refinement on a translational component of the initial affine model, and the other of the first stage and the second stage applies a second bilateral matching motion refinement on a non-translational component of the initial affine model. The processing circuitry reconstructs the current block using the refined affine model based on the first reference picture and the second reference picture.
    Type: Application
    Filed: October 16, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Guichun LI, Xin ZHAO, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240137509
    Abstract: Aspects of the disclosure include methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry receives, from a coded video bitstream, coded information associated with a current block in a current picture. The coded information indicates that the current block is coded in a geometric partition mode (GPM), the current block is partitioned into at least a first partition and a second partition in the GPM by a partition edge. The processing circuitry determines that at least the first partition is coded in a subblock motion mode. The first partition includes a plurality of subblocks. The processing circuitry determines a plurality of motion vectors for the plurality of subblocks in the first partition of the current block, and reconstructs the plurality of subblocks in the first partition of the current block according to the plurality of motion vectors respectively.
    Type: Application
    Filed: October 12, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Guichun LI, Han GAO, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240137540
    Abstract: A current block is coded by an affine mode and includes a first control point at a first corner of the current block. A current template associated with the first control point is determined. A plurality of candidate reference templates is determined in a reference picture for the current template. A reference template is selected from the plurality of candidate reference templates for the current template based on a template matching (TM) cost. The TM cost indicates a respective difference between each candidate reference template and the current template of the first control point. A first control point motion vector (CPMV) is determined based on the selected reference template, where the first CPMV indicates an offset between the selected reference template in the reference picture and the current template associated with the first control point. The current block is reconstructed based at least on the first CPMV.
    Type: Application
    Filed: October 16, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Guichun LI, Xin ZHAO, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240137488
    Abstract: Processing circuitry receives coded information of a current block indicative of applying LIC on the current block according to at least a first reference block in a first reference picture. The processing circuitry determines, for a sample in the current block, at least a first reference sample in the first reference block, the first reference sample is co-located to the sample in the current block. The processing circuitry calculates a weighted sum of a plurality of terms and an offset for the LIC according to a plurality of parameter values for a plurality of parameters used in the LIC, and reconstructs the sample accordingly. The plurality of parameter values includes at least a first weighting value for a first weighting that is applied to a non-linear term of the first reference sample of a kth power, k is a power index value and is not equal to 1.
    Type: Application
    Filed: October 17, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240137541
    Abstract: Aspects of the disclosure include methods and apparatuses for video coding. One of the apparatuses includes processing circuitry that receives a current block in a bitstream. The current block is predicted with intra prediction fusion comprising multiple candidate intra prediction modes. The processing circuitry determines a respective candidate prediction value of a sample in the current block for each of the multiple candidate intra prediction modes. The processing circuitry derives weights of the respective multiple candidate intra prediction modes based on intra prediction modes used to code neighboring blocks of the current block. The processing circuitry predicts, according to the derived weights, the sample in the current block by a weighted sum of the candidate prediction values associated with the multiple candidate intra prediction modes.
    Type: Application
    Filed: October 17, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240137515
    Abstract: A video bitstream comprising coding information of a current block in a current picture is received. The coding information indicates that the current block is coded by a flip mode in which locations of samples of the current block are adjusted within the current block. A reference block is determined from a plurality of candidate reference blocks in a reconstructed region of the current picture for the current block based on template matching (TM) costs. The TM costs indicate differences between a template of the current block and respective templates of the plurality of candidate reference blocks. A reconstruction block of the current block is determined based on the determined reference block. The current block is reconstructed by adjusting locations of samples of the reconstruction block within the reconstruction block based on the flip mode.
    Type: Application
    Filed: October 22, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Xiaozhong XU, Shan LIU
  • Publication number: 20240137542
    Abstract: Aspects of the disclosure include methods and apparatuses for video coding. One of the apparatuses includes processing circuitry that receives a current block in a bitstream. The current block is predicted with intra prediction fusion comprising multiple candidate intra prediction modes. The processing circuitry derives a dominant intra prediction mode from the multiple candidate intra prediction modes. The processing circuitry applies a transform from a transform set associated with the dominant intra prediction mode for the current block and decodes the current block according to the transform.
    Type: Application
    Filed: October 17, 2023
    Publication date: April 25, 2024
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240129508
    Abstract: A reference block is determined from a plurality of candidate reference blocks for a current block in a current picture based on template matching (TM) costs of the plurality of candidate reference blocks. The TM costs indicate differences between a template of the current block and respective reference templates of the plurality of candidate reference blocks. Samples of the determined reference block are classified into a plurality of classes of samples. A partitioning pattern of the current block is derived based on the determined reference block from a predetermined plurality of partitioning patterns. The derived partitioning pattern indicates a plurality of partitions of the current block. Each of the plurality of classes of the samples of the determined reference block corresponds to a respective partition of the plurality of partitions of the current block. The current block is reconstructed based on the derived partitioning pattern of the current block.
    Type: Application
    Filed: October 12, 2023
    Publication date: April 18, 2024
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Han GAO, Shan LIU
  • Publication number: 20240129506
    Abstract: A current block is partitioned into a first partition and a second partition. Template samples of the current block are split into a first template region adjacent to the first partition and a second template region adjacent to the second partition. A plurality of first candidate reference blocks is determined for the first partition. A plurality of second candidate reference blocks is determined for the second partition. At least one of the plurality of first candidate reference blocks and the plurality of second candidate reference blocks is reordered based on a size of the first template region of the template samples and a size of the second template region of the template samples. The current block is reconstructed based on a received index value and based on the reordered at least one of the plurality of first candidate reference blocks and the plurality of second candidate reference blocks.
    Type: Application
    Filed: August 31, 2023
    Publication date: April 18, 2024
    Applicant: Tencent America LLC
    Inventors: Lien-Fei CHEN, Guichun LI, Xin ZHAO, Shan LIU
  • Publication number: 20240129505
    Abstract: In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry receives coded information of a current block in a current picture from a coded video bitstream. The coded information includes a syntax element with a value indicative of a merge with motion vector difference (MMVD) mode being applied on the current block. The processing circuitry determines, in response to a motion vector predictor of a merge candidate being a bi-predictor, whether the merge candidate for the current block satisfies a requirement for applying a bi-prediction motion refinement. The processing circuitry can constrain the merge candidate for use in the MMVD mode when the merge candidate for the current block satisfies the requirement. Then, the processing circuitry reconstructs the current block in the MMVD mode with the merge candidate being constrained for use in the MMVD mode.
    Type: Application
    Filed: August 31, 2023
    Publication date: April 18, 2024
    Applicant: Tencent America LLC
    Inventors: Lien-Fei CHEN, Guichun LI, Xin ZHAO, Shan LIU
  • Publication number: 20240129454
    Abstract: Aspects of the disclosure include methods and apparatuses for video coding. One of the apparatuses includes processing circuitry that receives a coded video bitstream that includes a current picture with a block. The processing circuitry determines a prediction block of the block using one of an intra block copy (IBC) mode and an intra template matching (IntraTMP) mode. If boundary filtering is to be applied to the block, the processing circuitry applies the boundary filtering to a prediction sample located at a position (x?,y?) in the prediction block by determining a parameter W of the boundary filtering based on coded information of the block; determining weights used in the boundary filtering by right shifting the parameter W according to the position (x?,y?); and generating a filtered prediction sample based on a linear combination of reference samples and the prediction sample according to the determined weights.
    Type: Application
    Filed: October 13, 2023
    Publication date: April 18, 2024
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Shan LIU
  • Publication number: 20240129479
    Abstract: A video bitstream is received. The video bitstream includes a current block comprising a plurality of subblocks and a template region of the current block comprising a plurality of template subblocks adjacent to at least one of a top side and a left side of the current block. A motion vector (MV) located in a center position of the current block is determined. The MV is determined based on at least one MV of the plurality of subblocks of the current block. A MV for each of the plurality of template subblocks is determined based on the MV located in the center position of the current block and a respective MV of a corresponding subblock of the plurality of subblocks that is adjacent to the respective template subblock. The current block is reconstructed based on the determined MVs for the plurality of template subblocks.
    Type: Application
    Filed: August 31, 2023
    Publication date: April 18, 2024
    Applicant: Tencent America LLC
    Inventors: Lien-Fei CHEN, Guichun LI, Xin ZHAO, Xiaozhong XU, Shan LIU
  • Publication number: 20240121437
    Abstract: A video bitstream comprising a current picture of a video is received. A first group of samples and a second group of samples in the current picture are determined. A first geometric transform is determined for the first group of samples in the current picture and a second geometric transform is determined for the second group of samples in the current picture. The first geometric transform is configured to adjust an orientation of the first group of samples in the current picture. The second geometric transform is different from the first geometric transform and configured to adjust an orientation of the second group of samples in the current picture. The picture is reconstructed, where the first group of samples is reconstructed based on the determined first geometric transform and the second group of samples is reconstructed based on the determined second geometric transform.
    Type: Application
    Filed: October 4, 2023
    Publication date: April 11, 2024
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Shan LIU
  • Patent number: 11949863
    Abstract: In response to a current block being partitioned into a first partition and a second partition based on a geometric partition mode, a first prediction type for the first partition and a second prediction type for the second partition are determined based on a flag associated with one of intra prediction, inter prediction, and intra block copy (IBC). Each of the first and second prediction types is one of the intra prediction, the inter prediction, and the IBC. Based on the first prediction type, a first prediction mode for the first partition of the current block is determined. Based on the second prediction type, a second prediction mode for the second partition of the current block is determined. The first partition of the current block is reconstructed based on the first prediction mode and the second partition of the current block is reconstructed based on the second prediction mode.
    Type: Grant
    Filed: July 29, 2022
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Lien-Fei Chen, Xiang Li, Ling Li, Shan Liu
  • Publication number: 20240098279
    Abstract: In a method, coded information of a current block in a current picture of a video is received from a coded video bitstream. The coded information indicates that the current block is partitioned into at least a first partition and a second partition based on a geometric partition mode (GPM). The first partition is associated with an intra block copy (IBC) prediction mode, and the second partition is associated with an intra prediction mode. Prediction mode information for a first subblock of a plurality of subblocks of the current block is stored. The prediction mode information includes one of a DC mode, a Planar mode, and an intra prediction mode based on whether the first subblock is associated with one of the IBC prediction mode, the intra prediction mode, and both the IBC prediction mode and the intra prediction mode.
    Type: Application
    Filed: December 1, 2023
    Publication date: March 21, 2024
    Applicant: Tencent America LLC
    Inventors: Lien-Fei CHEN, Xiang LI, Shan LIU
  • Publication number: 20240089487
    Abstract: The various embodiments described herein include methods and systems for encoding and decoding video. In one aspect, a method includes receiving a video bitstream comprising a plurality of blocks, including a first block, where the first block includes a plurality of subblocks. The method also includes determining, based on a syntax element value in the video bitstream, that the first block is predicted in a subblock mode. The method further includes, in accordance with the first block being predicted in the subblock mode: deriving a set of motion vector predictors (MVPs) corresponding to a plurality of subblocks of the first block; deriving a set of motion vector differences (MVDs) for the plurality of subblocks; determining a set of motion vectors for the plurality of subblocks by applying the set of MVDs to the set of MVPs; and reconstructing the first block using the set of motion vectors.
    Type: Application
    Filed: June 14, 2023
    Publication date: March 14, 2024
    Inventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Shan LIU