Patents by Inventor Junru LI

Junru LI has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12294739
    Abstract: A video processing method includes performing a conversion between a video including a video unit and a coded representation of the video, where, after the video unit is encoded or decoded with an intra prediction mode, one or more frequence tables and/or one or more sorted intra prediction mode (IPM) tables are selectively updated according to a rule, where the one or more frequence tables include information about frequence of the intra prediction mode used for processing the video unit in the conversion, where the frequence indicates an occurrence of the intra prediction mode used for the conversion, and where the one or more sorted IPM tables indicate the intra prediction mode used in the processing.
    Type: Grant
    Filed: February 22, 2022
    Date of Patent: May 6, 2025
    Assignees: Beijing Bytedance Network Technology Co., Ltd., Bytedance Inc., Bytedance (HK) Limited
    Inventors: Junru Li, Meng Wang, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang, Shiqi Wang
  • Publication number: 20250119593
    Abstract: Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, for a conversion between a video unit of a video and a bitstream of the video, a connection to a plurality of filters; applying the plurality of filters with the connection in combination to the video unit; and performing the conversion based on the filtered video unit.
    Type: Application
    Filed: December 18, 2024
    Publication date: April 10, 2025
    Inventors: Junru LI, Kai ZHANG, Li ZHANG, Yue Li
  • Publication number: 20250039401
    Abstract: Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, a distortion value of the current video block based on a set of distortion metrics, the set of distortion metrics comprising at least one of: a first distortion metric determined according to a first machine learning model, a second distortion metric determined according to a second machine learning model, or a third distortion metric determined without using the first and second machine learning models; and performing the conversion based on the distortion value. In this way, a rate-distortion optimization process based on the distortion value can be improved, and thus the coding performance can be enhanced.
    Type: Application
    Filed: October 11, 2024
    Publication date: January 30, 2025
    Inventors: Junru LI, Yue Li, Kai Zhang, Li Zhang
  • Publication number: 20240406389
    Abstract: Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, during a conversion between a video unit of a video and a bitstream of the video unit, a plurality of filters in combination based on a model to the video unit; and performing the conversion based on the applying.
    Type: Application
    Filed: July 29, 2024
    Publication date: December 5, 2024
    Inventors: Junru LI, Kai ZHANG, Li ZHANG, Yue LI
  • Publication number: 20240388704
    Abstract: Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, during a conversion between a video unit of a video and a bitstream of the video unit, a plurality of filters in combination to the video unit; and performing the conversion based on the filtered video unit.
    Type: Application
    Filed: July 29, 2024
    Publication date: November 21, 2024
    Inventors: Junru LI, Kai ZHANG, Li ZHANG, Yue LI
  • Publication number: 20240276020
    Abstract: A method implemented by a video coding apparatus includes applying a neural network (NN) filter to an unfiltered sample of a video unit to generate a filtered sample. The NN filter is applied based on a syntax element of the video unit. The method also includes converting between a video media file and a bitstream based on the filtered sample that was generated.
    Type: Application
    Filed: April 2, 2024
    Publication date: August 15, 2024
    Inventors: Yue Li, Li Zhang, Kai Zhang, Junru Li, Meng Wang, Siwei Ma, Shiqi Wang
  • Publication number: 20240244239
    Abstract: Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a target video block of a video and a bitstream of the video, a target coding tool for the target video block by using a machine learning model; and performing the conversion by using the target coding tool. By taking the machine learning model into consideration in selecting the coding tool, a more proper coding tool can be selected. In this way, the coding performance can be enhanced.
    Type: Application
    Filed: March 29, 2024
    Publication date: July 18, 2024
    Inventors: Junru LI, Yue LI, Kai ZHANG, Li ZHANG
  • Publication number: 20240244226
    Abstract: Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a target video block of a video and a bitstream of the video, a distortion metric for the target video block based at least in part on at least one distortion of: a set of filtered distortions of the target video block according to a set of machine learning models, or a second distortion of the target video block determined without using the set of machine learning models; determining, based on the distortion metric, information regarding using the set of machine learning models in a rate-distortion optimization (RDO) process on the target video block; and performing the conversion based on the information. In this way, the RDO process can be improved, and thus the coding performance can be enhanced.
    Type: Application
    Filed: March 29, 2024
    Publication date: July 18, 2024
    Inventors: Junru LI, Yue Li, Kai Zhang, Li Zhang
  • Publication number: 20240179343
    Abstract: Embodiments of the present disclosure provide a solution for video processing. In some embodiments, a method for video processing is proposed, which comprises: reordering at least one intra string copy (ISC) reference string, the at least one ISC reference string matching with at least one string of a block of a video; reconstructing the block based on the reordered at least one ISC reference string; and performing a conversion between the reconstructed block and a bitstream of the video. The proposed method can advantageously improve the coding efficiency.
    Type: Application
    Filed: April 1, 2022
    Publication date: May 30, 2024
    Inventors: Kai ZHANG, Li ZHANG, Yuhuai ZHANG, Junru LI, Siwei MA
  • Publication number: 20240129489
    Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of processing video data includes determining, for a conversion between a video block of a video and a bitstream of the video, a gradient of a prediction vector at a sub-block level for the video block according to a rule, wherein the rule specifies to use a same gradient value is assigned for all samples within a sub-block of the video block; and performing the conversion based on the determining.
    Type: Application
    Filed: November 16, 2023
    Publication date: April 18, 2024
    Inventors: Kai Zhang, Yuwen He, Li Zhang, Hongbin Liu, Tianliang Fu, Junru Li, Siwei Ma
  • Patent number: 11956448
    Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of processing video data includes determining, for a conversion between a video block of a video and a bitstream of the video, a gradient of a prediction vector at a sub-block level for the video block according to a rule, wherein the rule specifies to use a same gradient value is assigned for all samples within a sub-block of the video block; and performing the conversion based on the determining.
    Type: Grant
    Filed: December 7, 2022
    Date of Patent: April 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Yuwen He, Li Zhang, Hongbin Liu, Tianliang Fu, Junru Li, Siwei Ma
  • Patent number: 11949918
    Abstract: A method implemented by a video coding apparatus includes applying a neural network (NN) filter to an unfiltered sample of a video unit to generate a filtered sample. The NN filter is applied based on a syntax element of the video unit. The method also includes converting between a video media file and a bitstream based on the filtered sample that was generated.
    Type: Grant
    Filed: April 13, 2022
    Date of Patent: April 2, 2024
    Assignees: LEMON INC., BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC., BYTEDANCE (HK) LIMITED
    Inventors: Yue Li, Li Zhang, Kai Zhang, Junru Li, Meng Wang, Siwei Ma, Shiqi Wang
  • Patent number: 11917196
    Abstract: A video processing method includes performing a conversion between a video comprising multiple video units and a coded representation of the video in which the multiple video units are processed in an order, where, when a video unit of the multiple video units is processed in the conversion, one or more frequence tables and/or one or more sorted intra prediction mode (IPM) tables are reset or initialized, where the one or more frequence tables include information about frequence of one or more intra prediction modes used for processing previous video units in the multiple video units, where the previous video units precede in time the video unit, where the frequence indicates an occurrence of the one or more intra prediction modes used for the conversion, and where the one or more sorted IPM tables indicate the one or more intra prediction modes used in the processing.
    Type: Grant
    Filed: February 22, 2022
    Date of Patent: February 27, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC., Bytedance (HK) Limited
    Inventors: Junru Li, Meng Wang, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang, Shiqi Wang
  • Publication number: 20240056570
    Abstract: A method implemented by a video coding apparatus. The method includes applying a first filter to an unfiltered sample of a video unit to generate a filtered sample. The first filter is a neural network (NN) filter based on a non-deep learning-based filter (NDLF) being disabled, and the first filter is the NDLF based on the NN filter being disabled. The method also includes performing a conversion between a video media file and a bitstream based on the filtered sample that was generated.
    Type: Application
    Filed: October 16, 2023
    Publication date: February 15, 2024
    Inventors: Yue Li, Li Zhang, Kai Zhang, Junru Li, Meng Wang, Siwei Ma, Shiqi Wang
  • Publication number: 20240007628
    Abstract: A mechanism for processing video data implemented by a video coding apparatus is disclosed. The mechanism determines usage of one or more of a separate tree coding and a partitioning beyond a minimum size threshold for a video unit. The mechanism also disables a cross-component coding tool for the video unit based on the determination. A conversion between a visual media data and a bitstream is performed in accordance with the coding tool being disabled.
    Type: Application
    Filed: September 18, 2023
    Publication date: January 4, 2024
    Inventors: Kai Zhang, Li Zhang, Xi Xie, Junru Li, Meng Wang
  • Publication number: 20230262225
    Abstract: Methods, systems and devices for video coding using sample string vectors are described. An example method of video processing includes determining, for a conversion between a video including a current block and a bitstream of the video, an availability of a block vector of one or more non-adjacent neighboring blocks of the current block for a prediction of a block vector of the current block according to a rule, and performing, based on the determining, the conversion, wherein the rule specifies a pre-defined order for checking the one or more non-adjacent neighboring blocks.
    Type: Application
    Filed: April 20, 2023
    Publication date: August 17, 2023
    Inventors: Hongbin Liu, Kai Zhang, Li Zhang, Yue Wang, Junru Li, Siwei Ma
  • Publication number: 20230262226
    Abstract: Methods, systems and devices for sample string processing in intra coding are described. An example method of video processing includes determining, for a conversion between a video comprising a current block and a bitstream of the video, whether a first sample string of the current block forms a rectangle, and performing, based on the determining, the conversion, wherein the determining is based on a position and a length of the first sample string.
    Type: Application
    Filed: April 21, 2023
    Publication date: August 17, 2023
    Inventors: Hongbin Liu, Kai Zhang, Li Zhang, Yue Wang, Junru Li, Tianliang Fu, Siwei Ma
  • Publication number: 20230107138
    Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of processing video data includes determining, for a conversion between a video block of a video and a bitstream of the video, a gradient of a prediction vector at a sub-block level for the video block according to a rule, wherein the rule specifies to use a same gradient value is assigned for all samples within a sub-block of the video block; and performing the conversion based on the determining.
    Type: Application
    Filed: December 7, 2022
    Publication date: April 6, 2023
    Inventors: Kai Zhang, Yuwen He, Li Zhang, Hongbin Liu, Tianliang Fu, Junru Li, Siwei Ma
  • Publication number: 20220394308
    Abstract: A method implemented by a video coding apparatus includes applying a neural network (NN) filter to an unfiltered sample of a video unit to generate a filtered sample. The NN filter is applied based on a syntax element of the video unit. The method also includes converting between a video media file and a bitstream based on the filtered sample that was generated.
    Type: Application
    Filed: April 13, 2022
    Publication date: December 8, 2022
    Inventors: Yue Li, Li Zhang, Kai Zhang, Junru Li, Meng Wang, Siwei Ma, Shiqi Wang
  • Publication number: 20220312020
    Abstract: Devices, systems and methods for digital video coding, which includes Prediction from Multiple Cross-components (PMC) methods, are described. An exemplary method for video processing includes making a first determination that a cross-component prediction (CCP) mode is disabled for a conversion between a video block of a video and a bitstream representation of the video and making a second determination, based on the first determination, regarding whether a first syntax element indicating usage of an enhanced Two-Step Cross-component Prediction Mode (TSCPM) coding tool or an enhanced cross-component linear model (CCLM) coding tool is included in the bitstream representation.
    Type: Application
    Filed: June 8, 2022
    Publication date: September 29, 2022
    Inventors: Junru LI, Meng WANG, Li ZHANG, Kai ZHANG