Patents by Inventor Kai Zhang

Kai Zhang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • CONDITIONAL SIGNALING OF VIDEO CODING SYNTAX ELEMENTS
    Publication number: 20230114860
    Abstract: Systems, methods and apparatus for video processing are described. The video processing may include video encoding, video decoding, or video transcoding. One example method of video processing includes performing a conversion between a video including one or more pictures and a bitstream of the video according to a format rule. The format rule specifies that a first syntax element that indicates whether motion vector difference for a particular reference picture list (RPL) is indicated is conditionally included in the bitstream based on (i) whether a second syntax element indicating whether an RPL information is included in a picture header and/or (ii) a number of reference pictures in the particular RPL in case that the RPL information is present in the picture header.
    Type: Application
    Filed: October 26, 2022
    Publication date: April 13, 2023
    Inventors: Li Zhang, Ye-kui Wang, Kai Zhang
  • SIGNALLING OF GENERAL CONSTRAINS FLAG
    Publication number: 20230115541
    Abstract: Methods, systems, apparatus for video processing are described. The processing may include encoding, decoding or transcoding. One example video processing method includes performing a conversion between a video and a bitstream of the video according to a rule, and wherein the rule specifies that a syntax element is included in a profile, tier, level information syntax structure to indicate whether one or more general constraint information syntax elements are included in a general constraint information syntax structure and/or whether the general constraint information syntax structure is included in the profile, tier, level information syntax structure.
    Type: Application
    Filed: November 22, 2022
    Publication date: April 13, 2023
    Inventors: Zhipin Deng, Ye-kui Wang, Li Zhang, Kai Zhang
  • Interactions between in-loop reshaping and palette mode
    Patent number: 11627333
    Abstract: A method for video processing is provided to include: making a determination that a coding mode is enabled for a conversion between a current video block of a video and a coded representation of the video; and performing the conversion using a palette prediction mode wherein at least a palette of representative sample values is used for the current video block, and wherein, in the coding mode, the current video block is constructed based on samples in a first domain and a second domain and/or chroma residue is scaled in a luma-dependent manner.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: April 11, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Syntax signaling in sub-block merge mode
    Patent number: 11627313
    Abstract: A method of visual media processing includes determining whether to use an affine adaptive motion vector resolution (AMVR) technique on visual media data relying on a control information related to the affine AMVR technique in a bitstream representation of the visual media data, wherein the control information is included or excluded from the bitstream representation based on a rule; and performing a conversion between the visual media data and the bitstream representation of the visual media data.
    Type: Grant
    Filed: November 8, 2021
    Date of Patent: April 11, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • TMVP derivation
    Patent number: 11627308
    Abstract: A video processing method includes deriving multiple temporal motion vector prediction (TMVP) candidates for a video block in a current picture based on multiple blocks associated with a second block in one or more pictures that are temporally co-located with the current picture, wherein the current picture is excluded from the one or more pictures, and the second block is temporally collocated with the video block, wherein the second block has a same size as the video block, and wherein a relative position of the second block to a top-left corner of a second picture of the one or more pictures is same as that of the video block to a top-left corner of the current picture; adding the multiple TMVP candidates to a motion candidate list associated with the video block; and performing a conversion between the video block and a bitstream.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: April 11, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • SIMPLIFICATION OF COMBINED INTER-INTRA PREDICTION
    Publication number: 20230106340
    Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video coded using a combined inter and intra prediction (CIIP) coding technique and a bitstream representation of the video, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.
    Type: Application
    Filed: November 29, 2022
    Publication date: April 6, 2023
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • NONLINEAR ADAPTIVE LOOP FILTERING IN VIDEO PROCESSING
    Publication number: 20230107861
    Abstract: A method of processing video data includes determining that a non-linear adaptive loop filtering operation is applied for a current video region of a video; deriving a first filtering index for the current video region and deriving a first filtering parameter based on the first filtering index; deriving a first clipping parameter from a clipping parameter set based on the first filtering index; performing a clipping operation that is part of the non-linear adaptive loop filtering operation based on the first clipping parameter, where the first clipping parameter is used to clip differences between reference sample values of a current sample value of the current video region and the current sample value before applying the first filtering parameter; and performing a conversion between the current video region and a bitstream of the video based on the non-linear adaptive loop filtering operation.
    Type: Application
    Filed: December 6, 2022
    Publication date: April 6, 2023
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Subpicture Sub-Bitstream Extraction Improvements
    Publication number: 20230106804
    Abstract: Embodiments for video processing, including video coding, video decoding and video transcoding are described. One example method includes performing a conversion between a video having one or more layers having one or more video pictures having one or more subpictures and a bitstream of the video according to a rule, wherein the rule defines network abstraction layer (NAL) units to be extracted from a bitstream during a sub-bitstream extraction process to output a sub-bitstream, wherein the rule further specifies that one or more inputs to the sub-bitstream extraction process include a target output layer set (OLS) index (targetOlsIdx) that identifies an OLS index of a target OLS and is equal to an index to a list of OLSs specified by a video parameter set, and wherein the one or more inputs satisfy a set of conditions.
    Type: Application
    Filed: November 22, 2022
    Publication date: April 6, 2023
    Inventors: Ye-kui Wang, Zhipin Deng, Kai Zhang, Li Zhang
  • SUB-BLOCK BASED USE OF TRANSFORM SKIP MODE
    Publication number: 20230108816
    Abstract: Devices, systems and methods for lossless coding for visual media coding are described. An exemplary method for video processing includes determining, at a sub-block level of a current video block comprising multiple sub-blocks, whether a coding mode is enabled for representing a corresponding sub-block in a bitstream representation, where, for a given sub-block with the coding mode enabled, the given sub-block is represented in the coded representation without applying a forward transform or the given sub-block is reconstructed from the coded representation without applying an inverse transform, and performing, based on the determining, a conversion between the current video block of a video and the bitstream representation of the video.
    Type: Application
    Filed: December 6, 2022
    Publication date: April 6, 2023
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Na Zhang, Yue Wang
  • CLASSIFICATION IN ADAPTIVE LOOP FILTERING
    Publication number: 20230107774
    Abstract: A method of video processing includes determining, for a conversion of a block of a video picture in a video and a bitstream representation of the video, gradients of a subset of samples in a region for a classification operation in a filtering process. The region has a dimension of M×N and the block has a dimension of K×L, M, N, K, L being positive integers. The block is located within the region. The method also includes performing the conversion based on the determining.
    Type: Application
    Filed: January 14, 2022
    Publication date: April 6, 2023
    Inventors: Li ZHANG, Kai ZHANG, Hongbin LIU, Yue WANG
  • AFFINE PREDICTION IMPROVEMENTS FOR VIDEO CODING
    Publication number: 20230107138
    Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of processing video data includes determining, for a conversion between a video block of a video and a bitstream of the video, a gradient of a prediction vector at a sub-block level for the video block according to a rule, wherein the rule specifies to use a same gradient value is assigned for all samples within a sub-block of the video block; and performing the conversion based on the determining.
    Type: Application
    Filed: December 7, 2022
    Publication date: April 6, 2023
    Inventors: Kai Zhang, Yuwen He, Li Zhang, Hongbin Liu, Tianliang Fu, Junru Li, Siwei Ma
  • Transform block size restriction in video coding
    Patent number: 11622109
    Abstract: A visual media processing method includes performing a conversion between a current video block of a visual media data and a bitstream representation of the current video block, wherein the bitstream representation is configured according to a format rule that specifies that a syntax element is selectively included or excluded in the bitstream representation indicative of a maximum number of merge candidates for a coding tool, thereby indicating whether the coding tool is enabled or disabled for the conversion, wherein the maximum number of merge candidates for the coding tool is zero or a positive number.
    Type: Grant
    Filed: January 11, 2022
    Date of Patent: April 4, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Using chroma quantization parameter in video coding
    Patent number: 11622120
    Abstract: An example method of video processing includes performing a conversion between a video comprising one or more coding units and a bitstream representation of the video. The bitstream representation conforms to a format rule that specifies that chroma quantization parameters are included in the bitstream representation at a coding unit level or a transform unit level according to the format rule.
    Type: Grant
    Filed: April 14, 2022
    Date of Patent: April 4, 2023
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Kai Zhang
  • Luma based secondary transform matrix selection for video processing
    Patent number: 11622131
    Abstract: A video processing method is provided to include: performing a conversion between a current video block of a video and a coded representation of the video, wherein the coded representation conforms to a format rule that specifies a last non-zero coefficient in a residual of the current video block and controls whether or how side information about a secondary transform tool is included in the coded representation, and wherein the secondary transform tool includes applying, during encoding, a forward secondary transform to an output of a forward primary transform applied to a residual of a video block prior to quantization, or applying, during decoding, an inverse secondary transform to an output of dequantization of the video block before applying an inverse primary transform.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: April 4, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Signaling of cross-component adaptive loop filter
    Patent number: 11622115
    Abstract: A method of video processing includes performing a conversion between a portion of a chroma component of a video and a bitstream representation of the video according to a rule, wherein the rule specifies that whether a cross-component adaptive loop filtering (CC-ALF) tool is available for the conversion of the portion of the video is dependent on whether an availability or a use of an adaptive loop filtering (ALF) tool is indicated for a corresponding portion of a luma component.
    Type: Grant
    Filed: April 29, 2022
    Date of Patent: April 4, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Weijia Zhu, Kai Zhang, Hongbin Liu
  • TREATMENT OF AUTOIMMUNE DISEASE
    Publication number: 20230099852
    Abstract: Provided herein are compositions and methods for the treatment of autoimmune and alloimmune diseases and conditions, including rheumatoid arthritis, multiple sclerosis, inflammatory bowel disease (IBD) (e.g., Crohn's disease, ulcerative colitis), optic neuritis, Neuromyelitis Optica, Sjögren's syndrome, psoriasis, systemic scleroderma, Ankylosing Spondylitis, autoimmune hepatitis, Graft vs host disease (GvHD), and organ transplant rejection. Said compositions useful for treating autoimmune diseases comprise pyrrolo-pyrazole PKC inhibitors.
    Type: Application
    Filed: October 28, 2022
    Publication date: March 30, 2023
    Inventors: Michael NIESMAN, Kai ZHANG
  • INTERACTIONS AMONG MULTIPLE INTRA CODING METHODS
    Publication number: 20230096273
    Abstract: A video processing method includes determining, for a conversion between a block of a video and a bitstream representation of the video, a manner in which information for a Matrix-based Intra Prediction (MIP) coding technique is coded in the bitstream representation. A prediction block of the block is determined using the MIP coding technique based on performing a matrix vector multiplication operation on previously coded samples of the video. The method also includes performing the conversion based on the determining.
    Type: Application
    Filed: August 25, 2022
    Publication date: March 30, 2023
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Signaling Of Chroma Residual Scaling
    Publication number: 20230096945
    Abstract: A method for visual media processing includes performing a conversion between a current video unit of a visual media data and a bitstream representation of the current video unit. The bitstream representation is configured according to a format rule. The format rule specifies a level of a video segment at which one or more syntax elements indicative of a scaling factor by which a chroma residual is scaled for coding the current video unit is selectively included in the bitstream representation.
    Type: Application
    Filed: October 31, 2022
    Publication date: March 30, 2023
    Inventors: Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang, Jizheng Xu
  • Handling Of Coded Video In Sub-Bitstream Extraction Process
    Publication number: 20230099966
    Abstract: Embodiments for video processing, including video coding, video decoding and video transcoding are described. One example method includes performing a conversion between a video having one or more video pictures in a video layer and a bitstream of the video according to a rule, wherein the rule specifies that, in a process of sub-bitstream extraction, removal of (i) a video coding layer (VCL) network abstraction layer (NAL) unit, (ii) filler data NAL units associated with the VCL NAL unit, and (iii) filler payload supplemental enhancement information (SEI) messages associated with the VCL NAL unit is performed regardless of an availability of an external means used to replace a parameter set that is removed during the sub-bitstream extraction.
    Type: Application
    Filed: November 22, 2022
    Publication date: March 30, 2023
    Inventors: Ye-kui Wang, Zhipin Deng, Kai Zhang, Li Zhang
  • Minimum Allowed Quantization For Transform Skip Blocks In Video Coding
    Publication number: 20230099893
    Abstract: A method of video processing includes performing a conversion between a video including a video region and a bitstream of the video according to a rule. The rule specifies a relationship between enablement of a palette mode and a coding type of the video region. The video region may represent a coding block of the video.
    Type: Application
    Filed: October 10, 2022
    Publication date: March 30, 2023
    Inventors: Jizheng Xu, Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang