Patents by Inventor Kai Zhang

Kai Zhang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11418798
    Abstract: Devices, systems and methods for applying intra-block copy (IBC) in video coding are described. In general, methods for integrating IBC with existing motion compensation algorithms for video encoding and decoding are described. In a representative aspect, a method for video encoding using IBC includes determining whether a current block of the current picture is to be encoded using a motion compensation algorithm, and encoding, based on the determining, the current block by selectively applying an intra-block copy to the current block. In a representative aspect, another method for video encoding using IBC includes determining whether a current block of the current picture is to be encoded using an intra-block copy, and encoding, based on the determining, the current block by selectively applying a motion compensation algorithm to the current block.
    Type: Grant
    Filed: March 15, 2021
    Date of Patent: August 16, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11418791
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, where the performing the conversion includes deriving, according to a rule, boundary samples by applying a left bit shift operation or a right bit shift operation on a sum of at least one reference boundary sample, and where the rule determines whether to apply the left bit shift or the right bit shift operation.
    Type: Grant
    Filed: June 9, 2021
    Date of Patent: August 16, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11418780
    Abstract: Devices, systems and methods related to management of syntax flags with respect chroma formats in video processing are described. In one representative aspect, a video decoding method includes determining, for a conversion between a video and a coded representation of the video, whether a syntax element associated with an adaptive loop filtering (ALF) operation for a chroma component of the video is included in the coded representation based on a condition. The method also includes performing the conversion according to the determining.
    Type: Grant
    Filed: October 6, 2021
    Date of Patent: August 16, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Na Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11418784
    Abstract: Methods, systems, and devices for coding or decoding video wherein the picture partition mode is based on block size are described. An example method for video processing includes using a dimension of a virtual pipeline data unit (VPDU) used for a conversion between a video comprising one or more video regions comprising one or more video blocks and a bitstream representation of the video to perform a determination of whether a ternary-tree (TT) or a binary tree (BT) partitioning of a video block of the one or more video blocks is enabled, and performing, based on the determination, the conversion, wherein the dimension is equal to VSize in luma samples, wherein dimensions of the video block are CtbSizeY in luma samples, wherein VSize=min(M, CtbSizeY), and wherein M is a positive integer.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: August 16, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Kai Zhang, Hongbin Liu
  • Publication number: 20220256146
    Abstract: An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.
    Type: Application
    Filed: April 18, 2022
    Publication date: August 11, 2022
    Inventors: Kai ZHANG, Zhipin DENG, Hongbin LIU, Li ZHANG, Jizheng XU
  • Publication number: 20220254582
    Abstract: A keyboard device includes a substrate, a keycap on the substrate, a first link member connected between the substrate and the keycap and is adjacent to the first side portion of the keycap, and a second link member connected between the substrate and the keycap and is adjacent to the second side portion of the keycap. The two first short swing arms of the first link member are respectively connected to two ends of the first pivot arm of the first link member. A length of each first short swing arm is less than half of a length of the first pivot arm. The two second short swing arms of the second link member are respectively connected to two ends of the second pivot arm of the second link member. A length of each second short swing arm is less than half of a length of the second pivot arm.
    Type: Application
    Filed: December 13, 2021
    Publication date: August 11, 2022
    Inventors: Mitsuo Horiuchi, He-Kai Zhang, Chih-Hao Chen
  • Publication number: 20220256197
    Abstract: An example method of video processing includes performing a conversion between a video including a video picture including one or more video units and a bitstream representation of the video. The bitstream representation conforms to a format rule that specifies that a first syntax element is included in a header of the video picture indicating allowed prediction types of at least some of the one or more video units in the video picture.
    Type: Application
    Filed: April 12, 2022
    Publication date: August 11, 2022
    Inventors: Kai ZHANG, Li ZHANG, Hongbin LIU, Zhipin DENG, Jizheng XU, Yue WANG
  • Publication number: 20220256195
    Abstract: An example method of video processing includes performing a conversion between a picture of a video that comprises one or more sub-pictures and a bitstream representation of the video. The bitstream representation conforms to a format rule that specifies that information about a sub-picture is included in the bitstream representation based on at least one of: (1) one or more corner positions of the sub-picture, or (2) a dimension of the sub-picture. The format rule further specifies that the information about the sub-picture is positioned after information about a coding tree block in the bitstream representation.
    Type: Application
    Filed: April 1, 2022
    Publication date: August 11, 2022
    Inventors: Kai ZHANG, Zhipin DENG, Hongbin LIU, Li ZHANG, Jizheng XU
  • Publication number: 20220256148
    Abstract: An example method of video processing includes performing a conversion between a picture of a video and a bitstream representation of the video. The picture includes one or more sub-pictures, and the bitstream representation conforms to a format rule that specifies that a length of a syntax element is equal to Ceil(Log 2(SS)) bits. SS is greater than 0, and the syntax element indicating a horizontal or a vertical position of a top-left corner of a coding tree unit of a sub-picture of the picture.
    Type: Application
    Filed: April 18, 2022
    Publication date: August 11, 2022
    Inventors: Kai ZHANG, Zhipin DENG, Hongbin LIU, Li ZHANG, Jizheng XU
  • Publication number: 20220250654
    Abstract: This document describes techniques, apparatuses, and systems that can implement auction-based cooperative perception for autonomous and semi-autonomous driving systems. The described techniques, apparatuses, and systems cooperatively use perception systems of an autonomous or semi-autonomous vehicle (AV) in a fleet of connected AVs to provide perception data to the entire fleet. An AV of the fleet is selected to act as an auction system (e.g., an auctioneer) and sends an announcement offering perception tasks to the fleet for bidding. The AVs of the fleet determine whether they have the communication and computational capabilities to perform the tasks and, if so, submit bids to perform one or more tasks. The auctioneer awards the tasks, and the bid-winning AV(s) perform the tasks and update the fleet. In this way, the described techniques, apparatuses, and systems can provide perception services with increased coverage and quality, which can make autonomous and semi-autonomous driving systems safer.
    Type: Application
    Filed: May 20, 2021
    Publication date: August 11, 2022
    Inventor: Kai Zhang
  • Publication number: 20220256166
    Abstract: A method of video processing is described. The method includes performing a conversion between a current video block of a video and a bitstream representation of the video, wherein, during the conversion, a prediction of the current video block is determined as a weighted sum of two or more predictions of the current video block, and a motion vector storing process for the current video block is determined according to a rule, wherein the current video block uses a partitioning prediction mode that is a first mode which is based on multiple first partitioning schemes or a second mode which is based on multiple second partitioning schemes, and wherein the rule specifies that a process used for determining which motion vector and how many motion vectors are stored is same for the first mode or the second mode.
    Type: Application
    Filed: April 11, 2022
    Publication date: August 11, 2022
    Inventors: Zhipin DENG, Li ZHANG, Hongbin LIU, Kai ZHANG, Jizheng XU, Yue WANG
  • Publication number: 20220254765
    Abstract: Embodiments of this application disclose a power structure, a preparation method, and a device, to provide a power structure with a high integration degree, to meet a requirement of the high-frequency and high-power field. The embodiments of this application provide a power structure, including a first substrate, a second substrate, a driver chip, a power chip, and a conductive part. A first surface of the first substrate and a second surface of the second substrate are disposed opposite to each other; a first end of the conductive part is connected to the first surface, and a second end of the conductive part is connected to the second surface; the driver chip is disposed on the first substrate; and the power chip is disposed on the second substrate.
    Type: Application
    Filed: February 8, 2022
    Publication date: August 11, 2022
    Inventors: Kai ZHANG, Jiahui XU, Baiyou CHEN, Weiwei YAO
  • Patent number: 11412238
    Abstract: A method for video processing is provided to include: performing a conversion between a current video block of a video and a coded representation of current video block, wherein the conversion uses a coding mode in which the current video block is constructed based on a first domain and a second domain and/or chroma residue is scaled in a luma-dependent manner, and wherein information used for the coding mode is signaled in a parameter set that is different from a sequence parameter set (SPS), a video parameter set (VPS), a picture parameter set (PPS), or an adaptation parameter set (APS) used for carrying adaptive loop filtering (ALF) parameters.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: August 9, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11412249
    Abstract: Devices, systems and methods for digital video coding, which includes motion prediction based on updated motion vectors generated using two-step inter-prediction, are described. Methods for clipping of updated MV or derived MV are described. An exemplary method for video coding includes: determining original motion information for a current block; updating original motion vectors of the original motion information for the current block based on a refining method; clipping the updated motion vectors to be within a range; and performing a conversion between the current block and a bitstream representation of a video including the current block, based on the clipped updated motion vectors.
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: August 9, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Yue Wang
  • Patent number: 11412268
    Abstract: Devices, systems and methods related to management of syntax flags with respect chroma formats in video processing are described. In one representative aspect, a video decoding method includes determining, based on a chroma format of a video comprising a region, whether one or more syntax flags applicable to the region of the video are absent in a syntax structure of a coded representation of the video. The one or more syntax flags are indicative of usage of a luma-dependent chroma residue scaling coding step for representing the region in the coded representation. The luma-dependent chroma residue scaling coding step comprises a scaling process in which a scaling coefficient is derived based on reconstructed luma samples and the scaling process is applied to a chroma residue. The method also includes generating one or more decoded video blocks of the video region by parsing the coded representation according to the determining.
    Type: Grant
    Filed: August 18, 2021
    Date of Patent: August 9, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11412214
    Abstract: A method for visual media processing, including: computing, during a conversion between a current video block of visual media data and a bitstream representation of the current video block, a cross-component linear model (CCLM) and/or a chroma residual scaling (CRS) factor for the current video block based, at least in part, on neighboring samples of a corresponding luma block which covers a top-left sample of a collocated luma block associated with the current video block, wherein one or more characteristics of the current video block are used for identifying the corresponding luma block.
    Type: Grant
    Filed: August 19, 2021
    Date of Patent: August 9, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang, Jizheng Xu
  • Patent number: 11412232
    Abstract: Devices, systems and methods for applying intra-block copy (IBC) in video coding are described. In general, methods for integrating IBC with existing motion compensation algorithms for video encoding and decoding are described. In a representative aspect, a method for video encoding using IBC includes determining whether a current block of the current picture is to be encoded using a motion compensation algorithm, and encoding, based on the determining, the current block by selectively applying an intra-block copy to the current block. In a representative aspect, another method for video encoding using IBC includes determining whether a current block of the current picture is to be encoded using an intra-block copy, and encoding, based on the determining, the current block by selectively applying a motion compensation algorithm to the current block.
    Type: Grant
    Filed: September 3, 2020
    Date of Patent: August 9, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11412213
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: July 23, 2021
    Date of Patent: August 9, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11412212
    Abstract: Techniques for video encoding and decoding are described. An example method of video processing is disclosed. The method includes classifying motion candidates in a candidate list into a plurality of categories of motion candidates, each category being assigned a corresponding pruning rule; performing pruning or skipping the pruning of the motion candidates in the candidate list based on the corresponding pruning rule, the pruning being applied to determine whether to insert motion candidates from the candidate list into a final candidate list for a current block; and performing a video processing on the current block based on the final candidate list.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: August 9, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11412227
    Abstract: A method of processing a video bitstream includes determining a motion precision set based on coding information of a current block. A conversion between a video block and a coded representation of the video block is performed based on the motion precision set. The conversion corresponds to a reconstruction of the current block. In some example aspects, a motion vector difference (MVD) precision of a current block from a motion precision set is determined based on a selected motion precision set and a MVD precision index. A conversion between a video block and a coded representation of the video block using an MVD is performed based on the MVD precision. The MVD represents a difference between a predicted motion vector and an actual motion vector used during motion compensation processing.
    Type: Grant
    Filed: July 28, 2020
    Date of Patent: August 9, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Yue Wang