Patents by Inventor Zhipin Liu

Zhipin Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240146927
    Abstract: Techniques for video processing, including video coding, video decoding and video transcoding are described. One example method includes performing a conversion between a video picture that includes one or more tiles and one or more rectangular slices and a bitstream of the video according to a rule. The rule specifies that, for iteratively determining information about the one or more rectangular slices, a variable indicating a tile index is updated only for slices having indices that are smaller than a value equal to a number of slices in the video picture minus 1.
    Type: Application
    Filed: November 27, 2023
    Publication date: May 2, 2024
    Inventors: Kai ZHANG, Li Zhang, Ye-Kui Wang, Zhipin Deng, Kui Fan, Jizheng Xu, Hongbin Liu
  • Patent number: 11968384
    Abstract: Devices, systems and methods related to digital video coding, and specifically, to signaling of slice types in video picture headers are described. One example method of video processing includes performing a conversion between a video including one or more video pictures including one or more slices and a bitstream of the video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies that for a video picture of the one or more video pictures having all slices coded as I slices, P slice and B slice related syntax elements are omitted from a picture header for the video picture.
    Type: Grant
    Filed: June 24, 2022
    Date of Patent: April 23, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Zhipin Deng, Jizheng Xu, Ye-kui Wang
  • Publication number: 20240129466
    Abstract: Methods, devices, and systems related to video processing are disclosed. In one example aspect, a method of video processing includes performing a conversion between a block of a current picture of a video and a coded representation of the video using an intra-subblock partitioning (ISP) mode. A prediction is determined for each sub-partition using an intra-prediction process based on samples in the current picture using the ISP mode. The block is partitioned into multiple sub-partitions including a first sub-partitions having a same top-left corner position as a top-left corner position of the block.
    Type: Application
    Filed: December 5, 2023
    Publication date: April 18, 2024
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Zhipin Deng, Na Zhang, Yue Wang
  • Patent number: 11962814
    Abstract: A method includes performing a conversion between a video including a video picture including one or more tiles and a bitstream of the video. The video picture refers to a picture parameter set, and the picture parameter set conforms to a format rule specifying that the picture parameter set includes a list of column widths for N tile columns, where N is an integer. An (N?1)-th tile column exists in the video picture and the (N?1)-th tile column has a width that is equal to an (N?1)-th entry in a list of explicitly included tile column widths plus one number of coding tree blocks.
    Type: Grant
    Filed: August 22, 2022
    Date of Patent: April 16, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Ye-kui Wang, Zhipin Deng, Kui Fan, Jizheng Xu, Hongbin Liu
  • Patent number: 11962771
    Abstract: An example method of video processing includes performing a conversion between a picture of a video and a bitstream representation of the video. The picture includes one or more sub-pictures, and the bitstream representation conforms to a format rule that specifies that a length of a syntax element is equal to Ceil(Log 2(SS)) bits. SS is greater than 0, and the syntax element indicating a horizontal or a vertical position of a top-left corner of a coding tree unit of a sub-picture of the picture.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: April 16, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • Publication number: 20240121396
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In one aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode, where the conversion includes performing the upsampling operation in which the final prediction block is determined by using a reduced prediction block of the current video block and by using reconstructed neighboring samples of the current video block according to a rule, and where the reduced prediction block is obtained by performing the matrix vector multiplication operation on reduced boundary samples of the current video block.
    Type: Application
    Filed: November 8, 2023
    Publication date: April 11, 2024
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11956432
    Abstract: An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: April 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • Patent number: 11956439
    Abstract: A method for visual media processing includes performing a conversion between a current video unit of a visual media data and a bitstream representation of the current video unit. The bitstream representation is configured according to a format rule. The format rule specifies a level of a video segment at which one or more syntax elements indicative of a scaling factor by which a chroma residual is scaled for coding the current video unit is selectively included in the bitstream representation.
    Type: Grant
    Filed: October 31, 2022
    Date of Patent: April 9, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang, Jizheng Xu
  • Publication number: 20240114133
    Abstract: A method of video processing is provided to include: performing a conversion between a video including one or more video regions including one or more luma blocks and one or more chroma blocks and a coded representation of the video according to a rule; wherein the rule specifies that a chroma block from the one or more chroma blocks having a size M×N is disallowed to be represented in the coded representation using an intra mode or an intra block copy mode, wherein M and N are integers that indicate a width and a height of the chroma block, respectively; wherein the intra mode includes encoding the chroma block based on previously encoded or reconstructed video blocks, and wherein the intra block copy mode includes encoding the chroma block using at least a block vector pointing to a video frame containing a video region.
    Type: Application
    Filed: November 7, 2023
    Publication date: April 4, 2024
    Inventors: Jizheng Xu, Zhipin Deng, Li Zhang, Hongbin Liu
  • Patent number: 11949880
    Abstract: A method of video processing is described. The method includes determining, for a conversion between a current video block of a video and a coded representation of the video, whether a certain partitioning scheme is allowed for the current video block according to a rule that depends on a coding mode type used for representing the current video block in the coded representation and a dimension of the current video block; and performing the conversion based on the determining.
    Type: Grant
    Filed: March 2, 2022
    Date of Patent: April 2, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang
  • Publication number: 20240107016
    Abstract: Methods, systems, and devices for coding or decoding video wherein the picture partition mode is based on block size are described. An example method for video processing includes using a dimension of a virtual pipeline data unit (VPDU) used for a conversion between a video comprising one or more video regions comprising one or more video blocks and a bitstream representation of the video to perform a determination of whether a ternary-tree (TT) or a binary tree (BT) partitioning of a video block of the one or more video blocks is enabled, and performing, based on the determination, the conversion, wherein the dimension is equal to VSize in luma samples, wherein dimensions of the video block are CtbSizeY in luma samples, wherein VSize=min(M, CtbSizeY), and wherein M is a positive integer.
    Type: Application
    Filed: November 27, 2023
    Publication date: March 28, 2024
    Inventors: Zhipin Deng, Li Zhang, Kai Zhang, Hongbin Liu
  • Publication number: 20240107036
    Abstract: A method of video processing is provided that includes performing a conversion between a block of a video and a bitstream of the video. The bitstream conforms to a formatting rule specifying that a size of a merge estimation region (MER) is indicated in the bitstream and the size of the MER is based on a dimension of a video unit. The MER comprises a region used for deriving a motion candidate for the conversion.
    Type: Application
    Filed: November 14, 2023
    Publication date: March 28, 2024
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu, Ye-kui Wang
  • Patent number: 11943444
    Abstract: A method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode, where the conversion includes performing the upsampling operation in which the final prediction block is determined by using a reduced prediction block of the current video block and by using reconstructed neighboring samples of the current video block according to a rule, and where the reduced prediction block is obtained by performing the matrix vector multiplication operation on reduced boundary samples of the current video block.
    Type: Grant
    Filed: August 12, 2022
    Date of Patent: March 26, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11936874
    Abstract: Devices, systems, and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and followed by an upsampling operation, where the upsampling operation is performed, in both a vertical direction and a horizontal direction in a fixed order, on samples obtained from the matrix vector multiplication operation.
    Type: Grant
    Filed: December 1, 2022
    Date of Patent: March 19, 2024
    Assignees: BYTEDANCE INC., BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Publication number: 20240089483
    Abstract: Devices, systems and methods related to digital video coding, and specifically, to signaling of slice types in video picture headers are described. One example method of video processing includes performing a conversion between a video including one or more video pictures including one or more slices and a bitstream of the video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies that for a video picture of the one or more video pictures having all slices coded as I slices, P slice and B slice related syntax elements are omitted from a picture header for the video picture.
    Type: Application
    Filed: November 14, 2023
    Publication date: March 14, 2024
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Zhipin Deng, Jizheng Xu, Ye-kui Wang
  • Patent number: 11930175
    Abstract: Methods, systems, and devices for coding or decoding video wherein the picture partition mode is based on block size are described. An example method for video processing includes using a dimension of a virtual pipeline data unit (VPDU) used for a conversion between a video comprising one or more video regions comprising one or more video blocks and a bitstream representation of the video to perform a determination of whether a ternary-tree (TT) or a binary tree (BT) partitioning of a video block of the one or more video blocks is enabled, and performing, based on the determination, the conversion, wherein the dimension is equal to VSize in luma samples, wherein dimensions of the video block are CtbSizeY in luma samples, wherein VSize=min(M, CtbSizeY), and wherein M is a positive integer.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: March 12, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Kai Zhang, Hongbin Liu
  • Publication number: 20240080441
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block according to a rule, where the rule specifies a relationship between samples of the current video block and matrices or offset values applied in a matrix weighted intra prediction (MIP) mode during the conversion, and where the MIP mode includes determining a prediction block of the current video block by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation.
    Type: Application
    Filed: November 6, 2023
    Publication date: March 7, 2024
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11924472
    Abstract: A method for visual media processing includes processing a bitstream representation for a conversion between a current video block in a video region of a visual media data and the bitstream representation. The bitstream representation is based on a rule that specifies that one or more syntax elements used in a luma-dependent chroma residual scaling step are selectively included in the bitstream representation. The luma-dependent chroma residual scaling step includes scaling chroma samples based on neighboring reconstructed luma samples during the conversion. The one or more syntax elements are usable to derive a chroma residual scaling factor used for the scaling.
    Type: Grant
    Filed: December 9, 2021
    Date of Patent: March 5, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang, Jizheng Xu
  • Patent number: 11924422
    Abstract: Methods, devices, and systems related to video processing are disclosed. In one example aspect, a method of video processing includes performing a conversion between a block of a current picture of a video and a coded representation of the video using an intra-subblock partitioning (ISP) mode. A prediction is determined for each sub-partition using an intra-prediction process based on samples in the current picture using the ISP mode. The block is partitioned into multiple sub-partitions including a first sub-partitions having a same top-left corner position as a top-left corner position of the block.
    Type: Grant
    Filed: February 28, 2022
    Date of Patent: March 5, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Zhipin Deng, Na Zhang, Yue Wang
  • Publication number: 20240073457
    Abstract: Methods, apparatus and systems for processing video are described. One example method includes performing a conversion between a video comprising a video unit and a bitstream of the video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies that a first syntax element indicating whether an in-loop filtering operation is performed across tile boundaries is selectively included in the bitstream responsive to whether or how the video unit is partitioned into tiles.
    Type: Application
    Filed: November 1, 2023
    Publication date: February 29, 2024
    Inventors: Kai Zhang, Li Zhang, Yang Wang, Ye-kui Wang, Zhipin Deng, Jizheng Xu, Hongbin Liu