Patents by Inventor Hongbin Liu

Hongbin Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12015784
    Abstract: A method for video processing is provided. The method includes determining, for a conversion between a current video block of a video that is a chroma block and a coded representation of the video, a final prediction P(x, y) of a chroma sample at a position (x, y) in the current video block as a combination of prediction results of multiple cross-component linear models (MCCLMs), wherein the MCCLMs are selected based on the position (x, y) of the chroma sample; and performing the conversion based on the final prediction.
    Type: Grant
    Filed: June 30, 2023
    Date of Patent: June 18, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 12015774
    Abstract: An example method of video processing includes partitioning, for a conversion between a current video block of a picture of a video and a bitstream of the video, the picture into one or more slices according to a requirement of bitstream conformance. The requirement of bitstream conformance specifies that a union of the one or more slices covers the whole picture, and a first syntax element is included in the bitstream to indicate whether the one or more slices have a rectangular shape. The method also includes performing the conversion at least based on the partitioning.
    Type: Grant
    Filed: November 25, 2022
    Date of Patent: June 18, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Zhipin Deng, Hongbin Liu, Li Zhang, Jizheng Xu
  • Patent number: 12015795
    Abstract: Devices, systems and methods related to digital video coding, and specifically, to signaling of slice types in video picture headers are described. One example method of video processing includes performing a conversion between a video including one or more video pictures including one or more slices and a bitstream of the video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies that for a video picture of the one or more video pictures having all slices coded as I slices, P slice and B slice related syntax elements are omitted from a picture header for the video picture.
    Type: Grant
    Filed: June 24, 2022
    Date of Patent: June 18, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Zhipin Deng, Jizheng Xu, Ye-kui Wang
  • Patent number: 12015768
    Abstract: A method of video processing includes determining, for a conversion between a current block of a video and a bitstream of the video, that the current block is split into multiple sub-blocks, wherein each of the multiple sub-blocks is coded in the bitstream using a corresponding coding technique according to a pattern, and performing the conversion based on the determining.
    Type: Grant
    Filed: December 2, 2021
    Date of Patent: June 18, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 12010317
    Abstract: A method of video processing includes performing a conversion between a video including a video region and a bitstream of the video according to a rule. The rule specifies a relationship between enablement of a palette mode and a coding type of the video region. The video region may represent a coding block of the video.
    Type: Grant
    Filed: October 10, 2022
    Date of Patent: June 11, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang
  • Patent number: 12010321
    Abstract: Disclosed and systems, methods and devices for video processing. An exemplary method for video processing includes: determining for a current video block, an indication which indicates that an affine merge with motion vector difference (MMVD) mode is applied to the current video block; performing a conversion between the current video block and a bitstream representation of a current video block based on the indication, the indication being activated based on the usage of at least one merge list for the current video block.
    Type: Grant
    Filed: July 12, 2021
    Date of Patent: June 11, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 12010333
    Abstract: A method for visual media processing, including performing a conversion between a current chroma video block of visual media data and a bitstream representation of the current chroma video block. During the conversion, a chroma residual of the current chroma video block is scaled based on a scaling coefficient. The scaling coefficient is derived at least based on luma samples located in predefined positions.
    Type: Grant
    Filed: December 19, 2022
    Date of Patent: June 11, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu
  • Publication number: 20240187639
    Abstract: A method of video processing is provided to include maintaining one or more tables, wherein each table includes one or more motion candidates and each motion candidate is associated with corresponding motion information; performing a conversion between a current block and a bitstream representation of a video including the current block by using motion information in a table; and updating, after performing of the conversion, one or more tables based on M sets of additional motion information associated with the current block, M being an integer.
    Type: Application
    Filed: December 5, 2023
    Publication date: June 6, 2024
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Publication number: 20240183727
    Abstract: Disclosed is a tactile sensing device, including a light source, a plurality of optical waveguides, photoelectric sensing components, and a contact point. The light source is disposed at an input end of each optical waveguide, and the photoelectric sensing component is disposed at an output end of each optical waveguide. The plurality of optical waveguides surround the contact point, and the contact point is in contact with each optical waveguide. When there is a contact force at the contact point, the plurality of optical waveguides are deformed, and deformations of the optical waveguides cause losses of optical signals transmitted in the optical waveguides. The photoelectric sensing component obtains an optical signal transmitted by each optical waveguide, and may detect a value and a direction of the contact force based on a variation of the optical signal transmitted by each optical waveguide.
    Type: Application
    Filed: February 9, 2024
    Publication date: June 6, 2024
    Inventors: Stephen WANG, Hongbin LIU, Jian HU, Danqian CAO, Gang NI, Tao HUANG
  • Publication number: 20240187636
    Abstract: Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: constructing, during a conversion between a target block of a video and a bitstream of the video, a list of motion candidates for motion information for the target block; determining a reordering scheme based at least in part on coding information, the reordering scheme indicating whether and/or how at least one motion candidate in the list of motion candidates is to be reordered; generating a target list of motion candidates from the list of motion candidates according to the reordering scheme; and deriving the motion information for the target block from the target list of motion candidates. Compared with the conventional solution, the proposed method can advantageously improve the coding effectiveness and coding efficiency.
    Type: Application
    Filed: April 8, 2022
    Publication date: June 6, 2024
    Applicants: Beijing Bytedance Network Technology Co., Ltd., Bytedance Inc.
    Inventors: Na ZHANG, Kai ZHANG, Li ZHANG, Hongbin LIU, Zhipin DENG, Yang WANG
  • Publication number: 20240187567
    Abstract: Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a current block of a video and a bitstream, reference samples of a sub-template of the current block based on a first set of reference samples of the sub-template in a first reference list and a second set of reference samples of the sub-template in a second reference list; and determining a target motion candidate list based on the reference samples of the sub-template. Compared with the conventional solution, the proposed method can advantageously improve the coding efficiency.
    Type: Application
    Filed: April 9, 2022
    Publication date: June 6, 2024
    Inventors: Na ZHANG, Kai ZHANG, Li ZHANG, Hongbin LIU, Zhipin DENG, Yang WANG
  • Patent number: 12003745
    Abstract: A method of visual media processing includes determining a size of a buffer to store reference samples for prediction in an intra block copy mode; and performing a conversion between a current video block of visual media data and a bitstream of the current video block, using the reference samples stored in the buffer, wherein the conversion is performed in the intra block copy mode which is based on motion information related to a reconstructed block located in same video region with the current video block without referring to a reference picture.
    Type: Grant
    Filed: July 27, 2021
    Date of Patent: June 4, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 12003712
    Abstract: A method of video processing includes determining, for a conversion between a picture of a video that includes one or more blocks and a bitstream representation of the video, whether a virtual boundary is enabled for a block within the picture for a filtering process based on a rule related to a relationship between a bottom boundary of the block and the picture. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: December 10, 2021
    Date of Patent: June 4, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 12003698
    Abstract: Devices, systems and methods for digital video coding, which include sub-block based inter prediction methods, are described. An exemplary method for video processing includes determining, for a conversion between a current block of video and a bitstream representation of the video, a maximum number of candidates in a sub-block based merge candidate list and/or whether to add sub-block based temporal motion vector prediction (SbTMVP) candidates to the sub-block based merge candidate list based on whether temporal motion vector prediction (TMVP) is enabled for use during the conversion or whether a current picture referencing (CPR) coding mode is used for the conversion, and performing, based on the determining, the conversion.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: June 4, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 12003715
    Abstract: In an exemplary aspect, a method for visual media processing includes identifying a boundary at a vertical edge and/or a horizontal edge of two video blocks; calculating a boundary strength of a filter based on at least one of the two video blocks crossing a vertical edge or a horizontal edge is coded using a combined intra-inter prediction (CIIP) mode; deciding whether to turn on or off the filter; selecting a strength of the filter in case the filter is turned on; and performing, based on the selecting, a deblocking filter (DB) process to the video blocks.
    Type: Grant
    Filed: September 28, 2022
    Date of Patent: June 4, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Weijia Zhu, Kai Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 12003714
    Abstract: A method of video processing is described. The method includes determining, for subblocks of a current video block of a video, subblock boundaries to which a deblocking filter is to be applied according to a rule; and performing a conversion between the video and a coded representation of the video using the deblocking filter, wherein the rule specifies that a deblocking filter length is determined without checking a relationship between i) a sum of a position of a subblock of the current video block and a predefined value and ii) a width or a height of the current video block.
    Type: Grant
    Filed: August 8, 2022
    Date of Patent: June 4, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Kai Zhang, Hongbin Liu
  • Patent number: 12003711
    Abstract: In an exemplary aspect, a method for visual media processing includes identifying a boundary at a vertical edge and/or a horizontal edge of two video blocks; calculating a boundary strength of a filter based on at least one of the two video blocks crossing a vertical edge or a horizontal edge is coded using a combined intra-inter prediction (CIIP) mode; deciding whether to turn on or off the filter; selecting a strength of the filter in case the filter is turned on; and performing, based on the selecting, a deblocking filter (DB) process to the video blocks.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: June 4, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Weijia Zhu, Kai Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 12003766
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes encoding a current video block of a video using a matrix intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation; and adding, to a coded representation of the current video block, a syntax element indicative of applicability of the MIP mode to the current video block using arithmetic coding in which a context for the syntax element is derived based on a rule.
    Type: Grant
    Filed: September 12, 2022
    Date of Patent: June 4, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 12003758
    Abstract: A method for video processing includes performing a conversion between a current video block of a video region of a video and a coded representation of the video. The conversion uses a coding mode in which the current video block is constructed based on a first domain and a second domain and/or chroma residue is scaled in a luma-dependent manner. A parameter set in the coded representation comprises parameter information for the coding mode.
    Type: Grant
    Filed: September 20, 2022
    Date of Patent: June 4, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11997303
    Abstract: Devices, systems and methods for sample refinement and filtering method for video coding are described. In an exemplary aspect, a method for video processing includes modifying for a conversion between a block of a video and a bitstream representation of the video, a refinement value for a prediction sample in the block by applying a clipping operation to refinement value. The refinement value is derived based on a gradient value of an optical flow coding process. An output of the clipping operation is within a range. The method also includes refining the prediction sample based on the refinement value and performing the conversion based on the refined prediction sample.
    Type: Grant
    Filed: June 13, 2022
    Date of Patent: May 28, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang