Patents by Inventor Hsiao-Chiang Chuang

Hsiao-Chiang Chuang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11445224
    Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques, and in particular, sub-block shapes in extended quadtree partitioning, are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block, where a size of the current visual media block is M×N, and the size of the at least one sub-block is based on a minimum value between M and N, or a maximum value between M and N; decoding, based on a bitstream representation, the four sub-blocks; and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: September 13, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
  • Publication number: 20220286672
    Abstract: A method of video processing is described. The method includes performing a conversion between a current block of a video and a bitstream representation of the video, wherein the current block is coded with a dictionary-based coding mode using one or more dictionaries, and wherein the conversion is based on the one or more dictionaries.
    Type: Application
    Filed: May 26, 2022
    Publication date: September 8, 2022
    Inventors: Weijia ZHU, Jizheng XU, Li ZHANG, Hsiao Chiang CHUANG, Kui FAN
  • Patent number: 11438635
    Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into more than four sub-blocks; decoding, based on a bitstream representation, the more than four sub-blocks; and decoding, based on the more than four sub-blocks and the partitioning process, the current visual media block. Another exemplary method for visual media encoding includes receiving input data associated with a current visual media block; applying, to the input data, a partitioning process that splits the current visual media block into more than four sub-blocks; encoding, based on the partitioning process, the more than four sub-blocks; and generating, based on the encoding, a bitstream representation of the current visual media block.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: September 6, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
  • Patent number: 11438597
    Abstract: Video coding and decoding methods are described. An example method includes determining, based on an applicability rule, that a differential coding mode is applicable to a conversion between a chroma video block of a video and a bitstream representation of the chroma video block, and performing, based on the determining, the conversion between the chroma video block and the bitstream representation of the chroma video block using the differential coding mode, where the chroma video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the chroma video block and a prediction of the quantized residual in the differential coding mode, where the intra prediction is performed in a first direction and the prediction of the quantized residual is performed in a second direction, and where the difference is represented using a differential pulse coding modulation (DPCM) representation.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: September 6, 2022
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
  • Patent number: 11431984
    Abstract: Video coding and decoding methods are described. In example method includes determining that a differential coding mode is applicable to a conversion between a current video block of a video and a bitstream representation of the current video block, and performing, based on the determining, the conversion between the current video block and the bitstream representation of the current video block using the differential coding mode according to an implementation rule, where, in the differential coding mode, the current video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual, and where, in the differential coding mode, the difference between the quantized residual and the prediction of the quantized residual is represented using a differential pulse coding modulation (DPCM) representation.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: August 30, 2022
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
  • Patent number: 11431966
    Abstract: Video coding and decoding methods are described. In example method includes performing a conversion between a current video block of a video and a bitstream representation of the current video block by determining a first intra coding mode to be stored which is associated with the current video block using a differential coding mode, where the first intra coding mode associated with the current video block is determined according to a second prediction mode used by the differential coding mode, and where, in the differential coding mode, a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual is represented in the bitstream representation for the current video block using a differential pulse coding modulation (DPCM) representation.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: August 30, 2022
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
  • Patent number: 11388411
    Abstract: Video coding and decoding methods are described. In example method includes determining that a differential coding mode is applicable to a conversion between a current video block of a video and a bitstream representation of the current video block, and performing, based on the determining, the conversion between the current video block and the bitstream representation of the current video block using the differential coding mode according to an implementation rule, where, in the differential coding mode, the current video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual, and where, in the differential coding mode, the difference between the quantized residual and the prediction of the quantized residual is represented using a differential pulse coding modulation (DPCM) representation.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: July 12, 2022
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
  • Publication number: 20220217408
    Abstract: Methods, systems, and devices for performing entropy coding for the palette escape symbol in palette mode coding and decoding are described. An example method for video processing includes performing a conversion between a video comprising one or more video regions comprising a current video block and a bitstream representation of the video, wherein the bitstream representation conforms to a format rule that the current video block is coded using a palette mode coding tool, wherein a binarization of an escape symbol for the current video block uses an exponential-Golomb (EG) code of order K, wherein K is a non-negative integer that is unequal to three, and wherein the palette mode coding tool represents the current video block using a palette of representative color values and wherein the escape symbol is used for a sample of the current video block coded without using the representative color values.
    Type: Application
    Filed: February 14, 2022
    Publication date: July 7, 2022
    Inventors: Weijia ZHU, Jizheng XU, Li ZHANG, Hsiao Chiang CHUANG
  • Patent number: 11381848
    Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block, decoding, based on a bitstream representation, the four sub-blocks, and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.
    Type: Grant
    Filed: November 5, 2020
    Date of Patent: July 5, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
  • Publication number: 20220182655
    Abstract: Methods, systems, and devices for using palette mode with different partition structures are described. An example method for video processing includes maintaining, for a conversion between a video comprising one or more video regions comprising a current video block and a bitstream representation of the video, a palette prediction table for a prediction of a palette used in a palette mode coding tool used for the current video block, making a determination that a local dual tree coding is applied to the conversion, modifying, based on the determination, the palette prediction table, and performing, based on the palette prediction table subsequent to the modifying, the conversion, wherein the palette mode coding tool represents the current video block using a palette of representative color values, and wherein the local dual tree coding enables partitioning of chroma blocks independently from corresponding luma blocks based on a block size.
    Type: Application
    Filed: February 14, 2022
    Publication date: June 9, 2022
    Inventors: Weijia ZHU, Jizheng XU, Li ZHANG, Hsiao Chiang CHUANG
  • Patent number: 11297340
    Abstract: A method of decoding video data includes constructing, by a video decoder implemented in processing circuitry, a candidate list of motion vector information for a portion of a current frame. The method includes receiving, by the video decoder, signaling information indicating starting motion vector information of the candidate list of motion vector information, the starting motion vector information indicating an initial position in a reference frame. The method includes refining, by the video decoder, based on one or more of bilateral matching or template matching, the starting motion vector information to determine refined motion vector information indicating a refined position in the reference frame that is within a search range from the initial position. The method includes generating, by the video decoder, a predictive block based on the refined motion vector information and decoding, by the video decoder, the current frame based on the predictive block.
    Type: Grant
    Filed: March 16, 2020
    Date of Patent: April 5, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Wei-Jung Chien, Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Li Zhang, Marta Karczewicz
  • Publication number: 20220070486
    Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.
    Type: Application
    Filed: November 10, 2021
    Publication date: March 3, 2022
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
  • Patent number: 11265551
    Abstract: Improved systems and methods related to decoder-side motion vector derivation (DMVD), for example, in applying one or more constraints to motion information, such as a MV derived by DMVD, and/or a MV difference between an initial MV and an MV derived by DMVD. These techniques may be applied to any of the existing video codecs, such as HEVC (High Efficiency Video Coding), and/or may be an efficient coding tool in any future video coding standards. In one example, the block size used for DMVD can be restricted. In another example, FRUC bilateral matching can be simplified by not searching outside reference blocks indicated by the original motion vector.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: March 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Hsiao-Chiang Chuang, Marta Karczewicz
  • Patent number: 11265584
    Abstract: An example method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block decoding, based on a bitstream representation, the four sub-blocks, and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.
    Type: Grant
    Filed: November 5, 2020
    Date of Patent: March 1, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
  • Publication number: 20220044386
    Abstract: A scalable hardware accelerator configured to compute video quality metrics is disclosed. In some embodiments, an accelerator for video quality metrics comprises an application-specific integrated circuit that includes an interface configured to receive pixel data of a frame of a video being analyzed for quality metric determination and a kernel configured to compute a video quality metric for the received pixel data using a fixed-point hardware approximation of a floating-point based algorithm associated with the video quality metric.
    Type: Application
    Filed: August 4, 2021
    Publication date: February 10, 2022
    Inventors: Deepa Palamadai Sundar, Xing Cindy Chen, Hsiao-Chiang Chuang, Visalakshi Vaduganathan, Harikrishna Madadi Reddy
  • Publication number: 20220038687
    Abstract: Video coding and decoding methods are described. In example method includes performing a conversion between a current video block of a video and a bitstream representation of the current video block by determining a first intra coding mode to be stored which is associated with the current video block using a differential coding mode, where the first intra coding mode associated with the current video block is determined according to a second prediction mode used by the differential coding mode, and where, in the differential coding mode, a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual is represented in the bitstream representation for the current video block using a differential pulse coding modulation (DPCM) representation.
    Type: Application
    Filed: October 15, 2021
    Publication date: February 3, 2022
    Inventors: Weijia ZHU, Li ZHANG, Jizheng XU, Hsiao Chiang CHUANG
  • Publication number: 20220014782
    Abstract: History based motion vector prediction is disclosed. In one example method of video processing, initializing, for a conversion between a first region of video and a bitstream of the first region, a first history motion vector predictor (HMVP) table associated with the first region based on at least one of stored multiple HMVP tables, the multiple HMVP tables being used to store motion information associated with regions coded prior the first region; and performing the conversion by using the initialized first HMVP table which includes at least one motion candidate.
    Type: Application
    Filed: September 27, 2021
    Publication date: January 13, 2022
    Inventors: Jaehong CHON, Hsiao Chiang CHUANG, Li ZHANG, Yue WANG
  • Patent number: 11223852
    Abstract: An example device for decoding video data includes a video decoder configured to decode one or more syntax elements at a region-tree level of a region-tree of a tree data structure for a coding tree block (CTB) of video data, the region-tree having one or more region-tree nodes including region-tree leaf and non-leaf nodes, each of the region-tree non-leaf nodes having at least four child region-tree nodes, decode one or more syntax elements at a prediction-tree level for each of the region-tree leaf nodes of one or more prediction trees of the tree data structure for the CTB, the prediction trees each having one or more prediction-tree leaf and non-leaf nodes, each of the prediction-tree non-leaf nodes having at least two child prediction-tree nodes, each of the prediction leaf nodes defining respective coding units (CUs), and decode video data for each of the CUs.
    Type: Grant
    Filed: March 20, 2017
    Date of Patent: January 11, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Xiang Li, Jianle Chen, Li Zhang, Xin Zhao, Hsiao-Chiang Chuang, Feng Zou, Marta Karczewicz
  • Patent number: 11218723
    Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.
    Type: Grant
    Filed: March 16, 2020
    Date of Patent: January 4, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
  • Publication number: 20210385459
    Abstract: Video coding and decoding methods are described. An example method includes determining, based on an applicability rule, that a differential coding mode is applicable to a conversion between a chroma video block of a video and a bitstream representation of the chroma video block, and performing, based on the determining, the conversion between the chroma video block and the bitstream representation of the chroma video block using the differential coding mode, where the chroma video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the chroma video block and a prediction of the quantized residual in the differential coding mode, where the intra prediction is performed in a first direction and the prediction of the quantized residual is performed in a second direction, and where the difference is represented using a differential pulse coding modulation (DPCM) representation.
    Type: Application
    Filed: August 25, 2021
    Publication date: December 9, 2021
    Inventors: Weijia ZHU, Li ZHANG, Jizheng XU, Hsiao Chiang CHUANG