Patents by Inventor Hsiao-Chiang Chuang
Hsiao-Chiang Chuang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11570482Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques and in particular, restricting extended quadtree (EQT) partitioning, are described. An exemplary method for visual media decoding includes making a decision, based on one or more conditions, regarding a selective inclusion of one or more signaling bits for a partitioning process in a bitstream representation of a current visual media block of a plurality of visual media blocks, where the partitioning process splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block; decoding, based on the bitstream representation, the four sub-blocks; and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.Type: GrantFiled: November 5, 2020Date of Patent: January 31, 2023Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
-
Patent number: 11528497Abstract: Methods, systems, and devices for using palette mode with different partition structures are described. An example method for video processing includes maintaining, for a conversion between a video comprising one or more video regions comprising a current video block and a bitstream representation of the video, a palette prediction table for a prediction of a palette used in a palette mode coding tool used for the current video block, making a determination that a local dual tree coding is applied to the conversion, modifying, based on the determination, the palette prediction table, and performing, based on the palette prediction table subsequent to the modifying, the conversion, wherein the palette mode coding tool represents the current video block using a palette of representative color values, and wherein the local dual tree coding enables partitioning of chroma blocks independently from corresponding luma blocks based on a block size.Type: GrantFiled: February 14, 2022Date of Patent: December 13, 2022Assignee: BYTEDANCE INC.Inventors: Weijia Zhu, Jizheng Xu, Li Zhang, Hsiao Chiang Chuang
-
Publication number: 20220385916Abstract: Video coding and decoding methods are described. An example method includes determining, based on an applicability rule, that a differential coding mode is applicable to a conversion between a chroma video block of a video and a bitstream representation of the chroma video block, and performing, based on the determining, the conversion between the chroma video block and the bitstream representation of the chroma video block using the differential coding mode, where the chroma video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the chroma video block and a prediction of the quantized residual in the differential coding mode, where the intra prediction is performed in a first direction and the prediction of the quantized residual is performed in a second direction, and where the difference is represented using a differential pulse coding modulation (DPCM) representation.Type: ApplicationFiled: August 4, 2022Publication date: December 1, 2022Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
-
Patent number: 11503324Abstract: An example method includes determining, without receiving explicit signaling, whether motion compensation for a current block of a current picture of video data is to be performed using a four-parameter affine motion model (AMM) defined by two motion vectors (MVs) or using a six-parameter AMM defined by three MVs; deriving values of predictors for MVs of the AMM of the current block; decoding a representation of differences between the values of the MVs of the AMM for the current block and the values of the predictors; determining the values of the MVs of the AMM for the current block from the values of the predictors and the decoded differences; determining, based on the determined values of the MVs of the AMM for the current block of video data, a predictor block of video data; and reconstructing the current block based on the predictor block.Type: GrantFiled: January 6, 2020Date of Patent: November 15, 2022Assignee: Qualcomm IncorporatedInventors: Feng Zou, Jianle Chen, Marta Karczewicz, Xiang Li, Hsiao-Chiang Chuang, Wei-Jung Chien
-
Patent number: 11503344Abstract: Methods, systems, and devices for performing entropy coding for the palette escape symbol in palette mode coding and decoding are described. An example method for video processing includes performing a conversion between a video comprising one or more video regions comprising a current video block and a bitstream representation of the video, wherein the bitstream representation conforms to a format rule that the current video block is coded using a palette mode coding tool, wherein a binarization of an escape symbol for the current video block uses an exponential-Golomb (EG) code of order K, wherein K is a non-negative integer that is unequal to three, and wherein the palette mode coding tool represents the current video block using a palette of representative color values and wherein the escape symbol is used for a sample of the current video block coded without using the representative color values.Type: GrantFiled: February 14, 2022Date of Patent: November 15, 2022Assignee: BYTEDANCE INC.Inventors: Weijia Zhu, Jizheng Xu, Li Zhang, Hsiao Chiang Chuang
-
Patent number: 11445224Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques, and in particular, sub-block shapes in extended quadtree partitioning, are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block, where a size of the current visual media block is M×N, and the size of the at least one sub-block is based on a minimum value between M and N, or a maximum value between M and N; decoding, based on a bitstream representation, the four sub-blocks; and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.Type: GrantFiled: December 2, 2020Date of Patent: September 13, 2022Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
-
Publication number: 20220286672Abstract: A method of video processing is described. The method includes performing a conversion between a current block of a video and a bitstream representation of the video, wherein the current block is coded with a dictionary-based coding mode using one or more dictionaries, and wherein the conversion is based on the one or more dictionaries.Type: ApplicationFiled: May 26, 2022Publication date: September 8, 2022Inventors: Weijia ZHU, Jizheng XU, Li ZHANG, Hsiao Chiang CHUANG, Kui FAN
-
Patent number: 11438635Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into more than four sub-blocks; decoding, based on a bitstream representation, the more than four sub-blocks; and decoding, based on the more than four sub-blocks and the partitioning process, the current visual media block. Another exemplary method for visual media encoding includes receiving input data associated with a current visual media block; applying, to the input data, a partitioning process that splits the current visual media block into more than four sub-blocks; encoding, based on the partitioning process, the more than four sub-blocks; and generating, based on the encoding, a bitstream representation of the current visual media block.Type: GrantFiled: December 2, 2020Date of Patent: September 6, 2022Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
-
Patent number: 11438597Abstract: Video coding and decoding methods are described. An example method includes determining, based on an applicability rule, that a differential coding mode is applicable to a conversion between a chroma video block of a video and a bitstream representation of the chroma video block, and performing, based on the determining, the conversion between the chroma video block and the bitstream representation of the chroma video block using the differential coding mode, where the chroma video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the chroma video block and a prediction of the quantized residual in the differential coding mode, where the intra prediction is performed in a first direction and the prediction of the quantized residual is performed in a second direction, and where the difference is represented using a differential pulse coding modulation (DPCM) representation.Type: GrantFiled: August 25, 2021Date of Patent: September 6, 2022Assignee: BYTEDANCE INC.Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
-
Patent number: 11431966Abstract: Video coding and decoding methods are described. In example method includes performing a conversion between a current video block of a video and a bitstream representation of the current video block by determining a first intra coding mode to be stored which is associated with the current video block using a differential coding mode, where the first intra coding mode associated with the current video block is determined according to a second prediction mode used by the differential coding mode, and where, in the differential coding mode, a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual is represented in the bitstream representation for the current video block using a differential pulse coding modulation (DPCM) representation.Type: GrantFiled: October 15, 2021Date of Patent: August 30, 2022Assignee: BYTEDANCE INC.Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
-
Patent number: 11431984Abstract: Video coding and decoding methods are described. In example method includes determining that a differential coding mode is applicable to a conversion between a current video block of a video and a bitstream representation of the current video block, and performing, based on the determining, the conversion between the current video block and the bitstream representation of the current video block using the differential coding mode according to an implementation rule, where, in the differential coding mode, the current video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual, and where, in the differential coding mode, the difference between the quantized residual and the prediction of the quantized residual is represented using a differential pulse coding modulation (DPCM) representation.Type: GrantFiled: August 25, 2021Date of Patent: August 30, 2022Assignee: BYTEDANCE INC.Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
-
Patent number: 11388411Abstract: Video coding and decoding methods are described. In example method includes determining that a differential coding mode is applicable to a conversion between a current video block of a video and a bitstream representation of the current video block, and performing, based on the determining, the conversion between the current video block and the bitstream representation of the current video block using the differential coding mode according to an implementation rule, where, in the differential coding mode, the current video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual, and where, in the differential coding mode, the difference between the quantized residual and the prediction of the quantized residual is represented using a differential pulse coding modulation (DPCM) representation.Type: GrantFiled: August 25, 2021Date of Patent: July 12, 2022Assignee: BYTEDANCE INC.Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
-
Publication number: 20220217408Abstract: Methods, systems, and devices for performing entropy coding for the palette escape symbol in palette mode coding and decoding are described. An example method for video processing includes performing a conversion between a video comprising one or more video regions comprising a current video block and a bitstream representation of the video, wherein the bitstream representation conforms to a format rule that the current video block is coded using a palette mode coding tool, wherein a binarization of an escape symbol for the current video block uses an exponential-Golomb (EG) code of order K, wherein K is a non-negative integer that is unequal to three, and wherein the palette mode coding tool represents the current video block using a palette of representative color values and wherein the escape symbol is used for a sample of the current video block coded without using the representative color values.Type: ApplicationFiled: February 14, 2022Publication date: July 7, 2022Inventors: Weijia ZHU, Jizheng XU, Li ZHANG, Hsiao Chiang CHUANG
-
Patent number: 11381848Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block, decoding, based on a bitstream representation, the four sub-blocks, and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.Type: GrantFiled: November 5, 2020Date of Patent: July 5, 2022Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
-
Publication number: 20220182655Abstract: Methods, systems, and devices for using palette mode with different partition structures are described. An example method for video processing includes maintaining, for a conversion between a video comprising one or more video regions comprising a current video block and a bitstream representation of the video, a palette prediction table for a prediction of a palette used in a palette mode coding tool used for the current video block, making a determination that a local dual tree coding is applied to the conversion, modifying, based on the determination, the palette prediction table, and performing, based on the palette prediction table subsequent to the modifying, the conversion, wherein the palette mode coding tool represents the current video block using a palette of representative color values, and wherein the local dual tree coding enables partitioning of chroma blocks independently from corresponding luma blocks based on a block size.Type: ApplicationFiled: February 14, 2022Publication date: June 9, 2022Inventors: Weijia ZHU, Jizheng XU, Li ZHANG, Hsiao Chiang CHUANG
-
Patent number: 11297340Abstract: A method of decoding video data includes constructing, by a video decoder implemented in processing circuitry, a candidate list of motion vector information for a portion of a current frame. The method includes receiving, by the video decoder, signaling information indicating starting motion vector information of the candidate list of motion vector information, the starting motion vector information indicating an initial position in a reference frame. The method includes refining, by the video decoder, based on one or more of bilateral matching or template matching, the starting motion vector information to determine refined motion vector information indicating a refined position in the reference frame that is within a search range from the initial position. The method includes generating, by the video decoder, a predictive block based on the refined motion vector information and decoding, by the video decoder, the current frame based on the predictive block.Type: GrantFiled: March 16, 2020Date of Patent: April 5, 2022Assignee: QUALCOMM IncorporatedInventors: Wei-Jung Chien, Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Li Zhang, Marta Karczewicz
-
Publication number: 20220070486Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.Type: ApplicationFiled: November 10, 2021Publication date: March 3, 2022Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
-
Patent number: 11265551Abstract: Improved systems and methods related to decoder-side motion vector derivation (DMVD), for example, in applying one or more constraints to motion information, such as a MV derived by DMVD, and/or a MV difference between an initial MV and an MV derived by DMVD. These techniques may be applied to any of the existing video codecs, such as HEVC (High Efficiency Video Coding), and/or may be an efficient coding tool in any future video coding standards. In one example, the block size used for DMVD can be restricted. In another example, FRUC bilateral matching can be simplified by not searching outside reference blocks indicated by the original motion vector.Type: GrantFiled: January 16, 2019Date of Patent: March 1, 2022Assignee: QUALCOMM IncorporatedInventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Hsiao-Chiang Chuang, Marta Karczewicz
-
Patent number: 11265584Abstract: An example method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block decoding, based on a bitstream representation, the four sub-blocks, and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.Type: GrantFiled: November 5, 2020Date of Patent: March 1, 2022Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
-
Publication number: 20220044386Abstract: A scalable hardware accelerator configured to compute video quality metrics is disclosed. In some embodiments, an accelerator for video quality metrics comprises an application-specific integrated circuit that includes an interface configured to receive pixel data of a frame of a video being analyzed for quality metric determination and a kernel configured to compute a video quality metric for the received pixel data using a fixed-point hardware approximation of a floating-point based algorithm associated with the video quality metric.Type: ApplicationFiled: August 4, 2021Publication date: February 10, 2022Inventors: Deepa Palamadai Sundar, Xing Cindy Chen, Hsiao-Chiang Chuang, Visalakshi Vaduganathan, Harikrishna Madadi Reddy