Patents by Inventor Hsiao-Chiang Chuang

Hsiao-Chiang Chuang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10785494
    Abstract: A method of decoding video data includes constructing, by a video decoder implemented in processing circuitry, a candidate list of motion vector information for a portion of a current frame. The method includes receiving, by the video decoder, signaling information indicating starting motion vector information of the candidate list of motion vector information, the starting motion vector information indicating an initial position in a reference frame. The method includes refining, by the video decoder, based on one or more of bilateral matching or template matching, the starting motion vector information to determine refined motion vector information indicating a refined position in the reference frame that is within a search range from the initial position. The method includes generating, by the video decoder, a predictive block based on the refined motion vector information and decoding, by the video decoder, the current frame based on the predictive block.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: September 22, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Wei-Jung Chien, Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Li Zhang, Marta Karczewicz
  • Patent number: 10779002
    Abstract: A video decoder is configured to determine a first motion vector for a first block of video data; perform motion vector refinement on the first motion vector for the first block to determine a refined motion vector for the first block of video data; determine that a second block of video data is coded in a mode that utilizes a motion vector associated with the first block as a motion vector predictor; in response to determining that the second block of video data is coded in the mode that utilizes the motion vector associated with the first block as a motion vector predictor and in response to performing the motion vector refinement on the first motion vector for the first block, use a different motion vector than the first refined motion vector as the motion vector predictor associated with the first block.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: September 15, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Marta Karczewicz
  • Patent number: 10778999
    Abstract: Methods, apparatuses, and computer-readable medium are provided for a frame rate up-conversion coding mode, in which an affine motion model is applied when conducting bilateral matching. The frame rate up-conversion coding mode can include generated additional frames from frames provided in a bitstream. In various implementations, bilateral matching includes, for a current block in a frame that is being generated, identifying a first block in a first reference picture a second block in a second reference picture. Affine (e.g., non-linear) motion information can be determined as between the first block and the second block. The current block can be predicted using the affine motion information.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: September 15, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Xiang Li, Jianle Chen, Hsiao-Chiang Chuang, Marta Karczewicz
  • Patent number: 10757442
    Abstract: A method of decoding video data includes determining, by a video decoder, a neighboring block in a current frame is inter coded. The method includes, in response to determining the neighboring block is inter coded, determining, by the video decoder, a template for a current block in the current frame based on a partial reconstruction of the neighboring block. The method includes determining, by the video decoder, a reference block in a reference frame corresponding to the template for the current block and determining, by the video decoder, motion vector information for the current frame based on the reference block and the template. The method includes generating, by the video decoder, a predictive block for the current block of video data based on the motion vector information and decoding, by the video decoder, the current block of video data based on the predictive block.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: August 25, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Xiang Li, Cheng-Teh Hsieh, Jianle Chen, Kai Zhang, Hsiao-Chiang Chuang, Marta Karczewicz
  • Publication number: 20200267418
    Abstract: An example device includes a memory to store the video data, and processing circuitry in communication with the memory. The processing circuitry is configured to compare a value of a dimension of a current block of the stored video data to a value of a corresponding dimension of a neighboring block of the current block to obtain a relative dimension value. The processing circuitry is further configured to determine, based on the relative dimension value, that the current block is to be partitioned according to a prediction tree (PT) portion of a multi-type tree-based partitioning scheme. The PT portion comprises partitioning according to one of a binary tree structure or a center-side triple tree structure. The processing circuitry is further configured to partition, based on the determination, the current block according to the PT portion, to form a plurality of sub-blocks.
    Type: Application
    Filed: February 21, 2020
    Publication date: August 20, 2020
    Inventors: Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Feng Zou, Wei-Jung Chien, Yi-Wen Chen, Marta Karczewicz
  • Publication number: 20200221116
    Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.
    Type: Application
    Filed: March 16, 2020
    Publication date: July 9, 2020
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
  • Publication number: 20200221110
    Abstract: A method of decoding video data includes constructing, by a video decoder implemented in processing circuitry, a candidate list of motion vector information for a portion of a current frame. The method includes receiving, by the video decoder, signaling information indicating starting motion vector information of the candidate list of motion vector information, the starting motion vector information indicating an initial position in a reference frame. The method includes refining, by the video decoder, based on one or more of bilateral matching or template matching, the starting motion vector information to determine refined motion vector information indicating a refined position in the reference frame that is within a search range from the initial position. The method includes generating, by the video decoder, a predictive block based on the refined motion vector information and decoding, by the video decoder, the current frame based on the predictive block.
    Type: Application
    Filed: March 16, 2020
    Publication date: July 9, 2020
    Inventors: Wei-Jung Chien, Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Li Zhang, Marta Karczewicz
  • Patent number: 10701390
    Abstract: Techniques and systems are provided for deriving one or more sets of affine motion parameters at a decoder. For example, the decoder can obtain video data from an encoded video bitstream. The video data includes at least a current picture and a reference picture. The decoder can determine a set of affine motion parameters for a current block of the current picture. The set of affine motion parameters can be used for performing motion compensation prediction for the current block. The set of affine motion parameters can be determined using a current affine template of the current block and a reference affine template of the reference picture.
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: June 30, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Xiang Li, Yi-Wen Chen, Jianle Chen, Hsiao-Chiang Chuang, Wei-Jung Chien, Yu-Chen Sun, Marta Karczewicz
  • Patent number: 10701366
    Abstract: An example device for decoding video data includes a memory configured to store video data, and a video decoder implemented in circuitry and configured to determine that motion information of a current block of the video data is to be derived using decoder-side motion vector derivation (DMVD), determine a pixels clue for the current block, the pixels clue comprising pixel data obtained from one or more groups of previously decoded pixels, derive the motion information for the current block according to DMVD from the pixels clue, and decode the current block using the motion information. The video decoder may generate the pixels clue using multiple hypothesis predictions from multiple motion compensated blocks. The video decoder may determine an inter-prediction direction for the motion information according to matching costs between different prediction directions. The video decoder may refine the motion information using a calculated matching cost for the pixels clue.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: June 30, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Jianle Chen, Xiang Li, Marta Karczewicz, Yu-Chen Sun
  • Patent number: 10652571
    Abstract: A video encoder performs an Advanced Motion Vector Prediction (AMVP) process for a current block of a current picture. As part of performing the AMVP process, the video encoder may determine whether local illumination compensation (LIC) is being applied in the AMVP process. Based on LIC being applied in the AMVP process, the video encoder may skip a bi-directional AMVP motion estimation process that sets a cost associated with encoding the current block using a bi-directional AMVP mode. Rather, the video encoder may set the cost to a maximum cost value.
    Type: Grant
    Filed: January 23, 2019
    Date of Patent: May 12, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Nan Hu, Hsiao-Chiang Chuang, Xiang Li, Vijayaraghavan Thirumalai, Marta Karczewicz
  • Publication number: 20200145688
    Abstract: An example method includes determining, without receiving explicit signaling, whether motion compensation for a current block of a current picture of video data is to be performed using a four-parameter affine motion model (AMM) defined by two motion vectors (MVs) or using a six-parameter AMM defined by three MVs; deriving values of predictors for MVs of the AMM of the current block; decoding a representation of differences between the values of the MVs of the AMM for the current block and the values of the predictors; determining the values of the MVs of the AMM for the current block from the values of the predictors and the decoded differences; determining, based on the determined values of the MVs of the AMM for the current block of video data, a predictor block of video data; and reconstructing the current block based on the predictor block.
    Type: Application
    Filed: January 6, 2020
    Publication date: May 7, 2020
    Inventors: Feng Zou, Jianle Chen, Marta Karczewicz, Xiang Li, Hsiao-Chiang Chuang, Wei-Jung Chien
  • Patent number: 10631002
    Abstract: Methods, apparatuses, and computer-readable medium are provided for a frame rate up-conversion coding mode, where a bilateral matching mode can be used to determine motion information. In various implementations, local illumination compensation is disallowed from being used for a block when a bilateral matching mode is used for the block. In various implementations, a bilateral matching mode is disallowed from being used when local illumination compensation is used for the block.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: April 21, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Xiang Li, Jianle Chen, Hsiao-Chiang Chuang, Marta Karczewicz
  • Patent number: 10609423
    Abstract: An example device includes a memory to store the video data, and processing circuitry in communication with the memory. The processing circuitry is configured to compare a value of a dimension of a current block of the stored video data to a value of a corresponding dimension of a neighboring block of the current block to obtain a relative dimension value. The processing circuitry is further configured to determine, based on the relative dimension value, that the current block is to be partitioned according to a prediction tree (PT) portion of a multi-type tree-based partitioning scheme. The PT portion comprises partitioning according to one of a binary tree structure or a center-side triple tree structure. The processing circuitry is further configured to partition, based on the determination, the current block according to the PT portion, to form a plurality of sub-blocks.
    Type: Grant
    Filed: September 6, 2017
    Date of Patent: March 31, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Feng Zou, Wei-Jung Chien, Yi-Wen Chen, Marta Karczewicz
  • Patent number: 10602180
    Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.
    Type: Grant
    Filed: June 8, 2018
    Date of Patent: March 24, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Yi-Wen Chen, Marta Karczewicz, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin
  • Patent number: 10595035
    Abstract: Techniques related to decoder-side motion vector derivation (DMVD) are described. For example, this disclosure describes techniques related to applying one or more constraints to motion information, such as a motion vector (MV) derived by DMVD, and/or a MV difference between an initial MV and an MV derived by DMVD. When the constraint is applied to the DMVD, in certain examples, only the derived motion information which meets the constraint is regarded as valid motion information. Conditions may be placed on the constraints.
    Type: Grant
    Filed: March 21, 2018
    Date of Patent: March 17, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Yi-Wen Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Xiang Li, Jianle Chen
  • Patent number: 10560712
    Abstract: An example method includes obtaining, for a current block of video data, values of motion vectors (MVs) of an affine motion model of a neighboring block of video data; deriving, from the values of the MVs of the affine motion model of the neighboring block, values of predictors for MVs of an affine motion model of the current block; decoding, from a video bitstream, a representation of differences between the values of the MVs of the affine motion model for the current block and the values of the predictors; determining the values of the MVs of the affine motion model for the current block from the values of the predictors and the decoded differences; determining, based on the determined values of the MVs of the affine motion model for the current block, a predictor block of video data; and reconstructing the current block based on the predictor block.
    Type: Grant
    Filed: May 4, 2017
    Date of Patent: February 11, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Feng Zou, Jianle Chen, Marta Karczewicz, Xiang Li, Hsiao-Chiang Chuang, Wei-Jung Chien
  • Patent number: 10523964
    Abstract: A video decoder can be configured to determine that a block of video data is encoded using a bi-directional inter prediction mode; determine that the block of video data is encoded using a bi-directional optical flow (BIO) process; inter predict the block of video data according to the bi-directional inter prediction mode; perform the BIO process for the block, wherein performing the BIO process for the block comprises determining a single motion vector refinement for a group of pixels in the block, wherein the group of pixels comprises at least two pixels; refine the group of pixels based on the single motion vector refinement; and output a BIO refined predictive block of video data comprising the refined group of pixels.
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: December 31, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Hsiao-Chiang Chuang, Jianle Chen, Yi-Wen Chen, Xiang Li, Marta Karczewicz, Wei-Jung Chien
  • Patent number: 10491917
    Abstract: A device for decoding video data determines a block of video data is coded in an inter prediction mode; implicitly determines that a decoder-side motion vector derivation (DMVD) mode is enabled for the block of video data; determines motion information for the block of video data; uses the motion information to determine a reference block in accordance with the DMVD mode; and generates a predictive block for the block of video data based on the reference block.
    Type: Grant
    Filed: March 21, 2018
    Date of Patent: November 26, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Yi-Wen Chen, Kai Zhang, Xiang Li, Jianle Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Marta Karczewicz
  • Publication number: 20190320197
    Abstract: A video decoder is configured to determine a first motion vector for a first block of video data; perform motion vector refinement on the first motion vector for the first block to determine a refined motion vector for the first block of video data; determine that a second block of video data is coded in a mode that utilizes a motion vector associated with the first block as a motion vector predictor; in response to determining that the second block of video data is coded in the mode that utilizes the motion vector associated with the first block as a motion vector predictor and in response to performing the motion vector refinement on the first motion vector for the first block, use a different motion vector than the first refined motion vector as the motion vector predictor associated with the first block.
    Type: Application
    Filed: April 15, 2019
    Publication date: October 17, 2019
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Marta Karczewicz
  • Publication number: 20190306506
    Abstract: A method of decoding video data including receiving a bitstream that includes a sequence of bits that forms a representation of a coded picture of the video data, partitioning the coded picture of the video data into a plurality of blocks using three or more different partition structures, and reconstructing the plurality of blocks of the coded picture of the video data. Partitioning the coded picture of the video data may include partitioning the coded picture of the video data into the plurality of blocks using a plurality partition structures. In some embodiments, partitioning is constrained to, for example, reduce memory bandwidth in implementations of video decoders.
    Type: Application
    Filed: April 2, 2019
    Publication date: October 3, 2019
    Inventors: Yi-Wen CHEN, Hsiao-Chiang CHUANG, Wei-Jung CHIEN, Marta KARCZEWICZ