Patents by Inventor Hsiao-Chiang Chuang
Hsiao-Chiang Chuang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10785494Abstract: A method of decoding video data includes constructing, by a video decoder implemented in processing circuitry, a candidate list of motion vector information for a portion of a current frame. The method includes receiving, by the video decoder, signaling information indicating starting motion vector information of the candidate list of motion vector information, the starting motion vector information indicating an initial position in a reference frame. The method includes refining, by the video decoder, based on one or more of bilateral matching or template matching, the starting motion vector information to determine refined motion vector information indicating a refined position in the reference frame that is within a search range from the initial position. The method includes generating, by the video decoder, a predictive block based on the refined motion vector information and decoding, by the video decoder, the current frame based on the predictive block.Type: GrantFiled: September 14, 2018Date of Patent: September 22, 2020Assignee: QUALCOMM IncorporatedInventors: Wei-Jung Chien, Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Li Zhang, Marta Karczewicz
-
Patent number: 10779002Abstract: A video decoder is configured to determine a first motion vector for a first block of video data; perform motion vector refinement on the first motion vector for the first block to determine a refined motion vector for the first block of video data; determine that a second block of video data is coded in a mode that utilizes a motion vector associated with the first block as a motion vector predictor; in response to determining that the second block of video data is coded in the mode that utilizes the motion vector associated with the first block as a motion vector predictor and in response to performing the motion vector refinement on the first motion vector for the first block, use a different motion vector than the first refined motion vector as the motion vector predictor associated with the first block.Type: GrantFiled: April 15, 2019Date of Patent: September 15, 2020Assignee: Qualcomm IncorporatedInventors: Yi-Wen Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Marta Karczewicz
-
Patent number: 10778999Abstract: Methods, apparatuses, and computer-readable medium are provided for a frame rate up-conversion coding mode, in which an affine motion model is applied when conducting bilateral matching. The frame rate up-conversion coding mode can include generated additional frames from frames provided in a bitstream. In various implementations, bilateral matching includes, for a current block in a frame that is being generated, identifying a first block in a first reference picture a second block in a second reference picture. Affine (e.g., non-linear) motion information can be determined as between the first block and the second block. The current block can be predicted using the affine motion information.Type: GrantFiled: September 28, 2017Date of Patent: September 15, 2020Assignee: QUALCOMM IncorporatedInventors: Xiang Li, Jianle Chen, Hsiao-Chiang Chuang, Marta Karczewicz
-
Patent number: 10757442Abstract: A method of decoding video data includes determining, by a video decoder, a neighboring block in a current frame is inter coded. The method includes, in response to determining the neighboring block is inter coded, determining, by the video decoder, a template for a current block in the current frame based on a partial reconstruction of the neighboring block. The method includes determining, by the video decoder, a reference block in a reference frame corresponding to the template for the current block and determining, by the video decoder, motion vector information for the current frame based on the reference block and the template. The method includes generating, by the video decoder, a predictive block for the current block of video data based on the motion vector information and decoding, by the video decoder, the current block of video data based on the predictive block.Type: GrantFiled: June 29, 2018Date of Patent: August 25, 2020Assignee: Qualcomm IncorporatedInventors: Xiang Li, Cheng-Teh Hsieh, Jianle Chen, Kai Zhang, Hsiao-Chiang Chuang, Marta Karczewicz
-
Publication number: 20200267418Abstract: An example device includes a memory to store the video data, and processing circuitry in communication with the memory. The processing circuitry is configured to compare a value of a dimension of a current block of the stored video data to a value of a corresponding dimension of a neighboring block of the current block to obtain a relative dimension value. The processing circuitry is further configured to determine, based on the relative dimension value, that the current block is to be partitioned according to a prediction tree (PT) portion of a multi-type tree-based partitioning scheme. The PT portion comprises partitioning according to one of a binary tree structure or a center-side triple tree structure. The processing circuitry is further configured to partition, based on the determination, the current block according to the PT portion, to form a plurality of sub-blocks.Type: ApplicationFiled: February 21, 2020Publication date: August 20, 2020Inventors: Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Feng Zou, Wei-Jung Chien, Yi-Wen Chen, Marta Karczewicz
-
Publication number: 20200221116Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.Type: ApplicationFiled: March 16, 2020Publication date: July 9, 2020Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
-
Publication number: 20200221110Abstract: A method of decoding video data includes constructing, by a video decoder implemented in processing circuitry, a candidate list of motion vector information for a portion of a current frame. The method includes receiving, by the video decoder, signaling information indicating starting motion vector information of the candidate list of motion vector information, the starting motion vector information indicating an initial position in a reference frame. The method includes refining, by the video decoder, based on one or more of bilateral matching or template matching, the starting motion vector information to determine refined motion vector information indicating a refined position in the reference frame that is within a search range from the initial position. The method includes generating, by the video decoder, a predictive block based on the refined motion vector information and decoding, by the video decoder, the current frame based on the predictive block.Type: ApplicationFiled: March 16, 2020Publication date: July 9, 2020Inventors: Wei-Jung Chien, Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Li Zhang, Marta Karczewicz
-
Patent number: 10701390Abstract: Techniques and systems are provided for deriving one or more sets of affine motion parameters at a decoder. For example, the decoder can obtain video data from an encoded video bitstream. The video data includes at least a current picture and a reference picture. The decoder can determine a set of affine motion parameters for a current block of the current picture. The set of affine motion parameters can be used for performing motion compensation prediction for the current block. The set of affine motion parameters can be determined using a current affine template of the current block and a reference affine template of the reference picture.Type: GrantFiled: March 12, 2018Date of Patent: June 30, 2020Assignee: QUALCOMM IncorporatedInventors: Xiang Li, Yi-Wen Chen, Jianle Chen, Hsiao-Chiang Chuang, Wei-Jung Chien, Yu-Chen Sun, Marta Karczewicz
-
Patent number: 10701366Abstract: An example device for decoding video data includes a memory configured to store video data, and a video decoder implemented in circuitry and configured to determine that motion information of a current block of the video data is to be derived using decoder-side motion vector derivation (DMVD), determine a pixels clue for the current block, the pixels clue comprising pixel data obtained from one or more groups of previously decoded pixels, derive the motion information for the current block according to DMVD from the pixels clue, and decode the current block using the motion information. The video decoder may generate the pixels clue using multiple hypothesis predictions from multiple motion compensated blocks. The video decoder may determine an inter-prediction direction for the motion information according to matching costs between different prediction directions. The video decoder may refine the motion information using a calculated matching cost for the pixels clue.Type: GrantFiled: February 20, 2018Date of Patent: June 30, 2020Assignee: Qualcomm IncorporatedInventors: Yi-Wen Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Jianle Chen, Xiang Li, Marta Karczewicz, Yu-Chen Sun
-
Patent number: 10652571Abstract: A video encoder performs an Advanced Motion Vector Prediction (AMVP) process for a current block of a current picture. As part of performing the AMVP process, the video encoder may determine whether local illumination compensation (LIC) is being applied in the AMVP process. Based on LIC being applied in the AMVP process, the video encoder may skip a bi-directional AMVP motion estimation process that sets a cost associated with encoding the current block using a bi-directional AMVP mode. Rather, the video encoder may set the cost to a maximum cost value.Type: GrantFiled: January 23, 2019Date of Patent: May 12, 2020Assignee: Qualcomm IncorporatedInventors: Nan Hu, Hsiao-Chiang Chuang, Xiang Li, Vijayaraghavan Thirumalai, Marta Karczewicz
-
Publication number: 20200145688Abstract: An example method includes determining, without receiving explicit signaling, whether motion compensation for a current block of a current picture of video data is to be performed using a four-parameter affine motion model (AMM) defined by two motion vectors (MVs) or using a six-parameter AMM defined by three MVs; deriving values of predictors for MVs of the AMM of the current block; decoding a representation of differences between the values of the MVs of the AMM for the current block and the values of the predictors; determining the values of the MVs of the AMM for the current block from the values of the predictors and the decoded differences; determining, based on the determined values of the MVs of the AMM for the current block of video data, a predictor block of video data; and reconstructing the current block based on the predictor block.Type: ApplicationFiled: January 6, 2020Publication date: May 7, 2020Inventors: Feng Zou, Jianle Chen, Marta Karczewicz, Xiang Li, Hsiao-Chiang Chuang, Wei-Jung Chien
-
Patent number: 10631002Abstract: Methods, apparatuses, and computer-readable medium are provided for a frame rate up-conversion coding mode, where a bilateral matching mode can be used to determine motion information. In various implementations, local illumination compensation is disallowed from being used for a block when a bilateral matching mode is used for the block. In various implementations, a bilateral matching mode is disallowed from being used when local illumination compensation is used for the block.Type: GrantFiled: September 28, 2017Date of Patent: April 21, 2020Assignee: QUALCOMM IncorporatedInventors: Xiang Li, Jianle Chen, Hsiao-Chiang Chuang, Marta Karczewicz
-
Patent number: 10609423Abstract: An example device includes a memory to store the video data, and processing circuitry in communication with the memory. The processing circuitry is configured to compare a value of a dimension of a current block of the stored video data to a value of a corresponding dimension of a neighboring block of the current block to obtain a relative dimension value. The processing circuitry is further configured to determine, based on the relative dimension value, that the current block is to be partitioned according to a prediction tree (PT) portion of a multi-type tree-based partitioning scheme. The PT portion comprises partitioning according to one of a binary tree structure or a center-side triple tree structure. The processing circuitry is further configured to partition, based on the determination, the current block according to the PT portion, to form a plurality of sub-blocks.Type: GrantFiled: September 6, 2017Date of Patent: March 31, 2020Assignee: QUALCOMM IncorporatedInventors: Hsiao-Chiang Chuang, Xiang Li, Jianle Chen, Feng Zou, Wei-Jung Chien, Yi-Wen Chen, Marta Karczewicz
-
Patent number: 10602180Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.Type: GrantFiled: June 8, 2018Date of Patent: March 24, 2020Assignee: Qualcomm IncorporatedInventors: Yi-Wen Chen, Marta Karczewicz, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin
-
Patent number: 10595035Abstract: Techniques related to decoder-side motion vector derivation (DMVD) are described. For example, this disclosure describes techniques related to applying one or more constraints to motion information, such as a motion vector (MV) derived by DMVD, and/or a MV difference between an initial MV and an MV derived by DMVD. When the constraint is applied to the DMVD, in certain examples, only the derived motion information which meets the constraint is regarded as valid motion information. Conditions may be placed on the constraints.Type: GrantFiled: March 21, 2018Date of Patent: March 17, 2020Assignee: QUALCOMM IncorporatedInventors: Marta Karczewicz, Yi-Wen Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Xiang Li, Jianle Chen
-
Patent number: 10560712Abstract: An example method includes obtaining, for a current block of video data, values of motion vectors (MVs) of an affine motion model of a neighboring block of video data; deriving, from the values of the MVs of the affine motion model of the neighboring block, values of predictors for MVs of an affine motion model of the current block; decoding, from a video bitstream, a representation of differences between the values of the MVs of the affine motion model for the current block and the values of the predictors; determining the values of the MVs of the affine motion model for the current block from the values of the predictors and the decoded differences; determining, based on the determined values of the MVs of the affine motion model for the current block, a predictor block of video data; and reconstructing the current block based on the predictor block.Type: GrantFiled: May 4, 2017Date of Patent: February 11, 2020Assignee: Qualcomm IncorporatedInventors: Feng Zou, Jianle Chen, Marta Karczewicz, Xiang Li, Hsiao-Chiang Chuang, Wei-Jung Chien
-
Patent number: 10523964Abstract: A video decoder can be configured to determine that a block of video data is encoded using a bi-directional inter prediction mode; determine that the block of video data is encoded using a bi-directional optical flow (BIO) process; inter predict the block of video data according to the bi-directional inter prediction mode; perform the BIO process for the block, wherein performing the BIO process for the block comprises determining a single motion vector refinement for a group of pixels in the block, wherein the group of pixels comprises at least two pixels; refine the group of pixels based on the single motion vector refinement; and output a BIO refined predictive block of video data comprising the refined group of pixels.Type: GrantFiled: March 12, 2018Date of Patent: December 31, 2019Assignee: QUALCOMM IncorporatedInventors: Hsiao-Chiang Chuang, Jianle Chen, Yi-Wen Chen, Xiang Li, Marta Karczewicz, Wei-Jung Chien
-
Patent number: 10491917Abstract: A device for decoding video data determines a block of video data is coded in an inter prediction mode; implicitly determines that a decoder-side motion vector derivation (DMVD) mode is enabled for the block of video data; determines motion information for the block of video data; uses the motion information to determine a reference block in accordance with the DMVD mode; and generates a predictive block for the block of video data based on the reference block.Type: GrantFiled: March 21, 2018Date of Patent: November 26, 2019Assignee: QUALCOMM IncorporatedInventors: Yi-Wen Chen, Kai Zhang, Xiang Li, Jianle Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Marta Karczewicz
-
Publication number: 20190320197Abstract: A video decoder is configured to determine a first motion vector for a first block of video data; perform motion vector refinement on the first motion vector for the first block to determine a refined motion vector for the first block of video data; determine that a second block of video data is coded in a mode that utilizes a motion vector associated with the first block as a motion vector predictor; in response to determining that the second block of video data is coded in the mode that utilizes the motion vector associated with the first block as a motion vector predictor and in response to performing the motion vector refinement on the first motion vector for the first block, use a different motion vector than the first refined motion vector as the motion vector predictor associated with the first block.Type: ApplicationFiled: April 15, 2019Publication date: October 17, 2019Inventors: Yi-Wen Chen, Wei-Jung Chien, Hsiao-Chiang Chuang, Marta Karczewicz
-
Publication number: 20190306506Abstract: A method of decoding video data including receiving a bitstream that includes a sequence of bits that forms a representation of a coded picture of the video data, partitioning the coded picture of the video data into a plurality of blocks using three or more different partition structures, and reconstructing the plurality of blocks of the coded picture of the video data. Partitioning the coded picture of the video data may include partitioning the coded picture of the video data into the plurality of blocks using a plurality partition structures. In some embodiments, partitioning is constrained to, for example, reduce memory bandwidth in implementations of video decoders.Type: ApplicationFiled: April 2, 2019Publication date: October 3, 2019Inventors: Yi-Wen CHEN, Hsiao-Chiang CHUANG, Wei-Jung CHIEN, Marta KARCZEWICZ