Patents by Inventor Shu Chiang

Shu Chiang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230209048
    Abstract: A video decoder that decodes a current block of pixels by using multi-hypothesis combined prediction mode is provided. The video decoder generates a first prediction of the current block based on an inter prediction mode. The video decoder enables the combined prediction mode for the current block based on a block size of the current block determined according to a width and a height of the current block. The combined prediction mode is disabled when the width of or the height of the current block is greater than a threshold length. When the combined prediction mode is enabled, the video decoder generates a second prediction based on an intra prediction mode that is inferred to be a planar mode, and subsequently a combined prediction for the current block based on the first prediction and the second prediction. The video decoder reconstructs the current block by using the combined prediction.
    Type: Application
    Filed: March 6, 2023
    Publication date: June 29, 2023
    Inventors: Man-Shu Chiang, Chih-Wei Hsu
  • Publication number: 20230209060
    Abstract: A method and apparatus for predictive coding. According to the method, combined prediction members are determined, where each of the combined prediction member includes a weighted sum of a first prediction candidate and a second prediction candidate using a target weighting selected from a weighting set. Boundary matching costs associated with the combined prediction members are determined, where each of the boundary matching costs is determined, for the combined prediction member with the target weighting, by using predicted samples of the current block based on the combined prediction member with the target weighting and neighbouring reconstructed samples of the current block. The current block is then encoded or decoded using a final combined prediction decided based on at least one of the boundary matching costs.
    Type: Application
    Filed: December 1, 2022
    Publication date: June 29, 2023
    Inventors: Man-Shu CHIANG, Chih-Wei HSU
  • Publication number: 20230209042
    Abstract: A method and apparatus for video coding. According to this method, a set of candidates associated with coding modes or coding parameters is determined. Boundary matching costs associated with the set of candidates are determined, where each of the boundary matching costs is determined, for one target candidate of the set of candidates, by using reconstructed or predicted samples of the current block and neighbouring reconstructed or predicted samples of the current block. The reconstructed or predicted samples of the current block are determined according to said one target candidate. The set of candidates are reordered according to the boundary matching costs. The current block is then encoded or decoded using a final candidate selected from the set of candidates based on reordered candidates of the set of candidates.
    Type: Application
    Filed: December 1, 2022
    Publication date: June 29, 2023
    Inventors: Man-Shu CHIANG, Chih-Wei HSU
  • Publication number: 20230199170
    Abstract: A video coding system generating candidates for Merge Mode with Motion Vector Difference (MMVD) with reduced resource usage is provided. The system receives data to be encoded or decoded as a current block of a current picture of a video. The system identifies multiple MMVD candidates for different offset positions based on a merge candidate of the current block. The system generates reference samples for the identified MMVD candidates. The system reconstructs the current block or encodes the current block into a bitstream by using the generated reference samples. The system processes the MMVD candidates in separate groups: a first group of vertical MMVD candidates and a second group of horizontal MMVD candidates. The system generates the reference samples for the identified MMVD candidates by applying a vertical filter to source reference samples of horizontal MMVD candidates and then applying a horizontal filter to outputs of the vertical filter.
    Type: Application
    Filed: October 31, 2022
    Publication date: June 22, 2023
    Inventors: Cheng-Yen Chuang, Man-Shu Chiang, Chun-Chia Chen, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang
  • Publication number: 20230199217
    Abstract: A video encoder receives raw pixel data to be encoded as a current block of a current picture of a video into a bitstream. The video encoder identifies multiple candidate bi-prediction positions for the current block, including a center position, a first set of offset positions, and a second set of offset positions. The first set of offset positions and the second set of offset positions interleave each other. The encoder computes distortion values for each of the candidate bi-prediction positions based on several possible weighting parameter values. The distortion values for the center position are based on each of the several possible weighting parameter values. The distortion values for the first set of offset positions are based on a first subset of the possible weighting parameter values. The distortion values for the second set of offset positions are based on a second subset of the possible weighting parameter values.
    Type: Application
    Filed: November 22, 2022
    Publication date: June 22, 2023
    Inventors: Cheng-Yen Chuang, Man-Shu Chiang, Yu-Ling Hsiao, Chun-Chia Chen, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang
  • Publication number: 20230130131
    Abstract: A method for video encoding and decoding using Low-Frequency Non-Separable Transform (LFNST) mode and apparatus thereof are disclosed. The input data correspond to primary transformed data at the encoder and the input data correspond to coded data of the current CU at the decoder. A CU is partitioned into one or more transform blocks (TBs). An LFNST syntax is determined at an encoder side or at a decoder side if one or more conditions are satisfied. The LFNST syntax indicates whether the LFNST mode is applied to the current CU and/or which LFNST kernel is applied when the LFNST mode is applied. The conditions comprise the CBF indications for the target TBs being false. The current CU is encoded or decoded according to the LFNST mode as indicated by the LFNST syntax.
    Type: Application
    Filed: February 24, 2021
    Publication date: April 27, 2023
    Inventors: Man-Shu CHIANG, Chih-Wei HSU, Tzu-Der CHUANG, Ching-Yeh CHEN
  • Patent number: 11632574
    Abstract: Video encoding or decoding methods and apparatuses receive input video data of a luma block and one or more corresponding chroma blocks, compare sizes of the luma and chroma blocks with a maximum transform skip size, and signal or parse a BDPCM luma enabling flag for the luma block when the size of the luma block is smaller than or equal to the maximum transform skip size, and signal or parse a BDPCM chroma enabling flag for the chroma block when the size of the chroma block is smaller than or equal to the maximum transform skip size. The size of the chroma block is derived from the size of the luma block and a color format sampling structure. The luma block is encoded/decoded by BDPCM based on the BDPCM luma enabling flag and the chroma block is encoded/decoded by BDPCM according to the BDPCM chroma enabling flag.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: April 18, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Tzu-Der Chuang, Chih-Wei Hsu
  • Patent number: 11616949
    Abstract: An intra prediction method comprises receiving input data of a current block in a current picture, deriving multiple Most Probable Modes (MPMs) to be included in a MPM list for the current block, setting remaining intra prediction modes as non-MPMs, and encoding or decoding the current block according to a current intra prediction mode selecting from the MPMs and non-MPMs. The first MPM in the MPM list is Planar mode for blocks coded or to be coded in intra prediction, and one or more other MPMs in the MPM list are derived according to a number of available angular mode of one or more neighboring blocks of the current block.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: March 28, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen, Mohammed Golam Sarwer
  • Patent number: 11616966
    Abstract: A video decoder receives data from a bitstream for a block of pixels to be decoded as a current block of a current picture of a video. The video decoder receives from the bitstream first and second signaled indices for the current block. The video decoder determines first and second merge indices from the first and second signaled indices. The video decoder uses the first and second merge indices to select first and second motion candidates, respectively. The video decoder generates a set of prediction samples in ALWIP mode and performs an inverse secondary transform and an inverse primary transform to generate a set of residual samples of the current block. Enabling or selection of secondary transform and/or primary transform depends on size, width, and/or height for the current block. The video decoder reconstructs the current block by using the set of residual samples and the set of prediction samples.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: March 28, 2023
    Inventors: Man-Shu Chiang, Chih-Wei Hsu
  • Patent number: 11553173
    Abstract: A video decoder receives to-be-decoded data from a bitstream for a block of pixels to be decoded as a current block of a current picture of the video. The video decoder generates a first prediction of the current block based on a first prediction mode that is selected from a first candidate list. The video decoder generates a second prediction of the current block based on a second prediction mode that is selected from a second candidate list. The video decoder generates a combined prediction for the current block based on the first prediction and the second prediction. The video decoder reconstructs the current block by using the combined prediction.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: January 10, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu
  • Patent number: 11546603
    Abstract: A video coder receives data from a bitstream for a block of pixels to be encoded or decoded as a current block of a current picture of a video. Upon determining that an applied block setting of the current block satisfies a threshold condition, the video coder generates a first prediction based on a first motion information for a first prediction unit of the current block. The video coder generates a second prediction based on a second motion information for a second prediction unit of the current block. The video coder generates a third prediction based on the first and second motion information for an overlap prediction region that is defined based on a partitioning between the first prediction unit and the second prediction unit. The video coder encodes or decodes the current block by using the first, second, and third predictions.
    Type: Grant
    Filed: July 28, 2021
    Date of Patent: January 3, 2023
    Inventors: Man-Shu Chiang, Chun-Chia Chen, Chih-Wei Hsu
  • Patent number: 11539940
    Abstract: A method and apparatus of prediction for video coding using MH (Multiple Hypothesis) mode are disclosed. According to this method, a block is partitioned into a first partition and a second partition. A first candidate and a second candidate are derived for the first and second partitions respectively. At least one of the first candidate and the second candidate is derived using a candidate list derived for a regular Merge mode (or also called as normal Merge mode). An MH prediction generated by blending a first prediction corresponding to a first candidate and a second prediction corresponding to a second candidate, and the MH prediction is applied to a part of the current block.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: December 27, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen
  • Publication number: 20220385946
    Abstract: In a method and apparatus for video coding using Low-Frequency Non-Separable Transform (LFNST) mode, a coding unit (CU) is partitioned into one or more transform blocks (TBs). A syntax is determined at an encoder side or at a decoder side, where the determining step is performed by signaling the syntax at the encoder side or by parsing the syntax at the decoder side if one or more conditions are satisfied. The syntax indicates whether the LFNST mode is applied to the current CU and/or which LFNST kernel is applied when the LFNSF is applied, and the conditions comprise a target condition corresponding to that all target TBs in a target TB set have a TS mode indication as false, and the target TB set is selected from the TBs in the current CU. The current CU is encoded or decoded according to the LFNST mode.
    Type: Application
    Filed: December 10, 2020
    Publication date: December 1, 2022
    Inventors: Man-Shu CHIANG, Tzu-Der CHUANG, Chih-Wei HSU, Ching-Yeh CHEN, Zhi-Yi LIN
  • Publication number: 20220360820
    Abstract: Video encoding or decoding methods and apparatuses receive input video data of a luma block and one or more corresponding chroma blocks, compare sizes of the luma and chroma blocks with a maximum transform skip size, and signal or parse a BDPCM luma enabling flag for the luma block when the size of the luma block is smaller than or equal to the maximum transform skip size, and signal or parse a BDPCM chroma enabling flag for the chroma block when the size of the chroma block is smaller than or equal to the maximum transform skip size. The size of the chroma block is derived from the size of the luma block and a color format sampling structure. The luma block is encoded/decoded by BDPCM based on the BDPCM luma enabling flag and the chroma block is encoded/decoded by BDPCM according to the BDPCM chroma enabling flag.
    Type: Application
    Filed: October 29, 2020
    Publication date: November 10, 2022
    Inventors: Man-Shu CHIANG, Tzu-Der CHUANG, Chih-Wei HSU
  • Publication number: 20220360824
    Abstract: A method and apparatus for video coding are disclosed. According to this method, a current block is received at an encoder side or compressed data comprising the current block is received at a decoder side, wherein the current block comprises one luma block and one or more chroma blocks, the current block is generated by partitioning an image area using a single partition tree into one or more partitioned blocks comprising the current block. A target coding mode is determined for the current block. The current block is then encoded or decoded according to the target coding mode, wherein an additional hypothesis of prediction for said one or more chroma blocks is disabled if the target coding mode corresponds to the multi-hypothesis prediction mode and width, height or area of said one or more chroma blocks is smaller than a threshold.
    Type: Application
    Filed: September 29, 2020
    Publication date: November 10, 2022
    Inventors: Man-Shu CHIANG, Chih-Wei HSU, Tzu-Der CHUANG
  • Patent number: 11477474
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to decode and/or encode video data. If the current coding block was using more than one hypotheses of prediction data to generate the prediction data, first prediction data is determined for a current coding block of a picture generated using a first prediction mode, and second prediction data is determined for the current coding block generated using a second prediction mode. Information derived from at least one of the first prediction mode and the second prediction mode can be stored. The stored information can be referenced by the subsequent coding blocks.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: October 18, 2022
    Assignee: MediaTek Inc.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu
  • Patent number: 11477444
    Abstract: A video processing method for a video encoder or decoder comprises receiving input data of a current chroma block in a current picture coded in a 4:2:2 color format, determining a luma mode of a luma block corresponding to the current chroma block, mapping the luma mode to a mapped intra mode of the current chroma block, selectively replacing the mapped intra mode by wide angle intra prediction mapping based on a width to height ratio of the current chroma block, deriving an intra predictor according to the mapped intra mode after wide angle intra prediction mapping, and encoding or decoding the current chroma block according to the intra predictor. The mapped intra mode is mode 57 when the luma mode is mode 61 and the mapped intra mode is mode 55 when the luma mode is mode 57.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: October 18, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Chia-Ming Tsai, Chih-Wei Hsu
  • Patent number: 11451816
    Abstract: A video coder implementing affine prediction is provided. The video coder receives input data associated with a current block to be coded. The video coder derives a control point motion vector (CPMV) of the current block according to an affine model. The video coder derives a set of motion compensation motion vectors (MCMVs) for a set of sub-blocks of the current block based on the derived CPMV of the current block according to the affine model. The video coder performs motion compensation for the current block based on the set of MCMVs. The CPMV of the current block is derived based on a CPMV of a first reference block that is a neighboring block located in a same region of the current block or an MCMV of a second reference block that is not a neighboring block located in the same region of the current block.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: September 20, 2022
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Man-Shu Chiang, Chih-Wei Hsu
  • Publication number: 20220279173
    Abstract: A video processing method for a video encoder or decoder comprises receiving input data of a current chroma block in a current picture coded in a 4:2:2 color format, determining a luma mode of a luma block corresponding to the current chroma block, mapping the luma mode to a mapped intra mode of the current chroma block, selectively replacing the mapped intra mode by wide angle intra prediction mapping based on a width to height ratio of the current chroma block, deriving an intra predictor according to the mapped intra mode after wide angle intra prediction mapping, and encoding or decoding the current chroma block according to the intra predictor. The mapped intra mode is mode 57 when the luma mode is mode 61 and the mapped intra mode is mode 55 when the luma mode is mode 57.
    Type: Application
    Filed: August 3, 2020
    Publication date: September 1, 2022
    Inventors: Man-Shu CHIANG, Chia-Ming TSAI, Chih-Wei HSU
  • Patent number: 11425378
    Abstract: A method and apparatus of prediction for video coding are disclosed. According to the method, when the Intra Sub-Partition (ISP) mode is applied to a block, the block is partitioned into multiple sub-blocks horizontally or vertically. A target horizontal transform and a target vertical transform are determined from a candidate transform set for each of the multiple sub-blocks according to a target setting belonging to a setting group comprising unified setting and block setting. The target horizontal transform and the target vertical transform selected are then applied to each of the multiple sub-blocks. According to another method, a target horizontal and vertical transform are determined from a candidate transform set without a transform index for the current block according to unified setting, wherein the unified setting comprises two or more Intra modes or Intra-related modes.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: August 23, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu