Patents by Inventor Tzu-Der Chuang

Tzu-Der Chuang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11546587
    Abstract: A method for signaling adaptive loop filter (ALF) settings is provided. A video decoder receives data from a bitstream for a block of pixels to be decoded as a current block of a current picture of a video. The video decoder parses whether to use adaptive parameter set (APS) for filtering the current block without determining whether to select a particular APS from a plurality of APSs. When the APS is used to filter the current block, the video decoder parses a first filter selection index for selecting a filter from a set of filters in the APS. When the APS is not used to filter the current block, the video decoder signals a second filter selection index for selecting a filter from a set of default fixed filters. The video decoder filters the current block based on the selected filter. The video decoder outputs the filtered current block.
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: January 3, 2023
    Inventors: Yu-Ling Hsiao, Chun-Chia Chen, Ching-Yeh Chen, Tzu-Der Chuang, Chih-Wei Hsu
  • Patent number: 11539939
    Abstract: Video processing methods and apparatuses for processing a current block in a current picture include receiving input data of the current block, determining a reference picture, determining whether picture sizes of the current and reference pictures are different, determining whether horizontal wraparound motion compensation is enabled for predicting the current block, performing motion compensation for the current block to obtain a reference block from the reference picture, and encoding or decoding the current block according to the reference block. Horizontal wraparound motion compensation is disabled when the picture sizes of the current and reference pictures are different.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: December 27, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Chih-Yao Chiu, Chun-Chia Chen, Chih-Wei Hsu, Ching-Yeh Chen, Yu-Wen Huang, Tzu-Der Chuang
  • Patent number: 11539977
    Abstract: A method and apparatus of Inter prediction for video coding using UMVE (Ultimate Motion Vector Expression) are disclosed. According to this method, a base candidate is selected from an original Inter candidate list, where the base candidate has a base prediction direction. One or more extended candidates are derived by adding one or more offsets to the base candidate, where said one or more extended candidates have a same prediction direction as the base prediction direction. The extended candidates are then inserted into the original Inter candidate list to form an extended Inter candidate list for encoding or decoding. According to another method, the UMVE mode is treated as an additional AMVP (Advanced Motion Vector Prediction) mode.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: December 27, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Chen-Yen Lai, Ching-Yeh Chen, Tzu-Der Chuang
  • Patent number: 11539940
    Abstract: A method and apparatus of prediction for video coding using MH (Multiple Hypothesis) mode are disclosed. According to this method, a block is partitioned into a first partition and a second partition. A first candidate and a second candidate are derived for the first and second partitions respectively. At least one of the first candidate and the second candidate is derived using a candidate list derived for a regular Merge mode (or also called as normal Merge mode). An MH prediction generated by blending a first prediction corresponding to a first candidate and a second prediction corresponding to a second candidate, and the MH prediction is applied to a part of the current block.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: December 27, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen
  • Publication number: 20220400287
    Abstract: Method and apparatus of coding VR360 video sequence are disclosed, wherein wraparound motion compensation is included as a coding tool. According to the method, a bitstream corresponding to encoded data of the VR360 video sequence is generated at an encoder side or received at a decoder side, where the bitstream comprises one or more PPS syntaxes related to wraparound motion compensation information in a PPS (Picture Parameter Set). The VR360 video sequence is encoded at the encoder side or decoded at the decoder side based on the wraparound motion compensation information.
    Type: Application
    Filed: November 13, 2020
    Publication date: December 15, 2022
    Inventors: Chih-Yao CHIU, Chun-Chia CHEN, Chih-Wei HSU, Ching-Yeh CHEN, Yu-Wen HUANG, Tzu-Der CHUANG
  • Publication number: 20220394246
    Abstract: Methods and apparatus for Adaptive Loop Filter (ALF) processing of reconstructed video are disclosed. According to one implementation, a method receives reconstructed pixels of a current block and determines one or more clipping values for the ALF processing, wherein a target clipping value is always signaled at an encoder side or parsed at a decoder side even if the target clipping value is zero. The method then derives a current ALF output for the current block, wherein the current ALF output has a weighted sum of clipped differences and each of the original differences is calculated between a first reconstructed pixel at a non-center filter location and a center reconstructed pixel at a center filter location, and each of the original differences is clipped according to a corresponding clipping value to form one clipped difference. The method then provides filtered-reconstructed pixels.
    Type: Application
    Filed: August 12, 2022
    Publication date: December 8, 2022
    Inventors: Chen-Yen LAI, Ching-Yeh CHEN, Tzu-Der CHUANG, Yu-Wen HUANG
  • Publication number: 20220385946
    Abstract: In a method and apparatus for video coding using Low-Frequency Non-Separable Transform (LFNST) mode, a coding unit (CU) is partitioned into one or more transform blocks (TBs). A syntax is determined at an encoder side or at a decoder side, where the determining step is performed by signaling the syntax at the encoder side or by parsing the syntax at the decoder side if one or more conditions are satisfied. The syntax indicates whether the LFNST mode is applied to the current CU and/or which LFNST kernel is applied when the LFNSF is applied, and the conditions comprise a target condition corresponding to that all target TBs in a target TB set have a TS mode indication as false, and the target TB set is selected from the TBs in the current CU. The current CU is encoded or decoded according to the LFNST mode.
    Type: Application
    Filed: December 10, 2020
    Publication date: December 1, 2022
    Inventors: Man-Shu CHIANG, Tzu-Der CHUANG, Chih-Wei HSU, Ching-Yeh CHEN, Zhi-Yi LIN
  • Patent number: 11516513
    Abstract: In one method, the current block is partitioned into multiple final sub-blocks using one or more stages of sub-tree partition comprising ternary tree partition and at least one other-type partition, where ternary partition tree is excluded from the sub-tree partition if a current sub-tree depth associated with a current sub-block is greater than a first threshold and the first threshold is an integer greater than or equal to 1. In another method, if a test condition is satisfied, the current block is encoded or decoded using a current Inter mode selected from a modified group of Inter tools, where the modified group of Inter tools is derived from an initial group of Inter tools by removing one or more first Inter tools from the initial group of Inter tools, replacing one or more second Inter tools with one or more complexity-reduced Inter tools, or both.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: November 29, 2022
    Assignee: MEDIATEK INC.
    Inventors: Chun-Chia Chen, Chia-Ming Tsai, Yu-Chi Su, Chen-Yen Lai, Chih-Wei Hsu, Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang, Han Huang
  • Patent number: 11509934
    Abstract: A method and apparatus for video coding incorporating enhanced multiple transform (EMT) are disclosed. According to one method, the number of candidates for EMT in the horizontal direction or vertical direction is reduced depending on the current block size. According to another method, an EMT flag, one or more EMT indices or both are signalled only if the total number of non-zero coefficients in at least a part of the 2D coefficient block is greater than a threshold, where the threshold is equal to 1 or larger. A method and apparatus for video coding using non-separable secondary transform (NSST) are disclosed. According to this method, a total number of non-zero first coefficients in a partial block of the 2D coefficient block is determined and used to determine whether to apply the NSST process.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: November 22, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Patent number: 11509938
    Abstract: Methods and apparatus for video coding are disclosed. According to one method, a bitstream is generated or received, where the bitstream includes a first syntax and a second syntax. The first syntax is related to a target number of bits used to represent a set of third syntaxes and each third syntax specifies one subpicture ID for one subpicture in a set of subpictures. The second syntax is related to a total number of subpictures in the set of subpicture, where a first number that can be represented by the target number of bits is equal to or greater than the total number of subpictures. According to another method, the subpicture ID syntaxes have different values for different subpictures.
    Type: Grant
    Filed: November 3, 2020
    Date of Patent: November 22, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Chen-Yen Lai, Shih-Ta Hsiang, Olena Chubach, Tzu-Der Chuang, Ching-Yeh Chen, Lulin Chen
  • Publication number: 20220368951
    Abstract: A method and apparatus for block partition in video encoding and decoding are disclosed. According to one method of the present invention, input data associated with a current block in a current picture are received, wherein the current block comprises a luma block and a chroma block to be encoded or decoded, and wherein a minimum block size is constrained to be no greater than a constrained minimum size for the luma block regardless of whether a dual partition tree or a single partition tree is used for the current block. The luma block is partitioned into one or more luma leaf blocks and the chroma block into one or more chroma leaf blocks using the dual partition tree or the single partition tree. Said one or more luma leaf blocks and said one or more chroma leaf blocks are encoded or decoded.
    Type: Application
    Filed: September 23, 2020
    Publication date: November 17, 2022
    Inventors: Tzu-Der CHUANG, Ching-Yeh CHEN, Chih-Wei HSU, Yu-Wen HUANG
  • Patent number: 11503329
    Abstract: A method and apparatus of Inter prediction for video coding are disclosed. According to one method, a sub-block motion vector prediction (MVP) mode is turned off for small size coding units (CUs). In another method, if the neighbouring reference block for a current coding unit (CU) is in a root CU region, the neighbouring reference block is not used to derive a Merge candidate or a modified neighbouring reference block on the shared boundary of the root CU is used to derive the Merge candidate for the current block. In yet another method, a shared sub-block Merge candidate list is derived for sub-CUs within a root CU region or an MER (Merge estimation region). If a neighbouring reference block is within the same MER as a current sub-CU, the neighbouring reference block is not used for deriving a candidate for the shared sub-CU Merge list.
    Type: Grant
    Filed: August 15, 2019
    Date of Patent: November 15, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Chun-Chia Chen, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11503300
    Abstract: Method and apparatus for coding system using affine motion model are disclosed. According to one method, a neighbouring block set of the current block comprising multiple spatial neighbouring blocks and one or more collocated blocks is determined for the current block. One or more constructed affine MVP candidates are derived for an affine MVP candidate list based on CP (control-point) MVs (motion vectors) at multiple spatial neighbouring blocks and said one or more collocated blocks. One constructed affine MVP candidate without one temporal MV is checked and inserted into the affine MVP candidate list before any constructed affine MV with one temporal MV. The current block or motion information of the current block is then encoded or decoded based on the affine MVP candidate list.
    Type: Grant
    Filed: May 24, 2019
    Date of Patent: November 15, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen
  • Publication number: 20220360820
    Abstract: Video encoding or decoding methods and apparatuses receive input video data of a luma block and one or more corresponding chroma blocks, compare sizes of the luma and chroma blocks with a maximum transform skip size, and signal or parse a BDPCM luma enabling flag for the luma block when the size of the luma block is smaller than or equal to the maximum transform skip size, and signal or parse a BDPCM chroma enabling flag for the chroma block when the size of the chroma block is smaller than or equal to the maximum transform skip size. The size of the chroma block is derived from the size of the luma block and a color format sampling structure. The luma block is encoded/decoded by BDPCM based on the BDPCM luma enabling flag and the chroma block is encoded/decoded by BDPCM according to the BDPCM chroma enabling flag.
    Type: Application
    Filed: October 29, 2020
    Publication date: November 10, 2022
    Inventors: Man-Shu CHIANG, Tzu-Der CHUANG, Chih-Wei HSU
  • Publication number: 20220360824
    Abstract: A method and apparatus for video coding are disclosed. According to this method, a current block is received at an encoder side or compressed data comprising the current block is received at a decoder side, wherein the current block comprises one luma block and one or more chroma blocks, the current block is generated by partitioning an image area using a single partition tree into one or more partitioned blocks comprising the current block. A target coding mode is determined for the current block. The current block is then encoded or decoded according to the target coding mode, wherein an additional hypothesis of prediction for said one or more chroma blocks is disabled if the target coding mode corresponds to the multi-hypothesis prediction mode and width, height or area of said one or more chroma blocks is smaller than a threshold.
    Type: Application
    Filed: September 29, 2020
    Publication date: November 10, 2022
    Inventors: Man-Shu CHIANG, Chih-Wei HSU, Tzu-Der CHUANG
  • Publication number: 20220353508
    Abstract: Methods and apparatus of video coding using sub-block based affine mode are disclosed. According to this method, control-point motion vectors (MVs) associated with the affine mode are determined for a block. A sub-block MV is derived for a target sub-block of the block from the control- point MVs for the block. A prediction offset is determined for a target pixel of the target sub-block using information comprising a pixel MV offset from the sub-block MV for the target pixel according to Prediction Refinement with Optical Flow (PROF). The target pixel of the target sub-block is encoded or decoded using a modified predictor. The modified prediction is generated by clipping the prediction offset to a target range and combining the clipped prediction offset with an original predictor.
    Type: Application
    Filed: September 22, 2020
    Publication date: November 3, 2022
    Inventors: Tzu-Der CHUANG, Ching-Yeh CHEN, Zhi-Yi LIN
  • Patent number: 11483575
    Abstract: A video coder that constrains the total number of regular bins used for entropy coding syntax elements of a current block is provided. The video coder entropy encodes or decodes the syntax elements selectively as either regular bins using context modeling or as bypass bins without context modeling. A constraint is specified to limit a total number of regular bins used for entropy coding the syntax elements of the current block. There may be no constraint limiting a number of regular bins specific to an individual syntax element of the current block.
    Type: Grant
    Filed: August 22, 2019
    Date of Patent: October 25, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Shih-Ta Hsiang, Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11477448
    Abstract: Methods and apparatus for Adaptive Loop Filter (ALF) processing of reconstructed video are disclosed. According to one method, clipping values for the ALF processing are determined depending on a bit depth of a center reconstructed pixel. A current ALF output for the current block is derived, where the current ALF output comprises a weighted sum of clipped differences of original differences and each of the original differences is calculated between a first reconstructed pixel at a non-center filter location and the center reconstructed pixel, and each of the original differences is clipped according to a corresponding clipping value to form one clipped difference. In another method, a target clipping value is always signaled at an encoder side or parsed at a decoder side even if the target clipping value is zero. In another method, the clipping values are encoded or decoded using a fixed-length code.
    Type: Grant
    Filed: January 21, 2020
    Date of Patent: October 18, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Chen-Yen Lai, Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Publication number: 20220329874
    Abstract: Encoding methods and apparatuses include receiving input video data of a current block in a current picture and applying a Cross-Component Adaptive Loop Filter (CCALF) processing on the current block based on cross-component filter coefficients to refine chroma components of the current block according to luma sample values. The method further includes signaling two Adaptive Loop Filter (ALF) signal flags and two CCALF signal flags in an Adaptation Parameter Set (APS) with an APS parameter type equal to ALF or parsing two ALF signal flags and two CCALF signal flags from an APS with an APS parameter type equal to ALF, signaling or parsing one or more Picture Header (PH) CCALF syntax elements or Slice Header (SH) CCALF syntax elements, wherein both ALF and CCALF signaling are present either in a PH or SH, and encoding or decoding the current block in the current picture.
    Type: Application
    Filed: June 28, 2022
    Publication date: October 13, 2022
    Inventors: Ching-Yeh CHEN, Olena CHUBACH, Chen-Yen LAI, Tzu-Der CHUANG, Chih-Wei HSU, Yu-Wen HUANG
  • Patent number: 11470356
    Abstract: A method and apparatus of video encoding video coding for a video encoder or decoder using Neural Network (NN) are disclosed. According to this method, the multiple frames in a video sequence comprises multiple segments, where each of the multiple segments comprises a set of frames. The NN (Neural Network) processing is applied to a target signal in one or more encoded frames of a target segment in the encoder side or to the target signal in one or more decoded frames of the target segment in the decoder side using one NN parameter set for the target segment. The target signal may correspond to reconstructed residual, reconstructed output, de-blocked output, SAO (sample adaptive offset) output, ALF (adaptive loop filter) output, or a combination thereof. In another embodiment, the NN processing is applied to a target signal only in one or more specific encoded or decoded frames.
    Type: Grant
    Filed: April 16, 2019
    Date of Patent: October 11, 2022
    Assignee: MEDIATEK INC.
    Inventors: Yu-Ling Hsiao, Yu-Chi Su, Jan Klopp, Ching-Yeh Chen, Tzu-Der Chuang, Chih-Wei Hsu, Yu-Wen Huang