Patents by Inventor Tzu-Der Chuang

Tzu-Der Chuang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11909965
    Abstract: Methods and apparatus for Adaptive Loop Filter (ALF) processing of reconstructed video are disclosed. According to one implementation, a method receives reconstructed pixels of a current block and determines one or more clipping values for the ALF processing, wherein a target clipping value is always signaled at an encoder side or parsed at a decoder side even if the target clipping value is zero. The method then derives a current ALF output for the current block, wherein the current ALF output has a weighted sum of clipped differences and each of the original differences is calculated between a first reconstructed pixel at a non-center filter location and a center reconstructed pixel at a center filter location, and each of the original differences is clipped according to a corresponding clipping value to form one clipped difference. The method then provides filtered-reconstructed pixels.
    Type: Grant
    Filed: August 12, 2022
    Date of Patent: February 20, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Chen-Yen Lai, Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Patent number: 11895291
    Abstract: A method and apparatus of encoding or decoding for a coding system, where bi-directional CU (coding unit) weighting (BCW) is enabled for the coding system to allow using multiple pairs of weights, are disclosed. According to this method, a Merge candidate list is generated for the current block, where current bi-directional CU weights for a bi-directional predictor of the current block associated with a target Merge candidate in the Merge candidate list are set to a pre-define pair of weights when the target Merge candidate corresponds to a selected Merge candidate. In another method, current bi-directional CU weights for a bi-directional predictor associated with a target Merge candidate in the Merge candidate list are inherited from the target Merge candidate when the target Merge candidate corresponds to a selected Merge candidate.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: February 6, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Yu-Chi Su, Ching-Yeh Chen, Zhi-Yi Lin, Tzu-Der Chuang
  • Patent number: 11889056
    Abstract: Video processing methods comprise receiving input data of a current block in a current picture having a plurality of Virtual Pipeline Data Units (VPDUs), wherein each VDPU is a fixed size, performing a decoding process to decode Coding Units (CUs) in the current VPDU and generate decoded samples of the current VPDU, wherein each CU coded in a Current Picture Referencing (CPR) mode is decoded by fetching decoded samples in a reference block stored in a CPR referring buffer, and updating the CPR referring buffer by storing the decoded samples of the current VPDU when finishing the decoding process of the current VPDU, wherein the CPR referring buffer is updated one VPDU by one VPDU.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: January 30, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Chen-Yen Lai, Yu-Ling Hsiao, Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11889099
    Abstract: Exemplary video processing methods and apparatuses for encoding or decoding a current block by bi-directional prediction are disclosed. L0 and L1 reference blocks are determined for the current block, and a motion vector refinement is applied to refine the L0 and L1 reference blocks using a motion estimation search performed on each processing unit in the current block. A bi-directional optical flow operation is early terminated according to a cost of each processing unit in the current block. The processing units for cost calculation in the motion vector refinement and the bi-directional optical flow early termination are unified. The bi-directional optical flow operation is applied to the current block to further refine the L0 and L1 reference blocks if the bi-directional optical flow operation is not early terminated. A final inter predictor is derived from the refined L0 and L1 reference blocks for encoding or decoding the current block.
    Type: Grant
    Filed: March 2, 2020
    Date of Patent: January 30, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Ching-Yeh Chen, Tzu-Der Chuang
  • Patent number: 11882276
    Abstract: According to a method for Adaptive Loop Filter (ALF) processing of reconstructed video, multiple indicators are signaled in slice at an encoder side or parsed at a decoder side, where the multiple indicators are Adaptive Parameter Set (APS) indices associated with temporal ALF filter sets for the ALF processing. A current indicator is determined from the multiple indicators, where the current indicator is used to select a current ALF filter set. Filtered-reconstructed pixels are derived for the current block by applying the current ALF filter to the current block. In another method, if the ALF processing applied at a target sample requires an outside sample on other side of a target virtual boundary from the target sample, the outside sample is replaced by a padded sample.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: January 23, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Patent number: 11882290
    Abstract: According to one implementation, a method receives input data related to a current block in a current picture at a video encoder side or receiving a video bitstream comprising coded data of the current block at a video decoder side. When hen the MIP mode is applied to the current block, the method checks availability for a target reference boundary region comprising left reference boundary samples and top reference boundary samples, wherein the left reference boundary samples and the top reference boundary samples are checked jointly for the current block. The method further performs a padding process if an unavailable sample exists in the target reference boundary region, wherein the unavailable sample is padded with a default value or a sample value of an available sample and derives a reduced predictor, and encodes or decodes the current block using a MIP predictor derived from the reduced predictor.
    Type: Grant
    Filed: March 2, 2023
    Date of Patent: January 23, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu
  • Patent number: 11870991
    Abstract: Video processing methods include receiving input data of a current block in a current slice, determine determining whether one or more components of the current block satisfy one or more predefined criteria during partitioning, and applying a mode constraint to the current block only if the one or more components of the current block satisfy the one or more predefined criteria, wherein the mode constraint restricts all blocks within the current block to be processed by a same prediction mode when the current block is split into a plurality of blocks. The methods adaptively split the current block into one or more blocks, and pare one or more prediction mode syntax elements of a first block in the current block according to a constrained mode of the current block. The methods further encode the current block with the mode constraint.
    Type: Grant
    Filed: January 5, 2023
    Date of Patent: January 9, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chia-Ming Tsai
  • Patent number: 11870978
    Abstract: An intra prediction method comprises receiving input data of a current block in a current picture, deriving reference samples of the current block from boundary samples, selecting a matrix for the current block, generating intermediate predicted samples by multiplying the reference samples and the matrix, and clipping the intermediate predicted samples before up-sampling. The intra prediction method further comprises performing an up-sampling process on the clipped intermediate predicted samples to generate predicted samples for the current block, and encoding or decoding the current block according to the predicted samples of the current block.
    Type: Grant
    Filed: May 5, 2022
    Date of Patent: January 9, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11863757
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode or decode video data. A current block of video data is coded using affine prediction. A first set of candidates of a candidate list for the current block is generated, including determining one or more inherited candidates and deriving one or more constructed candidates. After generating the first set of candidates, it is determined whether the candidate list is full. Upon determining the candidate list is not full, the candidate list is filled by generating a second set of candidates of the candidate list, including one or more of generating one or more zero motion vector candidates, generating one or more additional derived candidates based on the plurality of associated neighboring blocks of the current block, and generating a temporal motion vector candidate based on a temporal collocated picture.
    Type: Grant
    Filed: September 1, 2021
    Date of Patent: January 2, 2024
    Assignee: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Zhi-Yi Lin
  • Patent number: 11856194
    Abstract: A method and apparatus of Inter prediction for video coding using a target Merge mode comprising a triangle Merge mode are disclosed. According to this method, a current block is partitioned into a first region and a second region using the target partition. A candidate list is determined. Two candidates are determined for the two regions by deriving two target candidates from the candidate list. When a selected target candidate is a uni-prediction candidate, the selected target candidate is used as one candidate; and when the selected target candidate is a bi-prediction candidate, motion information associated of the selected target candidate with List 0 or List 1 is used as one candidate. The current block or current motion information associated with the current block is encoded or decoded according to the candidate list. The candidate list is used to derive the first candidate and the second candidate.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: December 26, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Man-Shu Chiang, Tzu-Der Chuang, Chih-Wei Hsu, Ching-Yeh Chen
  • Patent number: 11856227
    Abstract: Video encoding methods and apparatuses in a video encoding system receive an input residual signal of a current block by a shared transform circuit, apply horizontal transform and vertical transform by a shared transform circuit to generate transform coefficients, apply quantization and inverse quantization to generate recovered transform coefficients, apply inverse vertical transform and inverse horizontal transform to the recovered transform coefficients by the shared transform circuit to generate a reconstructed residual signal for the current block, and encode the current block based on quantized levels of the current block. The shared transform circuit and a coefficient buffer in the folded 4-time transform architecture reuse computation resources in each transform stage. In some embodiments of the folded 4-time transform architecture, a hierarchical design for block size grouping is implemented with fixed throughput for uniform hardware scheduling.
    Type: Grant
    Filed: May 26, 2022
    Date of Patent: December 26, 2023
    Assignee: MEDIATEK INC.
    Inventors: Chih-Hsuan Lo, Man-Shu Chiang, Chun-Chia Chen, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang
  • Patent number: 11838557
    Abstract: Video encoding methods and apparatuses include receiving reconstructed video samples, determining an initial clipping setting for ALF coefficients, deriving clipping setting candidates from the initial clipping setting. ALF coefficients for the initial clipping setting and the clipping setting candidates are derived by solving inverse matrices, where partial intermediate results of solving ALF coefficients are shared by two or more clipping settings. A distortion value corresponds to the derived ALF coefficients for each clipping setting is computed, and final clipping indices for final ALF coefficients are determined according to the distortion values. ALF filtering is applied to the reconstructed video samples based on the final ALF coefficients and the final clipping indices.
    Type: Grant
    Filed: April 22, 2022
    Date of Patent: December 5, 2023
    Assignee: MEDIATEK INC.
    Inventors: Shih-Chun Chiu, Chih-Wei Hsu, Ching-Yeh Chen, Chun-Chia Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Publication number: 20230388546
    Abstract: Video encoding methods and apparatuses in a video encoding system receive an input residual signal of a current block by a shared transform circuit, apply horizontal transform and vertical transform by a shared transform circuit to generate transform coefficients, apply quantization and inverse quantization to generate recovered transform coefficients, apply inverse vertical transform and inverse horizontal transform to the recovered transform coefficients by the shared transform circuit to generate a reconstructed residual signal for the current block, and encode the current block based on quantized levels of the current block. The shared transform circuit and a coefficient buffer in the folded 4-time transform architecture reuse computation resources in each transform stage. In some embodiments of the folded 4-time transform architecture, a hierarchical design for block size grouping is implemented with fixed throughput for uniform hardware scheduling.
    Type: Application
    Filed: May 26, 2022
    Publication date: November 30, 2023
    Inventors: Chih-Hsuan LO, Man-Shu CHIANG, Chun-Chia CHEN, Chih-Wei HSU, Tzu-Der CHUANG, Ching-Yeh CHEN, Yu-Wen HUANG
  • Patent number: 11831928
    Abstract: A method and apparatus for video coding are disclosed. According to this method, a current block is received at an encoder side or compressed data comprising the current block is received at a decoder side, wherein the current block comprises one luma block and one or more chroma blocks, the current block is generated by partitioning an image area using a single partition tree into one or more partitioned blocks comprising the current block. A target coding mode is determined for the current block. The current block is then encoded or decoded according to the target coding mode, wherein an additional hypothesis of prediction for said one or more chroma blocks is disabled if the target coding mode corresponds to the multi-hypothesis prediction mode and width, height or area of said one or more chroma blocks is smaller than a threshold.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: November 28, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang
  • Patent number: 11818383
    Abstract: Video processing methods and apparatuses for coding a current block generate a final predictor by combining multiple predictors for the current block. A first predictor and a second predictor for the current block are generated by applying one or a combination of settings to the first, second, or both predictors. One or both the first and second predictors are generated from motion compensation. The final predictor is derived from the first and second predictors, and the current block is encoded or decoded according to the final predictor. The settings include supported-mode setting, combined-weight setting, applied-portion setting, motion information setting, precision setting, or a combination of the above settings.
    Type: Grant
    Filed: October 9, 2019
    Date of Patent: November 14, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen
  • Publication number: 20230362403
    Abstract: Video encoding or decoding methods and apparatuses include receiving input data associated with a current block in a current picture, determining a preload region in a reference picture shared by two or more coding configurations of affine prediction or motion compensation or by two or more affine refinement iterations, loading reference samples in the preload region, generating predictors for the current block, and encoding or decoding the current block according to the predictors. The predictors associated with the affine refinement iterations or coding configurations are generated based on some of the reference samples in the preload region.
    Type: Application
    Filed: May 4, 2022
    Publication date: November 9, 2023
    Inventors: Chih-Hsuan LO, Tzu-Der CHUANG, Ching-Yeh CHEN, Chun-Chia CHEN, Chih-Wei HSU, Yu-Wen HUANG
  • Patent number: 11805245
    Abstract: For each prediction candidate of a set of one or more prediction candidates of the current block, a video coder computes a matching cost between a set of reference pixels of the prediction candidate in a reference picture and a set of neighboring pixels of a current block in a current picture. The video coder identifies a subset of the reference pictures as major reference pictures based on a distribution of the prediction candidates among the reference pictures of the current picture. A bounding block is defined for each major reference picture, the bounding block encompassing at least portions of multiple sets of reference pixels for multiple prediction candidates. The video coder assigns an index to each prediction candidate based on the computed matching cost of the set of prediction candidates. A selection of a prediction candidate is signaled by using the assigned index of the selected prediction candidate.
    Type: Grant
    Filed: July 26, 2022
    Date of Patent: October 31, 2023
    Inventors: Chih-Yao Chiu, Chun-Chia Chen, Chih-Wei Hsu, Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Publication number: 20230345029
    Abstract: Method and apparatus for affine CPMV or ALF refinement are mentioned. According to this method, statistical data associated with the affine CPMV or ALF refinement are collected over a picture area. Updated parameters for the affine CPMV refinement or the ALF refinement are then derived based on the statistical data, where a process to derive the updated parameters includes performing multiplication using a reduced-precision multiplier for the statistical data. The reduced-precision multiplier truncates at least one bit of the mantissa part. In another embodiment, the process to derive the updated parameters includes performing reciprocal for the statistical data using a lookup table with (m?k)-bit input by truncating k bits from the m-bit mantissa part, and contents of the lookup table includes m-bit outputs. m and k are positive integers.
    Type: Application
    Filed: April 25, 2022
    Publication date: October 26, 2023
    Inventors: Shih-Chun CHIU, Tzu-Der CHUANG, Ching-Yeh CHEN, Chun-Chia CHEN, Chih-Wei HSU, Yu-Wen HUANG
  • Patent number: 11800102
    Abstract: Low-latency video coding methods and apparatuses include receiving input data associated with a current Intra slice composed of Coding Tree Units (CTU), where each CTU includes luma and chroma Coding Tree Blocks (CTBs), partitioning each CTB into non-overlapping pipeline units, and encoding or decoding the CTUs in the current Intra slices by performing processing of chroma pipeline units after beginning processing of luma pipeline units in at least one pipeline stage. Each of the pipeline units is processed by one pipeline stage after another pipeline stage, and different pipeline stages process different pipeline units simultaneously. The pipeline stage in the low-latency video coding methods and apparatuses simultaneously processes one luma pipeline unit and at least one previous chroma pipeline unit within one pipeline unit time interval.
    Type: Grant
    Filed: December 16, 2021
    Date of Patent: October 24, 2023
    Assignee: MEDIATEK INC.
    Inventors: Chia-Ming Tsai, Chun-Chia Chen, Chih-Wei Hsu, Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Patent number: 11792401
    Abstract: Method and apparatus of video coding are disclosed. According to one method, the left reference boundary samples and the top reference boundary samples are checked jointly. According to another method, selected original left reference boundary samples and selected original top reference boundary samples at specific positions are used for predictor up-sampling. According to yet another method, the horizontal interpolation and the vertical interpolation are in a fixed order regardless of a shape of the current block, size of the current block or both.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: October 17, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu