Patents Assigned to HFI Innovation Inc.
  • Patent number: 11778235
    Abstract: A method for performing transform skip mode (TSM) in a video decoder is provided. A video decoder receives data from a bitstream to be decoded as a plurality of video pictures. The video decoder parses the bitstream for a first syntax element in a sequence parameter set (SPS) of a current sequence of video pictures. When the first syntax element indicates that transform skip mode is allowed for the current sequence of video pictures and when transform skip mode is used for a current block in a current picture of the current sequence, the video decoder reconstructs the current block by using quantized residual signals that are not transformed.
    Type: Grant
    Filed: April 11, 2022
    Date of Patent: October 3, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Shih-Ta Hsiang, Lulin Chen, Tzu-Der Chuang, Chih-Wei Hsu, Ching-Yeh Chen, Olena Chubach, Yu-Wen Huang
  • Publication number: 20230300370
    Abstract: Method and apparatus of Inter prediction for video coding are disclosed. When a sub-block motion compensation coding tool is selected for the current block, the method generates sub-block MVs (motion vectors) associated with multiple sub-blocks, which are included or contained in the current block, according to the sub-block motion compensation coding tool, constrains the sub-block MVs within a range to form constrained sub-block MVs, and applies motion compensation to the current block using the constrained sub-block MVs or applies motion compensation to the current block using one sub-block MV within the range around the primary MV in a second list if a corresponding sub-block MV in a first list is outside the range. In another method, motion compensation is applied to the current block only using reference pixels of reference sub-blocks within a primary reference block.
    Type: Application
    Filed: May 30, 2023
    Publication date: September 21, 2023
    Applicant: HFI INNOVATION INC.
    Inventors: Tzu-Der CHUANG, Ching-Yeh CHEN, Yu-Wen HUANG, Chih-Wei HSU
  • Publication number: 20230300373
    Abstract: An image or video processing method comprises receiving input data of a current block, mapping an MIP mode index to a default mode, and encoding or decoding the current block by referencing the default mode. Another image or video processing method comprises receiving input data of a current block coded or to be coded by an MIP mode, and parsing or signaling a transpose flag for the current block indicating whether transposing is applied in coding the current block. Reference samples of the current block are prepared from neighboring boundary samples according to the transpose flag. A matrix is selected to be multiplied to the reference samples to generate predicted samples. A transposing process is adaptively applied to the current block according to the transpose flag, and the predicted samples are used to encode or decode the current block.
    Type: Application
    Filed: May 22, 2023
    Publication date: September 21, 2023
    Applicant: HFI Innovation Inc.
    Inventors: Zhi-Yi LIN, Tzu-Der CHUANG, Ching-Yeh CHEN, Chih-Wei HSU
  • Patent number: 11765365
    Abstract: Method and apparatus for constrained de-blocking filter are disclosed. One method receives input data related to a current block in a current picture at a video encoder side or a video bitstream determines a block boundary of the current block and sub-block boundaries inside the current block, wherein the current block is partitioned into a plurality of sub-blocks using sub-block mode prediction. The method then applies de-blocking process to a reconstructed current block corresponding to the current block to result in a current filtered-reconstructed block, wherein said applying the de-blocking process to the current block comprises applying the de-blocking process to the sub-block boundaries inside the current filtered-reconstructed block, and generates a filtered decoded picture including the current filtered-reconstructed block.
    Type: Grant
    Filed: April 11, 2022
    Date of Patent: September 19, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Chia-Ming Tsai, Chih-Wei Hsu, Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Patent number: 11765384
    Abstract: Methods and apparatus of motion compensation using the bi-directional optical flow (BIO) techniques are disclosed. According to one method of the present invention, the BIO process is applied to encode or decode bi-directional current block in Merge mode only or in AMVP (advanced motion vector prediction) mode only. According to another method, the BIO process conditionally to encode or decode the current block depending on a jointly-coded flag if the current block is coded using a bi-prediction mode. According to yet another method, x-offset value vx and y-offset value vy for the current block are added to the current motion vector to form a final motion vector. The final motion vector is then used as a reference motion vector for following blocks. In still yet another method, the BIO process is applied to the chroma component.
    Type: Grant
    Filed: August 2, 2021
    Date of Patent: September 19, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
  • Patent number: 11758193
    Abstract: A method for for signaling high-level information in image and video coding is provided. A video decoder receives data from a bitstream to be decoded as a current picture of a video. The video decoder parses a picture header of the current picture that includes a set of one or more slice information syntax elements in the picture header for indicating presence of one or more types of slices that are present in the current picture. The video decoder reconstructs the slices of the current picture by using the set of slice information syntax elements.
    Type: Grant
    Filed: November 2, 2020
    Date of Patent: September 12, 2023
    Assignee: HFI INNOVATION INC.
    Inventor: Shih-Ta Hsiang
  • Patent number: 11750841
    Abstract: Video processing methods and apparatuses in a video encoding or decoding system for processing residual data of transform blocks. A current transform block in a video picture is divided into multiple sub-blocks, and each sub-block in the current transform block is entropy encoded or decoded using multiple sub-block coding passes. Each transform coefficient level in each sub-block is visited once according to a pre-defined scanning order in each sub-block coding pass. Two or more syntax elements associated with transform coefficient levels in the current transform block are aggregated and coded in one single sub-block coding pass. The video processing method is applied if the current transform block contains at least one non-zero transform coefficient level and the current transform block is coded in Transform Skip Mode (TSM) according to some embodiments.
    Type: Grant
    Filed: October 26, 2022
    Date of Patent: September 5, 2023
    Assignee: HFI INNOVATION INC.
    Inventor: Shih-Ta Hsiang
  • Patent number: 11750832
    Abstract: Aspects of the disclosure provide a method and an apparatus for video coding. A processing circuitry determines a process unit size for a decoder-side motion vector refinement (DMVR). Then, the processing circuitry enables an application of the DMVR on a current block when a size of the current block is smaller than or equal to the process unit size; and disables the application of the DMVR on the current block when the size of the current block is larger than the process unit size. In an example, the application of the DMVR refines the motion vectors with or without a template block.
    Type: Grant
    Filed: October 23, 2018
    Date of Patent: September 5, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Yu-Chi Su, Chen-Yen Lai, Ching-Yeh Chen
  • Patent number: 11743458
    Abstract: Methods and apparatus for in-loop processing of reconstructed video are disclosed. According to one method, a virtual boundary is determined for to-be-processed pixels in the current picture, where the virtual boundary is aligned with block boundaries and at least one to-be-processed pixel on a first side of the virtual boundary requires one or more second pixels on a second side of the virtual boundary. According to the method, the in-loop processing is modified if a target to-be-processed pixel requires at least one second pixel from the second side of the virtual boundary and the modified in-loop processing eliminates the need for any second pixel on the second side of the virtual boundary. According to another method, the operations of block classification are changed when part of the required pixels in one 10×10 window used in classification are at the other side of virtual boundaries.
    Type: Grant
    Filed: October 18, 2019
    Date of Patent: August 29, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Ching-Yeh Chen, Tzu-Der Chuang, Yu-Chi Su, Chih-Wei Hsu, Yu-Wen Huang
  • Publication number: 20230269373
    Abstract: A methods and apparatus for adaptive data dependency between corresponding blocks partitioned from separate partition trees according to an embodiment of the present invention are disclosed. The data dependency between different tree structures is allowed when the tree structures are mutually inclusive. When the splitting is not used in one tree or when splitting is used in one tree and the same splitting or no split is used in the other tree, the data dependency between different tree structures is allowed. When the splitting in different tree structures are different, then the data dependency between different tree structures is disallowed. For each leaf CU in chroma tree, it should include one or more complete luma leaf CUs or it is completely included in one luma leaf CU, when the data dependency between different tree structures is allowed. Otherwise, then the data dependency between different tree structures is disallowed.
    Type: Application
    Filed: May 2, 2023
    Publication date: August 24, 2023
    Applicant: HFI INNOVATION INC.
    Inventors: Tzu-Der CHUANG, Chih-Wei HSU, Ching-Yeh CHEN
  • Patent number: 11711513
    Abstract: Video processing methods and apparatuses include receiving input video data associated with a current picture composed of multiple Coding Tree Units (CTUs) for encoding or decoding, determining a number of subpictures, partitioning the current picture into one or more subpictures, and encoding or decoding each subpicture in the current picture. Each subpicture contains multiple complete CTUs and boundaries of each subpicture are aligned with grids of the current picture in units of CTUs. The number of subpictures in the current picture is limited by an allowed maximum number of slices.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: July 25, 2023
    Assignee: HFI INNOVATION INC.
    Inventor: Shih-Ta Hsiang
  • Patent number: 11700395
    Abstract: An image or video processing method comprises receiving input data of a current block, mapping an MIP mode index to a default mode, and encoding or decoding the current block by referencing the default mode. Another image or video processing method comprises receiving input data of a current block coded or to be coded by an MIP mode, and parsing or signaling a transpose flag for the current block indicating whether transposing is applied in coding the current block. Reference samples of the current block are prepared from neighboring boundary samples according to the transpose flag. A matrix is selected to be multiplied to the reference samples to generate predicted samples. A transposing process is adaptively applied to the current block according to the transpose flag, and the predicted samples are used to encode or decode the current block.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: July 11, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu
  • Patent number: 11700391
    Abstract: Method and apparatus of Inter prediction for video coding are disclosed. When a sub-block motion compensation coding tool is selected for the current block, the method generates sub-block MVs (motion vectors) associated with multiple sub-blocks, which are included or contained in the current block, according to the sub-block motion compensation coding tool, constrains the sub-block MVs within a range to form constrained sub-block MVs, and applies motion compensation to the current block using the constrained sub-block MVs or applies motion compensation to the current block using one sub-block MV within the range around the primary MV in a second list if a corresponding sub-block MV in a first list is outside the range. In another method, motion compensation is applied to the current block only using reference pixels of reference sub-blocks within a primary reference block.
    Type: Grant
    Filed: May 17, 2018
    Date of Patent: July 11, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang, Chih-Wei Hsu
  • Publication number: 20230188745
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to receive compressed video data, wherein the compressed video data is related to a set of frames. A decoder-side predictor refinement technique is used to calculate a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. An existing motion vector associated with a different frame from a motion vector buffer is retrieved. The new motion vector is calculated based on the existing motion vector using a decoder-side motion vector prediction technique, such that the existing motion vector is in the motion vector buffer after calculating the new motion vector.
    Type: Application
    Filed: February 10, 2023
    Publication date: June 15, 2023
    Applicant: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang
  • Patent number: 11665345
    Abstract: A methods and apparatus for adaptive data dependency between corresponding blocks partitioned from separate partition trees according to an embodiment of the present invention are disclosed. The data dependency between different tree structures is allowed when the tree structures are mutually inclusive. When the splitting is not used in one tree or when splitting is used in one tree and the same splitting or no split is used in the other tree, the data dependency between different tree structures is allowed. When the splitting in different tree structures are different, then the data dependency between different tree structures is disallowed. For each leaf CU in chroma tree, it should include one or more complete luma leaf CUs or it is completely included in one luma leaf CU, when the data dependency between different tree structures is allowed. Otherwise, then the data dependency between different tree structures is disallowed.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: May 30, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Tzu-Der Chuang, Chih-Wei Hsu, Ching-Yeh Chen
  • Patent number: 11641465
    Abstract: Methods and apparatus for loop-filter processing of reconstructed video are disclosed. According to this method, if a loop-filter is disallowed for a target boundary, the target loop filter is disabled at top, bottom, left and right of the target boundary. According to another method, CC-ALF (cross-component adaptive loop filter) shape is changed across a virtual boundary. According to yet another method, CC-ALF and luma ALF handle unavailable samples in a same way.
    Type: Grant
    Filed: July 22, 2020
    Date of Patent: May 2, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Chen-Yen Lai, Ching-Yeh Chen, Tzu-Der Chuang
  • Publication number: 20230131291
    Abstract: According to a method for Adaptive Loop Filter (ALF) processing of reconstructed video, multiple indicators are signaled in slice at an encoder side or parsed at a decoder side, where the multiple indicators are Adaptive Parameter Set (APS) indices associated with temporal ALF filter sets for the ALF processing. A current indicator is determined from the multiple indicators, where the current indicator is used to select a current ALF filter set. Filtered-reconstructed pixels are derived for the current block by applying the current ALF filter to the current block. In another method, if the ALF processing applied at a target sample requires an outside sample on other side of a target virtual boundary from the target sample, the outside sample is replaced by a padded sample.
    Type: Application
    Filed: December 22, 2022
    Publication date: April 27, 2023
    Applicant: HFI INNOVATION INC.
    Inventors: Ching-Yeh CHEN, Tzu-Der CHUANG, Yu-Wen HUANG
  • Patent number: 11638027
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to receive compressed video data, wherein the compressed video data is related to a set of frames. A decoder-side predictor refinement technique is used to calculate a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. An existing motion vector associated with a different frame from a motion vector buffer is retrieved. The new motion vector is calculated based on the existing motion vector using a decoder-side motion vector prediction technique, such that the existing motion vector is in the motion vector buffer after calculating the new motion vector.
    Type: Grant
    Filed: August 7, 2017
    Date of Patent: April 25, 2023
    Assignee: HFI Innovation, Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang
  • Patent number: 11632574
    Abstract: Video encoding or decoding methods and apparatuses receive input video data of a luma block and one or more corresponding chroma blocks, compare sizes of the luma and chroma blocks with a maximum transform skip size, and signal or parse a BDPCM luma enabling flag for the luma block when the size of the luma block is smaller than or equal to the maximum transform skip size, and signal or parse a BDPCM chroma enabling flag for the chroma block when the size of the chroma block is smaller than or equal to the maximum transform skip size. The size of the chroma block is derived from the size of the luma block and a color format sampling structure. The luma block is encoded/decoded by BDPCM based on the BDPCM luma enabling flag and the chroma block is encoded/decoded by BDPCM according to the BDPCM chroma enabling flag.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: April 18, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Tzu-Der Chuang, Chih-Wei Hsu
  • Patent number: 11632550
    Abstract: Method and apparatus of video coding are disclosed. According to one method, the left reference boundary samples and the top reference boundary samples are checked jointly. According to another method, selected original left reference boundary samples and selected original top reference boundary samples at specific positions are used for predictor up-sampling. According to yet another method, the horizontal interpolation and the vertical interpolation are in a fixed order regardless of a shape of the current block, size of the current block or both.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: April 18, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu