Patents Assigned to HFI Innovation Inc.
-
Patent number: 11778235Abstract: A method for performing transform skip mode (TSM) in a video decoder is provided. A video decoder receives data from a bitstream to be decoded as a plurality of video pictures. The video decoder parses the bitstream for a first syntax element in a sequence parameter set (SPS) of a current sequence of video pictures. When the first syntax element indicates that transform skip mode is allowed for the current sequence of video pictures and when transform skip mode is used for a current block in a current picture of the current sequence, the video decoder reconstructs the current block by using quantized residual signals that are not transformed.Type: GrantFiled: April 11, 2022Date of Patent: October 3, 2023Assignee: HFI INNOVATION INC.Inventors: Shih-Ta Hsiang, Lulin Chen, Tzu-Der Chuang, Chih-Wei Hsu, Ching-Yeh Chen, Olena Chubach, Yu-Wen Huang
-
Publication number: 20230300370Abstract: Method and apparatus of Inter prediction for video coding are disclosed. When a sub-block motion compensation coding tool is selected for the current block, the method generates sub-block MVs (motion vectors) associated with multiple sub-blocks, which are included or contained in the current block, according to the sub-block motion compensation coding tool, constrains the sub-block MVs within a range to form constrained sub-block MVs, and applies motion compensation to the current block using the constrained sub-block MVs or applies motion compensation to the current block using one sub-block MV within the range around the primary MV in a second list if a corresponding sub-block MV in a first list is outside the range. In another method, motion compensation is applied to the current block only using reference pixels of reference sub-blocks within a primary reference block.Type: ApplicationFiled: May 30, 2023Publication date: September 21, 2023Applicant: HFI INNOVATION INC.Inventors: Tzu-Der CHUANG, Ching-Yeh CHEN, Yu-Wen HUANG, Chih-Wei HSU
-
Publication number: 20230300373Abstract: An image or video processing method comprises receiving input data of a current block, mapping an MIP mode index to a default mode, and encoding or decoding the current block by referencing the default mode. Another image or video processing method comprises receiving input data of a current block coded or to be coded by an MIP mode, and parsing or signaling a transpose flag for the current block indicating whether transposing is applied in coding the current block. Reference samples of the current block are prepared from neighboring boundary samples according to the transpose flag. A matrix is selected to be multiplied to the reference samples to generate predicted samples. A transposing process is adaptively applied to the current block according to the transpose flag, and the predicted samples are used to encode or decode the current block.Type: ApplicationFiled: May 22, 2023Publication date: September 21, 2023Applicant: HFI Innovation Inc.Inventors: Zhi-Yi LIN, Tzu-Der CHUANG, Ching-Yeh CHEN, Chih-Wei HSU
-
Patent number: 11765365Abstract: Method and apparatus for constrained de-blocking filter are disclosed. One method receives input data related to a current block in a current picture at a video encoder side or a video bitstream determines a block boundary of the current block and sub-block boundaries inside the current block, wherein the current block is partitioned into a plurality of sub-blocks using sub-block mode prediction. The method then applies de-blocking process to a reconstructed current block corresponding to the current block to result in a current filtered-reconstructed block, wherein said applying the de-blocking process to the current block comprises applying the de-blocking process to the sub-block boundaries inside the current filtered-reconstructed block, and generates a filtered decoded picture including the current filtered-reconstructed block.Type: GrantFiled: April 11, 2022Date of Patent: September 19, 2023Assignee: HFI INNOVATION INC.Inventors: Chia-Ming Tsai, Chih-Wei Hsu, Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
-
Patent number: 11765384Abstract: Methods and apparatus of motion compensation using the bi-directional optical flow (BIO) techniques are disclosed. According to one method of the present invention, the BIO process is applied to encode or decode bi-directional current block in Merge mode only or in AMVP (advanced motion vector prediction) mode only. According to another method, the BIO process conditionally to encode or decode the current block depending on a jointly-coded flag if the current block is coded using a bi-prediction mode. According to yet another method, x-offset value vx and y-offset value vy for the current block are added to the current motion vector to form a final motion vector. The final motion vector is then used as a reference motion vector for following blocks. In still yet another method, the BIO process is applied to the chroma component.Type: GrantFiled: August 2, 2021Date of Patent: September 19, 2023Assignee: HFI INNOVATION INC.Inventors: Ching-Yeh Chen, Tzu-Der Chuang, Yu-Wen Huang
-
Patent number: 11758193Abstract: A method for for signaling high-level information in image and video coding is provided. A video decoder receives data from a bitstream to be decoded as a current picture of a video. The video decoder parses a picture header of the current picture that includes a set of one or more slice information syntax elements in the picture header for indicating presence of one or more types of slices that are present in the current picture. The video decoder reconstructs the slices of the current picture by using the set of slice information syntax elements.Type: GrantFiled: November 2, 2020Date of Patent: September 12, 2023Assignee: HFI INNOVATION INC.Inventor: Shih-Ta Hsiang
-
Patent number: 11750841Abstract: Video processing methods and apparatuses in a video encoding or decoding system for processing residual data of transform blocks. A current transform block in a video picture is divided into multiple sub-blocks, and each sub-block in the current transform block is entropy encoded or decoded using multiple sub-block coding passes. Each transform coefficient level in each sub-block is visited once according to a pre-defined scanning order in each sub-block coding pass. Two or more syntax elements associated with transform coefficient levels in the current transform block are aggregated and coded in one single sub-block coding pass. The video processing method is applied if the current transform block contains at least one non-zero transform coefficient level and the current transform block is coded in Transform Skip Mode (TSM) according to some embodiments.Type: GrantFiled: October 26, 2022Date of Patent: September 5, 2023Assignee: HFI INNOVATION INC.Inventor: Shih-Ta Hsiang
-
Patent number: 11750832Abstract: Aspects of the disclosure provide a method and an apparatus for video coding. A processing circuitry determines a process unit size for a decoder-side motion vector refinement (DMVR). Then, the processing circuitry enables an application of the DMVR on a current block when a size of the current block is smaller than or equal to the process unit size; and disables the application of the DMVR on the current block when the size of the current block is larger than the process unit size. In an example, the application of the DMVR refines the motion vectors with or without a template block.Type: GrantFiled: October 23, 2018Date of Patent: September 5, 2023Assignee: HFI INNOVATION INC.Inventors: Yu-Chi Su, Chen-Yen Lai, Ching-Yeh Chen
-
Patent number: 11743458Abstract: Methods and apparatus for in-loop processing of reconstructed video are disclosed. According to one method, a virtual boundary is determined for to-be-processed pixels in the current picture, where the virtual boundary is aligned with block boundaries and at least one to-be-processed pixel on a first side of the virtual boundary requires one or more second pixels on a second side of the virtual boundary. According to the method, the in-loop processing is modified if a target to-be-processed pixel requires at least one second pixel from the second side of the virtual boundary and the modified in-loop processing eliminates the need for any second pixel on the second side of the virtual boundary. According to another method, the operations of block classification are changed when part of the required pixels in one 10×10 window used in classification are at the other side of virtual boundaries.Type: GrantFiled: October 18, 2019Date of Patent: August 29, 2023Assignee: HFI INNOVATION INC.Inventors: Ching-Yeh Chen, Tzu-Der Chuang, Yu-Chi Su, Chih-Wei Hsu, Yu-Wen Huang
-
Publication number: 20230269373Abstract: A methods and apparatus for adaptive data dependency between corresponding blocks partitioned from separate partition trees according to an embodiment of the present invention are disclosed. The data dependency between different tree structures is allowed when the tree structures are mutually inclusive. When the splitting is not used in one tree or when splitting is used in one tree and the same splitting or no split is used in the other tree, the data dependency between different tree structures is allowed. When the splitting in different tree structures are different, then the data dependency between different tree structures is disallowed. For each leaf CU in chroma tree, it should include one or more complete luma leaf CUs or it is completely included in one luma leaf CU, when the data dependency between different tree structures is allowed. Otherwise, then the data dependency between different tree structures is disallowed.Type: ApplicationFiled: May 2, 2023Publication date: August 24, 2023Applicant: HFI INNOVATION INC.Inventors: Tzu-Der CHUANG, Chih-Wei HSU, Ching-Yeh CHEN
-
Patent number: 11711513Abstract: Video processing methods and apparatuses include receiving input video data associated with a current picture composed of multiple Coding Tree Units (CTUs) for encoding or decoding, determining a number of subpictures, partitioning the current picture into one or more subpictures, and encoding or decoding each subpicture in the current picture. Each subpicture contains multiple complete CTUs and boundaries of each subpicture are aligned with grids of the current picture in units of CTUs. The number of subpictures in the current picture is limited by an allowed maximum number of slices.Type: GrantFiled: June 10, 2021Date of Patent: July 25, 2023Assignee: HFI INNOVATION INC.Inventor: Shih-Ta Hsiang
-
Patent number: 11700395Abstract: An image or video processing method comprises receiving input data of a current block, mapping an MIP mode index to a default mode, and encoding or decoding the current block by referencing the default mode. Another image or video processing method comprises receiving input data of a current block coded or to be coded by an MIP mode, and parsing or signaling a transpose flag for the current block indicating whether transposing is applied in coding the current block. Reference samples of the current block are prepared from neighboring boundary samples according to the transpose flag. A matrix is selected to be multiplied to the reference samples to generate predicted samples. A transposing process is adaptively applied to the current block according to the transpose flag, and the predicted samples are used to encode or decode the current block.Type: GrantFiled: June 24, 2020Date of Patent: July 11, 2023Assignee: HFI Innovation Inc.Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu
-
Patent number: 11700391Abstract: Method and apparatus of Inter prediction for video coding are disclosed. When a sub-block motion compensation coding tool is selected for the current block, the method generates sub-block MVs (motion vectors) associated with multiple sub-blocks, which are included or contained in the current block, according to the sub-block motion compensation coding tool, constrains the sub-block MVs within a range to form constrained sub-block MVs, and applies motion compensation to the current block using the constrained sub-block MVs or applies motion compensation to the current block using one sub-block MV within the range around the primary MV in a second list if a corresponding sub-block MV in a first list is outside the range. In another method, motion compensation is applied to the current block only using reference pixels of reference sub-blocks within a primary reference block.Type: GrantFiled: May 17, 2018Date of Patent: July 11, 2023Assignee: HFI INNOVATION INC.Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang, Chih-Wei Hsu
-
Publication number: 20230188745Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to receive compressed video data, wherein the compressed video data is related to a set of frames. A decoder-side predictor refinement technique is used to calculate a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. An existing motion vector associated with a different frame from a motion vector buffer is retrieved. The new motion vector is calculated based on the existing motion vector using a decoder-side motion vector prediction technique, such that the existing motion vector is in the motion vector buffer after calculating the new motion vector.Type: ApplicationFiled: February 10, 2023Publication date: June 15, 2023Applicant: HFI Innovation Inc.Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang
-
Patent number: 11665345Abstract: A methods and apparatus for adaptive data dependency between corresponding blocks partitioned from separate partition trees according to an embodiment of the present invention are disclosed. The data dependency between different tree structures is allowed when the tree structures are mutually inclusive. When the splitting is not used in one tree or when splitting is used in one tree and the same splitting or no split is used in the other tree, the data dependency between different tree structures is allowed. When the splitting in different tree structures are different, then the data dependency between different tree structures is disallowed. For each leaf CU in chroma tree, it should include one or more complete luma leaf CUs or it is completely included in one luma leaf CU, when the data dependency between different tree structures is allowed. Otherwise, then the data dependency between different tree structures is disallowed.Type: GrantFiled: November 15, 2019Date of Patent: May 30, 2023Assignee: HFI INNOVATION INC.Inventors: Tzu-Der Chuang, Chih-Wei Hsu, Ching-Yeh Chen
-
Patent number: 11641465Abstract: Methods and apparatus for loop-filter processing of reconstructed video are disclosed. According to this method, if a loop-filter is disallowed for a target boundary, the target loop filter is disabled at top, bottom, left and right of the target boundary. According to another method, CC-ALF (cross-component adaptive loop filter) shape is changed across a virtual boundary. According to yet another method, CC-ALF and luma ALF handle unavailable samples in a same way.Type: GrantFiled: July 22, 2020Date of Patent: May 2, 2023Assignee: HFI INNOVATION INC.Inventors: Chen-Yen Lai, Ching-Yeh Chen, Tzu-Der Chuang
-
Publication number: 20230131291Abstract: According to a method for Adaptive Loop Filter (ALF) processing of reconstructed video, multiple indicators are signaled in slice at an encoder side or parsed at a decoder side, where the multiple indicators are Adaptive Parameter Set (APS) indices associated with temporal ALF filter sets for the ALF processing. A current indicator is determined from the multiple indicators, where the current indicator is used to select a current ALF filter set. Filtered-reconstructed pixels are derived for the current block by applying the current ALF filter to the current block. In another method, if the ALF processing applied at a target sample requires an outside sample on other side of a target virtual boundary from the target sample, the outside sample is replaced by a padded sample.Type: ApplicationFiled: December 22, 2022Publication date: April 27, 2023Applicant: HFI INNOVATION INC.Inventors: Ching-Yeh CHEN, Tzu-Der CHUANG, Yu-Wen HUANG
-
Patent number: 11638027Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to receive compressed video data, wherein the compressed video data is related to a set of frames. A decoder-side predictor refinement technique is used to calculate a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. An existing motion vector associated with a different frame from a motion vector buffer is retrieved. The new motion vector is calculated based on the existing motion vector using a decoder-side motion vector prediction technique, such that the existing motion vector is in the motion vector buffer after calculating the new motion vector.Type: GrantFiled: August 7, 2017Date of Patent: April 25, 2023Assignee: HFI Innovation, Inc.Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang
-
Patent number: 11632574Abstract: Video encoding or decoding methods and apparatuses receive input video data of a luma block and one or more corresponding chroma blocks, compare sizes of the luma and chroma blocks with a maximum transform skip size, and signal or parse a BDPCM luma enabling flag for the luma block when the size of the luma block is smaller than or equal to the maximum transform skip size, and signal or parse a BDPCM chroma enabling flag for the chroma block when the size of the chroma block is smaller than or equal to the maximum transform skip size. The size of the chroma block is derived from the size of the luma block and a color format sampling structure. The luma block is encoded/decoded by BDPCM based on the BDPCM luma enabling flag and the chroma block is encoded/decoded by BDPCM according to the BDPCM chroma enabling flag.Type: GrantFiled: October 29, 2020Date of Patent: April 18, 2023Assignee: HFI INNOVATION INC.Inventors: Man-Shu Chiang, Tzu-Der Chuang, Chih-Wei Hsu
-
Patent number: 11632550Abstract: Method and apparatus of video coding are disclosed. According to one method, the left reference boundary samples and the top reference boundary samples are checked jointly. According to another method, selected original left reference boundary samples and selected original top reference boundary samples at specific positions are used for predictor up-sampling. According to yet another method, the horizontal interpolation and the vertical interpolation are in a fixed order regardless of a shape of the current block, size of the current block or both.Type: GrantFiled: March 9, 2021Date of Patent: April 18, 2023Assignee: HFI INNOVATION INC.Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu