Patents Assigned to HFI Innovation Inc.
-
Patent number: 11743458Abstract: Methods and apparatus for in-loop processing of reconstructed video are disclosed. According to one method, a virtual boundary is determined for to-be-processed pixels in the current picture, where the virtual boundary is aligned with block boundaries and at least one to-be-processed pixel on a first side of the virtual boundary requires one or more second pixels on a second side of the virtual boundary. According to the method, the in-loop processing is modified if a target to-be-processed pixel requires at least one second pixel from the second side of the virtual boundary and the modified in-loop processing eliminates the need for any second pixel on the second side of the virtual boundary. According to another method, the operations of block classification are changed when part of the required pixels in one 10×10 window used in classification are at the other side of virtual boundaries.Type: GrantFiled: October 18, 2019Date of Patent: August 29, 2023Assignee: HFI INNOVATION INC.Inventors: Ching-Yeh Chen, Tzu-Der Chuang, Yu-Chi Su, Chih-Wei Hsu, Yu-Wen Huang
-
Publication number: 20230269373Abstract: A methods and apparatus for adaptive data dependency between corresponding blocks partitioned from separate partition trees according to an embodiment of the present invention are disclosed. The data dependency between different tree structures is allowed when the tree structures are mutually inclusive. When the splitting is not used in one tree or when splitting is used in one tree and the same splitting or no split is used in the other tree, the data dependency between different tree structures is allowed. When the splitting in different tree structures are different, then the data dependency between different tree structures is disallowed. For each leaf CU in chroma tree, it should include one or more complete luma leaf CUs or it is completely included in one luma leaf CU, when the data dependency between different tree structures is allowed. Otherwise, then the data dependency between different tree structures is disallowed.Type: ApplicationFiled: May 2, 2023Publication date: August 24, 2023Applicant: HFI INNOVATION INC.Inventors: Tzu-Der CHUANG, Chih-Wei HSU, Ching-Yeh CHEN
-
Patent number: 11711513Abstract: Video processing methods and apparatuses include receiving input video data associated with a current picture composed of multiple Coding Tree Units (CTUs) for encoding or decoding, determining a number of subpictures, partitioning the current picture into one or more subpictures, and encoding or decoding each subpicture in the current picture. Each subpicture contains multiple complete CTUs and boundaries of each subpicture are aligned with grids of the current picture in units of CTUs. The number of subpictures in the current picture is limited by an allowed maximum number of slices.Type: GrantFiled: June 10, 2021Date of Patent: July 25, 2023Assignee: HFI INNOVATION INC.Inventor: Shih-Ta Hsiang
-
Patent number: 11700395Abstract: An image or video processing method comprises receiving input data of a current block, mapping an MIP mode index to a default mode, and encoding or decoding the current block by referencing the default mode. Another image or video processing method comprises receiving input data of a current block coded or to be coded by an MIP mode, and parsing or signaling a transpose flag for the current block indicating whether transposing is applied in coding the current block. Reference samples of the current block are prepared from neighboring boundary samples according to the transpose flag. A matrix is selected to be multiplied to the reference samples to generate predicted samples. A transposing process is adaptively applied to the current block according to the transpose flag, and the predicted samples are used to encode or decode the current block.Type: GrantFiled: June 24, 2020Date of Patent: July 11, 2023Assignee: HFI Innovation Inc.Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu
-
Patent number: 11700391Abstract: Method and apparatus of Inter prediction for video coding are disclosed. When a sub-block motion compensation coding tool is selected for the current block, the method generates sub-block MVs (motion vectors) associated with multiple sub-blocks, which are included or contained in the current block, according to the sub-block motion compensation coding tool, constrains the sub-block MVs within a range to form constrained sub-block MVs, and applies motion compensation to the current block using the constrained sub-block MVs or applies motion compensation to the current block using one sub-block MV within the range around the primary MV in a second list if a corresponding sub-block MV in a first list is outside the range. In another method, motion compensation is applied to the current block only using reference pixels of reference sub-blocks within a primary reference block.Type: GrantFiled: May 17, 2018Date of Patent: July 11, 2023Assignee: HFI INNOVATION INC.Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang, Chih-Wei Hsu
-
Publication number: 20230188745Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to receive compressed video data, wherein the compressed video data is related to a set of frames. A decoder-side predictor refinement technique is used to calculate a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. An existing motion vector associated with a different frame from a motion vector buffer is retrieved. The new motion vector is calculated based on the existing motion vector using a decoder-side motion vector prediction technique, such that the existing motion vector is in the motion vector buffer after calculating the new motion vector.Type: ApplicationFiled: February 10, 2023Publication date: June 15, 2023Applicant: HFI Innovation Inc.Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang
-
Patent number: 11665345Abstract: A methods and apparatus for adaptive data dependency between corresponding blocks partitioned from separate partition trees according to an embodiment of the present invention are disclosed. The data dependency between different tree structures is allowed when the tree structures are mutually inclusive. When the splitting is not used in one tree or when splitting is used in one tree and the same splitting or no split is used in the other tree, the data dependency between different tree structures is allowed. When the splitting in different tree structures are different, then the data dependency between different tree structures is disallowed. For each leaf CU in chroma tree, it should include one or more complete luma leaf CUs or it is completely included in one luma leaf CU, when the data dependency between different tree structures is allowed. Otherwise, then the data dependency between different tree structures is disallowed.Type: GrantFiled: November 15, 2019Date of Patent: May 30, 2023Assignee: HFI INNOVATION INC.Inventors: Tzu-Der Chuang, Chih-Wei Hsu, Ching-Yeh Chen
-
Patent number: 11641465Abstract: Methods and apparatus for loop-filter processing of reconstructed video are disclosed. According to this method, if a loop-filter is disallowed for a target boundary, the target loop filter is disabled at top, bottom, left and right of the target boundary. According to another method, CC-ALF (cross-component adaptive loop filter) shape is changed across a virtual boundary. According to yet another method, CC-ALF and luma ALF handle unavailable samples in a same way.Type: GrantFiled: July 22, 2020Date of Patent: May 2, 2023Assignee: HFI INNOVATION INC.Inventors: Chen-Yen Lai, Ching-Yeh Chen, Tzu-Der Chuang
-
Publication number: 20230131291Abstract: According to a method for Adaptive Loop Filter (ALF) processing of reconstructed video, multiple indicators are signaled in slice at an encoder side or parsed at a decoder side, where the multiple indicators are Adaptive Parameter Set (APS) indices associated with temporal ALF filter sets for the ALF processing. A current indicator is determined from the multiple indicators, where the current indicator is used to select a current ALF filter set. Filtered-reconstructed pixels are derived for the current block by applying the current ALF filter to the current block. In another method, if the ALF processing applied at a target sample requires an outside sample on other side of a target virtual boundary from the target sample, the outside sample is replaced by a padded sample.Type: ApplicationFiled: December 22, 2022Publication date: April 27, 2023Applicant: HFI INNOVATION INC.Inventors: Ching-Yeh CHEN, Tzu-Der CHUANG, Yu-Wen HUANG
-
Patent number: 11638027Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to receive compressed video data, wherein the compressed video data is related to a set of frames. A decoder-side predictor refinement technique is used to calculate a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. An existing motion vector associated with a different frame from a motion vector buffer is retrieved. The new motion vector is calculated based on the existing motion vector using a decoder-side motion vector prediction technique, such that the existing motion vector is in the motion vector buffer after calculating the new motion vector.Type: GrantFiled: August 7, 2017Date of Patent: April 25, 2023Assignee: HFI Innovation, Inc.Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang
-
Patent number: 11632574Abstract: Video encoding or decoding methods and apparatuses receive input video data of a luma block and one or more corresponding chroma blocks, compare sizes of the luma and chroma blocks with a maximum transform skip size, and signal or parse a BDPCM luma enabling flag for the luma block when the size of the luma block is smaller than or equal to the maximum transform skip size, and signal or parse a BDPCM chroma enabling flag for the chroma block when the size of the chroma block is smaller than or equal to the maximum transform skip size. The size of the chroma block is derived from the size of the luma block and a color format sampling structure. The luma block is encoded/decoded by BDPCM based on the BDPCM luma enabling flag and the chroma block is encoded/decoded by BDPCM according to the BDPCM chroma enabling flag.Type: GrantFiled: October 29, 2020Date of Patent: April 18, 2023Assignee: HFI INNOVATION INC.Inventors: Man-Shu Chiang, Tzu-Der Chuang, Chih-Wei Hsu
-
Patent number: 11632550Abstract: Method and apparatus of video coding are disclosed. According to one method, the left reference boundary samples and the top reference boundary samples are checked jointly. According to another method, selected original left reference boundary samples and selected original top reference boundary samples at specific positions are used for predictor up-sampling. According to yet another method, the horizontal interpolation and the vertical interpolation are in a fixed order regardless of a shape of the current block, size of the current block or both.Type: GrantFiled: March 9, 2021Date of Patent: April 18, 2023Assignee: HFI INNOVATION INC.Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu
-
Patent number: 11616949Abstract: An intra prediction method comprises receiving input data of a current block in a current picture, deriving multiple Most Probable Modes (MPMs) to be included in a MPM list for the current block, setting remaining intra prediction modes as non-MPMs, and encoding or decoding the current block according to a current intra prediction mode selecting from the MPMs and non-MPMs. The first MPM in the MPM list is Planar mode for blocks coded or to be coded in intra prediction, and one or more other MPMs in the MPM list are derived according to a number of available angular mode of one or more neighboring blocks of the current block.Type: GrantFiled: August 27, 2019Date of Patent: March 28, 2023Assignee: HFI INNOVATION INC.Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen, Mohammed Golam Sarwer
-
Patent number: 11601647Abstract: Video processing methods and apparatuses include receiving input data associated with a current picture composed of multiple Coding Tree Units (CTUs) for encoding or decoding, partitioning the current picture into multiple subpictures, determining one or more reference pictures for inter coding the current picture, and encoding or decoding one or more blocks in one or more CTUs of the current picture by inter coding using the one or more reference pictures. Each of the reference pictures used for inter coding the current picture has a same CTU size as that of the current picture when the reference picture is not an Inter Layer Reference Picture (ILRP) containing one subpicture.Type: GrantFiled: June 10, 2021Date of Patent: March 7, 2023Assignee: HFI INNOVATION INC.Inventor: Shih-Ta Hsiang
-
Patent number: 11595690Abstract: Method and apparatus for encoding and decoding prediction residues in a video coding system also disclosed. At the decoder side, a Rice parameter for the target transform coefficient is determined based on a local sum of absolute levels of neighboring transform coefficients of the target transform coefficient. A dependent quantization state is determined and a zero-position variable is determined based on the dependent quantization state and the Rice parameter. One or more coded bits associated with a first syntax element for the target transform coefficient in a transform block are parsed and decoded using one or more codes including a Golomb-Rice code with the Rice parameter, where the first syntax element corresponds to a modified absolute level value of the target transform coefficient. An absolute level value of the target transform coefficient is derived according to the zero-position variable and the first syntax element.Type: GrantFiled: October 21, 2021Date of Patent: February 28, 2023Assignee: HFI INNOVATION INC.Inventor: Shih-Ta Hsiang
-
Patent number: 11595656Abstract: A method and apparatus for encoding or decoding transform coefficients in a video coding system are disclosed. According to this method, a region after zero-outis determined. A remaining number of context-coded bins is determined for the current TB based on a size of the region after zero-out. The current TB is encoded or decoded using context-based coding with a constraint based on the remaining number of context-coded bins. According to another method, a remaining number of context-coded bins is determined for the current TB based on the last significant CG index.Type: GrantFiled: January 22, 2020Date of Patent: February 28, 2023Assignee: HFI INNOVATION INC.Inventors: Tzu-Der Chuang, Ching-Yeh Chen
-
Patent number: 11589044Abstract: A video system that applies constraints on block partitioning is provided. The system receives a partitioning control parameter from a bitstream specifying a maximum block size for enabling ternary-tree split that is constrained to be 64 or smaller. The system receives data from a bitstream for a block of pixels to be decoded as a current block of a current picture of a video. The system splits the current block into one or more partitions recursively, wherein ternary split is disallowed for a partition of the current block unless the partition is less than or equal to the maximum block size. The system reconstructs the one or more partitions of the current block.Type: GrantFiled: October 12, 2020Date of Patent: February 21, 2023Assignee: HFI INNOVATION INC.Inventors: Shih-Ta Hsiang, Chen-Yen Lai, Ching-Yeh Chen
-
Patent number: 11589049Abstract: A method and apparatus of video coding operate by receiving input data associated with a current data unit in a current picture, wherein the current data unit includes a luma component and a chroma component and the current data unit includes a luma data unit and a chroma data unit. The operation proceeds by splitting the luma data unit and the Chroma data unit using one shared tree until the luma data unit and the chroma data unit reach a stop node, encoding or decoding the stop node as a leaf CU (coding unit) if the stop node is greater than M×N for the luma component, M and N are positive integers, and signalling or parsing a prediction mode for the stop node if the stop node is smaller than or equal to M×N for the luma component.Type: GrantFiled: August 6, 2021Date of Patent: February 21, 2023Assignee: HFI INNOVATION INC.Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Kung-Nien Yang, Chun-Chia Chen
-
Method and apparatus of encoding or decoding video blocks with constraints during block partitioning
Patent number: 11589050Abstract: Video processing methods comprise receiving input data of a current block, checking whether the current block is a root block by considering one or more predefined criteria, applying a mode constraint, a chroma split constraint, or both the mode and chroma split constraints to the current block if the current block is set to be a root block, and encoding or decoding the current block. The mode constraint restricts all blocks split from the current block to be processed by a same prediction mode and the chroma split constraints prohibits chroma components of the current block to be further partitioned while allowing a luma component of the current block to be partitioned into smaller blocks.Type: GrantFiled: December 10, 2019Date of Patent: February 21, 2023Assignee: HFI INNOVATION INC.Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chia-Ming Tsai -
Patent number: 11582454Abstract: A method and apparatus for video coding utilizing a current block, a maximum side of the transform block of the current block corresponds to 64. A scaling matrix is derived from elements of an 8×8 base scaling matrix, where the elements in a bottom-right 4×4 region of the 8×8 base scaling matrix are skipped, either not signaled or set to zero. According to another method, a current block belongs to a current picture in a first color format that has only a first color component. A first scaling matrix is signaled at the video encoder side or parsed at the video decoder side for the first color component of the current block. Signaling any second scaling matrix is disabled at the video encoder side or parsing any second scaling matrix is disabled at the video decoder side for a second or third color component of the current block.Type: GrantFiled: March 23, 2020Date of Patent: February 14, 2023Assignee: HFI INNOVATION INC.Inventors: Chen-Yen Lai, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang, Olena Chubach