Patents Assigned to HFI Innovation
  • Publication number: 20240388733
    Abstract: Methods, apparatus, and computer readable media configured to determine motion vectors for encoders and decoders are disclosed. A decoder receives compressed video data related to a set of frames. The decoder calculates, using a decoder-side predictor refinement technique, a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. The calculation includes retrieving a first motion vector associated with the current frame, executing a first portion of the decoding process using the first motion vector, retrieving a second motion vector associated with the current frame that is different than the first motion vector, and executing a second portion of the decoding process using the second motion vector.
    Type: Application
    Filed: June 27, 2024
    Publication date: November 21, 2024
    Applicant: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 12063387
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to determine motion vectors. The techniques relate to both encoders and decoders. For example, a decoder receives compressed video data related to a set of frames. The decoder calculates, using a decoder-side predictor refinement technique, a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. The calculation includes retrieving a first motion vector associated with the current frame, executing a first portion of the decoding process using the first motion vector, retrieving a second motion vector associated with the current frame that is different than the first motion vector, and executing a second portion of the decoding process using the second motion vector.
    Type: Grant
    Filed: January 3, 2018
    Date of Patent: August 13, 2024
    Assignee: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen
  • Publication number: 20240080490
    Abstract: A video codec receives data for a block of pixels to be encoded or decoded as a current block of a current picture of a video. The video codec signals or parses a first syntax element for a first coding mode in a particular set of two or more coding modes. Each of coding mode of the particular set of coding modes modifies a merge candidate or an inter-prediction that is generated based on the merge candidate. The video codec enables the first coding mode and disables one or more other coding modes in the particular set of coding modes. The disabled one or more coding modes in the particular set of coding modes are disabled without parsing syntax elements for the disabled coding modes. The video codec encodes or decodes the current block by using the enabled first coding mode and bypassing the disabled coding modes.
    Type: Application
    Filed: November 10, 2023
    Publication date: March 7, 2024
    Applicant: HFI Innovation Inc.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Ching-Yeh Chen
  • Patent number: 11863757
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode or decode video data. A current block of video data is coded using affine prediction. A first set of candidates of a candidate list for the current block is generated, including determining one or more inherited candidates and deriving one or more constructed candidates. After generating the first set of candidates, it is determined whether the candidate list is full. Upon determining the candidate list is not full, the candidate list is filled by generating a second set of candidates of the candidate list, including one or more of generating one or more zero motion vector candidates, generating one or more additional derived candidates based on the plurality of associated neighboring blocks of the current block, and generating a temporal motion vector candidate based on a temporal collocated picture.
    Type: Grant
    Filed: September 1, 2021
    Date of Patent: January 2, 2024
    Assignee: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Zhi-Yi Lin
  • Patent number: 11856194
    Abstract: A method and apparatus of Inter prediction for video coding using a target Merge mode comprising a triangle Merge mode are disclosed. According to this method, a current block is partitioned into a first region and a second region using the target partition. A candidate list is determined. Two candidates are determined for the two regions by deriving two target candidates from the candidate list. When a selected target candidate is a uni-prediction candidate, the selected target candidate is used as one candidate; and when the selected target candidate is a bi-prediction candidate, motion information associated of the selected target candidate with List 0 or List 1 is used as one candidate. The current block or current motion information associated with the current block is encoded or decoded according to the candidate list. The candidate list is used to derive the first candidate and the second candidate.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: December 26, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Man-Shu Chiang, Tzu-Der Chuang, Chih-Wei Hsu, Ching-Yeh Chen
  • Patent number: 11831928
    Abstract: A method and apparatus for video coding are disclosed. According to this method, a current block is received at an encoder side or compressed data comprising the current block is received at a decoder side, wherein the current block comprises one luma block and one or more chroma blocks, the current block is generated by partitioning an image area using a single partition tree into one or more partitioned blocks comprising the current block. A target coding mode is determined for the current block. The current block is then encoded or decoded according to the target coding mode, wherein an additional hypothesis of prediction for said one or more chroma blocks is disabled if the target coding mode corresponds to the multi-hypothesis prediction mode and width, height or area of said one or more chroma blocks is smaller than a threshold.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: November 28, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang
  • Patent number: 11818383
    Abstract: Video processing methods and apparatuses for coding a current block generate a final predictor by combining multiple predictors for the current block. A first predictor and a second predictor for the current block are generated by applying one or a combination of settings to the first, second, or both predictors. One or both the first and second predictors are generated from motion compensation. The final predictor is derived from the first and second predictors, and the current block is encoded or decoded according to the final predictor. The settings include supported-mode setting, combined-weight setting, applied-portion setting, motion information setting, precision setting, or a combination of the above settings.
    Type: Grant
    Filed: October 9, 2019
    Date of Patent: November 14, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen
  • Publication number: 20230300373
    Abstract: An image or video processing method comprises receiving input data of a current block, mapping an MIP mode index to a default mode, and encoding or decoding the current block by referencing the default mode. Another image or video processing method comprises receiving input data of a current block coded or to be coded by an MIP mode, and parsing or signaling a transpose flag for the current block indicating whether transposing is applied in coding the current block. Reference samples of the current block are prepared from neighboring boundary samples according to the transpose flag. A matrix is selected to be multiplied to the reference samples to generate predicted samples. A transposing process is adaptively applied to the current block according to the transpose flag, and the predicted samples are used to encode or decode the current block.
    Type: Application
    Filed: May 22, 2023
    Publication date: September 21, 2023
    Applicant: HFI Innovation Inc.
    Inventors: Zhi-Yi LIN, Tzu-Der CHUANG, Ching-Yeh CHEN, Chih-Wei HSU
  • Patent number: 11700395
    Abstract: An image or video processing method comprises receiving input data of a current block, mapping an MIP mode index to a default mode, and encoding or decoding the current block by referencing the default mode. Another image or video processing method comprises receiving input data of a current block coded or to be coded by an MIP mode, and parsing or signaling a transpose flag for the current block indicating whether transposing is applied in coding the current block. Reference samples of the current block are prepared from neighboring boundary samples according to the transpose flag. A matrix is selected to be multiplied to the reference samples to generate predicted samples. A transposing process is adaptively applied to the current block according to the transpose flag, and the predicted samples are used to encode or decode the current block.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: July 11, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu
  • Publication number: 20230188745
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to receive compressed video data, wherein the compressed video data is related to a set of frames. A decoder-side predictor refinement technique is used to calculate a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. An existing motion vector associated with a different frame from a motion vector buffer is retrieved. The new motion vector is calculated based on the existing motion vector using a decoder-side motion vector prediction technique, such that the existing motion vector is in the motion vector buffer after calculating the new motion vector.
    Type: Application
    Filed: February 10, 2023
    Publication date: June 15, 2023
    Applicant: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang
  • Patent number: 11638027
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to receive compressed video data, wherein the compressed video data is related to a set of frames. A decoder-side predictor refinement technique is used to calculate a new motion vector for a current frame from the set of frames, wherein the new motion vector estimates motion for the current frame based on one or more reference frames. An existing motion vector associated with a different frame from a motion vector buffer is retrieved. The new motion vector is calculated based on the existing motion vector using a decoder-side motion vector prediction technique, such that the existing motion vector is in the motion vector buffer after calculating the new motion vector.
    Type: Grant
    Filed: August 7, 2017
    Date of Patent: April 25, 2023
    Assignee: HFI Innovation, Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang
  • Patent number: 11546613
    Abstract: A method for adaptive MV precision is disclosed. According to one embodiment, whether to use or not to use the adaptive MV precision for a current block is determined according to a prediction mode/partition type of the current block. If the adaptive MV precision is used, a current MV precision is determined for a current MV of the current block, and the current MV is encoded or decoded at the current MV precision. If the adaptive MV precision is not used, the current MV is encoded or decoded at a finer MV precision. In another embodiment, a value of a current adaptive MV precision flag is selected for a current block to indicate whether to use or not to use the adaptive MV precision for a current block according to a prediction mode/partition type of the current block.
    Type: Grant
    Filed: January 12, 2021
    Date of Patent: January 3, 2023
    Assignee: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11539939
    Abstract: Video processing methods and apparatuses for processing a current block in a current picture include receiving input data of the current block, determining a reference picture, determining whether picture sizes of the current and reference pictures are different, determining whether horizontal wraparound motion compensation is enabled for predicting the current block, performing motion compensation for the current block to obtain a reference block from the reference picture, and encoding or decoding the current block according to the reference block. Horizontal wraparound motion compensation is disabled when the picture sizes of the current and reference pictures are different.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: December 27, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Chih-Yao Chiu, Chun-Chia Chen, Chih-Wei Hsu, Ching-Yeh Chen, Yu-Wen Huang, Tzu-Der Chuang
  • Patent number: 11509890
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode and/or decode video data. A prediction mode is determined for intra prediction coding a current data unit, where the determined prediction mode is a most probable mode of a plurality of most probable modes determined for the current data unit. The MPM information of the determined prediction mode is encoded using a coding bin, including context encoding the bin based on whether the bin is a first coding bin for the MPM information.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: November 22, 2022
    Assignee: HFI Innovation Inc.
    Inventor: Mohammed Golam Sarwer
  • Patent number: 11503337
    Abstract: Aspects of the disclosure include a video encoding device that includes a processing circuit configured to receive a first block corresponding to a first color space component and a second block corresponding to a second color space component. The processing circuit is configured to determine transform settings for processing a first transformed block and a second transformed block corresponding to the first and second blocks, respectively. The processing circuit is configured to generate a first syntax element set to be signaled in association with the first color space component, and to generate a second syntax element set to be signaled in association with the second color space component, where the first syntax element set indicates a first transform setting for processing the first transformed block, and the second syntax element set indicates a second transform setting for processing the second transformed block.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: November 15, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Han Huang, Kai Zhang
  • Patent number: 11483575
    Abstract: A video coder that constrains the total number of regular bins used for entropy coding syntax elements of a current block is provided. The video coder entropy encodes or decodes the syntax elements selectively as either regular bins using context modeling or as bypass bins without context modeling. A constraint is specified to limit a total number of regular bins used for entropy coding the syntax elements of the current block. There may be no constraint limiting a number of regular bins specific to an individual syntax element of the current block.
    Type: Grant
    Filed: August 22, 2019
    Date of Patent: October 25, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Shih-Ta Hsiang, Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11477445
    Abstract: Methods and apparatuses for processing video data include receiving input data associated with a current video picture, dividing the current video picture into non-overlapping rectangular tiles, grouping the tiles in the current video picture into tile groups, and encoding or decoding video data in the tile groups within the current video picture. According to one embodiment, each tile group is composed of an integer number of tiles, and shapes of all the tile groups are constrained to be rectangle. According to one embodiment, a flag is used to indicate whether one or more in-loop filtering operations are performed across tile group boundaries.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: October 18, 2022
    Assignee: HFI Innovation Inc.
    Inventor: Lulin Chen
  • Patent number: 11381808
    Abstract: An intra prediction method includes receiving input data of a current block in a current picture, deriving reference samples of the current block from boundary samples, selecting a matrix for the current block, generating intermediate predicted samples by multiplying the reference samples and the matrix, and clipping the intermediate predicted samples before up-sampling. The intra prediction method further includes performing an up-sampling process on the clipped intermediate predicted samples to generate predicted samples for the current block, and encoding or decoding the current block according to the predicted samples of the current block.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: July 5, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11363307
    Abstract: A method of decoding a video sequence coded with subpictures can include receiving a first syntax element corresponding to a coding tree unit (CTU) size in a bitstream at a decoder, receiving a second syntax element corresponding to whether a picture being partitioned into subpictures, in response to the second syntax element indicating the picture is partitioned into the subpictures, receiving third syntax elements indicating a position and a size of each of the subpictures in the picture based on a unit of the CTU size, and reconstructing one or more of the subpictures based on the position and the size of each of the respective subpictures in the picture.
    Type: Grant
    Filed: August 4, 2020
    Date of Patent: June 14, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Lulin Chen, Chih-Wei Hsu, Yu-Wen Huang
  • Patent number: 11297352
    Abstract: A method and apparatus are directed to applying deblocking filter to block boundaries in a video coding system including an IntraBC (Intra-block copy) mode. For at least one combination of two neighboring reconstructed blocks including at least one IntraBC coded block in the two neighboring reconstructed blocks, a boundary filter strength equal to one or zero is selected based on coding parameters associated with the two neighboring reconstructed blocks. Deblocking filter is then applied to neighboring samples of the two neighboring reconstructed blocks around the block boundary using the boundary filter strength selected. For example, when the two neighboring reconstructed blocks correspond to one IntraBC coded block and one Inter coded block, the boundary filter strength is set to one.
    Type: Grant
    Filed: July 15, 2020
    Date of Patent: April 5, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Xiaozhong Xu, Shan Liu