Patents by Inventor HONG-JHENG JHU

HONG-JHENG JHU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240146906
    Abstract: A computer system acquires a video bitstream. The video bitstream includes data associated with multiple encoded pictures. Each encoded picture includes one or more coding units (CUs). While decoding a current CU of a picture in the video bitstream, the current CU having a plurality of reference subblocks located in one or more reference pictures, in accordance with a determination that the plurality of reference subblocks satisfy a first set of predefined conditions for enabling a subblock-based temporal motion vector prediction (SbTMVP) mode, the computer system retrieves, from the video bitstream, syntax elements associated with the SbTMVP mode. The computer system then decodes the current CU using the retrieved syntax elements associated with the SbTMVP mode.
    Type: Application
    Filed: January 5, 2024
    Publication date: May 2, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Che-Wei KUO, Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Hong-Jheng JHU, Wei CHEN, Ning YAN, Bing YU
  • Publication number: 20240137546
    Abstract: An electronic apparatus performs a method of decoding video data. The method includes: receiving, from the video data, an Adaptation Parameter Set (APS) identifier associated with a number of previously used Cross-Component Sample Adaptive Offset (CCSAO) filter offset sets stored in APS; receiving, from the video data, a syntax in Picture Header (PH) or Slice Header (SH) that indicates the APS identifier used for a current picture or slice; decoding, for the current coding tree unit (CTU), a filter set index that indicates a particular previously used CCSAO filter offset set of the number of offset sets in the APS associated with the APS identifier; and applying the particular previously used CCSAO filter offset set to the current CTU of the video data.
    Type: Application
    Filed: November 27, 2023
    Publication date: April 25, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Che-Wei KUO, Xiaoyu XIU, Wei CHEN, Xianglin WANG, Yi-Wen CHEN, Hong-Jheng JHU, Ning YAN, Bing YU
  • Publication number: 20240137516
    Abstract: Methods and devices are provided for reducing the decoding latency introduced by LMCS. In one method, one or more luma prediction sample values are selected from an output of a bilinear filter of Decoder-side Motion Vector Derivation (DMVR), the one or more selected luma prediction sample values are adjusted into luma prediction sample values with the same bit depth as an original coding bit depth of an input video, the luma prediction sample values with the same bit depth as the original coding bit depth of the input video are used to derive a scaling factor for decoding one or more chroma residual samples, the scaling factor is used to scale one or more chroma residual samples, and one or more chroma residual samples are reconstructed by adding the one or more scaled chroma residual samples and their corresponding chroma prediction samples.
    Type: Application
    Filed: December 26, 2023
    Publication date: April 25, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Tsung-Chuan MA, Shuiming YE, Hong-Jheng JHU
  • Patent number: 11968388
    Abstract: A bit-width representation method of prediction refinement with optical flow (PROF), apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a reference picture I associated with a video block within the video signal, obtaining prediction samples I(i,j) of the video block from a reference block in the reference picture I, controlling internal bit-widths of a PROF derivation process for various representation precisions of internal PROF parameters by applying right-shifting to the internal PROF parameters based on different bit-shift values, obtaining prediction refinement values for samples in the video block based on the PROF derivation process being applied to the video block based on the prediction samples I(i,j), and obtaining prediction samples of the video block based on the combination of the prediction samples and the prediction refinement values.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: April 23, 2024
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu Xiu, Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Tsung-Chuan Ma, Hong-Jheng Jhu
  • Publication number: 20240129519
    Abstract: Implementations of the disclosure provide systems and methods for motion refinement in a video. The method may include determining an initial motion vector for a video block of a video frame from the video. The method may include determining a matching target based on a weighted combination of a first reference block from a first reference frame in the video and a second reference block from a second reference frame in the video. The method may include performing a bilateral matching based motion refinement process at a block level to iteratively update the initial motion vector based on the matching target until a refined motion vector is obtained. The method may include refining a motion vector for each sub-block in the video block using the refined motion vector of the video block. Refining the motion vector at a sub-block level applies an affine motion model of the video block.
    Type: Application
    Filed: December 18, 2023
    Publication date: April 18, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Wei CHEN, Xiaoyu Xiu, Che-Wei KUO, Yi-Wen Chen, Hong-Jheng Jhu, Ning YAN, Xianglin Wang, Bing Yu
  • Publication number: 20240129509
    Abstract: A method for decoding a video block in GPM includes: partitioning the video block into two geometric partitions; constructing a uni-directional motion victor (MV) candidate list by adding regular merge candidates; in response to determining that the candidate list is not full, constructing a first updated candidate list by adding additional uni-directional MVs derived from bi-prediction MVs of a regular merge candidate list to the candidate list; in response to determining that the first updated candidate list is not full, constructing a second updated candidate list by adding pairwise average candidates to the first updated candidate list; in response to determining that the second updated candidate list is not full, periodically adding zero uni-directional MVs to the second updated candidate list until a maximum length is reached; and respectively generating a uni-directional MV for each geometric partition.
    Type: Application
    Filed: December 28, 2023
    Publication date: April 18, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Wei CHEN, Che-Wei KUO, Hong-Jheng JHU, Ning YAN, Yi-Wen CHEN, Xianglin WANG, Bing YU
  • Publication number: 20240121431
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. The method includes obtaining a first reference picture I associated with a video block, obtaining control point motion vectors (CPMVs) of an affine coding block based on the video block, obtaining prediction samples I(i, j) of the affine coding block, deriving PROF prediction sample refinements of the affine coding block based on the PROF, receiving an LIC flag that indicates whether the LIC is applied to the affine coding block, deriving, and when the LIC is applied, LIC weight and offset based on neighboring reconstructed samples of the affine coding block and their corresponding reference samples in the first reference picture, and obtaining final prediction samples of the affine coding block based on the PROF prediction sample refinements and the LIC weight and offset.
    Type: Application
    Filed: December 15, 2023
    Publication date: April 11, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Shuiming YE, Tsung-Chuan MA, Hong-Jheng JHU
  • Publication number: 20240107070
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for video decoding. In one method, a decoder receives a Sequence Parameter Set (SPS) rice extension flag that indicates whether an extension of rice parameter derivation for binarization of abs_remainder and dec_abs_level is enabled. In a second method, the decoder may receive a Sequence Parameter Set (SPS) rice adaption enabled flag that indicates whether rice parameter derivation for binarization of abs_remainder and dec_abs_level is used.
    Type: Application
    Filed: November 25, 2023
    Publication date: March 28, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Hong-Jheng JHU, Xiaoyu XIU, Yi-Wen CHEN, Wei CHEN, Che-Wei KUO, Ning YAN, Xianglin WANG, Bing YU
  • Patent number: 11943468
    Abstract: An electronic apparatus performs a method of updating an inter-predicted current block using a neighboring affine block. The electronic apparatus first identifies a pixel within the inter-predicted current block, the pixel having a first inter-predicted pixel value. Next, the electronic apparatus determines a motion vector difference for the pixel based on a set of affine parameters of the neighboring affine block and then a pixel value difference for the pixel according to the motion vector difference. The pixel value difference is an inner product of the pixel value gradient vector and the motion vector difference as the pixel value difference. Finally, the electronic apparatus updates the first inter-predicted pixel value with the pixel value difference as a second inter-predicted pixel value.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: March 26, 2024
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen Chen, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang
  • Publication number: 20240098250
    Abstract: Methods and devices are provided for decoding a video block in GPM. The method includes: partitioning the video block into a first geometric partition and a second geometric partition; receiving a first template matching (TM) enable flag for the first geometric partition a second TM enable flag for the second geometric partition, the first TM enable flag indicating whether a uni-directional motion of the first geometric partition is refined by TM, and the second TM enable flag indicating whether a uni-directional motion of the second partition is refined by the TM; receiving a first merge GPM index for the first geometric partition and a second merge GPM index for the second geometric partition; constructing a uni-directional motion victor (MV) candidate list of the GPM; and generating a first uni-directional MV for the first geometric partition and a second uni-directional MV for the second geometric partition.
    Type: Application
    Filed: November 17, 2023
    Publication date: March 21, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Che-Wei KUO, Wei CHEN, Hong-Jheng JHU, Ning YAN, Yi-Wen CHEN, Xianglin WANG, Bing YU
  • Publication number: 20240098290
    Abstract: Methods and devices for video decoding are provided. The method may include obtaining a plurality of coding blocks within a video frame, where the plurality of coding blocks may include at least one chroma coding block and a plurality of luma coding blocks. Further, the method may include determining whether to apply OBMC to the at least one chroma coding block and the plurality of luma coding blocks to generate prediction samples for the video frame in response to determining that a local chroma tree partition is applied to the plurality of coding blocks.
    Type: Application
    Filed: November 24, 2023
    Publication date: March 21, 2024
    Inventors: Xiaoyu Xiu, Che-Wei Kuo, Wei Chen, Hong-Jheng Jhu, Ning Yan, Yi-Wen Chen, Xianglin Wang, Bing Yu
  • Publication number: 20240073440
    Abstract: Methods and devices for video decoding are provided. The method includes: receiving a control variable associated with the video block at a coding level, where the control variable enables adaptive switch between a plurality of motion vector refinement (MVR) offset sets, and the video block comprises first and second geometric partitions; receiving one or more syntax elements to determine a first MVR offset for the first geometric partition and a second MVR offset for the second geometric partition from a selected MVR offset set; obtaining a first motion vector (MV) and a second MV from a candidate list for the first and second geometric partitions; calculating a first refined MV and a second refined MV based on the first and second MVs and the first and second MVR offsets; and obtaining prediction samples for the video block based on the first and second refined MVs.
    Type: Application
    Filed: November 7, 2023
    Publication date: February 29, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Wei CHEN, Che-Wei KUO, Hong-Jheng JHU, Ning YAN, Yi-Wen CHEN, Xianglin WANG, Bing YU
  • Patent number: 11917189
    Abstract: A method of decoding a video signal, apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a video block from the video signal, obtaining spatial neighboring blocks based on the video block, obtaining up to one left non-scaled motion vector predictor (MVP) based on the multiple left spatial neighboring blocks, obtaining up to one above non-scaled MVP based on the multiple above spatial neighboring blocks, deriving, at the decoder and by reducing possibility of selecting scaled MVPs derived from the spatial neighboring blocks, an MVP candidate list based on the video block, the multiple left spatial neighboring blocks, the multiple above spatial neighboring blocks, receiving a best MVP based on the MVP candidate list, and obtaining a prediction signal of the video block based on the best MVP.
    Type: Grant
    Filed: December 3, 2021
    Date of Patent: February 27, 2024
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Yi-Wen Chen, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang
  • Publication number: 20240064296
    Abstract: A method and an apparatus for image filtering in video coding using a neural network are provided. The method includes: loading, a plurality of quantization parameter (QP) map (QpMap) values at a plurality of QpMap channels into the neural network; obtaining a QP scaling factor by adjusting a plurality of input QP values related to an input frame; and adjusting, according to a QP scaling factor, the plurality of QpMap values for the neural network to learn and filter the input frame to the neural network.
    Type: Application
    Filed: October 31, 2023
    Publication date: February 22, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Wei CHEN, Xiaoyu XIU, Yi-Wen CHEN, Hong-Jheng JHU, Che-Wei KUO, Xianglin WANG, Bing YU
  • Publication number: 20240048700
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video block in geometry partition mode (GPM). The method includes: partitioning the video block into first and second geometric partitions; obtaining a first prediction list for the first geometric partition and obtaining a second prediction list for the second geometric partition; obtaining motion vectors (MVs) for the first and second geometric partitions by applying a GPM with explicit motion signaling (EMS) to the first and second geometric partitions based on the first and second prediction lists; and obtaining prediction samples of the first and second geometric partitions based on the MVs.
    Type: Application
    Filed: October 9, 2023
    Publication date: February 8, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Wei CHEN, Che-Wei KUO, Yi-Wen CHEN, Hong-Jheng JHU, Xianglin WANG, Bing YU
  • Publication number: 20240040133
    Abstract: A computing device performs a method of decoding video data by generating a multi-model linear model (MMLM) including a first linear model between the minimum luma value and the threshold luma value, and a second linear model between the threshold luma value and the maximum luma value from a group of reference luma samples and a group of reference chroma samples; and reconstructing a respective sample value of the chroma block from a weighted combination of a respective first corresponding reconstructed sample value of the luma block using the multi-model linear model, and a respective second reconstructed sample value of a neighboring chroma block from an intra prediction mode.
    Type: Application
    Filed: October 12, 2023
    Publication date: February 1, 2024
    Inventors: Hong-Jheng Jhu, Xiaoyu Xiu, Yi-Wen Chen, Wei Chen, Che-wei Kuo, Xianglin Wang, Bing Yu
  • Publication number: 20240040129
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for video coding. The method for video coding includes: receiving, by a decoder, a residual coding rice constraint flag to provide general constraint controls for at least one of other flags; and in response to determining that a value of the residual coding rice constraint flag equals to 1, determining that a value of the at least one of other flags equals to 0.
    Type: Application
    Filed: July 5, 2023
    Publication date: February 1, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Hong-Jheng JHU, Xiaoyu XIU, Yi-Wen CHEN, Wei CHEN, Che-Wei KUO, Xianglin WANG, Bing YU
  • Publication number: 20240040134
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for video coding with a low-delay transform skip residual coding (TSRC) method. The TSRC method includes: deriving, by an encoder, a rice parameter based on coded information of a current slice of a video. The coded information may include one or more of following parameters: a quantization parameter or a coding bit-depth associated with a slice, a picture, or a sequence of the video; or a hash ratio associated with the slice, the picture, or the sequence of the video.
    Type: Application
    Filed: September 12, 2023
    Publication date: February 1, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Hong-Jheng JHU, Xiaoyu XIU, Yi-Wen CHEN, Wei CHEN, Che-Wei KUO, Xianglin WANG, Bing YU
  • Patent number: 11889110
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. The method includes obtaining a first reference picture I associated with a video block, obtaining control point motion vectors (CPMVs) of an affine coding block based on the video block, obtaining prediction samples I(i, j) of the affine coding block, deriving PROF prediction sample refinements of the affine coding block based on the PROF, receiving an LIC flag that indicates whether the LIC is applied to the affine coding block, deriving, and when the LIC is applied, LIC weight and offset based on neighboring reconstructed samples of the affine coding block and their corresponding reference samples in the first reference picture, and obtaining final prediction samples of the affine coding block based on the PROF prediction sample refinements and the LIC weight and offset.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: January 30, 2024
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Xiaoyu Xiu, Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Tsung-Chuan Ma, Hong-Jheng Jhu
  • Publication number: 20240015316
    Abstract: A method for video decoding is provided. The method includes obtaining a plurality of sub-blocks within an affine coding unit (CU) of a video frame, where the plurality of sub-blocks include a plurality of boundary sub-blocks and a plurality of non-boundary sub-blocks. Further, the method may include applying both overlapped block motion compensation (OBMC) and affine secondary prediction (ASP) to at least one sub-block to generate a sub-block-based prediction for the affine CU or enabling the ASP for the plurality of non-boundary sub-block and disabling the OBMC for the plurality of non-boundary sub-blocks.
    Type: Application
    Filed: September 26, 2023
    Publication date: January 11, 2024
    Inventors: Xiaoyu Xiu, Che-Wei Kuo, Wei Chen, Yi-Wen Chen, Hong-Jheng Jhu, Xianglin Wang, Bing Yu