Patents by Inventor Shuiming YE

Shuiming YE has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240137516
    Abstract: Methods and devices are provided for reducing the decoding latency introduced by LMCS. In one method, one or more luma prediction sample values are selected from an output of a bilinear filter of Decoder-side Motion Vector Derivation (DMVR), the one or more selected luma prediction sample values are adjusted into luma prediction sample values with the same bit depth as an original coding bit depth of an input video, the luma prediction sample values with the same bit depth as the original coding bit depth of the input video are used to derive a scaling factor for decoding one or more chroma residual samples, the scaling factor is used to scale one or more chroma residual samples, and one or more chroma residual samples are reconstructed by adding the one or more scaled chroma residual samples and their corresponding chroma prediction samples.
    Type: Application
    Filed: December 26, 2023
    Publication date: April 25, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Tsung-Chuan MA, Shuiming YE, Hong-Jheng JHU
  • Patent number: 11968388
    Abstract: A bit-width representation method of prediction refinement with optical flow (PROF), apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a reference picture I associated with a video block within the video signal, obtaining prediction samples I(i,j) of the video block from a reference block in the reference picture I, controlling internal bit-widths of a PROF derivation process for various representation precisions of internal PROF parameters by applying right-shifting to the internal PROF parameters based on different bit-shift values, obtaining prediction refinement values for samples in the video block based on the PROF derivation process being applied to the video block based on the prediction samples I(i,j), and obtaining prediction samples of the video block based on the combination of the prediction samples and the prediction refinement values.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: April 23, 2024
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu Xiu, Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Tsung-Chuan Ma, Hong-Jheng Jhu
  • Publication number: 20240121431
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. The method includes obtaining a first reference picture I associated with a video block, obtaining control point motion vectors (CPMVs) of an affine coding block based on the video block, obtaining prediction samples I(i, j) of the affine coding block, deriving PROF prediction sample refinements of the affine coding block based on the PROF, receiving an LIC flag that indicates whether the LIC is applied to the affine coding block, deriving, and when the LIC is applied, LIC weight and offset based on neighboring reconstructed samples of the affine coding block and their corresponding reference samples in the first reference picture, and obtaining final prediction samples of the affine coding block based on the PROF prediction sample refinements and the LIC weight and offset.
    Type: Application
    Filed: December 15, 2023
    Publication date: April 11, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Shuiming YE, Tsung-Chuan MA, Hong-Jheng JHU
  • Patent number: 11943468
    Abstract: An electronic apparatus performs a method of updating an inter-predicted current block using a neighboring affine block. The electronic apparatus first identifies a pixel within the inter-predicted current block, the pixel having a first inter-predicted pixel value. Next, the electronic apparatus determines a motion vector difference for the pixel based on a set of affine parameters of the neighboring affine block and then a pixel value difference for the pixel according to the motion vector difference. The pixel value difference is an inner product of the pixel value gradient vector and the motion vector difference as the pixel value difference. Finally, the electronic apparatus updates the first inter-predicted pixel value with the pixel value difference as a second inter-predicted pixel value.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: March 26, 2024
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen Chen, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang
  • Patent number: 11917189
    Abstract: A method of decoding a video signal, apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a video block from the video signal, obtaining spatial neighboring blocks based on the video block, obtaining up to one left non-scaled motion vector predictor (MVP) based on the multiple left spatial neighboring blocks, obtaining up to one above non-scaled MVP based on the multiple above spatial neighboring blocks, deriving, at the decoder and by reducing possibility of selecting scaled MVPs derived from the spatial neighboring blocks, an MVP candidate list based on the video block, the multiple left spatial neighboring blocks, the multiple above spatial neighboring blocks, receiving a best MVP based on the MVP candidate list, and obtaining a prediction signal of the video block based on the best MVP.
    Type: Grant
    Filed: December 3, 2021
    Date of Patent: February 27, 2024
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Yi-Wen Chen, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang
  • Patent number: 11889110
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. The method includes obtaining a first reference picture I associated with a video block, obtaining control point motion vectors (CPMVs) of an affine coding block based on the video block, obtaining prediction samples I(i, j) of the affine coding block, deriving PROF prediction sample refinements of the affine coding block based on the PROF, receiving an LIC flag that indicates whether the LIC is applied to the affine coding block, deriving, and when the LIC is applied, LIC weight and offset based on neighboring reconstructed samples of the affine coding block and their corresponding reference samples in the first reference picture, and obtaining final prediction samples of the affine coding block based on the PROF prediction sample refinements and the LIC weight and offset.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: January 30, 2024
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Xiaoyu Xiu, Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Tsung-Chuan Ma, Hong-Jheng Jhu
  • Patent number: 11533451
    Abstract: Embodiments of the disclosure provide systems and methods for performing frame rate up-conversion of video data including a sequence of image frames. The method may include determining a set of motion vectors of a target frame relative to a plurality of reference frames. The target frame is to be generated and interpolated into the sequence of image frames. The method may further include performing a motion vector classification on the set of motion vectors to generate a target object map for the target frame. The method may additionally include projecting the target object map onto the plurality of reference frames to generate a plurality of reference object maps based on the set of motion vectors. The method may additionally include detecting an occlusion area in the target frame based on the set of motion vectors, the target object map, and the plurality of reference object maps.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: December 20, 2022
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD
    Inventors: Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Guoxin Jin, Shufei Fan, Bing Yu
  • Publication number: 20220270267
    Abstract: Embodiments of the disclosure provide systems and methods for performing occlusion detection in frame rate up-conversion of video data including a sequence of image frames. The method includes determining, by a video processor, whether a target block of a target frame is a potential occlusion block based on at least one of motion vector information or distortion metric information associated with the target block. The target frame is to be generated and interpolated into the sequence of image frames. Responsive to the target block being the potential occlusion block, the method further includes detecting, by the video processor, an occlusion type of the target block. The method additionally includes generating, by the video processor, the target block by performing a motion compensation method adaptively selected based on the occlusion type of the target block.
    Type: Application
    Filed: February 1, 2022
    Publication date: August 25, 2022
    Applicant: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Shuiming Ye, Xianglin Wang, Yi-Wen Chen, Guoxin Jin, Shufei Fan, Bing Yu
  • Publication number: 20220210467
    Abstract: According to one aspect of the disclosure, a computer-implemented method for performing frame rate up-conversion of video data including a sequence of image frames is provided. The method may include performing, by a video processor, an interpolation quality reliability prediction for a target image level based on a reliability metric. In response to the interpolation quality reliability prediction meeting a first reliability threshold condition associated with a first reliability threshold, the method may include performing, by the video processor, a motion-compensation interpolation at the target image level. In response to the interpolation quality reliability prediction not meeting the first reliability threshold, the method may include performing, by the video processor, a fallback interpolation at the target image level or performing a new interpolation quality reliability prediction for a new image level below the target image level.
    Type: Application
    Filed: December 23, 2021
    Publication date: June 30, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Guoxin Jin, Shufei Fan, Bing Yu
  • Publication number: 20220182658
    Abstract: A bit-width representation method of prediction refinement with optical flow (PROF), apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a reference picture I associated with a video block within the video signal, obtaining prediction samples I(i,j) of the video block from a reference block in the reference picture I, controlling internal bit-widths of a PROF derivation process for various representation precisions of internal PROF parameters by applying right-shifting to the internal PROF parameters based on different bit-shift values, obtaining prediction refinement values for samples in the video block based on the PROF derivation process being applied to the video block based on the prediction samples I(i,j), and obtaining prediction samples of the video block based on the combination of the prediction samples and the prediction refinement values.
    Type: Application
    Filed: April 30, 2020
    Publication date: June 9, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Shuiming YE, Tsung-Chuan MA, Hong-Jheng JHU
  • Publication number: 20220116663
    Abstract: A method of decoding a syntax element for a current coding unit of video data is performed by an electronic apparatus. The electronic apparatus identifies, for the current coding unit, an above coding unit and a coding tree unit including the current coding unit. After determining that the above coding unit is within the coding tree unit, the electronic apparatus decodes, from a video bitstream, a corresponding syntax element for the current coding unit based, at least in part, on a syntax element associated with the above coding unit retrieved from a line buffer associated with the coding tree unit; otherwise, the electronic apparatus decodes, from the video bitstream, the corresponding syntax element for the current coding unit based, at least in part, on a default value assigned to the syntax element associated with the above coding unit.
    Type: Application
    Filed: December 21, 2021
    Publication date: April 14, 2022
    Inventors: Tsung-Chuan MA, Hong-Jheng JHU, Xianglin WANG, Yi-Wen CHEN, Xiaoyu XIU, Shuiming YE, Yun-fei ZHENG, Bing YU
  • Publication number: 20220116655
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. The method includes obtaining a first reference picture I associated with a video block, obtaining control point motion vectors (CPMVs) of an affine coding block based on the video block, obtaining prediction samples I(i, j) of the affine coding block, deriving PROF prediction sample refinements of the affine coding block based on the PROF, receiving an LIC flag that indicates whether the LIC is applied to the affine coding block, deriving, and when the LIC is applied, LIC weight and offset based on neighboring reconstructed samples of the affine coding block and their corresponding reference samples in the first reference picture, and obtaining final prediction samples of the affine coding block based on the PROF prediction sample refinements and the LIC weight and offset.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Shuiming YE, Tsung-Chuan MA, Hong-Jheng JHU
  • Publication number: 20220116616
    Abstract: Methods are provided for reducing the computation complexity and on-chip memory requirements as well as the decoding latency introduced by LMCS. In one method, a luma prediction sample is obtained for decoding a luma residual sample, a scaling factor is derived using the luma prediction sample, the scaling factor is used to scale the luma residual sample, and the reconstructed luma sample is calculated by adding the luma prediction sample and the scaled luma residual sample.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Tsung-Chuan MA, Shuiming YE, Hong-Jheng JHU
  • Publication number: 20220109849
    Abstract: Methods and devices are provided for reducing the decoding latency introduced by LMCS. In one method, one or more luma prediction sample values are selected from an output of a bilinear filter of Decoder-side Motion Vector Derivation (DMVR), the one or more selected luma prediction sample values are adjusted into luma prediction sample values with the same bit depth as an original coding bit depth of an input video, the luma prediction sample values with the same bit depth as the original coding bit depth of the input video are used to derive a scaling factor for decoding one or more chroma residual samples, the scaling factor is used to scale one or more chroma residual samples, and one or more chroma residual samples are reconstructed by adding the one or more scaled chroma residual samples and their corresponding chroma prediction samples.
    Type: Application
    Filed: December 16, 2021
    Publication date: April 7, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Tsung-Chuan MA, Shuiming YE, Hong-Jheng JHU
  • Publication number: 20220109886
    Abstract: A computing device performs a method of decoding video data by receiving, from a bitstream, a first syntax element associated with an SBT coding unit that indicates that there exists at least one non-zero transform coefficient in the SBT coding unit; determining a first transform unit that includes non-zero transform coefficients; receiving a second syntax element associated with a first chroma component of the first transform unit, a third syntax element associated with a second chroma component, and a fourth syntax element associated with luma component of the first transform unit; decoding the transform coefficients of chroma and luma components of the first transform unit, based on the second, third and fourth syntax elements; and setting transform coefficients of luma and chroma components of rest of the plurality of transform units to zeros.
    Type: Application
    Filed: December 13, 2021
    Publication date: April 7, 2022
    Inventors: Xiaoyu XIU, Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Tsung-Chuan Ma, Hong-Jheng Jhu
  • Publication number: 20220094942
    Abstract: A computing device performs a method of decoding video data by determining a co-located picture of the current coding unit; locating a spatial neighbor block of the current coding unit that corresponds to the co-located picture; determining a motion shift vector for the current coding unit from one or more motion vectors associated with the spatial neighbor block according to a predefined fixed order; and reconstructing a sub-block-based temporal motion vector for a respective sub-block of a plurality of sub-blocks in the current coding unit from a corresponding sub-block in the collocated picture based on the motion shift vector.
    Type: Application
    Filed: December 2, 2021
    Publication date: March 24, 2022
    Inventors: Yi-Wen Chen, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang
  • Publication number: 20220094913
    Abstract: A computer implemented method for symmetrical motion vector difference (SMVD) mode, apparatus, and a non-transitory computer-readable storage medium are provided. The decoder obtains a first and second reference picture associated with a current video block, a first reference picture list of the current video block, and a second reference picture list of the current video block. The decoder receives motion parameters and calculates a first motion vector associated with the first reference picture by adding the MVD to corresponding motion vector predictor associated with the first reference picture, and calculates a second motion vector associated with second reference picture by subtracting the MVD from corresponding motion vector predictor associated with the second reference picture. The decoder obtains a prediction signal of the current video block by combining the prediction blocks generated based on the first motion vector and the second motion vector.
    Type: Application
    Filed: November 30, 2021
    Publication date: March 24, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Shuiming YE, Tsung-Chuan MA, Hong-Jheng JHU
  • Publication number: 20220094970
    Abstract: A method of decoding a video signal, apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a video block from the video signal, obtaining spatial neighboring blocks based on the video block, obtaining up to one left non-scaled motion vector predictor (MVP) based on the multiple left spatial neighboring blocks, obtaining up to one above non-scaled MVP based on the multiple above spatial neighboring blocks, deriving, at the decoder and by reducing possibility of selecting scaled MVPs derived from the spatial neighboring blocks, an MVP candidate list based on the video block, the multiple left spatial neighboring blocks, the multiple above spatial neighboring blocks, receiving a best MVP based on the MVP candidate list, and obtaining a prediction signal of the video block based on the best MVP.
    Type: Application
    Filed: December 3, 2021
    Publication date: March 24, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA, Hong-Jheng JHU, Shuiming YE, Xianglin WANG
  • Publication number: 20220086464
    Abstract: A method of decoding video data is performed by an electronic apparatus. The electronic apparatus receives, from a video bitstream, one or more syntax elements indicating that a coding block is coded under a palette mode. The electronic apparatus divides the coding block into multiple segments, each of the multiple segments having a set of index values that is independent from another one of the multiple segments. The electronic apparatus receives, from the video bitstream, index values associated with each of the multiple segments and a palette table associated with the coding block and decodes the multiple segments in parallel according to the index values and the palette table associated with the coding block.
    Type: Application
    Filed: November 30, 2021
    Publication date: March 17, 2022
    Inventors: Hong-Jheng JHU, Xiaoyu XIU, Xianglin WANG, Yi-Wen CHEN, Tsung-Chuan MA, Shuiming YE
  • Publication number: 20220078478
    Abstract: An electronic apparatus performs a method of updating an inter-predicted current block using a neighboring affine block. The electronic apparatus first identifies a pixel within the inter-predicted current block, the pixel having a first inter-predicted pixel value. Next, the electronic apparatus determines a motion vector difference for the pixel based on a set of affine parameters of the neighboring affine block and then a pixel value difference for the pixel according to the motion vector difference. The pixel value difference is an inner product of the pixel value gradient vector and the motion vector difference as the pixel value difference. Finally, the electronic apparatus updates the first inter-predicted pixel value with the pixel value difference as a second inter-predicted pixel value.
    Type: Application
    Filed: November 15, 2021
    Publication date: March 10, 2022
    Inventors: Yi-Wen CHEN, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang