Patents by Inventor Xianglin Wang

Xianglin Wang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220078478
    Abstract: An electronic apparatus performs a method of updating an inter-predicted current block using a neighboring affine block. The electronic apparatus first identifies a pixel within the inter-predicted current block, the pixel having a first inter-predicted pixel value. Next, the electronic apparatus determines a motion vector difference for the pixel based on a set of affine parameters of the neighboring affine block and then a pixel value difference for the pixel according to the motion vector difference. The pixel value difference is an inner product of the pixel value gradient vector and the motion vector difference as the pixel value difference. Finally, the electronic apparatus updates the first inter-predicted pixel value with the pixel value difference as a second inter-predicted pixel value.
    Type: Application
    Filed: November 15, 2021
    Publication date: March 10, 2022
    Inventors: Yi-Wen CHEN, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang
  • Publication number: 20220070445
    Abstract: Methods and apparatuses are provided for video coding. The method includes: partitioning video pictures into a plurality of coding units (CUs), at least one of which is further partitioned into two prediction units (PUs) including at least one geometric shaped PU; obtaining a first merge list including a plurality of candidates, each including one or more motion vectors; and obtaining a uni-prediction merge list for the geometric shaped PU by selecting the one or more motion vectors directly from the first merge list.
    Type: Application
    Filed: November 9, 2021
    Publication date: March 3, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xianglin WANG, Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA, Hong-Jheng JHU, Shuiming YE
  • Publication number: 20220060656
    Abstract: Embodiments of the disclosure provide systems and methods for performing frame rate up-conversion of video data including a sequence of image frames. The method may include determining a set of motion vectors of a target frame relative to a plurality of reference frames. The target frame is to be generated and interpolated into the sequence of image frames. The method may further include performing a motion vector classification on the set of motion vectors to generate a target object map for the target frame. The method may additionally include projecting the target object map onto the plurality of reference frames to generate a plurality of reference object maps based on the set of motion vectors. The method may additionally include detecting an occlusion area in the target frame based on the set of motion vectors, the target object map, and the plurality of reference object maps.
    Type: Application
    Filed: July 20, 2021
    Publication date: February 24, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Guoxin Jin, Shufei Fan, Bing Yu
  • Publication number: 20220046249
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for prediction refinement with optical flow (PROF) for decoding a video signal. A decoder may obtain a first reference picture associated with a video block in a current picture within the video signal and a first motion vector (MV) from the video block in the current picture to a reference video block in the first reference picture. The decoder may obtain first prediction samples I(i, j) of a video block generated from the reference video block in the first reference picture. The decoder may control internal bit-depths of internal PROF parameters. The decoder may obtain prediction refinement values for the first prediction samples I(i, j) based on the horizontal and vertical gradient values and the horizontal and vertical motion differences. The decoder may obtain second prediction samples I?(i, j). The decoder may obtain final prediction samples of the video block.
    Type: Application
    Filed: October 25, 2021
    Publication date: February 10, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Shuiming YE, Tsung-Chuan MA, Hong-Jheng JHU
  • Publication number: 20220038726
    Abstract: An electronic apparatus performs a method of decoding video data. The method comprises: receiving the video signal that includes a first component and a second component; receiving a plurality of offsets associated with the second component; utilizing a sample value of the first component to obtain a classifier associated with the second component; dividing a range of the sample value of the first component into several bands based on the classifier; selecting a band based on an intensity value of the sample value of the first component; selecting an offset from the plurality of offsets for the second component according to the selected band; and modifying the second component based on the selected offset.
    Type: Application
    Filed: July 28, 2021
    Publication date: February 3, 2022
    Inventors: Che-Wei Kuo, Xiaoyu Xiu, Wei Chen, Xianglin Wang, Yi-Wen Chen, Tsung-Chuan Ma, Hong-Jheng Jhu, Bing Yu
  • Publication number: 20220030270
    Abstract: The present disclosure relates to a bit-width control method of bi-directional optical flow (BDOF) for coding a video signal. The method includes obtaining a first reference picture I(0) and a second reference picture I(1) associated with a video block, obtaining first prediction samples I(0)(i,j) of the video block from a reference block in the first reference picture I(0), obtaining second prediction samples I(1)(i,j) of the video block from a reference block in the second reference picture I(1), controlling internal bit-widths of the BDOF by deriving internal bit-widths of intermediate parameters, obtaining motion refinements for samples in the video block based on the BDOF being applied to the video block based on the first prediction samples I(0)(i,j) and the second prediction samples I(1)(i,j), and obtaining bi-prediction samples of the video block based on the motion refinements.
    Type: Application
    Filed: September 15, 2021
    Publication date: January 27, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG
  • Publication number: 20220030259
    Abstract: An electronic apparatus performs a method of decoding video data. The electronic apparatus first receives, from a video bitstream having a hierarchical structure, a first syntax element associated with a first level of the hierarchical structure. In accordance with a determination that the first syntax element indicates that a palette mode is enabled for one or more coding units (CUs) under the first level in the video bitstream, the electronic apparatus reconstructs, from the video bitstream, pixel values of at least one of the one or more CUs according to a corresponding palette table. But in accordance with a determination that the first syntax element indicates that a palette mode is disabled for the one or more CUs, the electronic apparatus reconstructs, from the video bitstream, the pixel values of any of the one or more CUs according to a non-palette scheme.
    Type: Application
    Filed: October 11, 2021
    Publication date: January 27, 2022
    Inventors: Xianglin Wang, Hong-Jheng Jhu, Xiaoyu Xiu, Yi-Wen Chen, Tsung-Chuan Ma, Shuiming Ye
  • Publication number: 20220030228
    Abstract: An electronic apparatus performs a method of updating a most probable modes candidate list for a current block of video data. The electronic apparatus first identifies a neighboring block located at a predefined location relative to the current block and its associated matrix-based intra prediction mode. Next, the electronic apparatus determines a regular intra prediction mode corresponding to the matrix-based intra prediction mode for the neighboring block according to a predefined mathematical relationship between regular intra prediction modes and matrix-based intra prediction modes. Finally, the electronic apparatus inserts the regular intra prediction mode associated with the neighboring block into the most probable modes candidate list according to a predefined order.
    Type: Application
    Filed: October 11, 2021
    Publication date: January 27, 2022
    Inventors: Tsung-chuan MA, Xianglin WANG, Yi-wen CHEN, Xiaoyu XIU, Hong-Jheng JHU, Shuiming YE, Yun-fei ZHENG
  • Publication number: 20220030219
    Abstract: Provided is a video coding method comprising that the width of a video picture is set to be a first multiple of a first number M, and the first number M is a positive integer. The height of the picture is set to be a second multiple of a second number N, and the second number N is a positive integer. The first number M and the second number N are predetermined. Additionally, it is determined that a merge sharing node is located outside of the picture. The merge sharing node is corresponding to a first region of the picture, a first set of coding units of the picture are within the first region, and the first set of coding units are coded with a merge mode. A constraint process is then applied such that the boundary of the merge sharing node is aligned with the boundary of the picture.
    Type: Application
    Filed: September 7, 2021
    Publication date: January 27, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA, Xianglin WANG
  • Publication number: 20220021894
    Abstract: A method for video coding is provided. The method includes: determining a signaling of merge modes for deriving motion information of a current block, where the merge modes include: regular merge mode and extended merge modes; and deriving motion information of the current block using the regular merge mode, upon determining that the signaling of merge modes includes a positive signal of regular merge mode.
    Type: Application
    Filed: September 28, 2021
    Publication date: January 20, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA, Hong-Jheng JHU, Shuiming YE, Xianglin WANG
  • Publication number: 20220014780
    Abstract: Methods are provided for video coding. The method includes: partitioning video pictures into a plurality of coding units (CUs), at least one of which is further partitioned into two prediction units (PUs) including at least one geometric shaped PU; obtaining a first merge list including a plurality of candidates, each including one or more motion vectors; and obtaining a uni-prediction merge list for the geometric shaped PU by selecting the one or more motion vectors directly from the first merge list.
    Type: Application
    Filed: September 23, 2021
    Publication date: January 13, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xianglin WANG, Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA
  • Publication number: 20220014741
    Abstract: The present disclosure relates to an intra sub-partition (ISP) method of decoding a video signal.
    Type: Application
    Filed: August 27, 2021
    Publication date: January 13, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Tsung-Chuan MA
  • Publication number: 20220007030
    Abstract: The present disclosure relates to a bit-width control method of bi-directional optical flow (BDOF) for coding a video signal. The method includes obtaining a first reference picture I(0) and a second reference picture I(1) associated with a video block, obtaining first prediction samples I(0)(i,j) of the video block from a reference block in the first reference picture I(0), obtaining second prediction samples I(1)(i,j) of the video block from a reference block in the second reference picture I(1), controlling internal bit-widths of the BDOF by deriving internal bit-widths of intermediate parameters, obtaining motion refinements for samples in the video block based on the BDOF being applied to the video block based on the first prediction samples I(0)(i,j) and the second prediction samples I(1)(i,j), and obtaining bi-prediction samples of the video block based on the motion refinements.
    Type: Application
    Filed: September 15, 2021
    Publication date: January 6, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG
  • Publication number: 20210409722
    Abstract: A method for video coding is provided. The method may include: identifying motion vectors (MVs) and control point motion vectors (CPMVs) for spatial MV prediction and affine motion inheritance, respectively; converting the MVs and the CPMVs into a mantissa-exponent format; and storing mantissa-exponent representations of the MVs and the CPMVs in a memory.
    Type: Application
    Filed: September 7, 2021
    Publication date: December 30, 2021
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG
  • Publication number: 20210409746
    Abstract: A computing device performs a method of decoding video data by receiving a bitstream corresponding to video data encoding one or more pictures, wherein the one or more pictures are recursively partitioned into a plurality of groups at different partition levels; determining a first syntax element that corresponds to a first group of the plurality of groups; in accordance with a determination that the first syntax element has a first value: decoding the first group in a first mode; and in accordance with a determination that the first syntax element has a second value: determining a respective second syntax element for each of one or more second groups within the first groups, wherein the one or more second groups are at a second partition level below the first partition level; and decoding each of the one or more second groups in accordance with a value of the respective second syntax element.
    Type: Application
    Filed: September 13, 2021
    Publication date: December 30, 2021
    Inventors: Xianglin WANG, Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA, Hong-Jheng JHU
  • Publication number: 20210409731
    Abstract: Methods and devices for video coding are provided. In the method, the device determines, for a current luma transform block in a coding unit, whether an intra subpartition (ISP) split type is an ISP mode. In response to determining that the intra subpartition split type is not the ISP mode, the device determines a first context index for a Coded Block Flag (CBF) flag of the current luma transform block as being equal to zero or one, where the CBF flag specifies whether the current luma transform block comprises one or more transform coefficient levels not equal to zero. In response to determining that the intra subpartition split type is the ISP mode, the device determines the first context index based on a CBF variable of a previous luma transform unit in the coding unit.
    Type: Application
    Filed: September 7, 2021
    Publication date: December 30, 2021
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA, Xianglin WANG
  • Publication number: 20210409750
    Abstract: Methods of constraining and adjusting the applications of Combined Inter- and Intra-Prediction (CIIP) mode employed in video coding standards, such as the now-current Versatile Video Coding (VVC), are performed at a computing device. In one method, the computing device determines whether to apply decoder-side motion vector refinement (DMVR) and bidirectional optical flow (BDOF) on a bi-prediction block. In another method, the computing device determines whether each CU among the neighboring CUs of the current CU is respectively CIIP-coded, and employing a unified criterion that does not depend upon a determination whether the current CU is intra- or CIIP-coded in the course of using the intra-mode of the neighboring CIIP-coded CU in the formation of the Most Probable Mode (MPM) candidate list for the current CU.
    Type: Application
    Filed: September 10, 2021
    Publication date: December 30, 2021
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG
  • Publication number: 20210400261
    Abstract: Methods and devices are provided for deriving constructed affine merge candidates. The method includes obtaining a first reference picture and a second reference picture associated with an inter mode coded block, where the first reference picture is before a current picture and the second reference picture is after the current picture in display order, obtaining a first motion vector from the inter mode coded block to a reference block in the first reference picture, obtaining a second motion vector from the inter mode coded block to a reference block in the second reference picture, applying bi-directional optical flow (BDOF) or decoder-side motion vector refinement (DMVR) to the inter mode coded block based on a mode information of the inter mode coded block, and predicting a bi-prediction of the inter mode coded block based on the applied BDOF or DMVR.
    Type: Application
    Filed: September 7, 2021
    Publication date: December 23, 2021
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA, Xianglin WANG
  • Publication number: 20210400294
    Abstract: The present disclosure relates to a method for deriving constructed affine merge candidates. The method includes acquiring, from a decoder, a regular merge flag for a coding unit (CU) which is coded as merge mode and merge related modes, when the regular merge flag is one, indicating that regular merge mode or merge mode with motion vector differences (MMVD) is used by the CU, constructing a motion vector merge list for the CU and using regular merge index to indicate which candidate is used, and when the regular merge flag is zero, indicating regular merge mode is not used by the CU, and further receiving mode flags to indicate associated merge related modes are used when a mode flag's constraints are met.
    Type: Application
    Filed: June 30, 2021
    Publication date: December 23, 2021
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen CHEN, Xianglin WANG
  • Publication number: 20210400293
    Abstract: Methods and apparatuses are provided for video coding. The method includes: partitioning video pictures into a plurality of coding units (CUs), at least one of which is further partitioned into two prediction units (PUs) including at least one geometric shaped PU; obtaining a first merge list including a plurality of candidates, each including one or more motion vectors; and obtaining a uni-prediction merge list for the geometric shaped PU; where the uni-prediction merge list including a plurality of uni-prediction merge candidates, and each uni-prediction merge candidate includes one motion vector of a corresponding candidate in the first merge list.
    Type: Application
    Filed: September 3, 2021
    Publication date: December 23, 2021
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xianglin WANG, Yi-Wen CHEN, Xiaoyu XUE, Tsung-Chuan MA