Patents by Inventor Xiaoyu Xiu

Xiaoyu Xiu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11381837
    Abstract: The present disclosure relates to a method for video coding. The method includes obtaining a reference picture in a reference picture list associated with a current coding block; generating an inter prediction based on a motion vector from a current picture to the reference picture; obtaining an intra prediction mode associated with the current coding block; generating an intra prediction of the current coding block based on the intra prediction mode; generating a final prediction of the current coding block by weighted averaging the inter prediction and the intra prediction; and determining whether the current coding block is treated as inter mode or intra mode for most probable mode (MPM) based intra mode prediction.
    Type: Grant
    Filed: July 9, 2021
    Date of Patent: July 5, 2022
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Xiaoyu Xiu, Yi-Wen Chen, Xianglin Wang
  • Publication number: 20220210431
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for PROF. A decoder obtains first reference picture and second reference picture associated with a video block that is coded by affine mode within a video signal. The decoder obtains first and second horizontal and vertical gradient values based on first prediction samples I(0)(i,j) and second prediction samples I(1)(i,j) associated with the first reference picture and second reference picture. The decoder obtains first and second horizontal and vertical motion refinements based on CPMVs associated with the first reference picture and second reference picture. The decoder obtains first prediction refinement ?I(0)(i,j) and second prediction refinement ?I(1)(i,j) based on the horizontal and vertical gradient values and the first and second horizontal and vertical motion refinements. The decoder obtains final prediction samples of the video block.
    Type: Application
    Filed: March 16, 2022
    Publication date: June 30, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Bing YU
  • Publication number: 20220201290
    Abstract: Video coding methods are described for reducing latency in template-based inter coding. In some embodiments, a method is provided for coding a video that includes a current picture and at least one reference picture. For at least a current block in the current picture, a respective predicted value is generated (e.g. using motion compensated prediction) for each sample in a template region adjacent to the current block. Once the predicted values are generated for each sample in the template region, a process is invoked to determine a template-based inter prediction parameter by using predicted values in the template region and sample values the reference picture. This process can be invoked without waiting for reconstructed sample values in the template region. Template-based inter prediction of the current block is then performed using the determined template-based inter prediction parameter.
    Type: Application
    Filed: March 14, 2022
    Publication date: June 23, 2022
    Inventors: Xiaoyu XIU, Yuwen HE, Yan YE
  • Publication number: 20220201301
    Abstract: An electronic apparatus performs a method of decoding video data, comprising: receiving, from bitstream, video data corresponding to a coding unit, wherein the coding unit is encoded in inter prediction mode or intra block copy mode; receiving a first syntax element from the video data, wherein the first syntax element indicates whether the coding unit has any non-zero residuals; in accordance with a determination that the first syntax element has a non-zero value: receiving a second syntax element from the video data, wherein the second syntax element indicates whether the coding unit has been encoded using adaptive color-space transform (ACT); in accordance with a determination that the first syntax element has a zero value: assigning the zero value to the second syntax element; and determining whether or not to perform inverse ACT on the video data of the coding unit in accordance with a value of the second syntax element.
    Type: Application
    Filed: March 8, 2022
    Publication date: June 23, 2022
    Inventors: Xiaoyu XIU, Yi-Wen Chen, Tsung-Chuan Ma, Hong-Jheng Jhu, Xianglin Wang, Bing Yu
  • Publication number: 20220201327
    Abstract: A video coding system (e.g., an encoder and/or a decoder) may perform face-based sub-block motion compensation for 360-degree video to predict samples (e.g., of a sub-block). The video coding system may receive a 360-degree video content. The 360-degree video content may include a current block. The current block may include a plurality of sub-blocks. The system may determine whether a sub-block mode is used for the current block. The system may predict a sample in the current block based on the sub-block level face association. For a first sub-block in the current block, the system may identify a first location of the first sub-block. The system may associate the first sub-block with a first face based on the identified first location of the first sub-block. The system may predict a first sample in the first sub-block based on the first face that is associated with the first sub-block.
    Type: Application
    Filed: March 9, 2022
    Publication date: June 23, 2022
    Applicant: VID SCALE, INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Patent number: 11368676
    Abstract: Systems, methods, and Instrumentalities are described herein for calculating local Illumination compensation (LIC) parameters for bi-predicted coding unit (CU). The LIC parameters may be used to generate adjusted samples for the current CU and to address local illumination changes that may exist among temporal neighboring pictures. LIC parameters may be calculated based on bi-predicted reference template samples and template samples for a current CU. Bi-predicted reference template samples may be generated based on reference template samples neighboring temporal reference CUs. For example, the bi-predicted reference template samples may be generated based on averaging the reference template samples. The reference template samples may correspond to template samples for the current CU. A CU may be or may include a coding block and/or a sub-block that may be derived by dividing the coding block.
    Type: Grant
    Filed: January 15, 2019
    Date of Patent: June 21, 2022
    Assignee: VID SCALE, Inc.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye, Saurav Bandyopadhyay
  • Patent number: 11363253
    Abstract: Systems and methods are described for video coding using generalized bi-prediction. In an exemplary embodiment, to code a current block of a video in a bitstream, a first reference block is selected from a first reference picture and a second reference block is selected from a second reference picture. Each reference block is associated with a weight, where the weight may be an arbitrary weight ranging, e.g., between 0 and 1. The current block is predicted using a weighted sum of the reference blocks. The weights may be selected from among a plurality of candidate weights. Candidate weights may be signaled in the bitstream or may be derived implicitly based on a template. Candidate weights may be pruned to avoid out-of-range or substantially duplicate candidate weights. Generalized bi-prediction may additionally be used in frame rate up conversion.
    Type: Grant
    Filed: May 11, 2017
    Date of Patent: June 14, 2022
    Assignee: Vid Scale, Inc.
    Inventors: Chun-Chi Chen, Xiaoyu Xiu, Yuwen He, Yan Ye
  • Patent number: 11363293
    Abstract: A device may determine whether to enable or disable bi-directional optical flow (BIO) for a current coding unit (CU) (e.g., block and/or sub-block). Prediction information for the CU may be identified and may include prediction signals associated with a first reference block and a second reference block (e.g., or a first reference sub-block and a second reference sub-block). A prediction difference may be calculated and may be used to determine the similarity between the two prediction signals. The CU may be reconstructed based on the similarity. For example, whether to reconstruct the CU with BIO enabled or BIO disabled may be based on whether the two prediction signals are similar, it may be determined to enable BIO for the CU when the two prediction signals are determined to be dissimilar. For example, the CU may be reconstructed with BIO disabled when the two prediction signals are determined to be similar.
    Type: Grant
    Filed: July 3, 2018
    Date of Patent: June 14, 2022
    Assignee: VID SCALE, Inc.
    Inventors: Yan Ye, Xiaoyu Xiu, Yuwen He
  • Publication number: 20220182658
    Abstract: A bit-width representation method of prediction refinement with optical flow (PROF), apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a reference picture I associated with a video block within the video signal, obtaining prediction samples I(i,j) of the video block from a reference block in the reference picture I, controlling internal bit-widths of a PROF derivation process for various representation precisions of internal PROF parameters by applying right-shifting to the internal PROF parameters based on different bit-shift values, obtaining prediction refinement values for samples in the video block based on the PROF derivation process being applied to the video block based on the prediction samples I(i,j), and obtaining prediction samples of the video block based on the combination of the prediction samples and the prediction refinement values.
    Type: Application
    Filed: April 30, 2020
    Publication date: June 9, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Shuiming YE, Tsung-Chuan MA, Hong-Jheng JHU
  • Publication number: 20220182659
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. A decoder obtains a first reference picture and a second reference picture associated with a video block. The decoder obtains first and second horizontal and vertical gradient values. The decoder obtains first and second horizontal and vertical motion refinements based on control point motion vectors. The decoder obtains first and second prediction refinements based on the first and second horizontal and vertical gradient values and the first and second horizontal and vertical motion refinements. The decoder obtains first and second refined samples based on the first and second prediction samples, and the first and second prediction refinements. The decoder obtains final prediction samples of the video block based on the first and second refined samples by manipulating the first and second refined samples and prediction parameters to prevent multiplication overflow.
    Type: Application
    Filed: February 22, 2022
    Publication date: June 9, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Bing YU
  • Publication number: 20220174301
    Abstract: An electronic apparatus performs a method of decoding video data. The method comprises, receiving, from bitstream, video data corresponding to a palette-mode coded block; determining a quantization parameter value from information included in a parameter set associated with the palette-mode coded block; identifying escape samples in the palette-mode coded block; in accordance with a determination that the quantization parameter value is greater than a threshold value: performing de-quantization on quantized escape samples according to a predefined formula to obtain reconstructed escape sample values; and in accordance with a determination that the quantization parameter value is less than or equal to the threshold value: setting the reconstructed escape samples to be the quantized escape sample values.
    Type: Application
    Filed: February 15, 2022
    Publication date: June 2, 2022
    Inventors: Hong-Jheng JHU, Xiaoyu XIU, Xianglin WANG, Yi-Wen CHEN, Tsung-Chuan MA, Shulming YE, Bing YU
  • Patent number: 11350123
    Abstract: A method for controlling bit-width for bi-directional optical flow (BDOF) for video coding includes decoding a first reference picture and a second reference picture, the second reference picture being different than the first reference picture, wherein the first reference picture is displayed before a current picture and the second reference picture is displayed after the current picture. A motion refinement of a coding unit (CU) is calculated by minimizing a difference between a first prediction L0 and a second prediction L1. First gradient values for the first prediction Lo and second gradient values for the second prediction L1 are calculated. A final bi-prediction of the CU is calculated. Also disclosed are an associated apparatus and an associated non-transitory computer readable storage medium.
    Type: Grant
    Filed: July 6, 2021
    Date of Patent: May 31, 2022
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Xiaoyu Xiu, Yi-Wen Chen, Xianglin Wang
  • Patent number: 11343519
    Abstract: Inter-layer motion mapping information may be used to enable temporal motion vector prediction (TMVP) of an enhancement layer of a bitstream. For example, a reference picture and a motion vector (MV) of an inter-layer video block may be determined. The reference picture may be determined based on a collocated base layer video block. For example, the reference picture may be a collocated inter-layer reference picture of the reference picture of the collocated base layer video block. The MV may be determined based on a MV of the collocated base layer video block. For example, the MV may be determined by determining the MV of the collocated base layer video block and scaling the MV of the collocated base layer video block according to a spatial ratio between the base layer and the enhancement layer. TMVP may be performed on the enhancement layer picture using the MV of the inter-layer video block.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: May 24, 2022
    Assignee: VID SCALE. Inc.
    Inventors: Xiaoyu Xiu, Yan Ye, Yong He, Yuwen He
  • Publication number: 20220159295
    Abstract: A method for coding video data comprises receiving a video picture comprising a plurality of coding units. The picture is divided into multiple non-overlapped blocks. An encoder calculates a hash value of each block of the multiple non-overlapped blocks. All the non-overlapped blocks are classified into at least two categories comprising a first category and a second category. The first category comprises one or more blocks representing one or more hash values covered by a first set of hash values, and the second category comprises all remaining blocks. The blocks in the second category are classified into at least two groups including a first group. The first group comprises one or more blocks representing the same hash value as another block in the second category. An associated computing device and a non-transitory computer readable storage medium are also provided.
    Type: Application
    Filed: March 11, 2020
    Publication date: May 19, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Tsung-Chuan MA
  • Publication number: 20220159248
    Abstract: A method of decoding video data, comprising: receiving, from bitstream, video data corresponding to a non-skip mode coded block; determining a parameter set associated with the non-skip mode coded block; if the parameter set satisfies a first condition, retrieving a first syntax element from the bitstream; if the parameter set satisfies a second condition, retrieving a second syntax element from the bitstream; if the parameter set satisfies a third condition, retrieving a third syntax element from the bitstream; decoding the video data corresponding to the non-skip mode coded block using palette mode when the first syntax element and the third syntax element have the first value; decoding the video data using intra prediction mode when the first syntax element has the first value and the third syntax element has a second value; and decoding the video data using inter prediction mode when the first syntax element has the second value.
    Type: Application
    Filed: February 2, 2022
    Publication date: May 19, 2022
    Inventors: Yi-Wen Chen, Xianglin Wang, Xiaoyu Xiu, Tsung-Chuan Ma, Bing Yu
  • Publication number: 20220150490
    Abstract: An electronic apparatus performs a method of decoding a video signal. The method comprises: receiving the video signal that includes a first component and a second component in a first picture frame; receiving, from the video signal, a plurality of sample offsets associated with the second component in the first picture frame; deriving a first class index for the second component from a first set of one or more samples of the first component relative to each sample of the second component; selecting a first sample offset from the plurality of sample offsets for the second component according to the first class index; and obtaining a cross-component offsetted sample value of the second component based on the first sample offset in the first picture frame. In some embodiments, the first picture frame is divided into a plurality of regions, and a different classifier is used for each of the plurality of regions.
    Type: Application
    Filed: January 21, 2022
    Publication date: May 12, 2022
    Inventors: Che-Wei KUO, Xiaoyu XIU, Wei CHEN, Xianglin WANG, Yi-Wen CHEN, Tsung-Chuan MA, Hong-Jheng JHU, Bing YU
  • Publication number: 20220150505
    Abstract: Bi-directional optical flow (BDOF) may be bypassed, for a current coding block, based on whether symmetric motion vector difference (8MVD) is used in motion vector coding for the current coding block, A coding device (e.g., an encoder or a decoder) may determine whether to bypass BDOF for the current coding block based at least in part on an SMVD indication for the current coding block, The coding device may obtain the SMVD indication that indicates whether SMVD is used in motion vector coding for the current coding block. If SMVD Indication indicates that SMVD is used in the motion vector coding for the current coding block, the coding device may bypass BDOF for the current coding block. The coding device may reconstruct, the current coding block without performing BDOF if it determines to bypass BDOF for the current coding block.
    Type: Application
    Filed: December 19, 2019
    Publication date: May 12, 2022
    Applicant: VID SCALE, INC.
    Inventors: Jiancong Luo, Xiaoyu Xiu, Yuwen He, Hua Yang
  • Publication number: 20220150522
    Abstract: An electronic apparatus performs a method of decoding video data. The method comprises: receiving, from bitstream, video data corresponding to a transform-skip mode coded block; decoding, from the video data, a first codeword, a second codeword and a first group of codewords for a pixel within the transform-skip mode coded block; deriving an initial level value from the first group of codewords; converting the first codeword into a remainder of the pixel in accordance with a predefined mapping relationship that is generated using a constant Rice parameter; converting the second codeword into a sign value of the remainder; and deriving a quantified residual of the pixel from the remainder, the sign value and the initial level value.
    Type: Application
    Filed: January 24, 2022
    Publication date: May 12, 2022
    Inventors: Yi-Wen CHEN, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Xianglin Wang, Bing Yu
  • Patent number: 11323722
    Abstract: Expressions of artistic intent are identified (e.g. by signaling or content analysis) and expressed as a set of artistic intent positions P.sub.ART and artistic intent characteristics C.sub.ART, Artistic intent characteristics C.sub.ART may be signaled and used to identify artistic intent positions P.sub.ART. Artistic intent preservation coding and processing may be applied to sample positions P.sub.ART to preserve characteristics C.sub.ART. A coding user interface may permit a user to specify an artistic set (e.g. P.sub.ART and/or C.sub.ART) and to select and/or configure treatment of pixels and/or blocks associated with an artistic set, such as a fidelity enhancement, QP adjustment value and/or postprocessing. Content priority or importance levels may be impliedly and/or expressly indicated at fine (e.g. pixel, sample) and/or coarse (e.g. block) levels of content for varying (e.g. enhanced, reduced) levels of treatment in content coding, delivery, processing and/or error resilience/robustness.
    Type: Grant
    Filed: April 21, 2016
    Date of Patent: May 3, 2022
    Assignee: InterDigital Madison Patent Holdings, SAS
    Inventors: Byung K. Yi, Yan Ye, Yuwen He, Xiaoyu Xiu, Yong He, Ralph Neff
  • Publication number: 20220132138
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for video decoding. The method includes dividing a video block to multiple non-overlapped video subblocks, dividing a video block to multiple non-overlapped video subblocks, obtaining a first reference picture I(0) and a second reference picture I(1), obtaining first prediction samples I(0)(i,j)'s, obtaining second prediction samples I(1)(i,j)'s, obtaining horizontal and vertical gradient values of the first prediction samples I(0)(i,j)'s and second prediction samples I(1)(i,j)'s, obtaining motion refinements for samples in the video subblock based on the BDOF when the video block is not coded in affine mode, obtaining motion refinements for samples in the video subblock based on the PROF when the video block is coded in affine mode, and obtaining prediction samples of the video block based on the motion refinements.
    Type: Application
    Filed: January 7, 2022
    Publication date: April 28, 2022
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Bing YU