Patents by Inventor Xiaoyu YE

Xiaoyu YE has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11991351
    Abstract: Video coding methods are described for reducing latency in template-based inter coding. In some embodiments, a method is provided for coding a video that includes a current picture and at least one reference picture. For at least a current block in the current picture, a respective predicted value is generated (e.g. using motion compensated prediction) for each sample in a template region adjacent to the current block. Once the predicted values are generated for each sample in the template region, a process is invoked to determine a template-based inter prediction parameter by using predicted values in the template region and sample values the reference picture. This process can be invoked without waiting for reconstructed sample values in the template region. Template-based inter prediction of the current block is then performed using the determined template-based inter prediction parameter.
    Type: Grant
    Filed: March 14, 2022
    Date of Patent: May 21, 2024
    Assignee: VID SCALE INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Patent number: 11991384
    Abstract: Systems, methods, and instrumentalities are disclosed for motion vector clipping when affine motion mode is enabled for a video block. A video coding device may determine that an affine mode for a video block is enabled. The video coding device may determine a plurality of control point affine motion vectors associated with the video block. The video coding device may store the plurality of clipped control point affine motion vectors for motion vector prediction of a neighboring control point affine motion vector. The video coding device may derive a sub-block motion vector associated with a sub-block of the video block, clip the derived sub-block motion vector, and store it for spatial motion vector prediction or temporal motion vector prediction. For example, the video coding device may clip the derived sub-block motion vector based on a motion field range that may be based on a bit depth value.
    Type: Grant
    Filed: November 11, 2022
    Date of Patent: May 21, 2024
    Assignee: VID SCALE, INC.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye, Philippe Hanhart
  • Publication number: 20240163469
    Abstract: A method of decoding a video signal, apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a video block from the video signal, obtaining spatial neighboring blocks based on the video block, obtaining up to one left non-scaled motion vector predictor (MVP) based on the multiple left spatial neighboring blocks, obtaining up to one above non-scaled MVP based on the multiple above spatial neighboring blocks, deriving an MVP candidate list based on the coding block, the multiple left spatial neighboring blocks, and the multiple above spatial neighboring blocks by performing no motion vector scaling in all scenarios for deriving motion vectors in deriving process for spatial MVP candidates, receiving an index indicating an MVP in the MVP candidate list, and obtaining a prediction signal of the coding block based on the MVP indicated by the index.
    Type: Application
    Filed: January 19, 2024
    Publication date: May 16, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen CHEN, Xiaoyu XIU, Tsung-Chuan MA, Hong-Jheng JHU, Shuiming YE, Xianglin WANG
  • Patent number: 11985356
    Abstract: A method of decoding a syntax element for a current coding unit of video data is performed by an electronic apparatus. The electronic apparatus identifies, for the current coding unit, an above coding unit and a coding tree unit including the current coding unit. After determining that the above coding unit is within the coding tree unit, the electronic apparatus decodes, from a video bitstream, a corresponding syntax element for the current coding unit based, at least in part, on a syntax element associated with the above coding unit retrieved from a line buffer associated with the coding tree unit; otherwise, the electronic apparatus decodes, from the video bitstream, the corresponding syntax element for the current coding unit based, at least in part, on a default value assigned to the syntax element associated with the above coding unit.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: May 14, 2024
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Tsung-Chuan Ma, Hong-Jheng Jhu, Xianglin Wang, Yi-Wen Chen, Xiaoyu Xiu, Shuiming Ye, Yun-fei Zheng, Bing Yu
  • Patent number: 11979575
    Abstract: Methods and devices are provided for reducing the decoding latency introduced by LMCS. In one method, one or more luma prediction sample values are selected from an output of a bilinear filter of Decoder-side Motion Vector Derivation (DMVR), the one or more selected luma prediction sample values are adjusted into luma prediction sample values with the same bit depth as an original coding bit depth of an input video, the luma prediction sample values with the same bit depth as the original coding bit depth of the input video are used to derive a scaling factor for decoding one or more chroma residual samples, the scaling factor is used to scale one or more chroma residual samples, and one or more chroma residual samples are reconstructed by adding the one or more scaled chroma residual samples and their corresponding chroma prediction samples.
    Type: Grant
    Filed: December 16, 2021
    Date of Patent: May 7, 2024
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Xiaoyu Xiu, Yi-Wen Chen, Xianglin Wang, Tsung-Chuan Ma, Shuiming Ye, Hong-Jheng Jhu
  • Patent number: 11973974
    Abstract: Embodiments of video coding systems and methods are described for reducing coding latency introduced by decoder-side motion vector refinement (DMVR). In one example, two non-refined motion vectors are identified for coding of a first block of samples (e.g. a first coding unit) using bi-prediction. One or both of the non-refined motion vectors are used to predict motion information for a second block of samples (e.g. a second coding unit). The two non-refined motion vectors are refined using DMVR, and the refined motion vectors are used to generate a prediction signal of the first block of samples. Such embodiments allow the second block of samples to be coded substantially in parallel with the first block without waiting for completion of DMVR on the first block. In additional embodiments, optical-flow-based techniques are described for motion vector refinement.
    Type: Grant
    Filed: December 5, 2022
    Date of Patent: April 30, 2024
    Assignee: VID SCALE, INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Publication number: 20240137516
    Abstract: Methods and devices are provided for reducing the decoding latency introduced by LMCS. In one method, one or more luma prediction sample values are selected from an output of a bilinear filter of Decoder-side Motion Vector Derivation (DMVR), the one or more selected luma prediction sample values are adjusted into luma prediction sample values with the same bit depth as an original coding bit depth of an input video, the luma prediction sample values with the same bit depth as the original coding bit depth of the input video are used to derive a scaling factor for decoding one or more chroma residual samples, the scaling factor is used to scale one or more chroma residual samples, and one or more chroma residual samples are reconstructed by adding the one or more scaled chroma residual samples and their corresponding chroma prediction samples.
    Type: Application
    Filed: December 26, 2023
    Publication date: April 25, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Tsung-Chuan MA, Shuiming YE, Hong-Jheng JHU
  • Patent number: 11968358
    Abstract: Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.
    Type: Grant
    Filed: October 10, 2022
    Date of Patent: April 23, 2024
    Assignee: Vid Scale, Inc.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye, Jiancong Luo
  • Patent number: 11968388
    Abstract: A bit-width representation method of prediction refinement with optical flow (PROF), apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a reference picture I associated with a video block within the video signal, obtaining prediction samples I(i,j) of the video block from a reference block in the reference picture I, controlling internal bit-widths of a PROF derivation process for various representation precisions of internal PROF parameters by applying right-shifting to the internal PROF parameters based on different bit-shift values, obtaining prediction refinement values for samples in the video block based on the PROF derivation process being applied to the video block based on the prediction samples I(i,j), and obtaining prediction samples of the video block based on the combination of the prediction samples and the prediction refinement values.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: April 23, 2024
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu Xiu, Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Tsung-Chuan Ma, Hong-Jheng Jhu
  • Patent number: 11962759
    Abstract: Systems, methods, and instrumentalities are described herein for calculating local illumination compensation (LIC) parameters for bi-predicted coding unit (CU). The LIC parameters may be used to generate adjusted samples for the current CU and to address local illumination changes that may exist among temporal neighboring pictures. LIC parameters may be calculated based on bi-predicted reference template samples and template samples for a current CU. Bi-predicted reference template samples may be generated based on reference template samples neighboring temporal reference CUs. For example, the bi-predicted reference template samples may be generated based on averaging the reference template samples. The reference template samples may correspond to template samples for the current CU. A CU may be or may include a coding block and/or a sub-block that may be derived by dividing the coding block.
    Type: Grant
    Filed: April 28, 2022
    Date of Patent: April 16, 2024
    Assignee: VID SCALE, Inc.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye, Saurav Bandyopadhyay
  • Publication number: 20240121431
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. The method includes obtaining a first reference picture I associated with a video block, obtaining control point motion vectors (CPMVs) of an affine coding block based on the video block, obtaining prediction samples I(i, j) of the affine coding block, deriving PROF prediction sample refinements of the affine coding block based on the PROF, receiving an LIC flag that indicates whether the LIC is applied to the affine coding block, deriving, and when the LIC is applied, LIC weight and offset based on neighboring reconstructed samples of the affine coding block and their corresponding reference samples in the first reference picture, and obtaining final prediction samples of the affine coding block based on the PROF prediction sample refinements and the LIC weight and offset.
    Type: Application
    Filed: December 15, 2023
    Publication date: April 11, 2024
    Applicant: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Shuiming YE, Tsung-Chuan MA, Hong-Jheng JHU
  • Patent number: 11943467
    Abstract: Systems, methods, and instrumentalities for affine motion estimation for affine model-based video coding may be disclosed herein. A first motion vector (MV) set including one or more MVs may be derived for a first coding block. The MVs may be control point MVs (CPMVs) and the MVs may be derived by performing affine motion estimation (ME) associated with the first coding block. The first MV set may be added to a recently-estimated MV list. A head of the recently-estimated MV list may be set to the first MV set. The recently-estimated MV list may be empty or may contain one or more previously-added MV sets.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: March 26, 2024
    Assignee: VID Scale, Inc.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye, Jiancong Luo
  • Patent number: 11943468
    Abstract: An electronic apparatus performs a method of updating an inter-predicted current block using a neighboring affine block. The electronic apparatus first identifies a pixel within the inter-predicted current block, the pixel having a first inter-predicted pixel value. Next, the electronic apparatus determines a motion vector difference for the pixel based on a set of affine parameters of the neighboring affine block and then a pixel value difference for the pixel according to the motion vector difference. The pixel value difference is an inner product of the pixel value gradient vector and the motion vector difference as the pixel value difference. Finally, the electronic apparatus updates the first inter-predicted pixel value with the pixel value difference as a second inter-predicted pixel value.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: March 26, 2024
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen Chen, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang
  • Patent number: 11917189
    Abstract: A method of decoding a video signal, apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a video block from the video signal, obtaining spatial neighboring blocks based on the video block, obtaining up to one left non-scaled motion vector predictor (MVP) based on the multiple left spatial neighboring blocks, obtaining up to one above non-scaled MVP based on the multiple above spatial neighboring blocks, deriving, at the decoder and by reducing possibility of selecting scaled MVPs derived from the spatial neighboring blocks, an MVP candidate list based on the video block, the multiple left spatial neighboring blocks, the multiple above spatial neighboring blocks, receiving a best MVP based on the MVP candidate list, and obtaining a prediction signal of the video block based on the best MVP.
    Type: Grant
    Filed: December 3, 2021
    Date of Patent: February 27, 2024
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Yi-Wen Chen, Xiaoyu Xiu, Tsung-Chuan Ma, Hong-Jheng Jhu, Shuiming Ye, Xianglin Wang
  • Publication number: 20230381646
    Abstract: Systems and methods are provided for an advanced stereoscopic 3D rendering system to solve several of these 3D rendering issues and work independently of different game engines. For example, the system can include a stereoscopic render mechanism to apply post-processing effects to OpenGL ES applications. The advanced stereoscopic 3D rendering system can be added as an interception layer between the game engine and the display screen of the user. This interception layer can be integrated with many different game engines to create a 3D view for various user device models, thus removing the need for image generators at the user device to create 3D images. The 3D images can be created by the advanced stereoscopic 3D rendering system for viewing by the end user and seemingly incorporated with the game or other software application.
    Type: Application
    Filed: August 11, 2023
    Publication date: November 30, 2023
    Inventors: Hongyu Sun, Chen Li, Chengeng Li, Zhebin Zhang, Xiaoyu Ye, Daniel Thornton
  • Publication number: 20220383907
    Abstract: The disclosure can provide a method and an apparatus for processing a video, a method and an apparatus for playing a video. The method for processing a video includes: displaying a video processing page including an editing region of a target template video, the editing region for displaying at least one video element of the target template video; obtaining associated object information of at least one associated object of a target video element corresponding to an object association instruction in response to the object association instruction triggered based on any video element; generating a target video based on the target template video in response to a video generation instruction, and establishing association information between the associated object information and the target video.
    Type: Application
    Filed: January 14, 2022
    Publication date: December 1, 2022
    Inventors: Gan Zhang, Wenhao Yin, Xiaoyu Ye
  • Patent number: 11466333
    Abstract: The invention discloses a continuous hot rolled coil for a high collapse-resistant SEW petroleum casing and a manufacturing method thereof, and belongs to the technical field of hot continuous rolling production. Provided is a continuous hot rolled coil for a high collapse-resistant SEW petroleum casing with low alloy element cost and excellent initial welding property, and a manufacturing method thereof. The production cost of the hot continuous rolled coil is lowered by reducing expensive alloy elements such as Mo and V therein, and strictly controlling the content components of chemical elements such as Cr, Mn and Ti.
    Type: Grant
    Filed: June 20, 2018
    Date of Patent: October 11, 2022
    Assignee: Pangang Group Panzhihua Iron & Steel Research Institute Co., Ltd.
    Inventors: Kaihua Zhang, Xiaoyu Ye, Xuegang Xiong, Yi Wang
  • Patent number: 11287401
    Abstract: Disclosed is a sample pretreatment method of microextraction tube injection, comprising providing a capillary micro-extraction tube with extracting medium in it as an injector, passing a sample through the capillary micro-extraction tube, during which an analyte is extracted into an extracting medium inside the capillary micro-extraction tube; then, filling the capillary micro-extraction tube with an organic solvent and keeping the filling for a certain period of time, so that the extracted analyte is dissolved in the organic solvent inside the capillary micro-extraction tube to form an injection solution; finally, keeping one end of the capillary micro-extraction tube sealed and inserting the other end directly into an injection port of a gas chromatography, such that the injection solution is automatically ejected out from the capillary micro-extraction tube into the injection port.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: March 29, 2022
    Assignee: WUHAN SPENRICH TECHNOLOGIES CO., LTD
    Inventors: Jun Xing, Xiaoyu Ye, Wenyu Huang
  • Publication number: 20200399728
    Abstract: The invention discloses a continuous hot rolled coil for a high collapse-resistant SEW petroleum casing and a manufacturing method thereof, and belongs to the technical field of hot continuous rolling production. Provided is a continuous hot rolled coil for a high collapse-resistant SEW petroleum casing with low alloy element cost and excellent initial welding property, and a manufacturing method thereof. The production cost of the hot continuous rolled coil is lowered by reducing expensive alloy elements such as Mo and V therein, and strictly controlling the content components of chemical elements such as Cr, Mn and Ti.
    Type: Application
    Filed: June 20, 2018
    Publication date: December 24, 2020
    Inventors: Kaihua ZHANG, Xiaoyu YE, Xuegang XIONG, Yi WANG
  • Publication number: 20200049672
    Abstract: Disclosed is a sample pretreatment method of microextraction tube injection, comprising providing a capillary micro-extraction tube with extracting medium in it as an injector, passing a sample through the capillary micro-extraction tube, during which an analyte is extracted into an extracting medium inside the capillary micro-extraction tube; then, filling the capillary micro-extraction tube with an organic solvent and keeping the filling for a certain period of time, so that the extracted analyte is dissolved in the organic solvent inside the capillary micro-extraction tube to form an injection solution; finally, keeping one end of the capillary micro-extraction tube sealed and inserting the other end directly into an injection port of a gas chromatography, such that the injection solution is automatically ejected out from the capillary micro-extraction tube into the injection port.
    Type: Application
    Filed: October 17, 2019
    Publication date: February 13, 2020
    Inventors: Jun XING, Xiaoyu YE, Wenyu HUANG