Patents by Inventor Yan Ye

Yan Ye has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11601651
    Abstract: The present disclosure provides a method and an apparatus for motion vector refinement. An exemplary method includes: determining a plurality of first blocks associated with a first motion vector and a plurality of second blocks associated with a second motion vector; determining a sum of absolute transformed difference (SATD) between one of the plurality of first blocks and one of the plurality of second blocks; and refining the first motion vector and the second motion vector based on the determined SATDs.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: March 7, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Jie Chen, Ru-Ling Liao, Yan Ye
  • Patent number: 11601655
    Abstract: The present disclosure provides a computer-implemented method for encoding or decoding video. The method includes encoding or decoding, in a plurality of picture parameter sets (PPS) associated with pictures of a coded layer video sequence (CLVS), corresponding first PPS flags indicating whether pictures are allowed to be partitioned into a plurality of tiles or slices. In a first PPS, a corresponding first PPS flag with a first value indicates a first picture of the CLVS is unpartitioned, and in a second PPS, another corresponding first PPS flag with a second value being different from the first value indicates that a second picture of the CLVS is allowed to be partitioned.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: March 7, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Jie Chen, Yan Ye, Ru-Ling Liao
  • Patent number: 11601676
    Abstract: Systems, methods, and instrumentalities are disclosed for performing horizontal geometry padding on a current sample based on receiving a wraparound enabled indication that indicates whether a horizontal wraparound motion compensation is enabled. If the horizontal wraparound motion compensation is enabled based on the wraparound enabled indication, a video coding device may determine a reference sample wraparound offset of a current sample in a picture. The reference sample wraparound offset may indicate a face width of the picture. The video coding device may determine a reference sample location for the current sample based on the reference sample wraparound offset, a picture width of the picture, and a current sample location. The video coding device may predict the current sample based on the reference sample location in a horizontal direction. Repetitive padding or clipping may be used in the vertical direction.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: March 7, 2023
    Assignee: VID Scale, Inc.
    Inventors: Philippe Hanhart, Yuwen He, Yan Ye
  • Publication number: 20230063385
    Abstract: The present disclosure provides video processing method and apparatus. An exemplary method includes: determining whether a coding block comprises samples outside a picture boundary; and in response to the coding block being determined to comprise samples outside a picture boundary, performing quad tree splitting of the coding block regardless of a value of a first parameter, wherein the first parameter indicates whether the quad tree is allowed to be used to split the coding block.
    Type: Application
    Filed: October 10, 2022
    Publication date: March 2, 2023
    Inventors: Ru-Ling LIAO, Yan YE, Jie CHEN, Jiancong LUO
  • Publication number: 20230055802
    Abstract: Methods and apparatuses for video encoding, comprising: receiving a video sequence; encoding the video sequence by using control flags for luma mapping with chroma scaling (LMCS) at a sequence level, a picture level, or a slice level, wherein the sequence level, the picture level, and the slice level are levels ranking from high to low; signaling a first control flag indicating whether the LMCS is enabled at a first level; and in response to the first control flag indicating the LMCS is enabled at the first level, signaling a second control flag indicating whether LMCS is enabled at a second level, wherein: the LMCS is enabled at the second level when a value of the second control flag equals to 1; the LMCS is disabled at the second level when the value of the second control flag equals to 0; and the second level is a lower level than the first level.
    Type: Application
    Filed: October 13, 2022
    Publication date: February 23, 2023
    Inventors: Jie CHEN, Jiancong LUO, Yan YE, Mohammed Golam SARWER
  • Patent number: 11589067
    Abstract: The present disclosure provides apparatus and methods for signaling sub-block transform (SBT) information. The SBT information is used for coding video data. According to certain disclosed embodiments, an exemplary method includes: signaling a first flag in a Sequence Parameter Set (SPS) of a video sequence indicating whether a sub-block transform (SBT) is enabled; and signaling a second flag indicating a maximum transform block (TB) size that allows the SBT. A maximum coding unit (CU) size that allows the SBT is determined directly based on the maximum TB size in response to the first flag indicating that the SBT is enabled.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: February 21, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Mohammed Golam Sarwer, Jiancong Luo, Yan Ye
  • Publication number: 20230053233
    Abstract: Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.
    Type: Application
    Filed: October 10, 2022
    Publication date: February 16, 2023
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye, Jiancong Luo
  • Publication number: 20230050213
    Abstract: Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.
    Type: Application
    Filed: October 10, 2022
    Publication date: February 16, 2023
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye, Jiancong Luo
  • Patent number: 11582474
    Abstract: The present disclosure provides video decoding method. An exemplary method includes: decoding a first parameter for a coding unit from a bitstream, and determining a candidate for the coding unit based on the first parameter; determining a value of a second parameter associated with the coding unit based on a value of a second parameter associated with the candidate, wherein the second parameter indicates whether a bi-directional prediction correction is enabled; and in response to the value of the second parameter associated with the coding unit indicating the bi-directional prediction correction being enabled, performing the bi-directional prediction correction on the coding unit.
    Type: Grant
    Filed: August 2, 2021
    Date of Patent: February 14, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Xinwei Li, Jie Chen, Ru-Ling Liao, Yan Ye
  • Patent number: 11582458
    Abstract: Systems and methods are described for video coding using affine motion models with adaptive precision. In an example, a block of video is encoded in a bitstream using an affine motion model, where the affine motion model is characterized by at least two motion vectors. A precision is selected for each of the motion vectors, and the selected precisions are signaled in the bitstream. In some embodiments, the precisions are signaled by including in the bitstream information that identifies one of a plurality of elements in a selected predetermined precision set. The identified element indicates the precision of each of the motion vectors that characterize the affine motion model. In some embodiments, the precision set to be used is signaled expressly in the bitstream; in other embodiments, the precision set may be inferred, e.g., from the block size, block shape or temporal layer.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: February 14, 2023
    Assignee: Vid Scale, Inc.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye, Jiancong Luo
  • Publication number: 20230045775
    Abstract: The present disclosure provides systems and methods for performing adaptive resolution change during video encoding and decoding. The methods include: comparing resolutions of a target picture and a first reference picture; in response to the target picture and the first reference picture having different resolutions, resampling the first reference picture to generate a second reference picture; and encoding or decoding the target picture using the second reference picture.
    Type: Application
    Filed: November 29, 2021
    Publication date: February 9, 2023
    Inventors: Mohammed Golam SARWER, Jiancong LUO, Yan YE
  • Publication number: 20230042364
    Abstract: An image processing method and a device configured to implement the same are disclosed. The device comprises: a hybrid imaging device configured to obtain optical input; and a processing device in signal communication with the hybrid imaging device. The processing device comprises: a motion detection circuit that performs feature tracking based on a first component of an obtained optical input; a motion estimation circuit that performs motion compensation based on output of the motion detection unit; a frame reconstruction circuit that reconstructs image frame based on both the output of the motion estimation unit and a second component of the optical input; and an output unit that outputs image frame at a predetermined global frame rate.
    Type: Application
    Filed: August 5, 2021
    Publication date: February 9, 2023
    Inventors: YAN YE, ZHONGYANG HUANG, GUANSONG LIU
  • Patent number: 11575953
    Abstract: A secondary content such as an advertisement may be inserted based on users' interests in 360 degree video streaming. Users may have different interests and may watch different areas within a 360 degree video. The information about area(s) of 360 degree scenes that users watch the most may be used to select an ad(s) relevant to their interests. One or more secondary content viewports may be defined within a 360 degree video frame. Secondary content viewport parameter(s) may be tracked. For example, statistics of the user's head orientation for some time leading to tile presentation of the ad(s) may be collected. Secondary content may be determined based on the tracked secondary content viewport parameters).
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: February 7, 2023
    Assignee: VID Scale, Inc.
    Inventors: Eduardo Asbun, Yong He, Srinivas Gudumasu, Ahmed Hamza, Yan Ye
  • Patent number: 11575933
    Abstract: A video coding device may be configured to perform directional Bi-directional optical flow (BDOF) refinement on a coding unit (CU). The device may determine the direction in which to perform directional BDOF refinement. The device may calculate the vertical direction gradient difference and the horizontal direction gradient difference for the CU. The vertical direction gradient difference may indicate the difference between the vertical gradients for a first reference picture and the vertical gradients for a second reference picture. The horizontal direction gradient difference may indicate the difference between the horizontal gradients for the first reference picture and the horizontal gradients for the second reference picture. The video coding device may determine the direction in which to perform directional BDOF refinement based on the vertical direction gradient difference and the horizontal direction gradient difference.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: February 7, 2023
    Assignee: VID Scale, Inc.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye
  • Patent number: 11575926
    Abstract: The present disclosure provides systems and methods for processing video content. The method can include: generating, for a coding block, a motion vector (MV) in a first coding mode; and updating the MV by performing a decoder side motion vector refinement (DMVR) process on the coding block.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: February 7, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Zhao Wang, Jiancong Luo, Yan Ye
  • Publication number: 20230035951
    Abstract: A method for controlling a phase-locked loop circuit, can include: acquiring values of a voltage-controlled oscillator capacitor array control signal respectively corresponding to desired values of a frequency control word signal and acquiring values of a charge pump current control signal respectively corresponding to the desired values of the frequency control word signal in a calibration mode, where the frequency control word signal characterizes a ratio of a desired locked frequency to a frequency of a reference signal; and determining a target value of the voltage-controlled oscillator capacitor array control signal corresponding to a target value of the frequency control word signal and a target value of the charge pump current control signal corresponding to the target value of the frequency control word signal in a phase-locked mode, in order to control the phase-locked loop circuit to achieve phase lock.
    Type: Application
    Filed: July 19, 2022
    Publication date: February 2, 2023
    Inventors: Yan Ye, Cheng Liang
  • Publication number: 20230037273
    Abstract: Systems, methods, and instrumentalities for affine motion estimation for affine model-based video coding may be disclosed herein. A first motion vector (MV) set including one or more MVs may be derived for a first coding block. The MVs may be control point MVs (CPMVs) and the MVs may be derived by performing affine motion estimation (ME) associated with the first coding block. The first MV set may be added to a recently-estimated MV list. A head of the recently-estimated MV list may be set to the first MV set. The recently-estimated MV list may be empty or may contain one or more previously-added MV sets.
    Type: Application
    Filed: September 20, 2019
    Publication date: February 2, 2023
    Applicant: VID SCALE, INC.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye, Jiancong Luo
  • Patent number: 11570470
    Abstract: Overlapped block motion compensation (OBMC) may be performed for a current video block based on motion information associated with the current video block and motion information associated with one or more neighboring blocks of the current video block. Under certain conditions, some or ail of these neighboring blocks may be omitted from the OBMC operation of the current block. For instance, a neighboring block may be skipped during the OBMC operation if the current video block and the neighboring block are both uni-directionally or bi-directionally predicted, if the motion vectors associated with the current block and the neighboring block refer to a same reference picture, and if a sum of absolute differences between those motion vectors is smaller than a threshold value. Further, OBMC may be conducted in conjunction with regular motion compensation and may use simplified filters than traditionally allowed.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: January 31, 2023
    Assignee: VID SCALE, Inc.
    Inventors: Yan Zhang, Xiaoyu Xiu, Yuwen He, Yan Ye
  • Publication number: 20230023977
    Abstract: The present disclosure provides systems and methods for signaling and using a palette mode in video processing. According to certain disclosed embodiments, an exemplary video processing method includes: receiving a first palette entry for palette coding a target coding unit (CU); determining whether the target CU is part of a single-tree slice; determining whether the target CU is coded with separate luma and chroma trees; and in response to the target CU being determined to be part of a single-tree slice and be coded with separate luma and chroma trees, decoding a first component of the target CU based on the first palette entry, and decoding a second component of the target CU based on a default palette entry.
    Type: Application
    Filed: September 16, 2022
    Publication date: January 26, 2023
    Inventors: Mohammed Golam SARWER, Ru-Ling LIAO, Yan YE, Jiancong LUO, Jie CHEN
  • Publication number: 20230026503
    Abstract: Improved method and apparatus for signaling of reference pictures used for temporal prediction. The signaling schemes and construction process for different reference picture lists in HEVC Working Draft 5 (WD5) are improved.
    Type: Application
    Filed: September 15, 2022
    Publication date: January 26, 2023
    Inventors: Yan YE, Yong He