Patents by Inventor Jiancong Luo

Jiancong Luo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230070492
    Abstract: Techniques for reducing reduce coding artifacts in video data are disclosed. In one aspect, a frame of video data is partitioned into pixel blocks, which are organized into slices. The pixel blocks of each slice are coded by a compression algorithm and an estimate of coding artifacts in the slice is made. For slices that are estimated to possess coding artifacts, the method revises coding parameters applied to pixel blocks in the slice and recodes the slice. The method substitutes recoded slices for originally-coded slices in frame, working in a priority order from a slice with the highest estimated likelihood of coding artifacts down to slices with lower estimated likelihoods of coding artifacts, measuring changes in the frame's coding size as it goes.
    Type: Application
    Filed: August 12, 2022
    Publication date: March 9, 2023
    Inventors: Jiancong Luo, Dzung T. Hoang, Francesco Iacopino, Linfeng Guo, Mukta S. Gore, Ryan Baldwin, Supradeep T. Rangarajan, Xiaohua Yang
  • Publication number: 20230063385
    Abstract: The present disclosure provides video processing method and apparatus. An exemplary method includes: determining whether a coding block comprises samples outside a picture boundary; and in response to the coding block being determined to comprise samples outside a picture boundary, performing quad tree splitting of the coding block regardless of a value of a first parameter, wherein the first parameter indicates whether the quad tree is allowed to be used to split the coding block.
    Type: Application
    Filed: October 10, 2022
    Publication date: March 2, 2023
    Inventors: Ru-Ling LIAO, Yan YE, Jie CHEN, Jiancong LUO
  • Publication number: 20230055802
    Abstract: Methods and apparatuses for video encoding, comprising: receiving a video sequence; encoding the video sequence by using control flags for luma mapping with chroma scaling (LMCS) at a sequence level, a picture level, or a slice level, wherein the sequence level, the picture level, and the slice level are levels ranking from high to low; signaling a first control flag indicating whether the LMCS is enabled at a first level; and in response to the first control flag indicating the LMCS is enabled at the first level, signaling a second control flag indicating whether LMCS is enabled at a second level, wherein: the LMCS is enabled at the second level when a value of the second control flag equals to 1; the LMCS is disabled at the second level when the value of the second control flag equals to 0; and the second level is a lower level than the first level.
    Type: Application
    Filed: October 13, 2022
    Publication date: February 23, 2023
    Inventors: Jie CHEN, Jiancong LUO, Yan YE, Mohammed Golam SARWER
  • Patent number: 11589067
    Abstract: The present disclosure provides apparatus and methods for signaling sub-block transform (SBT) information. The SBT information is used for coding video data. According to certain disclosed embodiments, an exemplary method includes: signaling a first flag in a Sequence Parameter Set (SPS) of a video sequence indicating whether a sub-block transform (SBT) is enabled; and signaling a second flag indicating a maximum transform block (TB) size that allows the SBT. A maximum coding unit (CU) size that allows the SBT is determined directly based on the maximum TB size in response to the first flag indicating that the SBT is enabled.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: February 21, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Mohammed Golam Sarwer, Jiancong Luo, Yan Ye
  • Publication number: 20230053233
    Abstract: Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.
    Type: Application
    Filed: October 10, 2022
    Publication date: February 16, 2023
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye, Jiancong Luo
  • Publication number: 20230050213
    Abstract: Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.
    Type: Application
    Filed: October 10, 2022
    Publication date: February 16, 2023
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye, Jiancong Luo
  • Patent number: 11582458
    Abstract: Systems and methods are described for video coding using affine motion models with adaptive precision. In an example, a block of video is encoded in a bitstream using an affine motion model, where the affine motion model is characterized by at least two motion vectors. A precision is selected for each of the motion vectors, and the selected precisions are signaled in the bitstream. In some embodiments, the precisions are signaled by including in the bitstream information that identifies one of a plurality of elements in a selected predetermined precision set. The identified element indicates the precision of each of the motion vectors that characterize the affine motion model. In some embodiments, the precision set to be used is signaled expressly in the bitstream; in other embodiments, the precision set may be inferred, e.g., from the block size, block shape or temporal layer.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: February 14, 2023
    Assignee: Vid Scale, Inc.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye, Jiancong Luo
  • Publication number: 20230045775
    Abstract: The present disclosure provides systems and methods for performing adaptive resolution change during video encoding and decoding. The methods include: comparing resolutions of a target picture and a first reference picture; in response to the target picture and the first reference picture having different resolutions, resampling the first reference picture to generate a second reference picture; and encoding or decoding the target picture using the second reference picture.
    Type: Application
    Filed: November 29, 2021
    Publication date: February 9, 2023
    Inventors: Mohammed Golam SARWER, Jiancong LUO, Yan YE
  • Patent number: 11575926
    Abstract: The present disclosure provides systems and methods for processing video content. The method can include: generating, for a coding block, a motion vector (MV) in a first coding mode; and updating the MV by performing a decoder side motion vector refinement (DMVR) process on the coding block.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: February 7, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Zhao Wang, Jiancong Luo, Yan Ye
  • Publication number: 20230037273
    Abstract: Systems, methods, and instrumentalities for affine motion estimation for affine model-based video coding may be disclosed herein. A first motion vector (MV) set including one or more MVs may be derived for a first coding block. The MVs may be control point MVs (CPMVs) and the MVs may be derived by performing affine motion estimation (ME) associated with the first coding block. The first MV set may be added to a recently-estimated MV list. A head of the recently-estimated MV list may be set to the first MV set. The recently-estimated MV list may be empty or may contain one or more previously-added MV sets.
    Type: Application
    Filed: September 20, 2019
    Publication date: February 2, 2023
    Applicant: VID SCALE, INC.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye, Jiancong Luo
  • Publication number: 20230023977
    Abstract: The present disclosure provides systems and methods for signaling and using a palette mode in video processing. According to certain disclosed embodiments, an exemplary video processing method includes: receiving a first palette entry for palette coding a target coding unit (CU); determining whether the target CU is part of a single-tree slice; determining whether the target CU is coded with separate luma and chroma trees; and in response to the target CU being determined to be part of a single-tree slice and be coded with separate luma and chroma trees, decoding a first component of the target CU based on the first palette entry, and decoding a second component of the target CU based on a default palette entry.
    Type: Application
    Filed: September 16, 2022
    Publication date: January 26, 2023
    Inventors: Mohammed Golam SARWER, Ru-Ling LIAO, Yan YE, Jiancong LUO, Jie CHEN
  • Publication number: 20230011928
    Abstract: The present disclosure provides systems and methods for signaling and using a palette mode in video processing. According to certain disclosed embodiments, an exemplary video processing method includes: receiving a first palette entry for palette coding a target coding unit (CU); determining whether the target CU is part of a single-tree slice; determining whether the target CU is coded with separate luma and chroma trees; and in response to the target CU being determined to be part of a single-tree slice and be coded with separate luma and chroma trees, decoding a first component of the target CU based on the first palette entry, and decoding a second component of the target CU based on a default palette entry.
    Type: Application
    Filed: September 16, 2022
    Publication date: January 12, 2023
    Inventors: Mohammed Golam SARWER, Ru-Ling LIAO, Yan YE, Jiancong LUO, Jie CHEN
  • Patent number: 11553206
    Abstract: Systems, methods, and instrumentalities may be provided for determining whether to bypass bi-directional optical flow (BDOF) if BDOF is used in combination with bi-prediction with coding unit (CU) weights (e.g., generalized bi-prediction (GBi)). A coding system may combine coding modes, coding techniques, and/or coding tools. The coding system may include a wireless transmit/receive unit (WTRU). For example, the coding system may combine BDOF and bi-prediction with GU weights (BCW). BDOF may include refining a motion vector associated with a current CU based at least in part on gradients associated with a location in the current CU. The coding system may determine that BDOF is enabled, and/or that bi-prediction with CU weights is enabled for the current CU. The coding system's determination that bi-prediction with CU weights is enabled and/or that BDOF is enabled may be based on one or more indications.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: January 10, 2023
    Assignee: VID SCALE, Inc.
    Inventors: Yuwen He, Jiancong Luo, Xiaoyu Xiu, Yan Ye
  • Patent number: 11546604
    Abstract: Bi-directional optical flow (BDOF) may be bypassed, for a current coding block, based on whether symmetric motion vector difference (8MVD) is used in motion vector coding for the current coding block, A coding device (e.g., an encoder or a decoder) may determine whether to bypass BDOF for the current coding block based at least in part on an SMVD indication for the current coding block, The coding device may obtain the SMVD indication that indicates whether SMVD is used in motion vector coding for the current coding block. If SMVD Indication indicates that SMVD is used in the motion vector coding for the current coding block, the coding device may bypass BDOF for the current coding block. The coding device may reconstruct, the current coding block without performing BDOF if it determines to bypass BDOF for the current coding block.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: January 3, 2023
    Assignee: VID SCALE, Inc.
    Inventors: Jiancong Luo, Xiaoyu Xiu, Yuwen He, Hua Yang
  • Patent number: 11523104
    Abstract: The present disclosure provides systems and methods for constructing a merge candidate list used for video processing. One exemplary method includes: inserting a set of spatial merge candidates to a merge candidate list of a coding block, wherein the set of spatial merge candidates are inserted according to an order of: top neighboring block, left neighboring block, top neighboring block, left neighboring block and above-left neighboring block. The method can further include adding to the merge candidate list at least one of: a temporal merge candidate from collocated coding units, a history-based motion vector predictor (HMVP) from a First-In, First-Out (FIFO) table, a pairwise average candidate, or a zero motion vector.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: December 6, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Zhao Wang, Yan Ye, Jiancong Luo
  • Patent number: 11523138
    Abstract: Methods and apparatuses for video processing include: filtering a luma sample using a first filter in a video coding process, the first filter being represented as a cross shape; filtering a chroma sample associated with the luma sample using a second filter in the video coding process; determining, based on the filtered luma sample, a residual correction value corresponding to the chroma sample; and determining a corrected chroma sample based on the residual correction value and the filtered chroma sample.
    Type: Grant
    Filed: March 26, 2021
    Date of Patent: December 6, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Mohammed Golam Sarwer, Jiancong Luo, Yan Ye
  • Patent number: 11509921
    Abstract: Methods and apparatuses for video encoding, comprising: receiving a video sequence; encoding the video sequence by using control flags for luma mapping with chroma scaling (LMCS) at a sequence level, a picture level, or a slice level, wherein the sequence level, the picture level, and the slice level are levels ranking from high to low; signaling a first control flag indicating whether the LMCS is enabled at a first level; and in response to the first control flag indicating the LMCS is enabled at the first level, signaling a second control flag indicating whether LMCS is enabled at a second level, wherein: the LMCS is enabled at the second level when a value of the second control flag equals to 1; the LMCS is disabled at the second level when the value of the second control flag equals to 0; and the second level is a lower level than the first level.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: November 22, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Jie Chen, Jiancong Luo, Yan Ye, Mohammed Golam Sarwer
  • Patent number: 11496741
    Abstract: The present disclosure provides video processing method and apparatus. An exemplary method includes: determining whether a coding block comprises samples outside a picture boundary; and in response to the coding block being determined to comprise samples outside a picture boundary, performing quad tree splitting of the coding block regardless of a value of a first parameter, wherein the first parameter indicates whether the quad tree is allowed to be used to split the coding block.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: November 8, 2022
    Assignee: Atibaba Group Holding Limited
    Inventors: Ru-Ling Liao, Yan Ye, Jie Chen, Jiancong Luo
  • Patent number: 11490097
    Abstract: The present disclosure provides methods and apparatuses for signaling subpicture partitioning information. An exemplary method includes: determining, according to a subpicture information present flag signaled in a bitstream, whether the bitstream comprises subpicture information; and in response to the bitstream comprising the subpicture information, signaling in the bitstream at least one of: a number of subpictures in a picture, a width, a height, a position, and an identifier (ID) mapping of a target subpicture, a subpic_treated_as_pic_flag, and a loop_filter_across_subpic_enabled_flag.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: November 1, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Jie Chen, Yan Ye, Jiancong Luo, Ru-Ling Liao
  • Publication number: 20220329866
    Abstract: The present disclosure provides a computer-implemented method for encoding video. The method includes: determining whether a coded video sequence (CVS) contains equal number of profile, tier and level (PTL) syntax structures and output layer sets (OLSs); and in response to the CVS containing equal number of PTL syntax structures and OLSs, coding the bitstream without signaling a first PTL syntax element specifying an index, to a list of PTL syntax structures in the VPS, of a PTL syntax structure that applies to a corresponding OLS in the VPS.
    Type: Application
    Filed: May 27, 2022
    Publication date: October 13, 2022
    Inventors: Jie CHEN, Jiancong LUO, Yan YE, Ru-Ling LIAO