Patents by Inventor Han Gao

Han Gao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11895292
    Abstract: Apparatuses and methods for encoding and decoding a video are provided. The method includes determining whether at least one of two blocks of an image in a video is predicted with a combined inter-intra prediction (CIIP), where the two blocks include a first block (block Q) and a second block (block P). There is a boundary between the two blocks. The method further includes setting a boundary strength (Bs) for the boundary to a first value when at least one of the two blocks is predicted with the CIIP, and performing deblocking filter based on the Bs.
    Type: Grant
    Filed: December 29, 2021
    Date of Patent: February 6, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Anand Meher Kotra, Semih Esenlik, Han Gao, Jianle Chen
  • Publication number: 20240037802
    Abstract: This application provides methods and apparatuses for processing of picture data or picture feature data using a neural network with two or more layers. The present disclosure may be applied in the field of artificial intelligence (AI)-based video or picture compression technologies, and in particular, to the field of neural network-based video compression technologies. According to some embodiments, position within the neural network, at which auxiliary information may be entered for processing is selectable based on a gathering condition. The gathering condition may assess whether some prerequisite is fulfilled. Some of the advantages may include better performance in terms of rate and/or disclosure due to the effect of increased flexibility in neural network configurability.
    Type: Application
    Filed: October 2, 2023
    Publication date: February 1, 2024
    Inventors: Timofey Mikhailovich Solovyev, Biao Wang, Elena Alexandrovna Alshina, Han Gao, Panqi Jia, Esin Koyuncu, Alexander Alexandrovich Karabutov, Mikhail Vyacheslavovich Sosulnikov, Semih Esenlik, Sergey Yurievich Ikonin
  • Publication number: 20240040142
    Abstract: Systems and methods for encoding and decoding using warp motion modes are provided. A method includes receiving a bitstream that includes a coded picture; obtaining a plurality of motion vectors pointing to positions in neighboring blocks that are adjacent to a current block in the coded picture, the plurality of motion vectors including at least one temporal motion vector; obtaining motion samples for a warp model based on the plurality of motion vectors; and decoding the current block by using the warp model and the motion samples including the at least one temporal motion vector for prediction. Some Embodiments may include methods of using temporal motion information to derive a warp model, and may further provide warp sample selection and grouping. Some embodiments may provide improvements on local warp motion modes.
    Type: Application
    Filed: November 3, 2022
    Publication date: February 1, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Han GAO, Xin ZHAO, Liang ZHAO, Shan LIU
  • Publication number: 20240031571
    Abstract: A partitioning method comprises determining whether a current block of a picture is a boundary block and whether the size of the current block is larger than a minimum allowed quadtree leaf node size; and if the current block is the boundary block and the size of the current block is not larger than the minimum allowed quadtree leaf node size (MinQTSize), applying forced binary tree (BT) partitioning to the current block. A method comprises making a determination that a current block of a picture is a boundary block and that a size of the current block is less than or equal to a minimum allowed quadtree (QT) leaf node size (MinQTSize); and applying, in response to the determination, forced binary tree (BT) partitioning to the current block.
    Type: Application
    Filed: August 4, 2023
    Publication date: January 25, 2024
    Inventors: Han Gao, Jianle Chen, Semih Esenlik, Zhijie Zhao, Anand Meher Kotra
  • Publication number: 20240031596
    Abstract: The various implementations described herein include methods and systems for coding video. In one aspect, a method includes receiving a video bitstream including a current coding block in a current image frame, obtaining a syntax element value, and determining whether the current coding block is coded with a warped motion mode or a translational motion mode based on the syntax element value. The method further includes in accordance with a determination that the current coding block is coded with the warped motion mode, selecting a first motion vector difference (MVD) setting for the current coding block; in accordance with a determination that the current coding block is coded with the translational motion mode, selecting a second MVD setting distinct from the second MVD setting for the current coding block; and reconstructing the current coding block based at least in part on the selected MVD setting for the current coding block.
    Type: Application
    Filed: May 10, 2023
    Publication date: January 25, 2024
    Inventors: Liang ZHAO, Han GAO, Xin ZHAO, Shan LIU
  • Publication number: 20240031598
    Abstract: A non-transitory computer-readable medium for inter-prediction and an encoder are provided. An initial motion vector is obtained for a current block. Search space positions are determined according to the initial motion vector. Matching costs for the search space positions are checked according to a checking order to select a target search space position with a minimal matching cost. A refining motion vector of the current block is determined based on the initial motion vector and the target search space position. A central search space position is determined according to the checking order, and the central search space position is pointed to by the initial motion vector.
    Type: Application
    Filed: July 21, 2023
    Publication date: January 25, 2024
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Semih Esenlik, Han Gao, Anand Meher Kotra, Biao Wang, Jianle Chen
  • Publication number: 20240031594
    Abstract: A method performed by a video decoder includes receiving a coded video bitstream including a current picture, a first reference picture, a second reference picture, and a joint motion vector difference (JMVD) associated with at least one block in the current picture. The method includes determining whether one or more scaling factors are used for an adaptive motion vector difference resolution (AMVD) based JMVD based on a predetermined condition. The method includes, in response to determining the one or more scaling factors are used for the AMVD based JMVD, scaling the JMVD based on the one or more scaling factors. The method includes deriving a first MVD for the first reference picture based on the scaled JMVD. The method includes deriving a second MVD for the second reference picture based on the derived first MVD. The method includes reconstructing the at least one block based on the derived first MVD and the derived second MVD.
    Type: Application
    Filed: November 8, 2022
    Publication date: January 25, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Liang ZHAO, Xin ZHAO, Han GAO, Shan LIU
  • Publication number: 20240022709
    Abstract: An approach for encoding/decoding video data, performed by at least one processor, including: obtaining video data; parsing the obtained video data into blocks; generating a set of parameters of a current block, the set of parameters including at least block position information, motion vector information, and delta values; storing a subset of parameters included in the set of parameters in association with the current block; selecting a first warp model of the current block based on a subset of parameters; and decoding the video data based on the first warp model.
    Type: Application
    Filed: November 3, 2022
    Publication date: January 18, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Han GAO, Xin ZHAO, Liang ZHAO, Shan LIU
  • Publication number: 20240022756
    Abstract: An approach for encoding/decoding video data, performed by at least one processor, may include: obtaining a coded video bitstream; obtaining a plurality of blocks from the video bitstream, wherein the plurality of blocks comprise a current block and one or more neighboring blocks; determining, based a syntax element in the video bitstream, that a warp delta mode is used to predict the current block; determining positions and motion vectors of the one or more neighboring blocks; generating a first warp model of the current block based on motion vectors of the one or more neighboring blocks; selecting a warp model from among the first warp model of the current block and a second warp model associated with one of the one or more neighboring blocks as a base model of a coding mode; and decoding the plurality of blocks in the coding mode based on the base model.
    Type: Application
    Filed: November 3, 2022
    Publication date: January 18, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Han GAO, Xin ZHAO, Liang ZHAO, Shan LIU
  • Patent number: 11876997
    Abstract: The present disclosure relates to the field of picture processing. Especially, the disclosure deals with improving the prediction of a block of a picture when decoding or encoding. A method of coding a block of a picture, comprising: obtaining an indication parameter for a current coding block. The indication parameter represents whether a multi-hypothesis prediction is applied to the current coding block. When the indication parameter represents that the multi-hypothesis prediction is applied to the current coding block, coding the current coding block according to a planar mode.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: January 16, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Semih Esenlik, Jianle Chen, Anand Meher Kotra, Han Gao
  • Publication number: 20240015303
    Abstract: An approach for encoding/decoding video data, performed by at least one processor, including: obtaining video data; parsing the video data into blocks, wherein the blocks are associated with reference picture lists; generating a warp model used for a first reference picture list and a second reference picture list of a current block, included in the reference picture lists, based on motion vectors of the current block and adjacent blocks to the current block; decoding a frame among the first reference picture list and the second reference picture list by applying the warp model to the frame.
    Type: Application
    Filed: November 9, 2022
    Publication date: January 11, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Han GAO, Xin ZHAO, Liang ZHAO, Madhu PERINGASSERY KRISHNAN, Shan LIU
  • Publication number: 20240013446
    Abstract: A method for encoding a picture and decoding a bitstream that represents a picture using a neural network (NN) that comprises a plurality of sub-networks is provided. The method includes applying, before processing an input with the at least one sub-network comprising at least two downsampling layers, a rescaling to the input, wherein the rescaling comprises changing the size S1 in the at least one dimension to be S1 so that S1 is an integer multiple of a combined downsampling ratio Rk of the at least one sub-network, after the rescaling, processing the input by the at least one sub-network comprising at least two downsampling layers and providing an output with the size S2, wherein S2 is smaller than S1, and providing, after processing the picture using the NN, a bitstream as output.
    Type: Application
    Filed: June 20, 2023
    Publication date: January 11, 2024
    Inventors: Elena Alexandrovna Alshina, Han Gao, Semih Esenlik
  • Publication number: 20240015314
    Abstract: Disclosed herein are methods and systems for encoding a picture and decoding a bitstream that may represent an encoded picture. During encoding and decoding, rescaling operations are applied to rescale an input to a size that can be processed by a layer of a neural network. Embodiments disclosed herein provide methods for rescaling that achieve a reduced size of the bitstream, thereby improving compression.
    Type: Application
    Filed: June 20, 2023
    Publication date: January 11, 2024
    Inventors: Elena Alexandrovna Alshina, Han Gao, Semih Esenlik
  • Publication number: 20240015278
    Abstract: A method includes receiving a current picture, a first reference picture, and a second reference picture. The method includes obtaining a plurality of predefined weighting patterns, each weighting pattern being signaled as an index value and selecting a weighting pattern based on a predetermined condition. The method includes deriving a first weight to be applied to a first sub-block in the first reference picture and a second weight to be applied to a second sub-block in the second reference picture based on the index value corresponding to the selected weighting pattern. The method includes assigning the first weight to the first sub-block and the second weight to the second sub-block based on the selected weighting pattern. The method includes decoding the current block by a weighted bi-prediction based at least on the first sub-block weighted by the first weight and the second sub-block weighted by the second weight.
    Type: Application
    Filed: November 3, 2022
    Publication date: January 11, 2024
    Applicant: Tencent America LLC
    Inventors: Madhu PERINGASSERY KRISHNAN, Xin Zhao, Liang Zhao, Han Gao, Xiaozhong Xu, Shan Liu
  • Publication number: 20240015290
    Abstract: A method for deblocking a chroma block edge between a first chroma block of a first image block and a second chroma block of a second image block. The method includes a decision process which includes: determining a first chroma quantization parameter for the first chroma block based on a first luma quantization parameter of a first luma block of the first image block and a chroma QP mapping table for the first chroma block; determining a second chroma quantization parameter for the second chroma block based on a second luma quantization parameter of a second luma block of the second image block and a chroma QP mapping table for the second chroma block; determining an averaged and rounded chroma quantization parameter based on the first chroma quantization parameter and the second chroma quantization parameter; and determining a threshold parameter based on the averaged and rounded chroma quantization parameter.
    Type: Application
    Filed: July 11, 2023
    Publication date: January 11, 2024
    Inventors: Anand Meher KOTRA, Elena Alexandrovna ALSHINA, Semih ESENLIK, Biao WANG, Han GAO, Roman Igorevich CHERNYAK
  • Patent number: 11870986
    Abstract: A method of filtering a sample value of a picture is provided, with an integer t that is less than k and with an integer j in the range of 1 to m: generating, with an integer i in the range of 1 to k?t?1, a filtered sample value by applying a filter to the value of the sample p(i,j), wherein the filter is supported by a set of filter support samples, the set of filter support samples does not comprise any samples p(i?,j?) with row index i? greater than k?t?1, and/or generating, with an integer i in the range of k?t to k, a filtered sample value by applying a filter to the value of the sample p(i,j), the filter is supported by a set of filter support samples, wherein the set of filter support samples does not comprise any samples p(i?,j?) with row index i? less than k?t.
    Type: Grant
    Filed: November 29, 2022
    Date of Patent: January 9, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Semih Esenlik, Jianle Chen, Han Gao, Biao Wang, Zhijie Zhao
  • Publication number: 20240002243
    Abstract: The present invention provides a method for separation and recovery of boron trifluoride and complexes thereof in an olefin polymerization reaction.
    Type: Application
    Filed: October 27, 2021
    Publication date: January 4, 2024
    Inventors: Tong LIU, Yuanyuan CAO, Yulong WANG, Libo WANG, Xianming XU, Hongping LI, Enhao SUN, Xiuhui WANG, Wei SUN, Han GAO, Hongling CHU, Yongjun ZHANG, Yonggang JI, Kecun MA, Yan JIANG, Qian CHEN, Hongliang HUO, Qi YU
  • Patent number: 11858618
    Abstract: Embodiments of the present application are a UAV foot stand and a UAV. The UAV foot stand includes a main body, a mounting board, and a support structure, where one end of the main body is provided with a lightening cavity, one end of the main body that is provided with the lightening cavity extends outward to form the mounting board, the support structure is fixed to the main body, and the support structure at least partially extends into the lightening cavity and is connected to an inner wall of the lightening cavity, so as to increase rigidity of the main body.
    Type: Grant
    Filed: July 15, 2022
    Date of Patent: January 2, 2024
    Assignee: AUTEL ROBOTICS CO., LTD.
    Inventor: Han Gao
  • Publication number: 20230421751
    Abstract: A coded video bitstream comprising a current block in a current picture is received. The current block includes a plurality of subblocks and is to be predicted by a subblock-based template matching motion vector prediction (SbTMVP) mode. A respective collocated reference subblock for each subblock is determined based on a combination of a displacement vector (DV) and a motion vector offset (MVO) that are associated with the respective subblock. A motion vector (MV) field in the respective collocated reference subblock of each subblock in the current block is determined. A respective reference template for each subblock is derived based on the determined MV field of the collocated reference subblock. The plurality of subblocks of the current block is reconstructed by predicting each subblock using the respective reference template in the SbTMVP mode.
    Type: Application
    Filed: November 9, 2022
    Publication date: December 28, 2023
    Applicant: Tencent America LLC
    Inventors: Xin ZHAO, Lien-Fei CHEN, Han GAO, Guichun LI, Shan LIU
  • Patent number: 11856228
    Abstract: A deblocking method is provided for deblocking a sub-partition boundary within a coding block during image encoding and/or image decoding process. The coding block is coded in an intra prediction mode and the coding block is partitioned into sub-partitions comprising a first sub-partition and a second sub-partition that is adjacent to the first sub-partition. The method comprises: determining a maximum filter length to be 1 for a first/second sub-partition when a width of the first or second sub-partition is 4 samples, or when a height of the first or second sub-partition is 4 samples; modifying a value of up to one sample of the first or second sub-partition, wherein the value of the up to one sample is obtained from a row or a column of the first or second sub-partition that is perpendicular to and adjacent to the sub-partitions boundary between the first sub-partition and the second sub-partition.
    Type: Grant
    Filed: August 11, 2021
    Date of Patent: December 26, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Anand Meher Kotra, Semih Esenlik, Han Gao, Jianle Chen