Patents by Inventor Zhijie ZHAO

Zhijie ZHAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11109024
    Abstract: The present disclosure relates to image coding/decoding applying deblocking filtering and decoder-based intra-mode determination. In order to efficiently use software and/or hardware resources, the size of the template for the decoder-based intra-mode determination is smaller than the number of lines used by the deblocking filtering.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: August 31, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Shan Liu, Zhijie Zhao, Semih Esenlik, Han Gao
  • Publication number: 20210266547
    Abstract: An encoder is provided that comprises a partitioner and an entropy coder. The partitioner is configured to receive a current block of the frame and obtain a list of candidate geometric partitioning (GP) lines. Each of the candidate GP lines is generated based on information of one or more candidate neighbor blocks of the current block. The partitioner is further configured to determine a final GP line that partitions the current block into two segments, select a GP line from the list of GP lines to obtain a selected GP line, and generate a GP parameter for the current block. The GP parameter includes an offset information indicating an offset between the final GP line and the selected GP line. The entropy coder is configured to encode the GP parameter.
    Type: Application
    Filed: May 12, 2021
    Publication date: August 26, 2021
    Inventors: Zhijie ZHAO, Max BLAESER, Mathias WIEN
  • Patent number: 11102480
    Abstract: An apparatus is configured to determine an adopted intra prediction mode on the basis of a most probable modes list, a selected modes list and a non-selected modes list having a first portion and a second portion, wherein the adopted intra prediction mode is one of a plurality of intra prediction modes comprising a plurality of angular intra prediction modes for predicting sample values of a current picture block. The apparatus includes a processor configured to generate the first portion of the non-selected modes list by including one or more angular intra prediction modes determined to be close to a respective angular intra prediction mode of the most probable modes list and the selected modes list. The processor is further configured to determine the adopted intra prediction mode.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: August 24, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Zhijie Zhao, Semih Esenlik, Han Gao
  • Patent number: 11102482
    Abstract: Embodiments of the present invention relate to the field of picture processing. Especially, the embodiments are directed to improving the deblocking filter of an image coding device. During the deblocking, at most a number MA of sample values of the first coding block adjacent to the block edge are modified and at most a number MB of sample values of the second coding block adjacent to the block edge are modified; or at most a number MA of sample values of the second coding block adjacent to the block edge are modified and at most a number MB of sample values of the first coding block adjacent to the block edge are modified, MA?MB.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: August 24, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Jianle Chen, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao
  • Publication number: 20210258618
    Abstract: The present disclosure relates generally to video coding and picture partitioning methods. In particular, the disclosure is concerned with relations between partition constraint elements, by setting partitioning rules for different picture partitioning methods. The disclosure provides devices and corresponding methods for generating or processing a bitstream including encoded pictures, particularly for setting and including partition constraint element into the bitstream. One of the devices is configured to determine a minimum luma size of a leaf block resulting from quadtree splitting (MinQtSizeY), determine a maximum luma size of a coding block where partitioning using a binary tree splitting is allowed (MaxBtSizeY) based on the MinQtSizeY, and include information for the determined MinQtSizeY into the bitstream.
    Type: Application
    Filed: February 5, 2021
    Publication date: August 19, 2021
    Inventors: Han GAO, Semih ESENLIK, Jianle CHEN, Anand Meher KOTRA, Biao WANG, Zhijie ZHAO
  • Publication number: 20210250590
    Abstract: A decoding method for decoding an encoded picture which is partitioned into coding tree blocks which are further partitioned into coding blocks with different sizes, comprises parsing a first indication from the sequence parameter set (SPS)/picture parameter set (PPS)/slice header/tile header of a bit stream containing the encoded picture, determining the partition mode of the coding tree blocks, which are confined by block size restriction parameter and partition depth restriction parameter included in the SPS/PPS/slice header/tile header when the first indication is first value, or determining the partition mode of the multiple coding tree blocks, which are confined by default by block size restriction parameter and default partition depth restriction parameter when the first indication is second value or not presented in the SPS/PPS/slice header/tile header, and partitioning the coding tree blocks into the coding blocks according to the partition mode, and decoding the coding blocks.
    Type: Application
    Filed: March 18, 2021
    Publication date: August 12, 2021
    Inventors: Han Gao, Semih Esenlik, Jianle Chen, Anand Meher Kotra, Biao Wang, Zhijie Zhao
  • Patent number: 11082714
    Abstract: The present invention relates to the construction of a search space for determining a motion vector for a current block of a picture in a video sequence. The search space construction is split into two main stages, wherein a first and a second partial search space are respectively determined. Based on an initial estimate of a motion vector, a first search space is first constructed. A first and a second candidate motion vector of the first search space are identified according to a cost function. Based on the first and the second candidate motion vectors, a second search space is constructed. The motion vector for the current block is selected from the candidate motion vectors of the first search space and the second search space.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: August 3, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Han Gao
  • Publication number: 20210235127
    Abstract: A method and image processing device are provided, including a deblocking filter. The deblocking filter modifies values of at most MA samples of the first image block as first filter output values, the at most MA samples being obtained from a column of the first image block that is perpendicular to and adjacent to the horizontal block edge; and modifies values of at most MB samples of the second image block as second filter output values, the at most MB samples being obtained from a column of the second image block that is perpendicular to and adjacent to the horizontal block edge. At most a number MA of sample values of the first image block adjacent to the block edge are modified and at most a number MB of sample values of the second image block adjacent to the block edge are modified, wherein MA<MB.
    Type: Application
    Filed: April 12, 2021
    Publication date: July 29, 2021
    Applicant: HUAWEI TECHNOLOGIES CO.,LTD.
    Inventors: Jianle Chen, Anand Meher Kotra, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao
  • Publication number: 20210227247
    Abstract: An apparatus and method are provided for inter prediction of a current geometric partition of a coding block. When the coding block is enabled for a geometric partition merge mode, a merge candidate list for the coding block partitioned into two geometric partitions including the current geometric partition is generated. The merge candidate list generation comprises deriving one or more spatial merge candidates from neighboring coding units, and directly or immediately deriving one or more temporal motion vector predictions (MVPs). An uni-prediction MV is derived as a motion vector of the current geometric partition based on the merge candidate list. The current geometric partition of the coding block is predicted based on the uni-prediction MV to obtain a predicted value of the current geometric partition.
    Type: Application
    Filed: April 8, 2021
    Publication date: July 22, 2021
    Applicant: HUAWEI TECHNOLOGIES CO.,LTD.
    Inventors: Max Blaeser, Zhijie Zhao
  • Publication number: 20210227218
    Abstract: The present disclosure relates to methods and devices to be employed for encoding and decoding of image or video signal. They include determination of whether or not the size of a current block is larger than a minimum allowed quadtree leaf node size. If the size of the current block is not larger than the minimum allowed quadtree leaf node size, multi-type tree splitting is applied to the current block. The minimum allowed quadtree leaf node size is not larger than a maximum allowed binary tree root node size or the minimum allowed quadtree leaf node size is not larger than a maximum allowed ternary tree root node size.
    Type: Application
    Filed: March 2, 2021
    Publication date: July 22, 2021
    Inventors: Han GAO, Semih ESENLIK, Jianle CHEN, Zhijie ZHAO, Anand Meher KOTRA, Biao WANG
  • Patent number: 11070804
    Abstract: The present disclosure provides an encoding apparatus and a decoding apparatus, as well as an encoding method and a decoding method. In particular, the present disclosure relates to block partitioning and signaling the partitioning parameters in a bitstream. An override flag in an image region header indicates whether or not a block is to be partitioned according to a first partition constraint information. The override flag is included in the bitstream and the block is partitioned accordingly.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: July 20, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Han Gao, Semih Esenlik, Jianle Chen, Anand Meher Kotra, Biao Wang, Zhijie Zhao
  • Patent number: 11064197
    Abstract: The present disclosure relates to image coding/decoding applying deblocking filtering and decoder-based intra-mode determination. In order to efficiently use software and/or hardware resources, the size of the template for the decoder-based intra-mode determination is smaller than the number of lines used by the deblocking filtering.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: July 13, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Shan Liu, Zhijie Zhao, Semih Esenlik, Han Gao
  • Publication number: 20210211665
    Abstract: A method of image partitioning, comprises determining a first indicator, wherein the first indicator is shared by a first part of a bitstream; determining a partitioning of an image area corresponding to the first part of the bitstream with binary tree (BT) splitting or ternary tree (TT) splitting when the first indicator takes a first value; and determining the partitioning of the image area corresponding to the first part of the bitstream without BT splitting and TT splitting when the first indicator takes a second value, wherein the first value is different from the second value.
    Type: Application
    Filed: March 17, 2021
    Publication date: July 8, 2021
    Inventors: Han Gao, Semih Esenlik, Jianle Chen, Anand Meher Kotra, Biao Wang, Zhijie Zhao
  • Publication number: 20210203997
    Abstract: The present disclosure relates to hybrid video and feature encoding and decoding, with the encoding and decoding of the image feature being performed independently or differentially. The video and feature are encoded and decoded in separate layers, e.g., base layer and enhancement layer. The feature is extracted for a frame of the video, providing a frame-based feature-video association. A feature is extracted from an uncompressed video encoded in an enhancement layer into a feature bitstream. The video is encoded into a video bitstream, with the feature bitstream being embedded into the video bitstream by multiplexing both streams into an output bitstream. The image feature, which may be a differential image feature, is included in a sequence enhancement information SEI message of a frame header information of the video.
    Type: Application
    Filed: March 10, 2021
    Publication date: July 1, 2021
    Inventors: Anton Igorevich VESELOV, Hu CHEN, Francesco ROMANO, Zhijie ZHAO, Marat Ravilevich GILMUTDINOV
  • Publication number: 20210203927
    Abstract: A decoding method and a decoder for decoding a current block of a video frame is provided, wherein the decoding method comprises determining a list of Most Probable Modes (MPMs) for the current block. When at least one condition is satisfied, the list of MPMs includes a DC mode, a Vertical mode, a Horizontal mode, an intra prediction mode corresponding to a value of the Vertical mode with a first offset, and an intra prediction mode corresponding to the value of the Vertical mode with a second offset. The decoding method further includes obtaining a MPM flag and a MPM index for the current block from a bitstream of the video, and obtaining an intra prediction mode for the current block for reconstructing the current block.
    Type: Application
    Filed: March 12, 2021
    Publication date: July 1, 2021
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Semih ESENLIK, Anand Meher Kotra, Han Gao, Jianle Chen, Zhijie Zhao
  • Publication number: 20210195232
    Abstract: An apparatus and method determining a motion vector for a block, which relates to motion vector determination employing template matching or bilateral matching, are provided. At first, candidate motion vectors are obtained and are mapped to respective representatives (representative motion vectors). In particular, if the obtained candidate motion vectors point to fractional positions and thus, interpolation from the integer sample positions is required, the initial motion vector is rounded to a closest integer sample position. The rounded position is then used to define the search space for the template or bilateral matching to determine the best matching motion vector for the block (in other words, a refinement of an initial motion vector around which the candidate space is spanned). Finally, the mapping operation can be reverted in order to obtain a result in the original search space.
    Type: Application
    Filed: December 28, 2020
    Publication date: June 24, 2021
    Inventors: Semih ESENLIK, Zhijie ZHAO, Ivan KRASNOV, Jianle CHEN
  • Patent number: 11044469
    Abstract: A method for constructing a most probable mode (MPM) list for prediction process corresponding to video block is provided. The method includes determining whether a left block of a current coding block is available, in response to determining that the left block of the current coding block is available, adding an intra prediction mode of the left block into an MPM list; determining whether an above block of the current coding block is available, in response to determining that the above block of the current coding block is available, adding an intra prediction mode of the above block into the MPM list; adding an offset to the prediction mode of the left block to obtain a new prediction mode; and adding the above-offset prediction mode into the MPM list when the above-offset prediction mode is not in the MPM list. The MPM list is used to improve coding efficiency.
    Type: Grant
    Filed: August 19, 2020
    Date of Patent: June 22, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Biao Wang, Semih Esenlik, Jianle Chen, Zhijie Zhao, Han Gao
  • Publication number: 20210185317
    Abstract: A method for boundary partition of a current block is provided. The method includes obtaining a partition indicator from a received bitstream; determining whether the partition indicator indicates that the current block is to be split and whether the current block is a boundary block; and performing a non-inverse transform operation on an inside part of the current block when the partition indicator indicates that the current block is not to be split and the current block is a boundary block, wherein the inside part of the block is located within the picture. For the boundary block which is determined not to be split, a non-inverse transform operation is chosen. This avoids a normal inverse transform on the residuals of the inside part (within the picture) of the current block in the decoder, so number of blocks for the inverse transformation is decreased, and decoding complexity is thus reduced.
    Type: Application
    Filed: March 1, 2021
    Publication date: June 17, 2021
    Inventors: Han GAO, Semih ESENLIK, Zhijie ZHAO, Anand Meher KOTRA, Jianle CHEN
  • Patent number: 11039137
    Abstract: The present invention provides an encoder for encoding a frame of a video sequence and a corresponding decoder. The encoder comprises a partitioner and an entropy coder. The partitioner is configured to receive a current block of the frame and obtain a list of candidate geometric partitioning (GP) lines. Each of the candidate GP lines is generated based on information of one or more candidate neighbor blocks of the current block. The partitioner is further configured to determine a final GP line that partitions the current block into two segments, select a GP line from the list of GP lines to obtain a selected GP line, and generate a GP parameter for the current block. The GP parameter includes offset information indicating an offset between the final GP line and the selected GP line. The entropy coder is configured to encode the GP parameter.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: June 15, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Max Blaeser, Mathias Wien
  • Publication number: 20210176493
    Abstract: The disclosure relates to a method of decoding implemented by a decoding device, comprising: obtaining a value of a reference line index for a current block; constructing a most probable mode, MPM, list for the current block; obtaining a value of intra-prediction mode index for the current block; when the value of the reference line index is not equal to 0, obtaining an intra prediction mode of the current block according to the MPM list for the current block and the value of the intra-prediction mode index for the current block, wherein the value of the intra-prediction mode index indicates a position that corresponds to the intra prediction mode of the current block among angular intra-prediction modes in the MPM list. The disclosure also relates to a coding apparatus and a non-transitory machine-readable medium.
    Type: Application
    Filed: February 8, 2021
    Publication date: June 10, 2021
    Inventors: Biao WANG, Jianle CHEN, Semih ESENLIK, Anand Meher KOTRA, Han GAO, Zhijie ZHAO