Patents by Inventor Zhijie ZHAO

Zhijie ZHAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11153595
    Abstract: The present disclosure relates to motion vector determination using template matching. In particular, an initial motion vector and a template are obtained for a prediction block. Then a refinement of the initial motion vector is determined by template matching with said template in a search space. The search space is located on a position given by the initial motion vector. The template matching accesses integer sample positions within a predetermined window, the predetermined window including said search space and further integer sample positions accessible for the template matching, replaces at least one integer sample position located out of the window by at least one replacement value, each replacement value is based on at least one sample within said window, and uses the accessed integer sample position values as well as the at least one replacement value to perform the template matching.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: October 19, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Zhijie Zhao, Han Gao, Anand Meher Kotra
  • Publication number: 20210314604
    Abstract: The embodiments disclosed herein relate to the construction of a search space for determining a motion vector for a current block of a picture in a video sequence. The search space construction is split into in two main stages, wherein a first and a second partial search space are respectively determined. Based on an initial estimate of a motion vector, a first search space is first constructed. A first and a second candidate motion of the first search space are identified according to a cost function. Based on the first and the second candidate motion vectors, a second search space is constructed. The motion vector for the current block is selected from the candidate motion vectors of the first search space and the second search space.
    Type: Application
    Filed: June 16, 2021
    Publication date: October 7, 2021
    Inventors: Semih ESENLIK, Anand Meher KOTRA, Zhijie ZHAO, Han GAO
  • Patent number: 11140389
    Abstract: Embodiments of the present invention relate to the field of picture processing. Especially, the embodiments are directed to improving the deblocking filter of an image coding device. During the deblocking, at most a number MA of sample values of the first coding block adjacent to the block edge are modified and at most a number MB of sample values of the second coding block adjacent to the block edge are modified; or at most a number MA of sample values of the second coding block adjacent to the block edge are modified and at most a number MB of sample values of the first coding block adjacent to the block edge are modified, MA?MB.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: October 5, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Jianle Chen, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao
  • Patent number: 11122292
    Abstract: A motion vector determination employs template matching. At first, an initial motion vector is obtained. If the initial motion vector points to a position that is fractional, and thus, requires interpolation from the integer sample positions, the initial motion vector is rounded to a closest integer sample position. The rounded position is then used to define the search space for the template matching to define a refinement of the initial motion vector.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: September 14, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Zhijie Zhao, Han Gao, Anand Meher Kotra
  • Patent number: 11122286
    Abstract: The present disclosure relates to motion vector determination using template matching. In particular, an initial motion vector and a template are obtained for a prediction block. Then a refinement of the initial motion vector is determined by template matching with said template in a search space. The search space is located on a position given by the initial motion vector. The template matching accesses integer sample positions within a predetermined window, the predetermined window including said search space and further integer sample positions accessible for the template matching, replaces at least one integer sample position located out of the window by at least one replacement value, each replacement value is based on at least one sample within said window, and uses the accessed integer sample position values as well as the at least one replacement value to perform the template matching.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: September 14, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Zhijie Zhao, Han Gao, Anand Meher Kotra
  • Publication number: 20210281884
    Abstract: An image processing device for use in an image encoder and/or an image decoder, for deblocking a block edge between a first block and a second block of an image encoded with a block code, is provided. The image processing device comprises a filter for filtering the block edge, configured to, for at least some of the pixels to be filtered, within a deblocking range from the block edge, the deblocking range being perpendicular to the block edge, determine a filtered pixel value from an original pixel value of the pixel and at least one further pixel value, determine a clipping value of the pixel, dependent upon a distance of the pixel from the block edge, and clip the filtered pixel value, using the clipping value resulting in a deblocked pixel value.
    Type: Application
    Filed: March 24, 2021
    Publication date: September 9, 2021
    Applicant: HUAWEI TECHNOLOGIES CO.,LTD.
    Inventors: Anand Meher Kotra, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao, Jianle Chen
  • Patent number: 11109024
    Abstract: The present disclosure relates to image coding/decoding applying deblocking filtering and decoder-based intra-mode determination. In order to efficiently use software and/or hardware resources, the size of the template for the decoder-based intra-mode determination is smaller than the number of lines used by the deblocking filtering.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: August 31, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Shan Liu, Zhijie Zhao, Semih Esenlik, Han Gao
  • Publication number: 20210266547
    Abstract: An encoder is provided that comprises a partitioner and an entropy coder. The partitioner is configured to receive a current block of the frame and obtain a list of candidate geometric partitioning (GP) lines. Each of the candidate GP lines is generated based on information of one or more candidate neighbor blocks of the current block. The partitioner is further configured to determine a final GP line that partitions the current block into two segments, select a GP line from the list of GP lines to obtain a selected GP line, and generate a GP parameter for the current block. The GP parameter includes an offset information indicating an offset between the final GP line and the selected GP line. The entropy coder is configured to encode the GP parameter.
    Type: Application
    Filed: May 12, 2021
    Publication date: August 26, 2021
    Inventors: Zhijie ZHAO, Max BLAESER, Mathias WIEN
  • Patent number: 11102482
    Abstract: Embodiments of the present invention relate to the field of picture processing. Especially, the embodiments are directed to improving the deblocking filter of an image coding device. During the deblocking, at most a number MA of sample values of the first coding block adjacent to the block edge are modified and at most a number MB of sample values of the second coding block adjacent to the block edge are modified; or at most a number MA of sample values of the second coding block adjacent to the block edge are modified and at most a number MB of sample values of the first coding block adjacent to the block edge are modified, MA?MB.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: August 24, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Jianle Chen, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao
  • Patent number: 11102480
    Abstract: An apparatus is configured to determine an adopted intra prediction mode on the basis of a most probable modes list, a selected modes list and a non-selected modes list having a first portion and a second portion, wherein the adopted intra prediction mode is one of a plurality of intra prediction modes comprising a plurality of angular intra prediction modes for predicting sample values of a current picture block. The apparatus includes a processor configured to generate the first portion of the non-selected modes list by including one or more angular intra prediction modes determined to be close to a respective angular intra prediction mode of the most probable modes list and the selected modes list. The processor is further configured to determine the adopted intra prediction mode.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: August 24, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Zhijie Zhao, Semih Esenlik, Han Gao
  • Publication number: 20210258618
    Abstract: The present disclosure relates generally to video coding and picture partitioning methods. In particular, the disclosure is concerned with relations between partition constraint elements, by setting partitioning rules for different picture partitioning methods. The disclosure provides devices and corresponding methods for generating or processing a bitstream including encoded pictures, particularly for setting and including partition constraint element into the bitstream. One of the devices is configured to determine a minimum luma size of a leaf block resulting from quadtree splitting (MinQtSizeY), determine a maximum luma size of a coding block where partitioning using a binary tree splitting is allowed (MaxBtSizeY) based on the MinQtSizeY, and include information for the determined MinQtSizeY into the bitstream.
    Type: Application
    Filed: February 5, 2021
    Publication date: August 19, 2021
    Inventors: Han GAO, Semih ESENLIK, Jianle CHEN, Anand Meher KOTRA, Biao WANG, Zhijie ZHAO
  • Publication number: 20210250590
    Abstract: A decoding method for decoding an encoded picture which is partitioned into coding tree blocks which are further partitioned into coding blocks with different sizes, comprises parsing a first indication from the sequence parameter set (SPS)/picture parameter set (PPS)/slice header/tile header of a bit stream containing the encoded picture, determining the partition mode of the coding tree blocks, which are confined by block size restriction parameter and partition depth restriction parameter included in the SPS/PPS/slice header/tile header when the first indication is first value, or determining the partition mode of the multiple coding tree blocks, which are confined by default by block size restriction parameter and default partition depth restriction parameter when the first indication is second value or not presented in the SPS/PPS/slice header/tile header, and partitioning the coding tree blocks into the coding blocks according to the partition mode, and decoding the coding blocks.
    Type: Application
    Filed: March 18, 2021
    Publication date: August 12, 2021
    Inventors: Han Gao, Semih Esenlik, Jianle Chen, Anand Meher Kotra, Biao Wang, Zhijie Zhao
  • Patent number: 11082714
    Abstract: The present invention relates to the construction of a search space for determining a motion vector for a current block of a picture in a video sequence. The search space construction is split into two main stages, wherein a first and a second partial search space are respectively determined. Based on an initial estimate of a motion vector, a first search space is first constructed. A first and a second candidate motion vector of the first search space are identified according to a cost function. Based on the first and the second candidate motion vectors, a second search space is constructed. The motion vector for the current block is selected from the candidate motion vectors of the first search space and the second search space.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: August 3, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Han Gao
  • Publication number: 20210235127
    Abstract: A method and image processing device are provided, including a deblocking filter. The deblocking filter modifies values of at most MA samples of the first image block as first filter output values, the at most MA samples being obtained from a column of the first image block that is perpendicular to and adjacent to the horizontal block edge; and modifies values of at most MB samples of the second image block as second filter output values, the at most MB samples being obtained from a column of the second image block that is perpendicular to and adjacent to the horizontal block edge. At most a number MA of sample values of the first image block adjacent to the block edge are modified and at most a number MB of sample values of the second image block adjacent to the block edge are modified, wherein MA<MB.
    Type: Application
    Filed: April 12, 2021
    Publication date: July 29, 2021
    Applicant: HUAWEI TECHNOLOGIES CO.,LTD.
    Inventors: Jianle Chen, Anand Meher Kotra, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao
  • Publication number: 20210227218
    Abstract: The present disclosure relates to methods and devices to be employed for encoding and decoding of image or video signal. They include determination of whether or not the size of a current block is larger than a minimum allowed quadtree leaf node size. If the size of the current block is not larger than the minimum allowed quadtree leaf node size, multi-type tree splitting is applied to the current block. The minimum allowed quadtree leaf node size is not larger than a maximum allowed binary tree root node size or the minimum allowed quadtree leaf node size is not larger than a maximum allowed ternary tree root node size.
    Type: Application
    Filed: March 2, 2021
    Publication date: July 22, 2021
    Inventors: Han GAO, Semih ESENLIK, Jianle CHEN, Zhijie ZHAO, Anand Meher KOTRA, Biao WANG
  • Publication number: 20210227247
    Abstract: An apparatus and method are provided for inter prediction of a current geometric partition of a coding block. When the coding block is enabled for a geometric partition merge mode, a merge candidate list for the coding block partitioned into two geometric partitions including the current geometric partition is generated. The merge candidate list generation comprises deriving one or more spatial merge candidates from neighboring coding units, and directly or immediately deriving one or more temporal motion vector predictions (MVPs). An uni-prediction MV is derived as a motion vector of the current geometric partition based on the merge candidate list. The current geometric partition of the coding block is predicted based on the uni-prediction MV to obtain a predicted value of the current geometric partition.
    Type: Application
    Filed: April 8, 2021
    Publication date: July 22, 2021
    Applicant: HUAWEI TECHNOLOGIES CO.,LTD.
    Inventors: Max Blaeser, Zhijie Zhao
  • Patent number: 11070804
    Abstract: The present disclosure provides an encoding apparatus and a decoding apparatus, as well as an encoding method and a decoding method. In particular, the present disclosure relates to block partitioning and signaling the partitioning parameters in a bitstream. An override flag in an image region header indicates whether or not a block is to be partitioned according to a first partition constraint information. The override flag is included in the bitstream and the block is partitioned accordingly.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: July 20, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Han Gao, Semih Esenlik, Jianle Chen, Anand Meher Kotra, Biao Wang, Zhijie Zhao
  • Patent number: 11064197
    Abstract: The present disclosure relates to image coding/decoding applying deblocking filtering and decoder-based intra-mode determination. In order to efficiently use software and/or hardware resources, the size of the template for the decoder-based intra-mode determination is smaller than the number of lines used by the deblocking filtering.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: July 13, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Shan Liu, Zhijie Zhao, Semih Esenlik, Han Gao
  • Publication number: 20210211665
    Abstract: A method of image partitioning, comprises determining a first indicator, wherein the first indicator is shared by a first part of a bitstream; determining a partitioning of an image area corresponding to the first part of the bitstream with binary tree (BT) splitting or ternary tree (TT) splitting when the first indicator takes a first value; and determining the partitioning of the image area corresponding to the first part of the bitstream without BT splitting and TT splitting when the first indicator takes a second value, wherein the first value is different from the second value.
    Type: Application
    Filed: March 17, 2021
    Publication date: July 8, 2021
    Inventors: Han Gao, Semih Esenlik, Jianle Chen, Anand Meher Kotra, Biao Wang, Zhijie Zhao
  • Publication number: 20210203927
    Abstract: A decoding method and a decoder for decoding a current block of a video frame is provided, wherein the decoding method comprises determining a list of Most Probable Modes (MPMs) for the current block. When at least one condition is satisfied, the list of MPMs includes a DC mode, a Vertical mode, a Horizontal mode, an intra prediction mode corresponding to a value of the Vertical mode with a first offset, and an intra prediction mode corresponding to the value of the Vertical mode with a second offset. The decoding method further includes obtaining a MPM flag and a MPM index for the current block from a bitstream of the video, and obtaining an intra prediction mode for the current block for reconstructing the current block.
    Type: Application
    Filed: March 12, 2021
    Publication date: July 1, 2021
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Semih ESENLIK, Anand Meher Kotra, Han Gao, Jianle Chen, Zhijie Zhao