Patents by Inventor Zhijie ZHAO

Zhijie ZHAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220217353
    Abstract: A deblocking filter of an image processing device is provided. The deblocking filter is used in an image coding process, for deblocking a block edge between a first coding block and a second coding block of an image. The first block has SA samples perpendicular to the block edge by N samples parallel to the block edge, and the second block has SB samples perpendicular to the block edge by N samples parallel to the block edge. No more than IA samples of the first coding block are used as first filter input values, and no more than IB samples of the second coding block are used as second filter input values. No more than MA samples of the first coding block are modified as first filter output values, and no more than MB samples of the second coding block are modified as second filter output values.
    Type: Application
    Filed: January 27, 2022
    Publication date: July 7, 2022
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Semih Esenlik, Zhijie Zhao, Han Gao
  • Patent number: 11363292
    Abstract: The present disclosure relates to motion vector determination using template or bilateral matching and predictor generation based on the motion vector. The template or bilateral matching and/or the predictor generation use interpolation filtering. The interpolation filtering operation accesses integer sample positions within a window, and further uses padded sample values for integer sample positions outside the window, which are based on at least one sample within said window, and uses the accessed integer sample position values as well as the padded sample values to perform the template or bilateral matching and/or predictor generation.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: June 14, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Ivan Krasnov, Zhijie Zhao, Jianle Chen
  • Publication number: 20220182628
    Abstract: The present disclosure provides apparatuses and methods for splitting an image into coding units. An image is divided into coding tree units (CTUs) which are hierarchically partitioned. Hierarchical partitioning includes multi-type partitioning such as binary tree or quad tree splitting. For CTUs completely within the image and CTUs on the boundary, respective multi-type partition depths are chosen. The present disclosure provides for multi-type partitioning flexibility in a boundary portion of the image.
    Type: Application
    Filed: February 28, 2022
    Publication date: June 9, 2022
    Inventors: Han GAO, Zhijie ZHAO, Semih ESENLIK, Anand Meher KOTRA, Jianle CHEN
  • Patent number: 11343488
    Abstract: A system for encoding and decoding a video coding block of a multi-view video signal is provided. A decoder is configured to decode a texture-depth video coding block (t0, d0) of a first texture frame and a first depth map associated with a first view for providing a decoded texture-depth video coding block (t0, d0) and the first depth map. A synthesized predicted texture-depth video coding block (tsyn, dsyn) of a view synthesis texture frame and a view synthesis depth map associated with a second view is generated. An inpainted synthesized predicted texture-depth video coding block is generated. Based on the impainted predicted texture-depth video block, the decoder reconstructs a texture-depth video coding block (t1, d1) of a second texture frame and a second depth map associated with the second view. An encoder is configured to encode the texture-depth video coding block in a manner that complements the decoding provided by the decoder.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: May 24, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Johannes Sauer, Mathias Wien
  • Patent number: 11343504
    Abstract: An apparatus, a method, and a computer program performs image coding with selective loop-filtering. That is, the loop-filters which operate on samples across discontinuous face boundaries are capable of being disabled. The loop-filter operation may be deferred until all samples across a face boundary are known. Then, the loop-filter can use the correct samples according to the 3D arrangement. This may be implemented on the coding block level or at a higher level.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: May 24, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Johannes Sauer, Mathias Wien
  • Patent number: 11330268
    Abstract: A method for encoding a video signal includes generating an extension region of a first face of a reference frame, where the extension region includes a plurality of extension samples, and a sample value of each extension sample is based on a sample value of a sample of a second face of the reference frame, determining a use of an extension region, providing, based on the use, picture level extension usage information based on the extension region, and encoding the picture level extension usage information into an encoded video signal.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: May 10, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Zhijie Zhao, Johannes Sauer, Mathias Wien
  • Patent number: 11323707
    Abstract: The present disclosure provides apparatuses and methods for splitting an image into coding units. An image is divided into coding tree units (CTUs) which are hierarchically partitioned. Hierarchical partitioning includes multi-type partitioning such as binary tree or quad tree splitting. For CTUs completely within the image and CTUs on the boundary, respective multi-type partition depths are chosen. The present disclosure provides for multi-type partitioning flexibility in a boundary portion of the image.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: May 3, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Han Gao, Zhijie Zhao, Semih Esenlik, Anand Meher Kotra, Jianle Chen
  • Patent number: 11323717
    Abstract: The present disclosure relates to encoding and decoding video by employing texture coding. In particular, a texture region is identified within a video picture and a texture patch is determined for the texture region. Moreover, a first set of parameters is derived specifying weighting factors for reconstructing spectral coefficients of the texture region by fitting the texture region in a spectral domain to a first function of the texture patch, the first function being defined by the first set of parameters. The texture patch and the first set of parameters are then included into a bitstream which is output by an encoder and provided in this way to the decoder which reconstructs the texture based on the patch and the function applied to the patch.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: May 3, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Bastian Wandt, Yiqun Liu, Thorsten Laude, Bodo Rosenhahn, Joern Ostermann
  • Publication number: 20220132144
    Abstract: A device for encoding and a device for decoding a picture, respectively, and corresponding methods relating to the field of picture coding are provided. The devices are respectively configured to partition the picture into one or more slices, each slice comprising one or more tiles, and one or more slices holding coded picture data. Further, the devices are configured to encode the one or more slices holding coded picture data, thereby improving coding and decoding of pictures with uncoded buffer space.
    Type: Application
    Filed: June 28, 2021
    Publication date: April 28, 2022
    Inventors: Johannes SAUER, Ye-Kui WANG, Zhijie ZHAO, Semih ESENLIK
  • Publication number: 20220116586
    Abstract: A method for coding implemented by a decoding device or an encoding device includes: obtaining a first prediction mode for a first sub-block, obtaining a second prediction mode for a second sub-block; obtaining a first prediction value for a sample in the current block according to the first prediction mode, obtaining a second prediction value for the sample in the current block according to the second prediction mode; obtaining a value of an indicator, the value of the indicator indicating a blending operation which is performed for the sample in the current block; and obtaining a combined prediction value for the sample in the current block, according to the value of the indictor, the first prediction value, and the second prediction value. The blending operation adaptively performs around a separation line dividing the current block into at least the first sub-block and the second sub-block.
    Type: Application
    Filed: December 21, 2021
    Publication date: April 14, 2022
    Inventors: Semih ESENLIK, Max BLAESER, Zhijie ZHAO, Han GAO, Biao WANG, Anand Meher KOTRA, Elena Alexandrovna ALSHINA
  • Patent number: 11303902
    Abstract: The present disclosure relates to apparatuses and methods for determination of motion parameters (e.g. motion vectors) for motion prediction of a coding block, and is applicable to video encoding and/or decoding. The motion parameter is selected from motion parameters, which include motion parameters associated with a set of respective image samples not included in the coding tree unit, where the set of image samples are located at a predetermined position relative to an extended boundary of the coding tree unit. The apparatuses and methods of the present disclosure may facilitate reducing on-chip buffer requirements for motion prediction.
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: April 12, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Jianle Chen
  • Patent number: 11297345
    Abstract: A method for constructing a Most Probable Mode (MPM) list for intra prediction, the method comprising: determining whether a left neighboring block of a current coding block is available or not; determining whether an above neighboring block of the current coding block is available or not; using a Planar mode, a DC mode, a vertical mode (VER_IDX), a horizontal mode (HOR_IDX), an intra prediction mode corresponding to the vertical mode with an offset ?4, an intra prediction mode corresponding to the vertical mode with an offset 4, to obtain a value of an intra prediction mode for the current coding block when one of conditions is satisfied. The MPM list is used to obtain an index value corresponding to a prediction mode of a picture block, so as to improve coding efficiency.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: April 5, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Anand Meher Kotra, Semih Esenlik, Jianle Chen, Zhijie Zhao, Han Gao
  • Patent number: 11290721
    Abstract: A deblocking filter of an image processing device is provided. The deblocking filter is used in an image coding process, for deblocking a block edge between a first coding block and a second coding block of an image. The first block has SA samples perpendicular to the block edge by N samples parallel to the block edge, and the second block has SB samples perpendicular to the block edge by N samples parallel to the block edge. No more than IA samples of the first coding block are used as first filter input values, and no more than IB samples of the second coding block are used as second filter input values. No more than MA samples of the first coding block are modified as first filter output values, and no more than MB samples of the second coding block are modified as second filter output values.
    Type: Grant
    Filed: September 27, 2020
    Date of Patent: March 29, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Semih Esenlik, Zhijie Zhao, Han Gao
  • Patent number: 11284086
    Abstract: The present disclosure relates to image encoding/decoding applying decoder side intra-prediction mode determination (DIMD). In order to reduce the computational complexity, DIMD for a current coding block based on a template of a neighboring reconstructed coding block is not performed if the border between the current and the reconstructed coding block concurs with a border between coding tree blocks.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: March 22, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Zhijie Zhao, Semih Esenlik, Han Gao
  • Patent number: 11277608
    Abstract: The present disclosure relates to a method and device of decoding video data. The device and method use a mapping process to simplify the calculation procedure for intra prediction, to improve coding efficiency. The decoding of encoded data comprises: obtaining an indication indicating whether the intra-prediction mode for a picture block is in a set of most probable modes, MPM, or not; if the indication indicates that the intra prediction mode for the picture block is not in the set of MPMs, generating a mapping relationship between at least one intra prediction mode in the first set of intra prediction modes and at least one intra prediction mode in the set of non-MPMs; decoding the encoded data to obtain an intra prediction mode codeword for the picture block; and obtaining the intra prediction mode for the picture block according to the mapping relationship and the intra prediction mode codeword.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: March 15, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Biao Wang, Semih Esenlik, Jianle Chen, Han Gao, Zhijie Zhao
  • Patent number: 11272220
    Abstract: Embodiments provide an apparatus and method of partitioning of an image or an image slice. In particular, on an image processing apparatus, the image or image slice is split into an integer number of coding tree units in both vertical and horizontal directions. Boundary coding tree units are then at least partially forced-split so that at least one resulting coding unit is a result of binary-tree partitioning, i.e., includes a coding unit which is longer on one side than on the other side. The longer side is parallel or concurrent to the image or image slice boundary. Recursively partitioning coding units that span the picture boundary without the requirement for signaling partition information in a bitstream can be achieved.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: March 8, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Han Gao, Zhijie Zhao, Semih Esenlik, Anand Meher Kotra, Shan Liu
  • Patent number: 11265538
    Abstract: An apparatus and a method for filtering reconstructed images, in particular, video images, with adaptive multiplicative filters. The efficiency of the filtering operation is increased by restricting the allowable values of the filter coefficients to those that have only a limited number of “ones” in the binary representation.
    Type: Grant
    Filed: September 9, 2020
    Date of Patent: March 1, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Jianle Chen
  • Publication number: 20220060754
    Abstract: A system and method for processing a video stream are provided. When coding or decoding a video stream a de-blocking filtering may be applied for reducing discontinuities caused by use of a block-based video coding. The de-blocking filtering is performed using a filter grid. The size of the filter grid is chosen adaptively based on the processing parameters. The adaptive size of the filtering grid is determined based on the number of samples used and modified in de-blocking filtering of an edge of a coding block. The filtering grid may be used both for vertical and horizontal edge filtering.
    Type: Application
    Filed: November 1, 2021
    Publication date: February 24, 2022
    Inventors: Anand Meher KOTRA, Semih ESENLIK, Zhijie ZHAO
  • Publication number: 20220060698
    Abstract: A coding apparatus configured to select an intra prediction mode for a current block, encode the selected intra prediction mode using truncated binary coding every time the selected intra prediction mode is a remaining mode, and encode the selected intra prediction mode using N bits when the selected intra prediction mode is included in a first portion from remaining modes and using N+1 bits when the selected intra prediction mode is included in a second portion of the remaining modes.
    Type: Application
    Filed: November 3, 2021
    Publication date: February 24, 2022
    Inventors: Anand Meher Kotra, Jianle Chen, Semih Esenlik, Zhijie Zhao, Han Gao, Biao Wang, Ivan Krasnov
  • Patent number: 11259054
    Abstract: An in-loop deblocking filter apparatus (120) for processing a current row or column of samples into a filtered row or column of samples. The current row or column of samples comprises a plurality of samples from a first sample block and a horizontally or vertically neighboring second sample block of a reconstructed picture of a video stream. The samples of the current row or column of samples have sample values pN?1?p0, q0?qN?1 wherein N is an even integer greater than 2. If a first condition or a second condition is satisfied, the current row or column is processed by: determining a filtered sample value q0? by applying a (2N?1)-tap filter to the sample values pN?2, . . . , p0, q0, . . . , qN?1 of the current row or column; and/or determining a filtered sample value p0? by applying a (2N?1)-tap filter to the sample values pN?1, . . . , p0, q0, . . . , qN?2 of the current row or column.
    Type: Grant
    Filed: December 27, 2020
    Date of Patent: February 22, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Biao Wang, Zhijie Zhao, Semih Esenlik, Han Gao, Jianle Chen