Patents by Inventor Zhijie ZHAO

Zhijie ZHAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230319266
    Abstract: A decoding method and a decoder for decoding a current block of a video frame is provided, wherein the decoding method comprises determining a list of Most Probable Modes (MPMs) for the current block. When at least one condition is satisfied, the list of MPMs includes a DC mode, a Vertical mode, a Horizontal mode, an intra prediction mode corresponding to a value of the Vertical mode with a first offset, and an intra prediction mode corresponding to the value of the Vertical mode with a second offset. The decoding method further includes obtaining a MPM flag and a MPM index for the current block from a bitstream of the video, and obtaining an intra prediction mode for the current block for reconstructing the current block.
    Type: Application
    Filed: April 12, 2023
    Publication date: October 5, 2023
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Semih Esenlik, Anand Meher Kotra, Han Gao, Jianle Chen, Zhijie Zhao
  • Patent number: 11765351
    Abstract: An apparatus and a method for filtering reconstructed images, in particular, video images, with adaptive multiplicative filters. The efficiency of the filtering operation is increased by restricting the allowable values of the filter coefficients to those that have only a limited number of “ones” in the binary representation.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: September 19, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Jianle Chen
  • Patent number: 11750810
    Abstract: A partitioning method comprises determining whether a current block of a picture is a boundary block and whether the size of the current block is larger than a minimum allowed quadtree leaf node size; and if the current block is the boundary block and the size of the current block is not larger than the minimum allowed quadtree leaf node size (MinQTSize), applying forced binary tree (BT) partitioning to the current block. A method comprises making a determination that a current block of a picture is a boundary block and that a size of the current block is less than or equal to a minimum allowed quadtree (QT) leaf node size (MinQTSize); and applying, in response to the determination, forced binary tree (BT) partitioning to the current block.
    Type: Grant
    Filed: July 28, 2022
    Date of Patent: September 5, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Han Gao, Jianle Chen, Semih Esenlik, Zhijie Zhao, Anand Meher Kotra
  • Publication number: 20230276076
    Abstract: A method and image processing device are provided, including a deblocking filter. The deblocking filter modifies values of at most MA samples of the first image block as first filter output values, the at most MA samples being located at a column of the first image block that is perpendicular to and adjacent to the horizontal block edge; and modifies values of at most MB samples of the second image block as second filter output values, the at most MB samples being located at a column of the second image block that is perpendicular to and adjacent to the horizontal block edge. At most a number MA of sample values of the first image block adjacent to the block edge are modified and at most a number MB of sample values of the second image block adjacent to the block edge are modified, wherein MA<MB.
    Type: Application
    Filed: May 8, 2023
    Publication date: August 31, 2023
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Jianle Chen, Anand Meher Kotra, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao
  • Patent number: 11736718
    Abstract: The embodiments disclosed herein relate to the construction of a search space for determining a motion vector for a current block of a picture in a video sequence. The search space construction is split into in two main stages, wherein a first and a second partial search space are respectively determined. Based on an initial estimate of a motion vector, a first search space is first constructed. A first and a second candidate motion of the first search space are identified according to a cost function. Based on the first and the second candidate motion vectors, a second search space is constructed. The motion vector for the current block is selected from the candidate motion vectors of the first search space and the second search space.
    Type: Grant
    Filed: June 16, 2021
    Date of Patent: August 22, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Han Gao
  • Publication number: 20230247293
    Abstract: This application relates to the field of image processing, and in particular, to a multi-lens video recording method and related devices. The method includes: performing collaborative photographing through a plurality of cameras, determining a target camera movement mode based on main subject information in images obtained through photographing and motion information of the cameras, and then fusing, based on the target camera movement mode, the images obtained through photographing by using the plurality of cameras, to implement online camera movement fusion on the plurality of video stream images.
    Type: Application
    Filed: March 24, 2023
    Publication date: August 3, 2023
    Inventors: Fei TENG, Junkai CHEN, Zhaolei XIAO, He WEI, Changqi HU, Zhijie ZHAO
  • Publication number: 20230239489
    Abstract: The present disclosure relates to motion vector refinement. As a first step, an initial motion vector and a template for the block are obtained. Then, the refinement of the initial motion vector is determined by template matching with said template in a search space. The search space is located on a position given by the initial motion vector and includes one or more fractional sample positions, wherein each of the fractional sample positions belonging to the search space is obtained by interpolation filtering with a filter of a predefined tap-size assessing integer samples only within a window, said window being formed by integer samples accessible for the template matching in said search space.
    Type: Application
    Filed: January 23, 2023
    Publication date: July 27, 2023
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Han Gao
  • Publication number: 20230224460
    Abstract: A method of filtering a sample value of a picture is provided, with an integer t that is less than k and with an integer j in the range of 1 to m: generating, with an integer i in the range of 1 to k?t?1, a filtered sample value by applying a filter to the value of the sample p(i,j), wherein the filter is supported by a set of filter support samples, the set of filter support samples does not comprise any samples p(i?,j?) with row index i? greater than k?t?1, and/or generating, with an integer i in the range of k?t to k, a filtered sample value by applying a filter to the value of the sample p(i,j), the filter is supported by a set of filter support samples, wherein the set of filter support samples does not comprise any samples p(i?,j?) with row index i? less than k?t.
    Type: Application
    Filed: November 29, 2022
    Publication date: July 13, 2023
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Semih Esenlik, Jianle Chen, Han Gao, Biao Wang, Zhijie Zhao
  • Publication number: 20230217025
    Abstract: The present disclosure relates to methods and devices to be employed for encoding and decoding of image or video signal. They include determination of whether or not the size of a current block is larger than a minimum allowed quadtree leaf node size. If the size of the current block is not larger than the minimum allowed quadtree leaf node size, multi-type tree splitting is applied to the current block. The minimum allowed quadtree leaf node size is not larger than a maximum allowed binary tree root node size or the minimum allowed quadtree leaf node size is not larger than a maximum allowed ternary tree root node size.
    Type: Application
    Filed: February 13, 2023
    Publication date: July 6, 2023
    Inventors: Han GAO, Semih ESENLIK, Jianle CHEN, Zhijie ZHAO, Anand Meher KOTRA, Biao WANG
  • Patent number: 11695927
    Abstract: A coding apparatus configured to select an intra prediction mode for a current block, encode the selected intra prediction mode using truncated binary coding every time the selected intra prediction mode is a remaining mode, and encode the selected intra prediction mode using N bits when the selected intra prediction mode is included in a first portion from remaining modes and using N+1 bits when the selected intra prediction mode is included in a second portion of the remaining modes.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: July 4, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Jianle Chen, Semih Esenlik, Zhijie Zhao, Han Gao, Biao Wang, Ivan Krasnov
  • Publication number: 20230209043
    Abstract: Embodiments provide methods and devices (encoder and/or decoder) of coding a picture. A History Based Motion Vector Prediction (HMVP) list for a current Coding Tree Unit (CTU) row within a tile of a picture is initialized and a CTU of the current CTU row is processed based on the initialized HMVP list.
    Type: Application
    Filed: December 19, 2022
    Publication date: June 29, 2023
    Inventors: Anand Meher KOTRA, Jianle Chen, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao
  • Patent number: 11683533
    Abstract: A method and image processing device are provided, including a deblocking filter. The deblocking filter modifies values of at most MA samples of the first image block as first filter output values, the at most MA samples being obtained from a column of the first image block that is perpendicular to and adjacent to the horizontal block edge; and modifies values of at most MB samples of the second image block as second filter output values, the at most MB samples being obtained from a column of the second image block that is perpendicular to and adjacent to the horizontal block edge. At most a number MA of sample values of the first image block adjacent to the block edge are modified and at most a number MB of sample values of the second image block adjacent to the block edge are modified, wherein MA<MB.
    Type: Grant
    Filed: April 12, 2021
    Date of Patent: June 20, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Jianle Chen, Anand Meher Kotra, Semih Esenlik, Biao Wang, Han Gao, Zhijie Zhao
  • Patent number: 11683520
    Abstract: The present invention relates to the performance of motion vector refinement in a search space for multi-reference inter-prediction. Two or more reference pictures are selected, one of those used for motion vector refinement. Based on an initial estimate of a motion vector to the reference picture for motion vector refinement, a search space in this reference image is constructed. Using template matching, the first motion vector is refined. The second motion vector to another reference picture is calculated using its initial estimate, the initial estimate of the first motion vector and the refined first motion vector.
    Type: Grant
    Filed: October 20, 2021
    Date of Patent: June 20, 2023
    Assignee: Huawei Technologies Co, , Ltd.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao
  • Patent number: 11671632
    Abstract: A method for encoding a video image using coding parameters, adapted on the basis of motion of the video image and of an output of a machine-learning based model, wherein the machine-learning based model is input with samples of a block of the video image and motion information of the samples, and along with texture, wherein the machine-learning model segments the video image into regions based on strength of the motion determined from the motion information. An object is detected within the video based on the motion and the texture, and spatial-time coding parameters are determined based on the strength of the motion, and whether or not the detected objects moves.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: June 6, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Kirill Aleksandrovich Malakhov, Hu Chen, Zhijie Zhao, Dmitry Vadimovich Novikov, Marat Ravilevich Gilmutdinov
  • Publication number: 20230171437
    Abstract: The present disclosure relates generally to video coding and picture partitioning methods. In particular, the disclosure is concerned with relations between partition constraint elements, by setting partitioning rules for different picture partitioning methods. The disclosure provides devices and corresponding methods for generating or processing a bitstream including encoded pictures, particularly for setting and including partition constraint element into the bitstream. One of the devices is configured to determine a minimum luma size of a leaf block resulting from quadtree splitting (MinQtSizeY), determine a maximum luma size of a coding block where partitioning using a binary tree splitting is allowed (MaxBtSizeY) based on the MinQtSizeY, and include information for the determined MinQtSizeY into the bitstream.
    Type: Application
    Filed: September 28, 2022
    Publication date: June 1, 2023
    Inventors: Han GAO, Semih ESENLIK, Jianle CHEN, Anand Meher KOTRA, Biao WANG, Zhijie ZHAO
  • Patent number: 11653032
    Abstract: A video processing method, comprising: initializing a HMVP list for a current CTU row when the current CTU is the beginning CTU of a current CTU row; and processing the current CTU row based on the HMVP list. By performing the method, the encoding efficiency and decoding efficiency are improved.
    Type: Grant
    Filed: August 15, 2020
    Date of Patent: May 16, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Semih Esenlik, Jianle Chen, Biao Wang, Han Gao, Zhijie Zhao
  • Patent number: 11647182
    Abstract: A decoding method and a decoder for decoding a current block of a video frame is provided, wherein the decoding method comprises determining a list of Most Probable Modes (MPMs) for the current block. When at least one condition is satisfied, the list of MPMs includes a DC mode, a Vertical mode, a Horizontal mode, an intra prediction mode corresponding to a value of the Vertical mode with a first offset, and an intra prediction mode corresponding to the value of the Vertical mode with a second offset. The decoding method further includes obtaining a MPM flag and a MPM index for the current block from a bitstream of the video, and obtaining an intra prediction mode for the current block for reconstructing the current block.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: May 9, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Semih Esenlik, Anand Meher Kotra, Han Gao, Jianle Chen, Zhijie Zhao
  • Patent number: 11641466
    Abstract: The present disclosure relates to methods and devices to be employed for encoding and decoding of image or video signal. They include determination of whether or not the size of a current block is larger than a minimum allowed quadtree leaf node size. If the size of the current block is not larger than the minimum allowed quadtree leaf node size, multi-type tree splitting is applied to the current block. The minimum allowed quadtree leaf node size is not larger than a maximum allowed binary tree root node size or the minimum allowed quadtree leaf node size is not larger than a maximum allowed ternary tree root node size.
    Type: Grant
    Filed: March 2, 2021
    Date of Patent: May 2, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Han Gao, Semih Esenlik, Jianle Chen, Zhijie Zhao, Anand Meher Kotra, Biao Wang
  • Publication number: 20230129504
    Abstract: A method of coding implemented by a decoding device, comprising obtaining a bitstream; obtaining a value of an indicator for a current block according to the bitstream; obtaining a value of a first parameter for the current block and a value of a second parameter for the current block, according to the value of the indicator and a predefined lookup table; obtaining a value of a sample distance for a sample which is located in the current block, according to the value of the first parameter and the value of the second parameter; obtaining a prediction value for the sample, according to the value of the sample distance for the sample.
    Type: Application
    Filed: December 6, 2022
    Publication date: April 27, 2023
    Inventors: Semih Esenlik, Max Blaeser, Zhijie Zhao, Han Gao, Anand Meher Kotra, Biao Wang, Elena Alexandrovna Alshina
  • Patent number: 11582477
    Abstract: The present disclosure relates to motion vector refinement. As a first step, an initial motion vector and a template for the block are obtained. Then, the refinement of the initial motion vector is determined by template matching with said template in a search space. The search space is located on a position given by the initial motion vector and includes one or more fractional sample positions, wherein each of fractional sample positions belonging to the search space is obtained by interpolation filtering with a filter of a predefined tap-size assessing integer samples only within a window, said window being formed by integer samples accessible for the template matching in said search space.
    Type: Grant
    Filed: June 24, 2022
    Date of Patent: February 14, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Han Gao