Patents by Inventor Zhijie ZHAO

Zhijie ZHAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210174092
    Abstract: The invention relates to an image processing apparatus for extracting a feature from an image of a scene. The apparatus may comprises processing circuitry configured, in response to a feature extraction event, to extract a feature from first image data representing a first image of a scene, wherein the feature extraction event is based on second image data representing a second image of the scene. The image processing apparatus may include an event driven sensor and the second image may include may include a positive/negative amount of the intensity change and the location of the intensity change. Moreover, the invention relates to a corresponding image processing method.
    Type: Application
    Filed: February 12, 2021
    Publication date: June 10, 2021
    Inventors: Zhijie ZHAO, Yuntan FANG, Jun ZHA, Hu CHEN, Jiantong ZHOU
  • Publication number: 20210168408
    Abstract: A method for encoding a video image using coding parameters, adapted on the basis of motion of the video image and of an output of a machine-learning based model, wherein the machine-learning based model is input with samples of a block of the video image and motion information of the samples, and along with texture, wherein the machine-learning model segments the video image into regions based on strength of the motion determined from the motion information. An object is detected within the video based on the motion and the texture, and spatial-time coding parameters are determined based on the strength of the motion, and whether or not the detected objects moves.
    Type: Application
    Filed: February 9, 2021
    Publication date: June 3, 2021
    Inventors: Kirill Aleksandrovich Malakhov, Hu Chen, Zhijie Zhao, Dmitry Vadimovich Novikov, Marat Ravilevich Gilmutdinov
  • Publication number: 20210168372
    Abstract: The present disclosure relates to encoding of video image using coding parameters, which are adapted based on events related to motion within the video image. Image content is captured by a standard image sensor and an event-triggered sensor, providing an event-signal indicating changes (e.g. amount and time-spatial location) of image intensity. Objects are detected within the video image, based on the event signal assessing motion of the object, and their textures extracted. The spatial-time coding parameters of the video image are determined based on the location and strength of the event signal, and the extent to which the detected objects moves.
    Type: Application
    Filed: February 8, 2021
    Publication date: June 3, 2021
    Inventors: Zhijie Zhao, Yuntan Fang, Jun Zha, Hu Chen, Jiantong Zhou
  • Publication number: 20210144369
    Abstract: The present disclosure relates to a method and device of decoding video data. The device and method use a mapping process to simplify the calculation procedure for intra prediction, to improve coding efficiency. The decoding of encoded data comprises: obtaining an indication indicating whether the intra-prediction mode for a picture block is in a set of most probable modes, MPM, or not; if the indication indicates that the intra prediction mode for the picture block is not in the set of MPMs, generating a mapping relationship between at least one intra prediction mode in the first set of intra prediction modes and at least one intra prediction mode in the set of non-MPMs; decoding the encoded data to obtain an intra prediction mode codeword for the picture block; and obtaining the intra prediction mode for the picture block according to the mapping relationship and the intra prediction mode codeword.
    Type: Application
    Filed: January 22, 2021
    Publication date: May 13, 2021
    Inventors: Anand Meher KOTRA, Biao WANG, Semih ESENLIK, Jianle CHEN, Han GAO, Zhijie ZHAO
  • Publication number: 20210144374
    Abstract: A method of coding implemented by a decoding device, comprising obtaining a bitstream; obtaining a value of an indicator for a current block according to the bitstream; obtaining a value of a first parameter for the current block and a value of a second parameter for the current block, according to the value of the indicator and a predefined lookup table; obtaining a value of a sample distance for a sample which is located in the current block, according to the value of the first parameter and the value of the second parameter; obtaining a prediction value for the sample, according to the value of the sample distance for the sample.
    Type: Application
    Filed: January 21, 2021
    Publication date: May 13, 2021
    Inventors: Semih ESENLIK, Max BLAESER, Zhijie ZHAO, Han GAO, Anand Meher KOTRA, Biao WANG, Elena Alexandrovna ALSHINA
  • Patent number: 11006147
    Abstract: An apparatus for decoding 3D video data is provided, the 3D video data comprising a plurality of texture frames and a plurality of associated depth maps, the apparatus comprising: a first texture decoder configured to decode a video coding block of a first texture frame associated with a first view; a first depth map decoder configured to decode a video coding block of a first depth map associated with the first texture frame; a depth map filter configured to generate an auxiliary depth map on the basis of the first depth map; a first view synthesis prediction unit configured to generate a predicted video coding block of a view synthesis predicted second texture frame associated with a second view on the basis of the video coding block of the first texture frame and the auxiliary depth map.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: May 11, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Jens Schneider, Johannes Sauer, Mathias Wien
  • Publication number: 20210136372
    Abstract: A partitioning method comprises determining whether a current block of a picture is a boundary block and whether the size of the current block is larger than a minimum allowed quadtree leaf node size; and if the current block is the boundary block and the size of the current block is not larger than the minimum allowed quadtree leaf node size (MinQTSize), applying forced binary tree (BT) partitioning to the current block. A method comprises making a determination that a current block of a picture is a boundary block and that a size of the current block is less than or equal to a minimum allowed quadtree (QT) leaf node size (MinQTSize); and applying, in response to the determination, forced binary tree (BT) partitioning to the current block.
    Type: Application
    Filed: January 8, 2021
    Publication date: May 6, 2021
    Inventors: Han GAO, Jianle CHEN, Semih ESENLIK, Zhijie ZHAO, Anand Meher KOTRA
  • Publication number: 20210127139
    Abstract: An in-loop deblocking filter apparatus (120) for processing a current row or column of samples into a filtered row or column of samples. The current row or column of samples comprises a plurality of samples from a first sample block and a horizontally or vertically neighboring second sample block of a reconstructed picture of a video stream. The samples of the current row or column of samples have sample values pN?1?p0, q0?qN?1 wherein N is an even integer greater than 2. If a first condition or a second condition is satisfied, the current row or column is processed by: determining a filtered sample value q0? by applying a (2N?1)-tap filter to the sample values pN?2, . . . , p0, q0, . . . , qN?1 of the current row or column; and/or determining a filtered sample value p0? by applying a (2N?1)-tap filter to the sample values pN?1, . . . , p0, q0, . . . , qN?2 of the current row or column.
    Type: Application
    Filed: December 27, 2020
    Publication date: April 29, 2021
    Inventors: Anand Meher Kotra, Biao Wang, Zhijie Zhao, Semih Esenlik, Han Gao, Jianle Chen
  • Publication number: 20210120250
    Abstract: A method for encoding a video signal includes generating an extension region of a first face of a reference frame, where the extension region includes a plurality of extension samples, and a sample value of each extension sample is based on a sample value of a sample of a second face of the reference frame, determining a use of an extension region, providing, based on the use, picture level extension usage information based on the extension region, and encoding the picture level extension usage information into an encoded video signal.
    Type: Application
    Filed: December 28, 2020
    Publication date: April 22, 2021
    Inventors: Zhijie Zhao, Johannes Sauer, Mathias Wien
  • Patent number: 10972725
    Abstract: A decoding method and a decoder for decoding a current block of a video is provided, wherein the decoding method comprises: determining a set of Most Probable Modes (MPMs) for the current block. When at least one condition is satisfied, the set of MPMs includes a Planar mode, a DC mode, a Vertical mode, a Horizontal mode, an intra prediction mode corresponding to a value of the Vertical mode with a first offset, and an intra prediction mode corresponding to the value of the Vertical mode with a second offset. The decoding method further includes obtaining a MPM flag and an MPM index for the current block from a bitstream of the video, and obtaining an intra prediction mode for the current block for reconstructing the current block.
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: April 6, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Semih Esenlik, Anand Meher Kotra, Han Gao, Jianle Chen, Zhijie Zhao
  • Publication number: 20210084299
    Abstract: The present disclosure provides apparatuses and methods for splitting an image into coding units. An image is divided into coding tree units (CTUs) which are hierarchically partitioned. Hierarchical partitioning includes multi-type partitioning such as binary tree or quad tree splitting. For CTUs completely within the image and CTUs on the boundary, respective multi-type partition depths are chosen. The present disclosure provides for multi-type partitioning flexibility in a boundary portion of the image.
    Type: Application
    Filed: November 30, 2020
    Publication date: March 18, 2021
    Inventors: Han GAO, Zhijie ZHAO, Semih ESENLIK, Anand Meher KOTRA, Jianle CHEN
  • Publication number: 20210084298
    Abstract: A method for boundary partition of a current block of a picture is provided. The method includes that a decoder receives a bitstream, where the bitstream includes a partition indicator; parses the bitstream to obtain the partition indicator; determines whether the current block is to be split based on the partition indicator; determines whether the current block is a boundary block when the current block is not to be split; and performs a boundary partition on the current block when the current block is a boundary block. The partition indicator of a same partition syntax is used no matter whether the current block is a boundary block (isB) or a non-boundary block (noB), which is benefit to keep the continuity of context-adaptive binary arithmetic coding (CABAC) engine, thus it will lead to higher coding efficiency.
    Type: Application
    Filed: November 29, 2020
    Publication date: March 18, 2021
    Inventors: Han Gao, Semih Esenlik, Zhijie Zhao, Anand Meher Kotra, Jianle Chen
  • Publication number: 20210058624
    Abstract: The present disclosure relates to apparatuses and methods for determination of motion parameters (e.g. motion vectors) for motion prediction of a coding block, and is applicable to video encoding and/or decoding. The motion parameter is selected from motion parameters, which include motion parameters associated with a set of respective image samples not included in the coding tree unit, where the set of image samples are located at a predetermined position relative to an extended boundary of the coding tree unit. The apparatuses and methods of the present disclosure may facilitate reducing on-chip buffer requirements for motion prediction.
    Type: Application
    Filed: October 20, 2020
    Publication date: February 25, 2021
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Jianle Chen
  • Patent number: 10931965
    Abstract: The invention relates to an encoding apparatus for processing a video signal comprising a plurality of frames dividable into video coding blocks. A first video coding block of a current frame of the video signal is partitioned into a first segment associated with a first segment motion vector relative to a first reference frame of the video signal and a second segment. The first video coding block is associated with a plurality of virtual partitions. Each virtual partition is associated with a respective subset of the plurality of video coding blocks of the current frame. Each video coding block of the respective subset neighbors the first video coding block and is associated with a motion vector.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: February 23, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Max Blaeser, Mathias Wien
  • Patent number: 10924756
    Abstract: Embodiments of the disclosure relate to an encoding apparatus and a decoding apparatus. The encoding apparatus is configured to process a video signal, the video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, each video coding block comprising a plurality of pixels. The encoding apparatus comprises a partitioner configured to partition a first video coding block of the plurality of video coding blocks of a first frame of the video signal into a first segment and a second segment, wherein the first segment comprises a first set of the plurality of pixels of the first video coding block and the second segment comprises a second set of the plurality of pixels of the first video coding block.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: February 16, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Max Blaeser, Mathias Wien
  • Publication number: 20210014498
    Abstract: A deblocking filter of an image processing device is provided. The deblocking filter is used in an image coding process, for deblocking a block edge between a first coding block and a second coding block of an image. The first block has SA samples perpendicular to the block edge by N samples parallel to the block edge, and the second block has SB samples perpendicular to the block edge by N samples parallel to the block edge. No more than IA samples of the first coding block are used as first filter input values, and no more than IB samples of the second coding block are used as second filter input values. No more than MA samples of the first coding block are modified as first filter output values, and no more than MB samples of the second coding block are modified as second filter output values.
    Type: Application
    Filed: September 27, 2020
    Publication date: January 14, 2021
    Applicant: HUAWEI TECHNOLOGIES CO.,LTD.
    Inventors: Anand Meher Kotra, Semih Esenlik, Zhijie Zhao, Han Gao
  • Publication number: 20210014484
    Abstract: The disclosure relates to a decoder for reconstructing a current block of an encoded picture, the decoder comprising processing circuitry configured to generate a most probable modes (MPM) candidates list for the current block, the MPM candidates list comprising four or more elements, wherein the first four elements of the MPM candidates list are, in this order, an intra-prediction mode associated with a left neighboring block of the current block, an intra-prediction mode associated with a top neighboring block of the current block, a planar mode, and an intra-prediction mode associated with a top-left neighboring block of the current block, prune the MPM candidates list, thereby generating an MPM list, and intra-predict the current block based on the MPM list. A higher compression ratio can thus be achieved.
    Type: Application
    Filed: September 29, 2020
    Publication date: January 14, 2021
    Inventors: Anand Meher Kotra, Zhijie Zhao, Semih Esenlik, Han Gao
  • Publication number: 20210006786
    Abstract: The present disclosure provides an encoding apparatus and a decoding apparatus, as well as an encoding method and a decoding method. In particular, the present disclosure relates to block partitioning and signaling the partitioning parameters in a bitstream. An override flag in an image region header indicates whether or not a block is to be partitioned according to a first partition constraint information. The override flag is included in the bitstream and the block is partitioned accordingly.
    Type: Application
    Filed: August 27, 2020
    Publication date: January 7, 2021
    Inventors: Han GAO, Semih ESENLIK, Jianle CHEN, Anand Meher KOTRA, Biao WANG, Zhijie ZHAO
  • Publication number: 20200413053
    Abstract: An apparatus and a method filters reconstructed images, in particular, video images, with adaptive multiplicative filters. The apparatus and method groups the multiplier coefficients of the filter into at least two groups; determines the value of each multiplier coefficient in a first group so as to be allowed to assume any value in a first set of allowed values of multiplier coefficients, determines the value of each multiplier coefficient in a second group so as to be allowed to assume any value in a second set of allowed values of multiplier coefficients, and filters the set of samples of an image with the filter. At least one of the first and second sets has at least one value that is not in the other set.
    Type: Application
    Filed: September 9, 2020
    Publication date: December 31, 2020
    Inventors: Semih ESENLIK, Zhijie ZHAO, Anand Meher KOTRA, Jianle CHEN
  • Publication number: 20200413054
    Abstract: An apparatus and a method for filtering reconstructed images, in particular, video images, with adaptive multiplicative filters. The efficiency of the filtering operation is increased by restricting the allowable values of the filter coefficients to those that have only a limited number of “ones” in the binary representation.
    Type: Application
    Filed: September 9, 2020
    Publication date: December 31, 2020
    Inventors: Semih ESENLIK, Anand Meher KOTRA, Zhijie ZHAO, Jianle CHEN