Patents Examined by Leron Beck
  • Patent number: 12015795
    Abstract: Devices, systems and methods related to digital video coding, and specifically, to signaling of slice types in video picture headers are described. One example method of video processing includes performing a conversion between a video including one or more video pictures including one or more slices and a bitstream of the video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies that for a video picture of the one or more video pictures having all slices coded as I slices, P slice and B slice related syntax elements are omitted from a picture header for the video picture.
    Type: Grant
    Filed: June 24, 2022
    Date of Patent: June 18, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Zhipin Deng, Jizheng Xu, Ye-kui Wang
  • Patent number: 12010306
    Abstract: An approach for encoding/decoding video data including obtaining video data; parsing the obtained video data to obtain partitioning parameters; obtaining a partitioned coding block based on the partitioning parameters; and decoding the obtained video data based on the partitioned coding block. The partitioned coding block may be partitioned into a rectangular partition and at least one non-rectangular partition.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: June 11, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Liang Zhao, Shan Liu
  • Patent number: 12010302
    Abstract: Disclosed according to one exemplary embodiment includes not limited to: a filtering unit configured to generate filtering information by filtering a residual image corresponding to a difference between an original image and a prediction image; an inverse filtering unit configured to generate inverse filtering information by inversely filtering the filtering information; an estimator configured to generate the prediction image based on the original image and reconstruction information; a CNN-based in-loop filter configured to receive the inverse filtering information and the prediction image and to output the reconstruction information; and an encoder configured to perform encoding based on the filtering information and information of the prediction image, and wherein the CNN-based in-loop filter is trained for each of the plurality of artefact sections according to an artefact value or for each of the plurality of quantization parameter sections according to a quantization parameter.
    Type: Grant
    Filed: December 26, 2022
    Date of Patent: June 11, 2024
    Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
    Inventor: Mun Churl Kim
  • Patent number: 12010327
    Abstract: Block-based, low latency rate control for an encoding system in which a wavelet transform decomposes pixel blocks into subbands stored as subbands in wavelet blocks (WBs) for encoding. Quantization parameters (QPs) for the subbands in each WB are estimated using a method that minimizes wavelet-inverse distortion given a rate bound. For each subband, a rate curve is generated based on an unquantized DCT histogram and bit count statistics for the subband, and a distortion curve is generated based on the unquantized DCT histogram and a distortion estimate for the subband that is estimated using a masked estimator. Once the rate-distortion curves for the subbands are generated, a bisection search may be used to find a point on each curve where the slope is the same for all the curves. The QPs associated with those equally sloped points are the global minimizing QPs for the wavelet block.
    Type: Grant
    Filed: April 5, 2023
    Date of Patent: June 11, 2024
    Assignee: Apple Inc.
    Inventor: Felix C. Fernandes
  • Patent number: 12003716
    Abstract: The long filter decision in VVC is modified by adding at least one gradient check that at least includes sample p6 or q6. This makes it possible to avoid using the long filters when there is some natural structure at sample p6 or q6. In one specific embodiment at least two gradient checks including both q6 and p6 are added. In another embodiment, the dpq threshold is modified from beta>>2 to beta>>4. This threshold change embodiment may be used in conjunction with or instead of the embodiment in which a gradient check that includes p6 and/or q6 is added to the long filter decision.
    Type: Grant
    Filed: December 15, 2022
    Date of Patent: June 4, 2024
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth Andersson, Jack Enhorn
  • Patent number: 12003772
    Abstract: An image decoding method according to the present invention can comprise the steps of: acquiring residual coefficients of a current block; dequantizing the residual coefficients; performing secondary inverse transformation on the dequantized residual coefficients; and performing primary inverse transformation on the performance result of the secondary inverse transformation. The secondary inverse transformation can be performed for a partial region of the current block.
    Type: Grant
    Filed: October 20, 2022
    Date of Patent: June 4, 2024
    Assignee: KT CORPORATION
    Inventor: Bae Keun Lee
  • Patent number: 11997275
    Abstract: A multimedia system allocates, during encoding of a multimedia stream, bits to portions of frames based on quality metrics and bit usages for different quantization parameters (QPs). An encoder of the multimedia system encodes a frame in a first pass with a first QP and in a second pass with a second QP. A comparator of the multimedia system measures and compares quality metrics, such as mean squared error, for each portion of the frame encoded with the first QP and the second QP. The comparator compares the difference between the quality metrics for each portion encoded with each QP to a threshold. If the difference in quality metrics for a portion exceeds the threshold, the comparator selects the portion for inclusion in a subset of portions to be encoded with the second QP.
    Type: Grant
    Filed: August 27, 2018
    Date of Patent: May 28, 2024
    Assignee: AT Technologies ULC
    Inventors: Boris Ivanovic, Mehdi Saeedi
  • Patent number: 11973941
    Abstract: Provided are a video decoding method and apparatus and a video encoding method and apparatus which determine whether to use a Most Probable Mode (MPM) list, based on encoding information of a current block, obtain, from a bitstream, intra prediction mode index information indicating one of candidate intra prediction modes included in the MPM list, and determine an intra prediction mode of the current block by using the obtained intra prediction mode index information.
    Type: Grant
    Filed: May 27, 2022
    Date of Patent: April 30, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Narae Choi, Minwoo Park, Chanyul Kim, Minsoo Park, Yumi Sohn, Seungsoo Jeong, Kiho Choi, Woongil Choi, Anish Tamse, Yinji Piao
  • Patent number: 11973985
    Abstract: Various schemes pertaining to pre-encoding processing of a video stream with motion compensated temporal filtering (MCTF) are described. An apparatus determines a filtering interval for a received raw video stream having pictures in a temporal sequence. The apparatus selects from the pictures a plurality of target pictures based on the filtering interval, as well as a group of reference pictures for each target picture to perform pixel-based MCTF, which generates a corresponding filtered picture for each target picture. The apparatus subsequently transmits the filtered pictures as well as non-target pictures to an encoder for encoding the video stream. Subpictures of natural images and screen content images are separately processed by the apparatus.
    Type: Grant
    Filed: August 22, 2022
    Date of Patent: April 30, 2024
    Assignee: MediaTek Inc.
    Inventors: Chih-Yao Chiu, Chun-Chia Chen, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang
  • Patent number: 11971546
    Abstract: An image encoder performs a first partitioning including using a first partition mode, without writing first splitting information indicative of the first partition mode into a bitstream, to split a first block into a plurality of second blocks in response to that the first block is located adjacent to an edge of a picture and that the dimensions of the first block satisfy a first condition; and performs a second partitioning on the second block by writing second splitting information indicative of a second partition mode into the bitstream, wherein the second partition mode allows at least one of a quad tree splitting and a binary splitting, and using the second partition mode to split the second block into a plurality of coding units (CUs), wherein the second partition mode prohibits the quad tree splitting of the second block in certain conditions.
    Type: Grant
    Filed: May 30, 2023
    Date of Patent: April 30, 2024
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Ryuichi Kanoh, Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma
  • Patent number: 11968403
    Abstract: Methods, systems and apparatus for video processing are described. One example video processing method includes performing a conversion between a video including a video block and a bitstream of the video according to a rule, wherein the rule specifies whether to include, in a slice header (SH), a first syntax element that indicates whether a transform skip based residual coding is disabled for a slice, and wherein the rule specifies that whether to include the first syntax element in the SH is selectively based on a second syntax element in a sequence parameter set (SPS) that indicates whether a TS mode is enabled for the video block.
    Type: Grant
    Filed: September 12, 2022
    Date of Patent: April 23, 2024
    Assignees: BEIJING BYTEDANCE NETWROK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Ye-Kui Wang, Li Zhang, Kai Zhang
  • Patent number: 11968384
    Abstract: Devices, systems and methods related to digital video coding, and specifically, to signaling of slice types in video picture headers are described. One example method of video processing includes performing a conversion between a video including one or more video pictures including one or more slices and a bitstream of the video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies that for a video picture of the one or more video pictures having all slices coded as I slices, P slice and B slice related syntax elements are omitted from a picture header for the video picture.
    Type: Grant
    Filed: June 24, 2022
    Date of Patent: April 23, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Zhipin Deng, Jizheng Xu, Ye-kui Wang
  • Patent number: 11962796
    Abstract: This disclosure describes gradient-based prediction refinement. A video coder (e.g., video encoder or video decoder) determines one or more prediction blocks for inter-predicting a current block (e.g., based on one or more motion vectors for the current block). In gradient-based prediction refinement, the video coder modifies one or more samples of the prediction block based on various factors such as displacement in a horizontal direction, the horizontal gradient, a displacement in the vertical direction, and a vertical gradient. This disclosure provides for gradient-based prediction refinement where a precision level of the displacement (e.g., at least one of the horizontal or vertical displacement) is unified (e.g., the same) for different prediction modes.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: April 16, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Han Huang, Wei-Jung Chien, Marta Karczewicz
  • Patent number: 11956468
    Abstract: Provided is a video decoding method including: determining a prediction mode of a current block to be one of a skip mode and a merge mode; when a motion vector, which is determined from a merge candidate list of the current block, and a merge motion vector difference are to be used, obtaining merge candidate information indicating one candidate in the merge candidate list by performing entropy encoding on a bitstream by applying one piece of context information; determining a base motion vector from one candidate determined from the merge candidate list, based on the merge candidate information; and determining a motion vector of the current block by using a distance index of a merge motion vector difference of the current block and a direction index of the merge motion vector difference to use the base motion vector and the merge motion vector difference.
    Type: Grant
    Filed: January 12, 2022
    Date of Patent: April 9, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Seungsoo Jeong, Minsoo Park, Minwoo Park, Kiho Choi, Yinji Piao
  • Patent number: 11956466
    Abstract: An encoder includes circuitry and memory connected to the circuitry. In operation, the circuitry: stores MV information and correction processing information into a FIFO buffer for an HMVP mode in association, the MV information being derived for a processed block and correction processing information being related to correction processing of a prediction image of the processed block; registers, in a prediction candidate list for a merge mode, one or more prediction candidates each being a combination of MV information and correction processing information, the prediction candidates including a prediction candidate which is a combination of the motion vector information and the correction processing information stored in the FIFO buffer; and selects a prediction candidate from the prediction candidate list when a current block is to be processed in the merge mode, and performs correction processing of a prediction image of the current block, based on the correction processing information.
    Type: Grant
    Filed: May 23, 2023
    Date of Patent: April 9, 2024
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma
  • Patent number: 11949897
    Abstract: The entropy coding of a current part of a predetermined entropy slice is based on, not only, the respective probability estimations of the predetermined entropy slice as adapted using the previously coded part of the predetermined entropy slice, but also probability estimations as used in the entropy coding of a spatially neighboring, in entropy slice order preceding entropy slice at a neighboring part thereof. Thereby, the probability estimations used in entropy coding are adapted to the actual symbol statistics more closely, thereby lowering the coding efficiency decrease normally caused by lower-delay concepts. Temporal interrelationships are exploited additionally or alternatively.
    Type: Grant
    Filed: January 27, 2023
    Date of Patent: April 2, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Anastasia Henkel, Heiner Kirchhoffer, Detlev Marpe, Thomas Schierl
  • Patent number: 11949904
    Abstract: In the present disclosure, a method of decoding a video signal and a device therefor are disclosed. Specifically, a method of decoding an image based on an inter prediction mode includes deriving a motion vector of an available spatial neighboring block around a current block; deriving a collocated block of the current block based on the motion vector of the spatial neighboring block; deriving a motion vector in a sub-block unit in the current block based on a motion vector of the collocated block; and generating a prediction block of the current block using the motion vector derived in the sub-block unit, wherein the collocated block may be specified by the motion vector of the spatial neighboring block in one pre-defined reference picture.
    Type: Grant
    Filed: March 6, 2023
    Date of Patent: April 2, 2024
    Assignee: LG Electronics Inc.
    Inventors: Hyeongmoon Jang, Junghak Nam, Naeri Park
  • Patent number: 11936885
    Abstract: A method includes: decoding a bitstream and thereby outputting a transform coefficients for each color component of the block, a first flag indicating for each color component whether the block includes a non-zero transform coefficient, and a second flag indicating whether the block has been encoded using a color space transform that transforming a color space of a prediction residual from a color space of the original image to another color space; performing a color space inverse transform for the prediction residual restored from the transform coefficients, when the second flag indicates that the block has been encoded using the color space transform; and determining whether to perform chroma residual scaling for the prediction residual of the chrominance component, based on the first flag of a chrominance component and the second flag, the chroma residual scaling that performs scaling based on a luminance component corresponding to the chrominance component.
    Type: Grant
    Filed: May 1, 2023
    Date of Patent: March 19, 2024
    Assignee: NIPPON HOSO KYOKAI
    Inventors: Shunsuke Iwamura, Shimpei Nemoto, Atsuro Ichigaya
  • Patent number: 11936865
    Abstract: Several techniques for video encoding and video decoding are described. A method for video processing includes performing a conversion between a video block of a video and a bitstream of the video, wherein the video block uses a low frequency non-separable transform for the conversion, wherein the bitstream conforms to a format rule that specifies that a syntax element is included at a syntax level for the bitstream, wherein the syntax element is indicative of whether use of a scaling matrix which is derived from a reference scaling list is enabled for the video block, and wherein the syntax level is a sequence level, a picture level, or a slice level.
    Type: Grant
    Filed: September 1, 2022
    Date of Patent: March 19, 2024
    Assignee: BYTEDANCE INC.
    Inventors: Ye-kui Wang, Kai Zhang, Li Zhang
  • Patent number: 11936863
    Abstract: A method and apparatus for improving the performance of video encoders and decoders involves selecting a set of transforms from among a plurality of sets of transforms that can be used for coding blocks in a region of a video image. Within a region, selection of a particular transform from among a plurality of transforms comprising the selected set of transforms is used to encoder or decode at least one block in the region. Associated indices representing the set of transforms to be used within a region and the selected transform for a block can be sent in a bitstream. In an alternate embodiment, a default set of transforms is complemented by selection of an additional set of transforms on a block or region basis.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: March 19, 2024
    Inventors: Sebastien Lasserre, Saurabh Puri, Patrick Le Callet