Quantization Patents (Class 375/240.03)
  • Patent number: 11664816
    Abstract: Techniques are disclosed relating to compression of pixel data using different quantization for different regions of a block of pixels being compressed. In some embodiments, compression circuitry is configured to determine, for multiple components included in pixels of the block of pixels being compressed, respective smallest and greatest component values in respective regions of the block of pixels. The compression circuitry may determine, based on the determined smallest and greatest component values, to use a first number of bits to represent delta values relative to a base value for a first component in a first region and a second, different number of bits to represent delta values relative to a base value for a second component in the first region. The compression circuitry may then quantize delta values for the first and second components of pixels in the first region of the block of pixels using the determined first and second numbers of bits.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: May 30, 2023
    Assignee: Apple Inc.
    Inventors: Tyson J. Bergland, Karthik Ramani, Stephan Lachowsky, Justin A. Hensley, Davoud A. Jamshidi
  • Patent number: 11665350
    Abstract: A video encoding method, performed by a computer device, includes: obtaining a reference frame corresponding to a current frame from a video input to be encoded; determining a sampling manner corresponding to the current frame; sampling the reference frame based on the sampling manner according to resolution information of the current frame, to obtain a target reference frame corresponding to the reference frame; and encoding the current frame according to the target reference frame.
    Type: Grant
    Filed: August 13, 2020
    Date of Patent: May 30, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LTD
    Inventors: Xinwei Gao, Xu Nan Mao, Chen Chen Gu
  • Patent number: 11659188
    Abstract: A video decoding device and method, including extracting PCM block size information including a threshold, from a bitstream, determining the threshold based on the extracted PCM block size information; parsing a PCM header from the bitstream with respect to an encoded block, only when said encoded block is prediction mode of intra prediction and a block size of said encoded block is equal to or greater than the determined threshold, controlling an entropy decoding process and a PCM decoding process based on the parsed PCM header; parsing transformed data of a prediction error data of an image in the bitstream; and PCM-decoding PCM data of the image in the bitstream, wherein the decoding performs the decoding operation based on the prediction mode being intra prediction and based on the block size of the encoded block being equal to or greater than the determined threshold.
    Type: Grant
    Filed: March 4, 2022
    Date of Patent: May 23, 2023
    Assignee: NEC CORPORATION
    Inventors: Keiichi Chono, Yuzo Senda, Junji Tajime, Hirofumi Aoki, Kenta Senzaki
  • Patent number: 11659182
    Abstract: A method of signaling additional chroma QP offset values that are specific to quantization groups is provided, in which each quantization group explicitly specifies its own set of chroma QP offset values. Alternatively, a table of possible sets of chroma QP offset values is specified in the header area of the picture, and each quantization group uses an index to select an entry from the table for determining its own set of chroma QP offset values. The quantization group specific chroma QP offset values are then used to determine the chroma QP values for blocks within the quantization group in addition to chroma QP offset values already specified for higher levels of the video coding hierarchy.
    Type: Grant
    Filed: April 16, 2021
    Date of Patent: May 23, 2023
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Guy Cote
  • Patent number: 11659183
    Abstract: A system and method for regenerating high dynamic range (HDR) video data from encoded video data, extracts, from the encoded video data, a self-referential metadata structure specifying a video data reshaping transfer function. The video data reshaping transfer function is regenerated using data from the metadata structure and the extracted reshaping transfer function is used to generate the HDR video data by applying decoded video data values to the reshaping transfer function.
    Type: Grant
    Filed: June 14, 2021
    Date of Patent: May 23, 2023
    Assignee: ARRIS Enterprises LLC
    Inventors: David M. Baylon, Zhouye Gu, Ajay Luthra, Koohyar Minoo, Yue Yu
  • Patent number: 11659189
    Abstract: A video decoding device and method, including extracting PCM block size information including a threshold, from a bitstream, determining the threshold based on the extracted PCM block size information; parsing a PCM header from the bitstream with respect to an encoded block, only when said encoded block is prediction mode of intra prediction and a block size of said encoded block is equal to or greater than the determined threshold, controlling an entropy decoding process and a PCM decoding process based on the parsed PCM header; parsing transformed data of a prediction error data of an image in the bitstream; and PCM-decoding PCM data of the image in the bitstream, wherein the decoding performs the decoding operation based on the prediction mode being intra prediction and based on the block size of the encoded block being equal to or greater than the determined threshold.
    Type: Grant
    Filed: March 4, 2022
    Date of Patent: May 23, 2023
    Assignee: NEC CORPORATION
    Inventors: Keiichi Chono, Yuzo Senda, Junji Tajime, Hirofumi Aoki, Kenta Senzaki
  • Patent number: 11659210
    Abstract: Disclosed are a method of encoding a division block in video encoding and a method of decoding a division block in video decoding. An input picture is divided into encoding unit blocks. The encoding unit blocks are divided into sub-blocks. The sub-blocks are encoded by selectively using at least one of intra prediction encoding and inter prediction encoding. A decoding process is performed through a reverse process of the encoding method. When pixel values of an encoding unit block are encoded in video encoding, the flexibility in selecting an encoding mode is increased and the efficiency of encoding is increased.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: May 23, 2023
    Assignees: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY, KOREAN BROADCASTING SYSTEM
    Inventors: Mun Churl Kim, Bum Shik Lee, Jae II Kim, Chang Seob Park, Sang Jin Hahm, In Joon Cho, Keun Sik Lee, Byung Sun Kim
  • Patent number: 11659165
    Abstract: A video signal processing method and device for encoding or decoding a video signal may perform operations of determining whether a coding tree block is divided into a plurality of blocks; determining whether an upper boundary of a current block is adjacent to an upper boundary of the coding tree block, determining a first intra prediction mode for prediction of the current block based on whether the upper boundary of the current block is adjacent to the upper boundary of the coding tree block, reconstructing the current block based on the first intra prediction mode.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: May 23, 2023
    Assignee: HUMAX CO., LTD.
    Inventors: Geonjung Ko, Juhyung Son, Dongcheol Kim, Jaehong Jung, Jinsam Kwak
  • Patent number: 11652984
    Abstract: An example device for coding (encoding or decoding) video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine a first number of neighboring blocks to a current block of the video data that are intra-predicted; determine a second number of the neighboring blocks that are inter-predicted; determine a first weight value to be applied to intra-prediction samples of an intra-prediction block for the current block; determine a second weight value to be applied to inter-prediction samples of an inter-prediction block for the current block; generate a prediction block for the current block as a weighted combination of the intra-prediction block to which the first weight value is applied and the inter-prediction block to which the second weight value is applied; and code the current block using the prediction block.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: May 16, 2023
    Assignee: QUALCOMM INCORPORATED
    Inventors: Geert Van der Auwera, Luong Pham Van, Adarsh Krishnan Ramasubramonian, Marta Karczewicz
  • Patent number: 11653006
    Abstract: Provided is a method of decoding an image, the method including: determining at least one coding unit for splitting an image, based on block shape information of a current coding unit; determining at least one transformation unit, based on a shape of the current coding unit included in the at least one coding unit; and decoding the image by performing inverse transformation based on the at least one transformation unit, wherein the block shape information indicates whether the current coding unit is a square shape or a non-square shape. Also, provided is an encoding method corresponding to the decoding method. In addition, provided is an encoding apparatus or decoding apparatus capable of performing the encoding or decoding method.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: May 16, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jung-hye Min, Min-woo Park, Bo-ra Jin, Chan-yul Kim
  • Patent number: 11647230
    Abstract: A video processing method is provided, including: performing a conversion between a coded representation of a video including one or more video regions and the video, wherein the coded representation includes reshaping model information applicable for in-loop reshaping (ILR) of some of the one or more video regions, wherein the reshaping model information provides information for a reconstruction of a video unit of a video region based on a representation in a first domain and a second domain and/or scaling chroma residue of a chroma video unit, wherein the reshaping model information includes a parameter set that includes a first syntax element that derives a number of bits used to represent a second syntax element specifying an absolute delta codeword value from a corresponding bin, and wherein the first syntax element has a value smaller than a threshold.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: May 9, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11647179
    Abstract: A method and apparatus for encoding/decoding images according to the present invention may configure a prediction mode candidate group on a screen of a target block, determine a reference pixel for a prediction mode on the screen of the target block, perform at least one of filtering and interpolation on the reference pixel, and perform prediction on the screen of the target block on the basis of the prediction mode candidate group on the screen and the reference pixel.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: May 9, 2023
    Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
    Inventor: Ki Baek Kim
  • Patent number: 11647202
    Abstract: An image decoding method performed by a decoding device, according to the present document, comprises the steps of: receiving a bitstream including residual information of a current block; deriving a specific number of context-encoding bins for context syntax elements for a current sub-block of the current block; decoding the context syntax elements for the current sub-block included in the residual information on the basis of the specific number; deriving transform coefficients for the current sub-block on the basis of the decoded context syntax elements; deriving residual samples for the current block on the basis of the transform coefficients; and generating a reconstructed picture on the basis of the residual samples.
    Type: Grant
    Filed: April 28, 2022
    Date of Patent: May 9, 2023
    Assignee: LG Electronics Inc.
    Inventors: Jungah Choi, Jaehyun Lim, Jin Heo, Sunmi Yoo, Ling Li, Jangwon Choi, Seunghwan Kim
  • Patent number: 11647190
    Abstract: An image coding apparatus configured to divide an image into one or more slices each including a plurality of blocks and to code each slice on a block-by-block basis includes a first coding unit configured to code blocks included in a first portion of the slice, and a second coding unit configured to code blocks included in a second portion of the slice, wherein, when the second coding unit codes an initial block in the second portion, the second coding unit codes the initial included in the second portion by referring to a first quantization parameter provided to the slice as an initial value and referred to by the first coding unit when the first coding units codes the initial block in the first portion.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: May 9, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Koji Okawa
  • Patent number: 11647193
    Abstract: In an embodiment, a method involves receiving a pixel array, compressing the pixel array by, for each pixel block of multiple pixel blocks: accessing pixel values associated with pixels in the pixel block, determining a range of the pixel values and an endpoint pixel value in the range, determining quantization levels corresponding to different values within the range of the pixel values, selecting a quantization level from the quantization levels for each of the pixel values in the pixel block, and encoding the pixel values in the pixel block using their respective selected quantization levels and the endpoint pixel value.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: May 9, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventor: Richard Webb
  • Patent number: 11647216
    Abstract: A method and apparatus for video coding comprising computer code configured to cause at least one processor to perform obtaining an input video stream, generating a coded video bitstream based on the input video stream using a neural network, the coded video bitstream including a plurality of supplemental enhancement information (SEI) messages and blocks, determining a plurality of pieces of neural network topology information associated with the neural network, and signaling the determined plurality of pieces of neural network topology information in a plurality of syntax elements associated with the coded video bitstream.
    Type: Grant
    Filed: October 12, 2021
    Date of Patent: May 9, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Zeqiang Li, Wei Wang, Wei Jiang, Stephan Wenger, Shan Liu
  • Patent number: 11641478
    Abstract: A video processing method includes determining, fora conversion between a video block of a video and a coded representation of the video, factors of a scaling tool based on a coding mode of the video block; and performing the conversion using the scaling tool, wherein the use of the scaling tool comprises: scaling at least some coefficients representing the video block during encoding or descaling at least some coefficients from the coded representation during decoding.
    Type: Grant
    Filed: February 18, 2022
    Date of Patent: May 2, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11641488
    Abstract: Systems, methods and instrumentalities are disclosed for adaptively selecting an adaptive loop filter (ALF) procedure for a frame based on which temporal layer the frame is in. ALF procedures may vary in computational complexity. One or more frames including the current frame may be in a temporal layer of a coding scheme. The decoder may determine the current frame's temporal layer level within the coding scheme. The decoder may select an ALF procedure based on the current frame's temporal layer level. If the current frame's temporal layer level is higher within the coding scheme than some other temporal layer levels, an ALF procedure that is less computationally complex may be selected for the current frame. Then the decoder may perform the selected ALF procedure on the current frame.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: May 2, 2023
    Assignee: VID SCALE, Inc.
    Inventors: Rahul Vanam, Yuwen He, Yan Ye
  • Patent number: 11632569
    Abstract: Innovations in adaptive encoding for units of a video sequence can improve coding efficiency. For example, some of the innovations relate to encoding that includes adaptive switching of color spaces between units within a video sequence. Other innovations relate encoding that includes adaptive switching of color sampling rates between units within a video sequence. Still other innovations relate encoding that includes adaptive switching of bit depths between units within a video sequence.
    Type: Grant
    Filed: October 1, 2021
    Date of Patent: April 18, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Bin Li, Jizheng Xu, Feng Wu
  • Patent number: 11622120
    Abstract: An example method of video processing includes performing a conversion between a video comprising one or more coding units and a bitstream representation of the video. The bitstream representation conforms to a format rule that specifies that chroma quantization parameters are included in the bitstream representation at a coding unit level or a transform unit level according to the format rule.
    Type: Grant
    Filed: April 14, 2022
    Date of Patent: April 4, 2023
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Kai Zhang
  • Patent number: 11616985
    Abstract: The present disclosure provides a method of reconstructing a video signal based on a reduced secondary transform, which includes: obtaining a secondary transform index from the video signal; deriving a secondary transform corresponding to the secondary transform index, wherein the secondary transform represents a reduced secondary transform, and the reduced secondary transform represents a transform outputting L (L<N) transform coefficient data (L×1 transform coefficient vectors) based on inputted N residual data (N×1 residual vectors); obtaining a transform coefficient block by performing an entropy decoding and a dequantization for a current block (N×N); performing an inverse secondary transform for the transform coefficient block using the reduced secondary transform; performing an inverse primary transform for a block which the inverse secondary transform is applied to; and reconstructing the current block using a block which the inverse primary transform is applied to.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: March 28, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Moonmo Koo, Mehdi Salehifar, Seunghwan Kim, Jaehyun Lim
  • Patent number: 11616958
    Abstract: A method for decoding a data stream representative of an image split into blocks. The method includes: for a current block, determining whether the size of the current block is less than or equal to a threshold, and if so, decoding information indicating a coding mode of the block among first and second coding modes, and reconstructing the current block according to the indicated coding mode, and otherwise reconstructing according to the first coding mode. According to the first coding mode, the current block is reconstructed using an inverse transform of a transformed prediction residue decoded for the current block, and according to the second coding mode the current block is reconstructed, for each pixel, by obtaining a prediction of the pixel from another previously decoded pixel belonging to the current block or to a previously decoded block, and reconstructing the pixel from the prediction and a decoded prediction residue.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: March 28, 2023
    Assignee: ORANGE
    Inventors: Félix Henry, Mohsen Abdoli, Pierrick Philippe, Gordon Clare
  • Patent number: 11616983
    Abstract: A Method of decoding an encoded video bitstream using at least one processor includes: obtaining an encoded video bitstream, the encoded video bitstream including encoded color components; entropy parsing the encoded color components; dequantizing the color components and obtaining transform coefficients of the color components; applying a joint components secondary transform (JCST) on the transform coefficients of the color components, thereby generating JCST outputs; performing a backward transform on the JCST outputs, thereby obtaining residual components of the color components; and decoding the encoded video bitstream based on the residual components of the color components.
    Type: Grant
    Filed: October 16, 2020
    Date of Patent: March 28, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Sehoon Yea, Shan Liu
  • Patent number: 11616997
    Abstract: A method, system, and computer program product for trick play using partial video file chunks includes a processor to retrieve the selected video file from an HLS server, the video file having a plurality of video chunks, and each one of the video chunks beginning with an I-frame. The processor may determine an average size of the plurality of I-frames. The average I-frame size may be based on a bitrate speed of the video file. The processor may retrieve a portion equal to the average I-frame size of from the beginning of each one of the plurality of chunks of the video. The processor may receive a begin trick play request of the selected video and initiate trick play of the selected video. The trick play of the video includes displaying each portion of each one of the plurality of chunks of the video.
    Type: Grant
    Filed: December 9, 2020
    Date of Patent: March 28, 2023
    Assignee: ARRIS Enterprises LLC
    Inventors: Kaliraj Kalaichelvan, William P. Franks, Mark Schmidt, Beena Devadathan, Rajesh Kechal Rao
  • Patent number: 11606560
    Abstract: Lossy or lossless compression and transmission, comprising the steps of: (i) receiving an input image; (ii) encoding it to produce a y latent representation; (iii) encoding the y latent representation to produce a z hyperlatent representation; (iv) quantizing the z hyperlatent representation to produce a quantized z hyperlatent representation; (v) entropy encoding the quantized z hyperlatent representation into a first bitstream, (vi) processing the quantized z hyperlatent representation to obtain a location entropy parameter ?y, an entropy scale parameter ?y, and a context matrix Ay of the y latent representation; (vii) processing the y latent representation, the location entropy parameter ?y and the context matrix Ay, to obtain quantized latent residuals; (viii) entropy encoding the quantized latent residuals into a second bitstream; and (ix) transmitting the bitstreams.
    Type: Grant
    Filed: May 19, 2022
    Date of Patent: March 14, 2023
    Assignee: DEEP RENDER LTD.
    Inventors: Chri Besenbruch, Aleksandar Cherganski, Christopher Finlay, Alexander Lytchier, Jonathan Rayner, Tom Ryder, Jan Xu, Arsalan Zafar
  • Patent number: 11606572
    Abstract: A video processing method includes determining, fora conversion between a video block of a video and a coded representation of the video, factors of a scaling tool based on a coding mode of the video block; and performing the conversion using the scaling tool, wherein the use of the scaling tool comprises: scaling at least some coefficients representing the video block during encoding or descaling at least some coefficients from the coded representation during decoding.
    Type: Grant
    Filed: February 18, 2022
    Date of Patent: March 14, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11606554
    Abstract: A video encoder is configured to encode, by block based predictive encoding, pictures of a video into coding data, wherein the block based predictive encoding includes an intra-picture prediction. The video encoder is configured to use, for the intra-picture prediction, for encoding a prediction block of a picture, a plurality of nearest reference samples of the picture directly neighboring the prediction block and a plurality of extended reference samples, each extended reference sample of the plurality of extended reference samples separated from the prediction block at least by one nearest reference sample of the plurality of reference samples. The video encoder is further configured to sequentially determine an availability or unavailability of each of the plurality of nearest reference samples and to substitute a nearest reference sample being determined as unavailable by a substitution sample. The video encoder is configured to use the substitution sample for the intra-picture prediction.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: March 14, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Benjamin Bross, Philipp Merkle, Simone Walter, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Paul Keydel
  • Patent number: 11599975
    Abstract: An apparatus and method for geometrically correcting a distorted input frame and generating an undistorted output frame. The apparatus includes an external memory block that stores the input frame, a counter block to compute output coordinates of the output frame for a region based on a block size of the region, a back mapping block to generate input coordinates corresponding to each of the output coordinates, a bounding module to compute input blocks corresponding to each of the input coordinates, a buffer module to fetch data corresponding to each of the input blocks, an interpolation module to interpolate data from the buffer module and a display module that receives the interpolated data for each of the regions and stitch an output image. The method includes determining the size of the output block based on a magnification data.
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: March 7, 2023
    Assignee: Texas Instruments Incorporated
    Inventors: Rajasekhar Reddy Allu, Niraj Nandan, Mihir Narendra Mody, Gang Hua, Brian Okchon Chae, Shashank Dabral, Hetul Sanghvi, Vikram VijayanBabu Appia, Sujith Shivalingappa
  • Patent number: 11601663
    Abstract: A video decoding method includes determining a usage of an SVT-vertical (V) or an SVT-horizontal (H) for a residual block; determining a transform block position of a transform block of the residual block; determining a transform type of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein at least one of the horizontal transform or the vertical transform is a discrete sine transform (DST)-7; and reconstructing the residual block based on the transform type, the transform block position, and transform coefficients of the transform block.
    Type: Grant
    Filed: December 23, 2021
    Date of Patent: March 7, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Yin Zhao, Haitao Yang, Jianle Chen
  • Patent number: 11595688
    Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding are provided. In a method, prediction information of a current block of a coding unit tree is generated. The prediction information indicates at least one block partitioning structure is allowed for the current block and a SBT mode is used for the current block. A partition direction and a partition size of the SBT mode for the current block is determined based on the at least one allowed block partitioning structure indicated in the prediction information and based on a comparison between at least one dimension of the current block and a first threshold. A partition of the current block based on the partition direction and the partition size of the SBT mode is different from at least one partition of the current block based on the at least one allowed block partitioning structure indicated in the prediction information.
    Type: Grant
    Filed: April 8, 2022
    Date of Patent: February 28, 2023
    Assignee: Tencent America LLC
    Inventors: Xiang Li, Xin Zhao, Liang Zhao, Shan Liu
  • Patent number: 11595650
    Abstract: Systems, apparatuses, and methods may provide for multi-session encoding to optimize multiple encoding sessions on Wi-Fi display (WFD) source devices when the WFD source devices are connected to multiple sink devices. The multiple encoding sessions may be optimized with encoding hints that are generated by a compositor and transmitted to a pre-encoding checking device. The encoding session that has the highest encoding resolution is subjected to hierarchical motion estimation (HME) processing, and the encoding sessions that have lower resolutions are optimized based on a motion vector prediction hint generated by the encoding session that has the highest encoding resolution and a scaling factor.
    Type: Grant
    Filed: March 31, 2017
    Date of Patent: February 28, 2023
    Assignee: Intel Corporation
    Inventors: Ning Luo, Changliang Wang, Ujwal Paidipathi, Karthik Veeramani, Rajneesh Chowdhury
  • Patent number: 11589045
    Abstract: The present invention relates to a block partitioning structure from among the video coding schemes and to a method and apparatus for encoding and decoding the block partitioning structure, the method comprising the steps of: acquiring block partitioning data; partitioning a block by means of the acquired block partitioning data; and encoding and decoding by means of the partitioned block. The encoding and decoding method and apparatus according to the present invention has the benefit of improving encoding efficiency with respect to the existing video compression schemes.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: February 21, 2023
    Assignee: INTELLECTUAL DISCOVERY CO., LTD.
    Inventors: Ho Chan Ryu, Yong Jo Ahn
  • Patent number: 11589057
    Abstract: An image decoding method according to the present document can comprise the steps of: on the basis of first flag information indicating whether or not matrix-based intra prediction (MIP) can be applied to a current block, receiving second flag information indicating whether or not the MIP is used for the current block; receiving matrix-based intra prediction (MIP) mode information on the basis of the second flag information; generating intra prediction samples for the current block on the basis of the MIP mode information; and generating reconstructed samples for the current block on the basis of the intra prediction samples.
    Type: Grant
    Filed: November 16, 2021
    Date of Patent: February 21, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Mehdi Salehifar, Seunghwan Kim
  • Patent number: 11582470
    Abstract: A method of multi-scale neural image compression with intra-prediction residuals is performed by at least one processor and includes downsampling an input image, generating a current predicted image, based on a previously-recovered predicted image, and generating a prediction residual based on a difference between the downsampled input image and the generated current predicted image. The method further includes encoding the generated prediction residual, decoding the encoded prediction residual, and generating a currently-recovered predicted image based on an addition of the current predicted image and the decoded prediction residual. The method further includes upsampling the currently-recovered predicted image, generating a scale residual based on a difference between the input image and the upsampled currently-recovered predicted image, and encoding the scale residual.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: February 14, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Wei Jiang, Wei Wang, Ding Ding, Shan Liu
  • Patent number: 11582454
    Abstract: A method and apparatus for video coding utilizing a current block, a maximum side of the transform block of the current block corresponds to 64. A scaling matrix is derived from elements of an 8×8 base scaling matrix, where the elements in a bottom-right 4×4 region of the 8×8 base scaling matrix are skipped, either not signaled or set to zero. According to another method, a current block belongs to a current picture in a first color format that has only a first color component. A first scaling matrix is signaled at the video encoder side or parsed at the video decoder side for the first color component of the current block. Signaling any second scaling matrix is disabled at the video encoder side or parsing any second scaling matrix is disabled at the video decoder side for a second or third color component of the current block.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: February 14, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Chen-Yen Lai, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Yu-Wen Huang, Olena Chubach
  • Patent number: 11575899
    Abstract: A method for transforming high dynamic range (HDR) video data into standard dynamic range (SDR) video data and encoding the SDR video data so that the HDR video data may be recovered at the decoder includes generating a tone map describing a transformation applied to the HDR video data to generate the SDR video data. The generated tone map describes the transformation as the multiplication of each HDR pixel in the HDR video data by a scalar to generate the SDR video data. The tone map is then modeled as a reshaping transfer function and the HDR video data is processed by the reshaping transfer function to generate the SDR video data. The reshaping transfer function is then inverted and described in a self-referential metadata structure. The SDR video data is then encoded including the metadata structure defining the inverse reshaping transfer function.
    Type: Grant
    Filed: February 8, 2022
    Date of Patent: February 7, 2023
    Assignee: ARRIS Enterprises LLC
    Inventors: Koohyar Minoo, Zhouye Gu, David M. Baylon, Ajay Luthra, Yue Yu
  • Patent number: 11575895
    Abstract: In a method of video decoding at a video decoder, a first high level syntax (HLS) element and a second HLS element can be received. The first HLS element can indicate whether an explicit multiple transform selection (MTS) is enabled or disabled for an intra coded block. The second HLS element can indicate whether the explicit MTS is enabled or disabled for an inter coded block. The first and second HLS elements can control a same set of coding blocks that include the intra coded block and the inter coded block. An implicit MTS can be enabled for the intra coded block when the first HLS element indicates the explicit MTS is disabled for the intra coded block, and the second HLS element indicates the explicit MTS is enabled for the inter coded block.
    Type: Grant
    Filed: September 1, 2021
    Date of Patent: February 7, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Shan Liu, Xin Zhao, Xiang Li
  • Patent number: 11575907
    Abstract: In the present invention, a method for processing an image on the basis of an intra prediction mode and an apparatus therefor are disclosed. Particularly, the method for processing an image on the basis of an intra prediction mode may comprise the steps of: partitioning a block to be processed, on the basis of an intra prediction mode of the block to be processed; and performing intra prediction for the split block to be processed, wherein the direction in which the block to be processed is split is perpendicular to the prediction direction of the intra prediction mode of the block to be processed.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: February 7, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Jin Heo, Yongjoon Jeon, Sunmi Yoo, Eunyong Son, Junghak Nam
  • Patent number: 11575885
    Abstract: The present invention relates to an image encoding method and an image decoding method. The image decoding method includes partitioning a picture into a plurality of coding units, constructing a coding unit group including at least one coding unit of the plurality of coding units, obtaining coding information in units of one coding unit group, and decoding at least one coding unit of the plurality of coding units included in the coding unit group by using the obtained coding information.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: February 7, 2023
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jung Won Kang, Sung Chang Lim, Hyun Suk Ko, Ha Hyun Lee, Jin Ho Lee, Dong San Jun, Seung Hyun Cho, Hui Yong Kim, Jin Soo Choi
  • Patent number: 11570476
    Abstract: A video decoding method according to the present document comprises a step of deriving a modified transform coefficient, and the step of deriving the transform coefficient may comprise the steps of: determining whether an LFNST can be applied to the height and width of a current block on the basis of the tree type and color format of the current block; parsing an LFNST index if the LFNST can be applied; and deriving the modified transform coefficient on the basis of the LFNST index and an LFNST matrix.
    Type: Grant
    Filed: March 21, 2022
    Date of Patent: January 31, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Moonmo Koo, Seunghwan Kim, Jaehyun Lim
  • Patent number: 11570439
    Abstract: An inverse quantization method is implemented by an inverse quantization device, the method configured for acquiring quantized coefficients, estimating a quantization parameter in quantization groups or quantization parameter prediction group units, generating an inverse quantization matrix for adaptive quantization, and generating transform coefficients from the quantized coefficients using the quantization parameter and the inverse quantization matrix.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: January 31, 2023
    Assignees: Hyundai Motor Company, Kia Motors Corporation, Kwangwoon University Industry-Academic Collaboration Foundation
    Inventors: Dong Gyu Sim, Sea Nae Park, Jong Seok Lee, Seung Wook Park, Wha Pyeong Lim
  • Patent number: 11570440
    Abstract: An image decoding method is disclosed in the present specification. A method of decoding an image, the method may comprises determining whether to perform a context update for a first syntax element of a current block, updating, on the basis of the determination, a context for entropy decoding of the first syntax element and generating, on the basis of the updated context, a bin for the first syntax element, and wherein whether to perform the context update is determined on the basis of the number of pre-decoded predetermined syntax elements for the current block.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: January 31, 2023
    Assignees: Electronics and Telecommunications Research Institute, CHIPS & MEDIA, INC
    Inventors: Sung Chang Lim, Jung Won Kang, Ha Hyun Lee, Jin Ho Lee, Hui Yong Kim, Dae Yeon Kim, Wook Je Jeong, Hyun Gyu Kim
  • Patent number: 11570479
    Abstract: A camera module includes a compressor configured to divide a plurality of pixels included in image data, into a plurality of pixel groups, with respect to each of the plurality of pixel groups into which the plurality of pixels is divided, calculate a representative pixel value of a corresponding pixel group, based on pixel values of multiple pixels included in the corresponding pixel group, generate first compressed data, based on the calculated representative pixel value of each of the plurality of pixel groups, with respect to each of the plurality of pixel groups into which the plurality of pixels is divided, calculate residual values representing differences between the pixel values of the multiple pixels included in the corresponding pixel group and the representative pixel value of the corresponding pixel group, and generate second compressed data, based on the calculated residual values of each of the plurality of pixel groups.
    Type: Grant
    Filed: April 21, 2021
    Date of Patent: January 31, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Wonseok Lee, Seongwook Song, Yunseok Choi
  • Patent number: 11563938
    Abstract: An example device for filtering a decoded block of video data includes one or more processors implemented in circuitry and configured to decode a current block of a current picture of the video data, select a filter (such as an adaptive loop filter) to be used to filter pixels of the current block, calculate a gradient of at least one pixel for the current block, select a geometric transform to be performed on one of a filter support region or coefficients of the selected filter, wherein the one or more processors are configured to select the geometric transform that corresponds to an orientation of the gradient of the at least one pixel, perform the geometric transform on either the filter support region or the coefficients of the selected filter, and filter the at least one pixel of the current block using the selected filter after performing the geometric transform.
    Type: Grant
    Filed: February 14, 2017
    Date of Patent: January 24, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Wei-Jung Chien, Li Zhang
  • Patent number: 11563945
    Abstract: A technique for determining an adaptive quantization parameter offset for a block of encoded video includes obtaining a rate control factor for the quantization parameter, determining a content-based quantization parameter factor for the quantization parameter, determining an adaptive variance based quantization offset based on content-based quantization parameter factors for a frame prior to the current frame, and combining the rate control factor, the content-based quantization parameter factor, and the adaptive offset to generate the quantization parameter.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: January 24, 2023
    Assignees: Advanced Micro Devices, Inc., ATI Technologies ULC
    Inventors: Jiao Wang, Ying Zhang, Richard George, Edward A. Harold, Zhenhua Yang
  • Patent number: 11558615
    Abstract: Apparatus and methods for encoding and decoding video data having improved quantization parameter prediction are presented and can include using a combination of quantization parameter prediction values obtained from respective ones of a plurality of quantization parameter prediction methods to encode or decode the video data.
    Type: Grant
    Filed: April 9, 2019
    Date of Patent: January 17, 2023
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Edouard Francois, Fabrice Le Leannec, Fabien Racape
  • Patent number: 11553181
    Abstract: A three-dimensional data encoding method includes: quantizing geometry information of each of three-dimensional points, using a first quantization parameter; quantizing a first luminance using a second quantization parameter and quantizing a first chrominance using a third quantization parameter, the first luminance and the first chrominance indicating a first color among attribute information of each of the three dimensional points; and generating a bitstream including the geometry information quantized, the first luminance quantized, the first chrominance quantized, the first quantization parameter, the second quantization parameter, and a first difference between the second quantization parameter and the third quantization parameter.
    Type: Grant
    Filed: January 15, 2021
    Date of Patent: January 10, 2023
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Chung Dean Han, Pongsak Lasang, Chi Wang, Noritaka Iguchi, Toshiyasu Sugio
  • Patent number: 11553131
    Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: January 10, 2023
    Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
    Inventor: Ki Baek Kim
  • Patent number: 11553190
    Abstract: An extension to the motion-constrained tile sets SEI message provides functionality to signal all tiles are independently decodable and to signal the ROIs that may have more than one tile per ROI. With this extension, the functionality to redefine any independently decodable region-of-interest in a CVS at a coding tree unit level based on user interactivity is enabled. The extension supports the interactivity utilized in various applications such as interactive Ultra High Definition Television (UHDTV), dynamic high-quality zoom-in application, interactive on-demand, e-learning, smart surveillance and many other applications. Additionally, the temporal MCTS SEI message is able to be used by an encoder for tiled streaming to signal explicitly to the decoder that the decoder need only to display the ROI.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: January 10, 2023
    Assignee: SONY CORPORATION
    Inventors: Cheung Auyeung, Jun Xu, Ali J Tabatabai
  • Patent number: 11553130
    Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: January 10, 2023
    Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
    Inventor: Ki Baek Kim