Transform Patents (Class 375/240.18)
  • Patent number: 11563978
    Abstract: A method of video encoding includes determining an offset value based on an output of a monotonically non-decreasing function performed on a sum of a group of partially reconstructed transform coefficients. The method further includes determining a context model index based on a sum of the determined offset value and a base value. The method further includes selecting, for at least one syntax of a current transform coefficient of a transform block in a current picture, a context model from a plurality of context models based on the determined context model index. The method further includes generating a coded video bitstream including the current picture and the at least one syntax element that corresponds to transform coefficients of the transform block in the current picture.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: January 24, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Cheung Auyeung, Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11563982
    Abstract: A video processing method is provided to comprise: performing a conversion between a current video block of a video and a coded representation of the current video block, wherein the coded representation conforms to a format rule specifying that a syntax element corresponding to side information of a secondary transform tool for the current video block is signaled in the coded representation before transform related information, wherein the secondary transform tool includes applying, during encoding, a forward secondary transform to an output of a forward primary transform applied to a residual of a video block prior to quantization, or applying, during decoding, an inverse secondary transform to an output of dequantization of the video block before applying an inverse primary transform.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: January 24, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11563939
    Abstract: The present application relates to the field of picture processing, for example still picture/image and/or video picture/image coding. In particular, the application relates to a device and corresponding method for intra-predicting a prediction block of a video image. The device is configured to select a directional intra-prediction mode from a set of directional intra-prediction modes, where each directional intra-prediction mode corresponds to a different intra-prediction angle. Further, the device is configured to select a filter from a set of filters based on the selected directional intra-prediction mode. Further, the device is configured to determine, for a given prediction sample of the prediction block, a reference sample from a set of reference samples based on the selected directional intra-prediction mode, and apply the selected filter to the determined reference sample.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: January 24, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Alexey Konstantinovich Filippov, Vasily Alexeevich Rufitskiy
  • Patent number: 11553186
    Abstract: The in-loop filtering method performed by a video decoding apparatus includes: classifying reconstructed samples according to an absolute classification standard or relative classification standard; acquiring offset data on the basis of results of classifying the reconstructed samples; adding an offset value to the reconstructed samples by referencing the acquired offset data; and outputting the offset value-added reconstructed samples. Accordingly, errors in the reconstructed image can be corrected.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: January 10, 2023
    Assignee: Industry-University Cooperation Foundation Hanyang University
    Inventors: Ki Baek Kim, Je Chang Jeong
  • Patent number: 11544301
    Abstract: The disclosure provides an identification method with multi-type input, which is suitable for multiple type input devices. The identification method includes: capturing a corresponding original data through the input devices, and converting the original data into a plurality of structure units correspondingly. Performing a text integration step, deconstructing a text reference element corresponding to the attributes of the structural units based on the structural units and associated elements thereof, and performing a weight evaluation and reconstruction to generate a candidate content according to the text reference element. Making a decision based on the candidate content, outputting the candidate text as a recommended content when the candidate content includes a unique candidate text, and transmitting it to a corresponding output device. An electronic device using the identification method is also provided.
    Type: Grant
    Filed: July 13, 2021
    Date of Patent: January 3, 2023
    Assignee: ASUSTEK COMPUTER INC.
    Inventors: Hao-Yu Hung, Chi-Lin Cheng, Yi-Chi Lai, Tsung-Lun Wu, Ying-Ru Chen, Shih-Xian Yeh
  • Patent number: 11546594
    Abstract: A decoding device includes circuitry configured to decode a bit stream and generate a quantized value and inversely quantize the generated quantized value by using a flat scaling list, in a case where a block size of a transform block to which a transform skip is applied is larger than a 4 by 4 block size.
    Type: Grant
    Filed: April 29, 2021
    Date of Patent: January 3, 2023
    Assignee: SONY CORPORATION
    Inventor: Kazushi Sato
  • Patent number: 11539952
    Abstract: An example method includes inferring, for a current transform block of a current video block, a transform type from a plurality of transform types that includes one or more discrete cosine transforms (DCTs) and one or more discrete sine transforms (DSTs), wherein inferring the transform type comprises: determining a size of the current transform block; determining whether the current video block is partitioned using intra-subblock partitioning (ISP); and responsive to determining that the size of the current transform block is less than a threshold and that the current video block is partitioned using ISP, selecting a particular DST of the one or more DSTs as the selected transform type; transforming, using the selected transform type, the current transform block to obtain a block of reconstructed residual data for the video block; and reconstructing, based on the reconstructed residual data for the video block, the video block.
    Type: Grant
    Filed: March 11, 2020
    Date of Patent: December 27, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Hilmi Enes Egilmez, Amir Said, Vadim Seregin, Marta Karczewicz
  • Patent number: 11523136
    Abstract: Video processing methods and apparatuses in a video encoding or decoding system for processing residual data of transform blocks. A current transform block in a video picture is divided into multiple sub-blocks, and each sub-block in the current transform block is entropy encoded or decoded using multiple sub-block coding passes. Each transform coefficient level in each sub-block is visited once according to a pre-defined scanning order in each sub-block coding pass. Two or more syntax elements associated with transform coefficient levels in the current transform block are aggregated and coded in one single sub-block coding pass. The video processing method is applied if the current transform block contains at least one non-zero transform coefficient level and the current transform block is coded in Transform Skip Mode (TSM) according to some embodiments.
    Type: Grant
    Filed: December 26, 2019
    Date of Patent: December 6, 2022
    Assignee: HFI INNOVATION INC.
    Inventor: Shih-Ta Hsiang
  • Patent number: 11523128
    Abstract: A video decoding method performed by a decoding device according to the present document comprises the steps of: entropy decoding residual information for a current block to derive residual coefficients for the current block; rearranging the residual coefficients; deriving residual samples of the current block on the basis of the rearranged residual coefficients; and restoring a current picture on the basis of the residual samples.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: December 6, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Sunmi Yoo, Jin Heo, Junghak Nam, Ling Li, Jangwon Choi, Jungah Choi, Seunghwan Kim
  • Patent number: 11523124
    Abstract: Techniques for coding and deriving (e.g., determining) one or more coded-block-flags associated with video content are described herein. A coded-block-flag of a last node may be determined when coded-block-flags of preceding nodes are determined to be a particular value and when a predetermined condition is satisfied. In some instances, the predetermined condition may be satisfied when log2(size of current transform unit) is less than log2(size of maximum transform unit) or log2(size of current coding unit) is less than or equal to log2(size of maximum transform unit)+1. The preceding nodes may be nodes that precede the last node on a particular level in a residual tree.
    Type: Grant
    Filed: September 2, 2021
    Date of Patent: December 6, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Bin Li, Jizheng Xu
  • Patent number: 11515961
    Abstract: When encoding a block of data elements in an array of data elements, the data values for data elements in the block are represented and stored in a data packet as truncated data values using a subset of one or more most significant bits of the respective bit sequences for the data values of the data elements. A rounding mode is selected from a plurality of available rounding modes that can be applied when decoding the block of data elements and an indication of the selected rounding mode is provided along with the encoded data packet. The rounding mode is associated with one or more rounding bit sequence(s) that can then be applied to the truncated data values when decoding the data packet to obtain decoded data values for the data elements in the block.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: November 29, 2022
    Assignee: Arm Limited
    Inventors: Sven Ola Johannes Hugosson, Jakob Axel Fries, Hakan Lars-Goran Persson, Muhammad Ali Shami
  • Patent number: 11490088
    Abstract: A method for decoding an image by a decoding device according to the present disclosure comprises the steps of: receiving a bit stream including residual information; deriving a quantized conversion factor of a current block on the basis of the residual information included in the bit stream; deriving a residual sample of the current block on the basis of the quantized conversion factor; and generating a reconstructed picture on the basis of the residual sample of the current block.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: November 1, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Jungah Choi, Seunghwan Kim, Sunmi Yoo, Jangwon Choi, Jin Heo
  • Patent number: 11490089
    Abstract: Devices, systems and methods for transform design for large blocks in video coding are described. An exemplary method for video processing includes determining that a size of a residual block of a video is larger than a maximum block size allowed for a transform skip mode, in which, during a decoding operation, residual coefficients are decoded without performing an inverse transform operation; splitting, based on the size of a residual block, the residual block into multiple regions, wherein each region represents a portion of the residual block of a difference between a portion of a current video block and a prediction block corresponding to the portion of the current video block; and determining a reconstructed current video block from the residual block based on selectively performing the inverse transform operation according to an indicator that indicates the transform skip mode.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: November 1, 2022
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu
  • Patent number: 11483562
    Abstract: Methods and apparatuses for video coding and decoding are provided. The method of video encoding includes accessing (1410) a bin of a syntax element associated with a block in a picture of a video, determining (1420) a context for the bin of the syntax element from a set of contexts associated with a block type of the block, the set of contexts including at least a first context and a second context, the second context being associated with a larger number of block types than the first context and entropy encoding (1430) the bin of the syntax element based on the determined context. A bitstream formatted to include encoded data, a computer-readable storage medium and a computer-readable program product are also described.
    Type: Grant
    Filed: December 12, 2018
    Date of Patent: October 25, 2022
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Fabrice Leleannec, Tangi Poirier, Ya Chen, Edouard Francois
  • Patent number: 11483561
    Abstract: The present disclosure provide a transform method in picture block encoding, an inverse transform method in picture block decoding, and an apparatus. The inverse transform method includes: determining, in a target transform set, a corresponding transform pair of each region of at least two regions that constitute a to-be-decoded current block; inverse transforming each region based on the corresponding transform pair of each region to obtain an inverse transform result of each region; and obtaining an inverse transform result of the current block based on the inverse transform result of each region and a position of each region in the current block, where the at least two regions do not overlap each other, the target transform set includes a correspondence between a transform pair and a position of a region in the current block, and the transform pair includes a horizontal transform core and a vertical transform core.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: October 25, 2022
    Assignees: Huawei Technologies Co., Ltd., TSINGHUA UNIVERSITY
    Inventors: Liqiang Wang, Jianhua Zheng, Quanhe Yu, Yongbing Lin, Yun He
  • Patent number: 11475281
    Abstract: An electronic apparatus is provided. The electronic apparatus includes a storage storing a matrix included in an artificial intelligence model, and a processor. The processor divides data included in at least a portion of the matrix by one of rows and columns of the matrix to form groups, clusters the groups into clusters based on data included in each of the groups, and quantizes data divided by the other one of rows and columns of the matrix among data included in each of the clusters.
    Type: Grant
    Filed: August 29, 2019
    Date of Patent: October 18, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Parichay Kapoor, Saehyung Lee, Dongsoo Lee, Byeoungwook Kim
  • Patent number: 11470324
    Abstract: An image decoding method, according to the present document, may comprise the steps of: deriving transform coefficients for a current block on the basis of residual information; determining whether a significant coefficient is present in a second region excluding a first region in the top-left end of the current block; parsing a LFNST index from a bitstream if the significant coefficient is not present in the second region; deriving modified transform coefficients by applying a LFNST matrix, derived on the basis of the LFNST index, to transform coefficients of the first region; and deriving residual samples of the current block on the basis of an inverse primary transform of the modified transform coefficients.
    Type: Grant
    Filed: November 24, 2021
    Date of Patent: October 11, 2022
    Assignee: LG Electronics Inc.
    Inventors: Moonmo Koo, Jaehyun Lim, Junghak Nam, Seunghwan Kim
  • Patent number: 11470329
    Abstract: A method of video decoding performed in a video decoder is provided. In the method, a bit stream including coded bits of bins of syntax elements is received. The syntax elements correspond to residues of a region of a transform skipped block in a coded picture. Context modeling is performed to determine a context model for each of a number of the bins of syntax elements of the region. The number of the bins of syntax elements that are context coded does not exceed a maximum number of context coded bins set for the region. The coded bits of the number of the bins of syntax elements are decoded based on the determined context models.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: October 11, 2022
    Assignee: Tencent America LLC
    Inventors: Meng Xu, Xiang Li, Xiaozhong Xu, Shan Liu
  • Patent number: 11470319
    Abstract: An image decoding method according to the present document comprises the steps of: receiving a bitstream including residual information; deriving a quantized transform coefficient for a current block on the basis of the residual information included in the bitstream; deriving a residual sample for the current block on the basis of the quantized transform coefficient; and generating a reconstructed picture on the basis of the residual sample for the current block, wherein the residual information may be derived via different syntax elements depending on whether a transform has been applied to the current block.
    Type: Grant
    Filed: October 4, 2019
    Date of Patent: October 11, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Sunmi Yoo, Jungah Choi, Seunghwan Kim, Jangwon Choi, Jin Heo
  • Patent number: 11470321
    Abstract: An encoder may determine a plurality of coding units associated with a frame of a media file and a plurality of prediction units associated with the frame of the media file. The encoder may determine, based on the plurality of coding units associated with the frame and the plurality of prediction units associated with the frame, and based on a training of the encoder using one or more neural networks, that a particular region of the frame can be encoded using one or more encoding characteristics that are different than the encoding characteristics of one or more other particular regions of the frame. The encoder may allocate one or more encoding resources to the particular region of the frame based on the one or more encoding characteristics of the particular region of the frame in order to reduce the overall media bitrate.
    Type: Grant
    Filed: February 18, 2021
    Date of Patent: October 11, 2022
    Assignee: Comcast Cable Communications, LLC
    Inventors: Dan Grois, Alexander Giladi
  • Patent number: 11463730
    Abstract: A method and apparatus for decoding a video sequence using a discrete sine transform (DST) type-VII transform core includes generating a set of tuples of transform core elements associated with an n-point DST-VII transform core. A first sum of a first subset of transform core elements of a first tuple is equal to a second sum of a second subset of remaining transform core elements of the first tuple. The n-point DST-VII transform core is generated based on generating the set of tuples of transform core elements. A transform on a block is performed using the n-point DST-VII transform core.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: October 4, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11451777
    Abstract: Encoding a digital image divided into a plurality of blocks of pixels processed in a defined order, including the following steps, implemented for a current block, with preset sizes: predicting values of the current block from at least one block previously processed; calculating a residual block by subtracting the predicted values from the original values of the current block; obtaining a residual block by applying a transform to pixels of the residual block, said transformed residual block comprising coefficients; encoding the transformed residual block; calculating at least one characteristic representative of at least one transformed residual coefficient of the current block; determining initial identification data representative of a sub-list of at least one transform associated with said at least one calculated characteristic; and verifying that the transform applied to the current block is part of the sub-list identified by the initial data.
    Type: Grant
    Filed: January 13, 2021
    Date of Patent: September 20, 2022
    Assignee: B<>COM
    Inventor: Pierrick Philippe
  • Patent number: 11451772
    Abstract: An intra-frame prediction coding method includes determining N candidate intra-frame prediction modes for a current coding block, and saving the N candidate intra-frame prediction modes to a candidate mode list, N being a positive integer. The method also includes obtaining, by processing circuitry of a coder, optimal coding modes respectively corresponding to spatially neighboring coding blocks and an upper-layer coding block of the current coding block, and saving the optimal coding modes respectively corresponding to the spatially neighboring coding blocks and the upper-layer coding block to a neighboring mode list. The method further includes determining an optimal coding mode for the current coding block based on the candidate mode list and the neighboring mode list.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: September 20, 2022
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventor: Yonglin Luo
  • Patent number: 11451835
    Abstract: An image coding method and apparatus and an image decoding method and apparatus are provided by the present invention. The image coding method includes: implementing matching coding for pixels of an input video image to obtain one or more matching relationship parameters, herein the matching relationship parameters are parameters used in a process of constructing predicted values and/or reconstructed values of the pixels in the image; mapping the matching relationship parameters to obtain mapped values of the matching relationship parameters; and performing entropy coding on the mapped values of the matching relationship parameters. The present invention addresses the problem existing in the conventional art which is caused by the direct implementation of entropy coding for matching relationship parameters and achieves a good data compression effect through entropy coding.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: September 20, 2022
    Assignees: Tongji University, ZTE Corporation
    Inventors: Tao Lin, Ming Li, Guoqiang Shang, Zhao Wu
  • Patent number: 11451780
    Abstract: A method of video processing is described. The method includes performing a conversion between a current video block of a video and a coded representation of the current video block according to a rule, wherein the rule specifies that, due to use of an identity transform coding tool for representing the current video block into the coded representation, a syntax field indicative of a quantization parameter used for decoding the current video block is included such that a value of the quantization parameter is modified according to a rule, wherein the identity transform coding tool allows coefficient values at a transform domain of the current block to be same as values of a residual block of the current video block.
    Type: Grant
    Filed: November 17, 2021
    Date of Patent: September 20, 2022
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu
  • Patent number: 11445218
    Abstract: There is provided an image processing apparatus and an image processing method for enabling suppression of an increase in a memory capacity required for orthogonal transform and inverse orthogonal transform. A second transformation matrix is derived using a first transformation matrix, a prediction residual of an image is orthogonally transformed using the derived second transformation matrix, and coefficient data obtained by orthogonally transforming the prediction residual is encoded to generate a bit stream. The present disclosure can be applied to, for example, an image processing apparatus, an image encoding device, an image decoding device, or the like.
    Type: Grant
    Filed: November 12, 2018
    Date of Patent: September 13, 2022
    Assignee: SONY CORPORATION
    Inventor: Takeshi Tsukuba
  • Patent number: 11438583
    Abstract: A method of controlling intra prediction for decoding or encoding of a video sequence, is by at least one processor and includes identifying whether an intra prediction mode of a current block has a wide angle direction, based on the intra prediction mode being identified to have the wide angle direction, filtering reference samples of the current block, using an edge-smoothing filter, and based on the intra prediction mode being identified to not have the wide angle direction, filtering the reference samples, using an edge-preserve filter.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: September 6, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiaozhong Xu, Shan Liu, Yiming Li
  • Patent number: 11432017
    Abstract: Several methods and systems for reducing blocking artifacts are disclosed. In an embodiment, the method includes receiving a pair of adjacent blocks having an edge being positioned between the adjacent blocks. The pair of adjacent blocks is associated with one or more coding blocks. The one or more coding blocks comprise one or more coding information associated with the coding of the pair of adjacent blocks. The method also includes conducting a determination of whether the pair of adjacent blocks is coded in a skip-mode based on the one or more coding information. The edge is filtered based on the determination. Filtering the edge comprises disabling a de-blocking filtering of the edge based on a determination that the pair of adjacent blocks is coded in the skip-mode; and enabling the de-blocking filtering of the edge based on determination that the pair of adjacent blocks is not associated with the skip-mode.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: August 30, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventor: Mangesh Devidas Sadafale
  • Patent number: 11425380
    Abstract: A method of visual processing includes determining, during a conversion between a block of a video and a bitstream representation of the video, whether there is a switch from a first residual coding technique to a second residual coding technique based on a number of context coded bins per unit used in the first residual coding technique. The unit is included in the block, and coefficients of the unit are coded in the bitstream representation in multiple passes. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: August 23, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11425426
    Abstract: The present invention relates to an image encoding/decoding method and device, and the image encoding method or device according to an embodiment of the present invention may encode a position of a reference coefficient within a current transform block to be encoded, and encoding skip region information of a skip region selected on the basis of the position of the reference coefficient. The skip region information may represent whether or not coefficients within the skip region have an identical coefficient value.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: August 23, 2022
    Assignee: INDUSTRY ACADEMY COOPERATION FOUNDATION OF SEJONG UNIVERSITY
    Inventors: Joo Hee Moon, Jae Min Ha, Dong Jae Won, Sung Won Lim
  • Patent number: 11418785
    Abstract: Methods of encoding and decoding for video data are described in which multi-level significance maps are used in the encoding and decoding processes. The significant-coefficient flags that form the significance map are grouped into contiguous groups, and a significant-coefficient-group flag signifies for each group whether that group contains no non-zero significant-coefficient flags. If there are no non-zero significant-coefficient flags in the group, then the significant-coefficient-group flag is set to zero. The set of significant-coefficient-group flags is encoded in the bitstream. Any significant-coefficient flags that fall within a group that has a significant-coefficient-group flag that is non-zero are encoded in the bitstream, whereas significant-coefficient flags that fall within a group that has a significant-coefficient-group flag that is zero are not encoded in the bitstream.
    Type: Grant
    Filed: February 1, 2021
    Date of Patent: August 16, 2022
    Assignee: Velos Media, LLC
    Inventors: Nguyen Nguyen, Tianying Ji, Dake He
  • Patent number: 11412258
    Abstract: A method, computer program, and computer system is provided for coding video data. Video data is received. One or more transform cores corresponding to a transform associated with the video data are identified. The one or more transform cores include one or more of a line graph transform (LGT) and a discrete sine transform (DST) The video data is decoded based on the identified transform core. The transform cores correspond to one or more from among an 8-bit transform core and a 10-bit transform core. The transform corresponds to one or more from among a 2-point transform, a 4-point transform, an 8-point transform, and a 16-point transform.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: August 9, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Madhu Peringassery Krishnan, Xin Zhao, Shan Liu
  • Patent number: 11412235
    Abstract: A method of video decoding performed in a video decoder includes receiving a syntax element from a bitstream of a coded video. The syntax element can indicate that residual blocks of a current coding unit (CU) are processed with a color space conversion. The residual blocks of the current CU can include a luma residual block, a first chroma residual block, and a second chroma residual block. In response to receiving the syntax element indicating that the residual blocks of the current CU are processed with the color space conversion, one of two options of color space conversion equations can be selected. An inverse color space conversion using the selected option of color space conversion equations can be applied to the residual blocks of the current CU to generate modified versions of the residual blocks of the current CU.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: August 9, 2022
    Assignee: Tencent America LLC
    Inventors: Ling Li, Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11412234
    Abstract: A method and apparatus for parallel processing of at least two bins relating to at least one of a video and an image. The method includes determining scan type of at least a portion of the at least one of video and an image, analyzing neighboring position of a bin, removing dependencies of context selection based on the scan type and position of location being encoded in a transform, and performing parallel processing of that least two bins.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: August 9, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Vivienne Sze, Madhukar Budagavi
  • Patent number: 11412240
    Abstract: The present invention relates to a method and an apparatus for interlayer prediction, and the method for interlayer prediction, according to the present invention, comprises the steps of: deciding whether to apply an interlayer prediction to an enhancement layer; and performing a prediction on a current block of the enhancement layer based on reference information that is generalized and generated from a reference picture, which is decoded, of a reference layer, when the interlayer prediction is applied, wherein the reference layer information can be encoding information of a reference block, which corresponds to a current block of the enhancement layer, from the reference layer, and residual information.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: August 9, 2022
    Assignees: Electronics and Telecommunications Research Institute, KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
    Inventors: Ha Hyun Lee, Jung Won Kang, Jin Soo Choi, Jin Woong Kim, Dong Gyu Sim, Hyo Min Choi, Jung Hak Nam
  • Patent number: 11405655
    Abstract: The present invention avoids waste caused by performing both a Secondary Transform and an Adaptive Multiple Core Transform. Provided is a device including: a core transform unit (1521) that can perform an Adaptive Multiple Core Transform on a Coding Tree Unit; and a Secondary Transform unit (1522) that can perform, before the Adaptive Multiple Core Transform, a Secondary Transform on at least any one of sub-blocks included in the Coding Tree Unit. The device omits any of the Adaptive Multiple Core Transform and the Secondary Transform in accordance with at least any of a flag associated with the Adaptive Multiple Core Transform and a flag associated with the Secondary Transform, or in accordance with a size of the Coding Tree Unit.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: August 2, 2022
    Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company Limited
    Inventor: Tomohiro Ikai
  • Patent number: 11405647
    Abstract: A method, computer program, and computer system is provided for coding video data. Video data is received. One or more transform cores corresponding to a transform associated with the video data are identified. The one or more transform cores include one or more of a line graph transform (LGT) and a discrete cosine transform (DCT) The video data is decoded based on the identified transform core. The transform cores correspond to one or more from among an 8-bit transform core and a 10-bit transform core. The transform corresponds to one or more from among a 2-point transform, a 4-point transform, an 8-point transform, a 16-point transform, a 32-point transform, and a 64-point transform.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: August 2, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Madhu Peringassery Krishnan, Xin Zhao, Shan Liu
  • Patent number: 11388439
    Abstract: A sparse matrix representation of image or video data for encoding or decoding uses a boundary of non-zero coefficients within the image or video data. A bounding box encloses each non-zero coefficient within an image or video block. The coefficients enclosed within the bounding box are encoded to a bitstream along with dimensional information usable to identify the bounding box within the image or video block during decoding. Coefficients not enclosed within the bounding box are not specifically encoded within the bitstream. The dimensional information represents one or more of a shape, size, or position within the image or video block of the bounding box. The bounding box may be identified according to a scan order used to process the coefficients within the image or video block. The bounding box may be rectangular or non-rectangular.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: July 12, 2022
    Assignee: GOOGLE LLC
    Inventors: Pascal Massimino, Vincent Rabaud
  • Patent number: 11388441
    Abstract: According to certain aspects, an apparatus for coding video information includes a memory and a processor configured to determine whether a first syntax element is present in a bitstream, the first syntax element associated with a sequence parameter set (SPS) and a first flag indicative of whether a temporal identifier (ID) of a reference picture for pictures that refer to the SPS can be nested; and in response to determining that the first syntax element is not present in the bitstream: obtain a second syntax element indicative of a maximum number of temporal sub-layers in a particular layer of the plurality of layers; and determine whether to set the first flag equal to a second flag indicative of whether a temporal ID of a reference picture for any pictures can be nested based at least in part on a value of the second syntax element.
    Type: Grant
    Filed: March 13, 2015
    Date of Patent: July 12, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Fnu Hendry, Adarsh Krishnan Ramasubramonian, Ye-Kui Wang, Vadim Seregin
  • Patent number: 11381847
    Abstract: Techniques for coding coefficients in a residual block are described. A video coder (e.g., video encoder or video decoder) may code (e.g., encode or decode), in an interleaving manner, coefficient information on a coefficient-by-coefficient basis for coefficients in a residual block of a current block of the video data in a first pass, wherein the coefficient information for a coefficient includes one or more of a significance flag indicating whether a value of the coefficient is not zero, a parity flag indicating whether the value of the coefficient is odd or even, a sign flag indicating whether the value of the coefficient is positive or negative, and one or more greater than flags indicating whether an absolute value of the coefficient is greater than respective threshold values, and after the first pass, code remainder information for coefficients in the residual block of the current block in a second pass.
    Type: Grant
    Filed: May 28, 2020
    Date of Patent: July 5, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Hongtao Wang, Muhammed Zeyd Coban, Yung-Hsuan Chao
  • Patent number: 11368511
    Abstract: According to an embodiment, a method of selecting a Rice parameter for encoding a video bitstream using at least one processor includes obtaining an absolute level corresponding to a current transform block; determining whether transform skip is enabled; generating a lookup variable based on the absolute level and the determination of whether the transform skip is enabled; obtaining the Rice parameter from a lookup table based on the lookup variable; and encoding a residual subblock based on the Rice parameter.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: June 21, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Cheung Auyeung, Xiang Li, Shan Liu
  • Patent number: 11350095
    Abstract: A method and apparatus for frame coding in adaptive raster scan order. The method includes encoding at least one of image or video utilizing input frames and at least one of a data related to the input frame to produce bitstream with raster scan order information and displacement information for producing compressed video bitstream, at decoding time, decoding at least one of the encoded bitstream with raster scan order information and displacement information for producing compressed video bitstream.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: May 31, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Do-Kyoung Kwon, Hyung Joon Kim, Madhukar Budagavi
  • Patent number: 11350128
    Abstract: The present application provides methods, systems, devices and computer-readable mediums for encoding and decoding transform. A method of the present application comprises: performing transform-encoding on a prediction residual block separately using a plurality of transform matrices, to obtain transformed residual blocks; based on the transformed residual block, determining, by a rate-distortion optimization decision, a transform matrix or a combination of transform matrices matching the residual characteristics of the prediction residual block from the plurality of transform matrices, and determining a transformed residual block to be outputted in a bitstream. Compared with the prior art, the method of the embodiments of the present invention performs a residual transform using transform matrices that are more closely matched with the residual characteristic, thereby improving the expression of the residual signal and improving the coding efficiency of the residual block.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: May 31, 2022
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ronggang Wang, Kui Fan, Guisen Xu, Zhenyu Wang, Wen Gao
  • Patent number: 11336917
    Abstract: An image decoding apparatus including a header decoder configured to decode, from coded data, a flag indicating whether dependent quantization is enabled and a flag prohibiting transform skip residual quantization, and a TU decoder configured to decode a transform coefficient in a TU block in an RRC mode in which a LAST position is coded, the LAST position corresponding to a decoding start position for the transform coefficient, or a TSRC mode in which the LAST position is not coded. The TU decoder performs dependent quantization in the RRC mode in a case that the transform coefficient for transform skip is decoded in the TSRC mode, and does not perform dependent quantization in the RRC mode in a case that the transform coefficient for transform skip is decoded in the RRC mode.
    Type: Grant
    Filed: February 18, 2021
    Date of Patent: May 17, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tomonori Hashimoto, Eiichi Sasaki, Tomohiro Ikai, Tomoko Aono
  • Patent number: 11330273
    Abstract: According to the present invention, an image-encoding method comprises the following steps: receiving image information; generating a restored block for the current block based on the image information; and generating a finally restored block for the current block by applying an in-loop filter to the restored block on the basis of the image information. According to the present invention, image-encoding/decoding efficiency may be improved.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: May 10, 2022
    Assignee: LG Electronics Inc.
    Inventors: Seung Wook Park, Jae Hyun Lim, Jung Sun Kim, Joon Young Park, Young Hee Choi, Byeong Moon Jeon, Yong Joon Jeon
  • Patent number: 11310531
    Abstract: A video decoding method according to the present document is characterized by comprising: a step for deriving transform coefficients through inverse quantization on the basis of quantized transform coefficients for a target block; a step for deriving modified transform coefficients on the basis of an inverse reduced secondary transform (RST) of the transform coefficients; and a step for generating a reconstructed picture on the basis of residual samples for the target block on the basis of an inverse primary transform of the modified transform coefficients, wherein the inverse RST using a transform kernel matrix is performed on transform coefficients of the upper-left 4×4 region of an 8×8 region of the target block, and the modified transform coefficients of the upper-left 4×4 region, upper-right 4×4 region, and lower-left 4×4 region of the 8×8 region are derived through the inverse RST.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: April 19, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Moonmo Koo, Seunghwan Kim, Jaehyun Lim
  • Patent number: 11303904
    Abstract: A device for decoding video data determines a quantization parameter (QP) for a block of transform coefficients, wherein the block of transform coefficients is a non-square, rectangular block; determines a value for (log2 (width)+log2 (height), wherein width represents a width of the block of transform coefficients and height represents a height of the block of transform coefficients; in response to the value not being divisible by 2, determines a modified QP for the block of transform coefficients based on the QP; inverse transforms the transform coefficients to determine a block of quantized residual samples; and dequantizes the quantized residual samples based on the modified QP to determine a block of residual samples.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: April 12, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Muhammed Zeyd Coban
  • Patent number: 11297338
    Abstract: A video encoder encodes a video into a data stream, the video encoder being configured to vary a granularity at which a Quantization Parameter—QP—is applied depending on an association of frames of the video to temporally hierarchical layers at which the video is encoded into the data stream. The technology also concerns a respective decoder, a respective method for encoding and decoding, and a computer program for implementing the methods.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: April 5, 2022
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Christian Helmrich, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Adam Wieckowski, Mischa Siekmann, Benjamin Bross
  • Patent number: 11284070
    Abstract: A method for derivation of a temporal motion data (TMD) candidate for a prediction unit (PU) in video encoding or video decoding is provided. The derived TMD candidate is for inclusion in an inter-prediction candidate list for the PU. The method includes determining a primary TMD position relative to a co-located PU in a co-located largest coding unit (LCU), wherein the co-located PU is a block in a reference picture having a same size, shape, and coordinates as the PU, and selecting at least some motion data of a secondary TMD position as the TMD candidate when the primary TMD position is in a bottom neighboring LCU or in a bottom right neighboring LCU of the co-located LCU, wherein the secondary TMD position is determined relative to the co-located PU.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: March 22, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventor: Minhua Zhou
  • Patent number: 11277614
    Abstract: A decoder for decoding a data stream into which media data is coded has a mode switch configured to activate a low-complexity mode or a high-efficiency mode depending on the data stream, an entropy decoding engine configured to retrieve each symbol of a sequence of symbols by entropy decoding using a selected one of a plurality of entropy decoding schemes, a desymbolizer configured to desymbolize the sequence of symbols to obtain a sequence of syntax elements, a reconstructor configured to reconstruct the media data based on the sequence of syntax elements, selection depending on the activated low-complexity mode or the high-efficiency mode.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: March 15, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand, Christian Bartnik