Adaptive Patents (Class 375/240.02)
  • Patent number: 11930220
    Abstract: Several techniques for video encoding and video decoding are described. One example method includes performing a conversion between a subpicture in a video picture of a video and a bitstream of the video according to a rule. The rule specifies that, in in case a subpicture is treated as a video picture for the conversion, a cross-layer alignment restriction is applied to less than all of the multiple layers including a current layer that includes the subpicture and a subset of layers associated with the current layer.
    Type: Grant
    Filed: September 21, 2022
    Date of Patent: March 12, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Ye-kui Wang, Li Zhang, Kai Zhang, Zhipin Deng
  • Patent number: 11930183
    Abstract: A method of determining a distance table of a merge with motion vector difference (MMVD) mode, wherein the method comprises determining a reference picture from at least one reference picture list of a current processing unit based on at least one parameter of the reference picture, and obtaining the distance table for the current processing unit based on the reference picture, wherein the at least one parameter of the reference picture comprises a picture order count (POC) number of the reference picture, a number of MMVD blocks of the reference picture, a reference picture list index of the reference picture, a reference picture index of the reference picture, and a quantization parameter (QP) of the reference picture.
    Type: Grant
    Filed: July 9, 2021
    Date of Patent: March 12, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Alexander Alexandrovich Karabutov, Timofey Mikhailovich Solovyev, Roman Igorevich Chernyak, Sergey Yurievich Ikonin, Jianle Chen
  • Patent number: 11928803
    Abstract: An image processing apparatus comprises a receiver (201) for receiving an image signal which comprises at least an encoded image and a target display reference. The target display reference is indicative of a dynamic range of a target display for which the encoded image is encoded. A dynamic range processor (203) generates an output image by applying a dynamic range transform to the encoded image in response to the target display reference. An output (205) then outputs an output image signal comprising the output image, e.g. to a suitable display. The dynamic range transform may furthermore be performed in response to a display dynamic range indication received from a display. The invention may be used to generate an improved High Dynamic Range (HDR) image from e.g. a Low Dynamic Range (LDR) image, or vice versa.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: March 12, 2024
    Assignee: Koninklijke Philips N.V.
    Inventors: Charles Leonardus Cornelius Maria Knibbeler, Renatus Josephus Van Der Vleuten, Wiebe De Haan
  • Patent number: 11930169
    Abstract: Methods and apparatus for video coding are disclosed. According to one method, First ALF (Adaptive Loop Filter) processing is applied to the reconstructed chroma samples for a target reconstructed chroma sample to generate a first filtered chroma sample. Second ALF processing is applied to the related reconstructed luma samples to generate a second filtered chroma sample for the target reconstructed chroma sample, where positions of the related reconstructed luma samples selected for the second ALF processing are determined according to the target chroma format. According to another method, the luma ALF and the cross-component ALF have the same filter coefficient precision.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: March 12, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Chen-Yen Lai, Ching-Yeh Chen, Tzu-Der Chuang
  • Patent number: 11924438
    Abstract: Embodiments include a picture reconstruction method and apparatus for a video picture. The picture reconstruction method includes: obtaining a prediction mode of a current coding unit, and/or obtaining a prediction partition mode of the current coding unit, where the current coding unit includes a luma coding block and a chroma coding block, and the prediction partition mode is a mode of splitting the current coding unit into prediction blocks or prediction units; obtaining a transform block of the current coding unit based on the prediction partition mode and/or the prediction mode; and generating a reconstructed picture block of the current coding unit based on the transform block. According to the method in the embodiments, video coding efficiency can be improved.
    Type: Grant
    Filed: June 11, 2021
    Date of Patent: March 5, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Yin Zhao, Haitao Yang, Riyang Zhao, Zhongliang Li, Lian Zhang
  • Patent number: 11924407
    Abstract: The present disclosure relates to video encoding and decoding, and in particular, a method for inter prediction for a block in a frame of a video signal includes: constructing a history-based motion information candidate list, wherein the list is an ordered list comprising N history-based motion information candidates Hk containing motion information of N preceding blocks preceding the block, wherein each history-based motion information candidate comprises: one or more motion vectors (MVs), one or more reference picture indices corresponding to the MVs, and an interpolation filter index; adding one or more history-based motion information candidates from the history-based motion information candidate list into a motion information candidate list for the block; and deriving motion information for the block based on the motion information candidate list.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: March 5, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Timofey Mikhailovich Solovyev, Sergey Yurievich Ikonin, Roman Igorevich Chernyak, Alexander Alexandrovich Karabutov, Elena Alexandrovna Alshina, Huanbang Chen
  • Patent number: 11917182
    Abstract: A video coding mechanism is disclosed. The mechanism includes encoding a sequence of point cloud compression (PCC) components into a bitstream. A buffering period supplemental enhancement information (SEI) message is also encoded into the bitstream. A hypothetical reference decoder (HRD) is initialized at a coded atlas access unit (AU) associated with the buffering period SEI message. A HRD conformance check of the bitstream is performed starting at the coded atlas AU. The bitstream is stored for communication toward a decoder.
    Type: Grant
    Filed: December 27, 2021
    Date of Patent: February 27, 2024
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Ye-Kui Wang, Jianle Chen, Fnu Hendry
  • Patent number: 11917168
    Abstract: Disclosed are an image encoding and decoding method, image processing device, and computer storage medium. the image coding method includes: when copying coding is performed on a current coding block by using one of the at least two different palette and pixel string copying coding manners, generating a new palette color according to pixels of the current coding block; generating a palette for the current coding block according to the new palette color and a palette color candidate set shared by the at least two different palette and pixel string copying coding manners; and performing palette and pixel string copying coding by using the palette for the current coding block, and generating a video bitstream comprising a copying manner and a copying parameter.
    Type: Grant
    Filed: September 2, 2022
    Date of Patent: February 27, 2024
    Assignees: TONGJI UNIVERSITY, ZTE CORPORATION
    Inventors: Tao Lin, Ming Li, Ping Wu, Guoqiang Shang, Zhao Wu
  • Patent number: 11917129
    Abstract: An image decoding method according to the present invention includes: a step for determining a reference sample line of a current block; a step for determining whether candidate intra-prediction modes identical to the intra-prediction mode of the current block exist; a step for deriving the intra-prediction mode of the current block on the basis of the determination; and a step for performing intra-prediction on the current block on the basis of the reference sample line and the intra-prediction mode. Here, at least one of the candidate intra prediction modes may be derived by adding or subtracting an offset to or from the maximum value among the intra-prediction mode of a neighboring block that is above the current block and the intra-prediction mode of a neighboring block that is to the left of the current block.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: February 27, 2024
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Bae Keun Lee
  • Patent number: 11917147
    Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method performed by an image decoding apparatus includes determining a splitting type of a current block, splitting the current block into a plurality of lower-layer blocks based on the splitting type, and decoding the lower-layer blocks. In this case, the current block may be a chroma block, and the determining the splitting type of the current block may be performed by disallowing a predetermined type, in which a width or height of the lower-layer blocks is a predetermined value, among a plurality of splitting types.
    Type: Grant
    Filed: June 19, 2020
    Date of Patent: February 27, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Jangwon Choi, Jin Heo, Sunmi Yoo, Jungah Choi, Seung Hwan Kim
  • Patent number: 11909956
    Abstract: Systems and methods for deep neural network (DNN)-based cross component prediction are provided. A method includes inputting a reconstructed luma block of an image or video into a DNN; and predicting, by the DNN, a reconstructed chroma block of the image or video based on the reconstructed luma block that is input. Luma and chroma reference information and side information may also be input into the DNN to predict the reconstructed chroma block. The various inputs may also be generated using processes such as downsampling and transformation.
    Type: Grant
    Filed: May 20, 2022
    Date of Patent: February 20, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Sheng Lin, Wei Jiang, Wei Wang, Liqiang Wang, Shan Liu, Xiaozhong Xu
  • Patent number: 11909999
    Abstract: Disclosed are a coding management method and apparatus based on High Efficiency Video Coding (HEVC). The method includes: obtaining a calculated correlation result for a HEVC basic unit before and after division, the correlation result including a spatial correlation result for the basic unit before the division and N basic units generated after the division, and N being an integer greater than 1; and judging whether or not to perform the division on the basic unit according to the calculated correlation result.
    Type: Grant
    Filed: April 20, 2020
    Date of Patent: February 20, 2024
    Assignee: SANECHIPS TECHNOLOGY CO., LTD.
    Inventors: Ke Xu, Jianjun Song
  • Patent number: 11909983
    Abstract: A method comprising: encoding video media content into at least a first representation and a second representation, wherein the first representation comprises a switchable inter-coded picture, wherein the switchable picture has a first characteristic that no pictures preceding the switchable picture in decoding order are used as reference pictures for any non-switchable pictures following the switchable picture in decoding order; and the second representation comprises one or more decoder reset pictures aligned with the switchable pictures of the first representation, wherein the frame rate of the second representation is smaller than or equal to the frame rate of the first representation and the resolutions of the first and the second representation are equal.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: February 20, 2024
    Assignee: Nokia Technologies Oy
    Inventors: Miska Hannuksela, Igor Curcio, Sujeet Shyamsundar Mate, Emre Aksu, Ari Hourunranta
  • Patent number: 11902509
    Abstract: An image encoding/decoding method and apparatus for predicting a second color component block using a first color component block are provided. An image decoding method of the present invention comprises deriving a prediction parameter using the first color component block, and predicting the second color component block using the derived prediction parameter.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: February 13, 2024
    Assignee: LX Semicon Co., Ltd.
    Inventors: Jin Ho Lee, Hyun Suk Ko, Jung Won Kang, Sung Chang Lim, Ha Hyun Lee, Dong San Jun, Seung Hyun Cho, Hui Yong Kim, Jin Soo Choi
  • Patent number: 11902582
    Abstract: An image decoding method performed by a decoding apparatus according to the present disclosure includes receiving a bitstream including residual information; deriving quantized transform coefficients for a current block based on the residual information included in the bitstream; deriving residual samples for the current block based on the quantized transform coefficients; and generating a reconstructed picture based on the residual samples for the current block.
    Type: Grant
    Filed: April 5, 2023
    Date of Patent: February 13, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Jungah Choi, Sunmi Yoo, Jin Heo, Ling Li, Jangwon Choi, Seunghwan Kim
  • Patent number: 11902516
    Abstract: A method for deblocking at least one boundary of a coding unit, wherein the boundary forms a first side and a second side of the coding unit, wherein a video picture comprises the coding unit, and wherein the first and second sides use a same reference picture. The method includes obtaining a first motion vector component in the first side; obtaining a second motion vector component in the second side; determining whether an absolute difference between the first motion vector component and the second motion vector component is equal to or larger than a predetermined threshold that is less than 1 sample; and as a result of determining that the absolute difference between the first motion vector component and the second motion vector component is equal to or larger than the predetermined threshold, applying deblocking to the vertical or horizontal boundary between the first side and the second side.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: February 13, 2024
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth Andersson, Jack Enhorn, Ruoyang Yu
  • Patent number: 11902515
    Abstract: A video coding device, comprising a sequence of filters that are configurable by one or more primary parameters and one or more secondary parameters, and a filter controller configured to adjust the one or more secondary parameters based on the one or more primary parameters and based on a strength criterion of the sequence of filters.
    Type: Grant
    Filed: August 20, 2021
    Date of Patent: February 13, 2024
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Alexey Konstantinovich Filippov, Vasily Alexeevich Rufitskiy
  • Patent number: 11902587
    Abstract: An image decoding method performed by a decoding apparatus, according to the present document, comprises the steps of: acquiring syntax elements for a first transform coefficient through an n-th transform coefficient of a current block, wherein the syntax elements are syntax elements according to a first residual data coding structure of TSRC; and acquiring syntax elements for an n+1st transform coefficient through a last transform coefficient of the current block, wherein the syntax elements are syntax elements according to a second residual data coding structure of the TSRC, wherein the number of context-coded syntax elements for the first transform coefficient through the n-th transform coefficient is equal to the maximum number of context-coded bins of the current block, and the syntax elements according to the second residual data coding structure include coefficient level information and a sign flag for a transform coefficient.
    Type: Grant
    Filed: September 26, 2022
    Date of Patent: February 13, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Jungah Choi, Jin Heo, Sunmi Yoo, Jaehyun Lim, Jangwon Choi, Seunghwan Kim
  • Patent number: 11902510
    Abstract: Video processing methods and apparatuses for coding a current block and a adjacent block comprise receiving input data of the current and adjacent blocks in a current picture, determines the current and adjacent blocks are both coded in a BDPCM or RDPCM mode, performing a deblocking filtering operation on an edge between the current and adjacent blocks by de-activating deblocking filtering for a first color component and activating deblocking filtering for a second color component, and encoding or decoding the current and adjacent blocks. Each current pixel in a BDPCM coded block is predicted by one or more neighboring pixels of the current pixel. RDPCM is applied to process quantized residues of a RDPCM coded block according to a prediction direction of the RDPCM coded block.
    Type: Grant
    Filed: May 28, 2020
    Date of Patent: February 13, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Chia-Ming Tsai, Chih-Wei Hsu
  • Patent number: 11902536
    Abstract: The disclosure discloses a method for processing a video signal and an apparatus therefor. Specifically, a method of processing a video signal based on inter prediction includes constructing a first merge candidate list of a current block using a spatial merge candidate and temporal merge candidate of the current block, constructing a second merge candidate list by adding a history-based merge candidate indicating motion information of a block coded prior to the current block to the first merge candidate list, obtaining a merge index indicating a merge candidate applied to the current block within the second merge candidate list, and generating a prediction block of the current block using motion information of a merge candidate indicated by the merge index.
    Type: Grant
    Filed: January 19, 2022
    Date of Patent: February 13, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Jane Zhao, Seethal Paluri, Seunghwan Kim
  • Patent number: 11902526
    Abstract: An encoder includes circuitry and memory. In both of a first type of residual coding where an orthogonal transform is applied and a second type of residual coding where the orthogonal transform is skipped, wherein when a restriction on a number of CABAC processes allows CABAC coding of a set of coefficient information flags, the circuitry: encodes the coefficient information flags by CABAC; and otherwise, the circuitry: skips the CABAC encoding of the coefficient information flags; and the circuitry encodes a remainder value of the coefficient with Golomb-Rice code when the coefficient information flags are encoded; and otherwise the circuitry encodes a value of the coefficient with the Golomb-Rice code, wherein in the second type of residual coding, the circuitry encodes absolute value flags each relating to an absolute value of the coefficient after encoding the coefficient information flags and before encoding the remainder value of the coefficient.
    Type: Grant
    Filed: October 6, 2021
    Date of Patent: February 13, 2024
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Yusuke Kato, Takahiro Nishi, Tadamasa Toma, Kiyofumi Abe
  • Patent number: 11902593
    Abstract: Interpolation between explicitly signaled CPB (or HRD) parameters at selected bit rates is used to achieve a good compromise between CPB parameter transmission capacity and CPB parametrization effectiveness and may be, particularly, made in an effective manner.
    Type: Grant
    Filed: May 18, 2023
    Date of Patent: February 13, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Yago Sánchez De La Fuente, Benjamin Bross, Robert Skupin, Cornelius Hellge, Thomas Schierl, Thomas Wiegand
  • Patent number: 11902530
    Abstract: An image decoding method according to the present document may comprise the steps of: deriving an intra prediction mode of a chroma block as a cross-component linear model (CCLM) mode on the basis of intra prediction mode information; updating the intra prediction mode of the chroma block on the basis of an intra prediction mode of a luma block corresponding to the chroma block; when the chroma block is not square, remapping the updated intra prediction mode to a wide-angle intra prediction mode; and determining an LFNST set including LFNST matrices on the basis of the remapped intra prediction mode.
    Type: Grant
    Filed: November 16, 2022
    Date of Patent: February 13, 2024
    Assignee: LG Electronics Inc.
    Inventors: Moonmo Koo, Hyeongmoon Jang, Seunghwan Kim, Jaehyun Lim
  • Patent number: 11895331
    Abstract: Video data may be palette decoded. Data defining a palette table may be received. The palette table may comprise index values corresponding to respective colors. Palette index prediction data may be received and may comprise data indicating index values for at least a portion of a palette index map mapping pixels of the video data to color indices in the palette table. The palette index prediction data may comprise run value data associating run values with index values for at least a portion of a palette index map. A run value may be associated with an escape color index. The palette index map may be generated from the palette index prediction data at least in part by determining whether to adjust an index value of the palette index prediction data based on a last index value. The video data may be reconstructed in accordance with the palette index map.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: February 6, 2024
    Assignee: VID Scale, Inc.
    Inventors: Chia-Ming Tsai, Yuwen He, Xiaoyu Xiu, Yan Ye
  • Patent number: 11895306
    Abstract: Devices, systems and methods for sub-block based prediction are described. In a representative aspect, a method for video encoding includes partitioning, based on a first rule, a luma component of a block of video data into a first set of sub-blocks. The method also includes partitioning, based on a second rule, a first chroma component of the block of video data into a second set of sub-blocks. The first and the second set of sub-blocks include different numbers of sub-blocks. The method also includes performing a subsequent motion prediction based on the first and the second set of sub-blocks.
    Type: Grant
    Filed: April 29, 2022
    Date of Patent: February 6, 2024
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11889092
    Abstract: A mechanism is provided that implements video coding and decoding such that only a specific partial image region on a screen can be independently decoded. A video decoding apparatus (31) according to an aspect of the present invention configures, in intra prediction, inter prediction, loop filter processing, or the like, a partial image region in a picture, handles a region outside the partial image region in a similar manner to a region outside the picture, and does not apply such restriction to a non-partial image region other than the partial image region in the picture.
    Type: Grant
    Filed: October 26, 2022
    Date of Patent: January 30, 2024
    Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company Limited
    Inventors: Takeshi Chujoh, Yukinobu Yasugi, Eiichi Sasaki, Tomoko Aono, Tomohiro Ikai
  • Patent number: 11889112
    Abstract: Aspects of the disclosure provide a method, an apparatus, and a non-transitory computer-readable storage medium for video decoding. The apparatus can include processing circuitry. The processing circuitry is configured to decode first neural network update information in a coded bitstream for a first neural network in the video decoder. The first neural network is configured with first pretrained parameters. The first neural network update information corresponds to a first block in an image to be reconstructed and indicates a first replacement parameter corresponding to a first pretrained parameter in the first pretrained parameters. The processing circuitry is configured to update the first neural network in the video decoder based on the first replacement parameter. The processing circuitry can decode the first block based on the updated first neural network for the first block.
    Type: Grant
    Filed: April 26, 2022
    Date of Patent: January 30, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Ding Ding, Wei Jiang, Wei Wang, Shan Liu
  • Patent number: 11889073
    Abstract: A decoding method for decoding a block of an image is disclosed that comprises: determining a split mode for said block in a set of split modes; splitting said block into at least two sub-blocks responsive to said split mode; decoding each of the at least two sub-blocks; wherein said set of split modes comprises at least one split mode for asymmetrically splitting said block into the at least two sub-blocks.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: January 30, 2024
    Assignee: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
    Inventors: Fabrice Leleannec, Antoine Robert, Tangi Poirier
  • Patent number: 11882295
    Abstract: A method includes receiving a block comprising pixels; encoding the pixels by: arranging the pixels in a sequence; generating a delta encoding of the pixels, the delta encoding comprising (a) a base value and (b) delta values having non-zero delta values and zero delta values, each delta value representing a difference between a corresponding pixel in the sequence and a previous pixel in the sequence; generating a symbol mask indicating whether each of the delta values is zero or non-zero; determining, based on magnitudes of the non-zero delta values, a symbol width for encoding each of the non-zero delta values; generating a sequence of symbols that respectively encode the non-zero delta values using the symbol width; generating a compression of the block by collating the symbol mask, the symbol width, and the sequence of symbols.
    Type: Grant
    Filed: April 15, 2022
    Date of Patent: January 23, 2024
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Nilanjan Goswami, Sonal Pinto
  • Patent number: 11877010
    Abstract: A decoding method performed by a decoding device according to the present document comprises: a step for determining the prediction mode of a current block on the basis of information on a prediction mode acquired from a bitstream; a step for deriving movement information on the current block on the basis of the prediction mode; a step for generating prediction samples of the current block on the basis of the movement information; and a step for generating reconstructed samples on the basis of the prediction samples, wherein the step for determining the prediction mode may include a step for acquiring a regular merge flag from the bitstream on the basis of a combined inter-picture merge and intra-picture prediction (CIIP) available flag that indicates whether or not a CIIP is available.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: January 16, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyeongmoon Jang, Naeri Park, Seunghwan Kim
  • Patent number: 11877000
    Abstract: Methods and systems for canvas size scalability across the same or different bitstream layers of a video coded bitstream are described. Offset parameters for a conformance window, a reference region of interest (ROI) in a reference layer, and a current ROI in a current layer are received. The width and height of a current ROI and a reference ROI are computed based on the offset parameters and they are used to generate a width and height scaling factor to be used by a reference picture resampling unit to generate an output picture based on the current ROI and the reference ROI.
    Type: Grant
    Filed: August 5, 2020
    Date of Patent: January 16, 2024
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Taoran Lu, Fangjun Pu, Peng Yin, Sean Thomas McCarthy, Tao Chen
  • Patent number: 11876972
    Abstract: An image decoding method includes: deriving an L0 motion vector and a L1 motion vector of the current block; deriving prediction samples of the current block based on the L0 motion vector and the L1 motion vector; and generating reconstructed samples of the current block based on the prediction samples. Deriving the prediction samples includes applying bi-directional optical flow (BDOF) to the current block based on whether the condition for applying BDOF to the current block is satisfied, and the application condition of the BDOF includes a condition whereby the values of L0 luma weighted prediction flag information and L1 luma weighted prediction flag information are both zero, where the a value of each of the L0 luma weighted prediction flag information and L1 luma weighted prediction flag information being 0 represents that a weight factor for each of a L0 and L1 prediction luma components does not exist, respectively.
    Type: Grant
    Filed: September 13, 2022
    Date of Patent: January 16, 2024
    Assignee: LG Electronics Inc.
    Inventors: Naeri Park, Junghak Nam, Hyeongmoon Jang
  • Patent number: 11876981
    Abstract: Coding techniques for 360-degree video are described. An encoder selects a projection format and maps the 360-degree video to a 2D planar video using the selected projection format. The encoder encodes the 2D planar video in a bitstream and further signals, in the bitstream, parameters identifying the projection format. The parameters identifying the projection format may be signaled in a video parameter set, sequence parameter set, and/or picture parameter set of the bitstream. Different projection formats that may be signaled include formats using geometries such as equirectangular, cubemap, equal-area, octahedron, icosahedron, cylinder, and user-specified polygon. Other parameters that may be signaled include different arrangements of geometric faces or different encoding quality for different faces. Corresponding decoders are also described. In some embodiments, projection parameters may further include relative geometry rotation parameters that define an orientation of the projection geometry.
    Type: Grant
    Filed: February 14, 2022
    Date of Patent: January 16, 2024
    Assignee: VID SCALE, INC.
    Inventors: Philippe Hanhart, Yuwen He, Yan Ye
  • Patent number: 11876970
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry determines that a non-interleaved separate tree structure is used for coding different color components of coding tree units (CTUs) in a bitstream. The processing circuitry decodes a first color component of a plurality of CTUs from a first portion of the bitstream, and decodes a second color component of the plurality of CTUs from a second portion of the bitstream, the second portion is located after the first portion in the bitstream.
    Type: Grant
    Filed: July 18, 2022
    Date of Patent: January 16, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiang Li, Guichun Li, Shan Liu
  • Patent number: 11876965
    Abstract: A versatile video coding (VVC) method includes obtaining a plurality of video sources; encoding the plurality of video sources into a bitstream including a plurality of independent layers corresponding to the plurality of video sources; generating signaling information on the plurality of independent layers and integrating the signaling information with the bitstream; and transferring the bitstream for decoding processing, wherein the signaling information is to be used in the decoding process to enable a single decoder instance to decode the plurality of independent layers similar to a single-layer bitstream. The signaling information includes at least a video parameter set (VPS), and the VPS includes a flag inbl_one_pic_per_poc_flag equal to 1, which specifies that the bitstream contains independent layers and there is one and only one coded picture with a particular picture order count (POC) value in a same coded video sequence (CVS) among all layers.
    Type: Grant
    Filed: December 12, 2022
    Date of Patent: January 16, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Stephan Wenger, Shan Liu
  • Patent number: 11870991
    Abstract: Video processing methods include receiving input data of a current block in a current slice, determine determining whether one or more components of the current block satisfy one or more predefined criteria during partitioning, and applying a mode constraint to the current block only if the one or more components of the current block satisfy the one or more predefined criteria, wherein the mode constraint restricts all blocks within the current block to be processed by a same prediction mode when the current block is split into a plurality of blocks. The methods adaptively split the current block into one or more blocks, and pare one or more prediction mode syntax elements of a first block in the current block according to a constrained mode of the current block. The methods further encode the current block with the mode constraint.
    Type: Grant
    Filed: January 5, 2023
    Date of Patent: January 9, 2024
    Assignee: HFI INNOVATION INC.
    Inventors: Zhi-Yi Lin, Tzu-Der Chuang, Ching-Yeh Chen, Chia-Ming Tsai
  • Patent number: 11871018
    Abstract: Disclosed are techniques for compressing data of an image. Intermediate pixels may be determined. Each location of the image may be associated with a block of a plurality of blocks of a first size and a block of a plurality of blocks of a second size. For each block of the first size and of the second size, a first cost for a first mode and a second cost for a second mode may be determined in parallel using the intermediate pixels. A final mode and a final block size may be selected for each location of the image using the first cost and the second cost for each of a respective block of the first size and a respective block of the second size associated with a corresponding location. Final pixels may be determined, and a representation of the image may be obtained based on the final pixels.
    Type: Grant
    Filed: October 22, 2021
    Date of Patent: January 9, 2024
    Assignee: Nvidia Corporation
    Inventors: Jianjun Chen, Wei Feng, Xi He, Sangeun Han, Ranga Ramanujam Srinivasan
  • Patent number: 11871043
    Abstract: A method of three-dimensional (3D)-Tree coding for neural network model compression, is performed by at least one processor, and includes reshaping a four-dimensional (4D) parameter tensor of a neural network into a 3D parameter tensor of the neural network, the 3D parameter tensor comprising a convolution kernel size, an input feature size, and an output feature size, partitioning the 3D parameter tensor along a plane that is formed by the input feature size and the output feature size into 3D coding tree units (CTU3Ds), partitioning each of the CTU3Ds into a plurality of 3D coding units (CU3Ds) recursively until a predetermined depth, using a quad-tree, and constructing a 3D tree for each of the plurality of CU3Ds, wherein the 3D tree for each of the plurality of CU3Ds is a 3D-Unitree.
    Type: Grant
    Filed: January 13, 2023
    Date of Patent: January 9, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Wei Wang, Wei Jiang, Shan Liu
  • Patent number: 11870997
    Abstract: Systems and methods are described for video coding using affine motion prediction. In an example method, motion vector gradients are determined from respective motion vectors of a plurality of neighboring sub-blocks neighboring a current block. An estimate of at least one affine parameter for the current block is determined based on the motion vector gradients. An affine motion model is determined based at least in part on the estimated affine parameter(s), and a prediction of the current block is generated using the affine motion model. The estimated parameter(s) may be used in the affine motion model itself. Alternatively, the estimated parameter(s) may be used in a prediction of the affine motion model. In some embodiments, only neighboring sub-blocks above and/or to the left of the current block are used in estimating the affine parameter(s).
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: January 9, 2024
    Assignee: VID SCALE, INC.
    Inventors: Jiancong Luo, Yuwen He, Wei Chen
  • Patent number: 11871016
    Abstract: An encoder which encodes a video including a plurality of pictures includes circuitry and memory. Using the memory, the circuitry performs: encoding a first picture among the plurality of pictures; and performing (i) a first operation for encoding a parameter set for a second picture which follows the first picture in coding order among the plurality of pictures after encoding the first picture, and encoding the second picture after encoding the parameter set, or (ii) a second operation for encoding the second picture without encoding the parameter set after encoding the first picture. The circuitry performs the first operation when the second picture is a determined picture, in the performing of the first operation or the second operation.
    Type: Grant
    Filed: December 29, 2022
    Date of Patent: January 9, 2024
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Takahiro Nishi, Tadamasa Toma, Kiyofumi Abe, Ryuichi Kanoh
  • Patent number: 11870975
    Abstract: A method and apparatus for performing intra prediction for encoding or decoding adds multiple prediction modes to those of prior intra prediction schemes. A horizontal mode, a vertical mode, and a diagonal mode are added. Reference pixels for each of the added modes can come from multiple pixel positions away from a block to be encoded or decoded. Reference pixels to the left and above a block are reconstructed from those already coded. Reference pixels from right of, and below, a block are estimated or extrapolated and can be based on other pixels around the block. An index can be sent in a bitstream indicating which prediction was used.
    Type: Grant
    Filed: February 11, 2020
    Date of Patent: January 9, 2024
    Assignee: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
    Inventors: Fabien Racape, Gagan Rath, Fabrice Urban
  • Patent number: 11863773
    Abstract: A method and apparatus for decoding multiple semantically independent picture parts into a single video picture includes decoding unique picture order count values for each coded picture, coded slice, or coded tile in a coded video sequence, with multiple decoded pictures, cycles, and tiles belonging to a same access unit representing a frame of the video. A value representing the amount of pictures, cycles, or tiles, is then assigned to each access unit for assigning sequential access unit count values to the access units. As a result, each access unit, which represents multiple pictures, slices, or tiles to be combined into a single frame, is decoded for display processing.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: January 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Stephan Wenger, Shan Liu
  • Patent number: 11863796
    Abstract: Methods and apparatus for processing of video are described. The processing may include video encoding, decoding or transcoding. One example video processing method includes performing a conversion between a video including a current picture including a current subpicture including a current slice and a bitstream of the video. The bitstream conforms to a format rule that disallows an active entry in a reference picture list of the current slice from including a first picture that precedes in a decoding order a second picture that includes a step-wise temporal sublayer access subpicture in response to conditions associated with at least the first picture and the current subpicture.
    Type: Grant
    Filed: September 20, 2022
    Date of Patent: January 2, 2024
    Assignee: BYTEDANCE INC.
    Inventor: Ye-kui Wang
  • Patent number: 11863754
    Abstract: A method and for reconstructing chroma blocks and a video decoding apparatus are disclosed. In accordance with one aspect of the present disclosure, provided is a method for reconstructing a chroma block of a target block to be reconstructed. The method includes decoding correlation information between first residual samples and second residual samples, the first residual sample, and prediction information of the chroma block from a bitstream, wherein the first residual samples are residual samples of a first chroma component and the second residual samples are residual samples of a second chroma component. The method further includes generating predicted samples of the first chroma component and predicted samples of the second chroma information on the basis of the prediction information, and deriving the second residual samples by applying the correlation information to the first residual samples.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: January 2, 2024
    Assignees: Hyundai Motor Company, Kia Corporation, Kwangwoon University Industry-Academic Collaboration Foundation
    Inventors: Dong Gyu Sim, Sea Nae Park, Seung Wook Park, Wha Pyeong Lim
  • Patent number: 11863746
    Abstract: Embodiments of the disclosure provide a method and apparatus for processing video signals. An image signal decoding method according to an embodiment of the disclosure comprises the steps of: determining, on the basis of the height and width of a current block, an input length and output length of a non-separable transform; determining a non-separable transform matrix corresponding to the input length and output length of the non-separable transform; and applying the non-separable transform matrix to the current block, wherein, when the height and width of the current block are 4 each, the input length and output length of the non-separable transform are determined to be 8 and 16 respectively.
    Type: Grant
    Filed: July 27, 2021
    Date of Patent: January 2, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Moonmo Koo, Mehdi Salehifar, Seunghwan Kim, Jaehyun Lim
  • Patent number: 11863762
    Abstract: Embodiments for video processing, including video coding, video decoding and video transcoding are described. One example method includes performing a conversion between a video having one or more layers having one or more video pictures having one or more subpictures and a bitstream of the video according to a rule, wherein the rule defines network abstraction layer (NAL) units to be extracted from a bitstream during a sub-bitstream extraction process to output a sub-bitstream, wherein the rule further specifies that one or more inputs to the sub-bitstream extraction process include a target output layer set (OLS) index (targetOlsIdx) that identifies an OLS index of a target OLS and is equal to an index to a list of OLSs specified by a video parameter set, and wherein the one or more inputs satisfy a set of conditions.
    Type: Grant
    Filed: November 22, 2022
    Date of Patent: January 2, 2024
    Assignees: BEIJING BYTEDANCE TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Ye-kui Wang, Zhipin Deng, Kai Zhang, Li Zhang
  • Patent number: 11856214
    Abstract: One or more computing devices, systems, and/or methods for video encoding are provided. For example, a video file may be segmented into at least a first portion and a second portion. The first portion may be analyzed to determine that the first portion is associated with a first level of complexity, and the second portion may be analyzed to determine that the second portion is associated with a second level of complexity. A first bitrate associated with the first level of complexity may be determined, and a second bitrate associated with the second level of complexity may be determined. The first portion may be encoded at the first bitrate to generate a first encoded portion, and the second portion may be encoded at the second bitrate to generate a second encoded portion. The first encoded portion and the second encoded portion may be assembled to generate an optimized video file.
    Type: Grant
    Filed: August 1, 2022
    Date of Patent: December 26, 2023
    Assignee: YAHOO ASSETS LLC
    Inventors: Jian Zhou, Congxia Dai, Heri Zhao, Zhonghua Ma, Xumin Wu, Michael Chang-Ping Chen, Sagar Dattatraya Bhandare
  • Patent number: 11856197
    Abstract: The present specification discloses a method of decoding an image. The method of decoding an image according to the method includes: obtaining transform skip information of a current block from a bitstream; obtaining multiple transform selection information of the current block on the basis of the transform skip information from the bitstream; and performing inverse transform on the current block on the basis of the multiple transform selection information, wherein the multiple transform selection information is used to set each of a horizontal transform type and a vertical transform type.
    Type: Grant
    Filed: September 30, 2022
    Date of Patent: December 26, 2023
    Assignees: Electronics and Telecommunications Research Institute, RESEARCH & BUSINESS FOUNDATION SUNGKYUNK WAN UNIVERSITY
    Inventors: Jung Won Kang, Ha Hyun Lee, Sung Chang Lim, Jin Ho Lee, Hui Yong Kim, Byeung Woo Jeon, Jee Yoon Park
  • Patent number: 11849127
    Abstract: A video decoding method, a video encoding method, and related apparatuses. The video decoding method includes: determining a current video frame; obtaining, from video frames that have been decoded, a first quantity of blocks of a first size and a second quantity of blocks of a second size in a reference frame associated with the current video frame, the first size being less than the second size; determining, according to a relationship between the first quantity and the second quantity, a target resolution used for decoding the current video frame; and decoding the current video frame by using the target resolution. In this application, the technical problem of the relatively low video encoding and decoding efficiency caused by complex processing operations in the related art is resolved.
    Type: Grant
    Filed: September 17, 2021
    Date of Patent: December 19, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xinwei Gao, Xunan Mao
  • Patent number: 11849142
    Abstract: A method and a device for encoding or decoding video data. It concerns more particularly the encoding according to a particular encoding mode using a decoder side motion vector derivation mode referenced as frame-rate up conversion mode or FRUC mode. In FRUC merge mode, the derivation process comprises a refinement step to increase the accuracy of the obtained motion vector at the sub-pixel level. This process involves the evaluation of different sub-pixel position around the obtained motion vector according to different patterns. The present invention has been devised to improve the known refinement step. It aims at improving the coding efficiency by considering the characteristics of the matching type and/or the signal inside the templates.
    Type: Grant
    Filed: June 6, 2022
    Date of Patent: December 19, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Guillaume Laroche, Patrice Onno, Jonathan Taquet, Christophe Gisquet