Pre/post Filtering Patents (Class 375/240.29)
  • Patent number: 11949919
    Abstract: In various embodiments, a tunable VMAF application reduces an amount of influence that image enhancement operations have on perceptual video quality estimates. In operation, the tunable VMAF application computes a first value for a first visual quality metric based on reconstructed video content and a first enhancement gain limit. The tunable VMAF application computes a second value for a second visual quality metric based on the reconstructed video content and a second enhancement gain limit. Subsequently, the tunable VMAF application generates a feature value vector based on the first value for the first visual quality metric and the second value for the second visual quality metric. The tunable VMAF application executes a VMAF model based on the feature value vector to generate a tuned VMAF score that accounts, at least in part, for at least one image enhancement operation used to generate the reconstructed video content.
    Type: Grant
    Filed: December 13, 2021
    Date of Patent: April 2, 2024
    Assignee: NETFLIX, INC.
    Inventor: Zhi Li
  • Patent number: 11943461
    Abstract: A method includes receiving a bit stream; determining, using the bit stream, whether an adaptive resolution management mode is enabled; determining, using the bit stream, a scaling factor including a vertical scaling constant component and a horizontal scaling constant component; and reconstructing pixel data of a current block in adaptive resolution management mode and using the determined scaling factor, the reconstructing including scaling the current block horizontally by the horizontal scaling constant component and scaling the current block vertically by the vertical scaling constant component. Related apparatus, systems, techniques and articles are also described.
    Type: Grant
    Filed: September 3, 2020
    Date of Patent: March 26, 2024
    Assignee: OP Solutions. LLC
    Inventors: Borivoje Furht, Hari Kalva, Velibor Adzic
  • Patent number: 11882314
    Abstract: Disclosed here are methods, systems, and devices for measuring visual quality degradation of digital content caused by an encoding process. There is received first data for a digital content item, which is not encoded by the encoding process, and second data for the digital content item, which is encoded by the encoding process. For a given artefact type, the first data and the second data are processed to obtain a first quality metric measuring visual quality degradation in the digital content item attributable to the given artefact type caused by the encoding process. A stored mapping corresponding to the given artefact type is applied to the first quality metric to obtain a second quality metric which measures visual quality degradation in the digital content item attributable to the given artefact type caused by the encoding process and approximates subjective assessment of the digital content item by a human visual system.
    Type: Grant
    Filed: July 11, 2022
    Date of Patent: January 23, 2024
    Assignee: MK Systems USA Inc.
    Inventor: Jean Kypreos
  • Patent number: 11863775
    Abstract: This disclosure relates to cross component methods for refining decoded transform coefficients before or after dequantization in video decoding. For example, a method for video decoding is disclosed. The method may include, comprising extracting a first transform coefficient of a first color component from a bitstream of a coded video; extracting a second transform coefficient of a second color component from the bitstream of the coded video; deriving an offset value based on a magnitude or sign value of the first transform coefficient; adding the offset value to a magnitude of the second transform coefficient to generate a modified second transform coefficient for the second color component; and reconstructing the coded video based on at least the first transform coefficient of the first color component and the modified second transform coefficient of the second color component.
    Type: Grant
    Filed: January 13, 2022
    Date of Patent: January 2, 2024
    Assignee: Tencent America LLC
    Inventors: Xin Zhao, Madhu Peringassery Krishnan, Shan Liu
  • Patent number: 11843799
    Abstract: An encoder includes circuitry and memory coupled to the circuitry. In operation, the circuitry: derives a motion vector of a current block by referring to at least one reference picture different from a picture to which the current block belongs; performs a mode for estimating, for each sub-block unit of sub-blocks obtained by splitting the current block, a surrounding region of the motion vector to correct the motion vector; determines whether to apply deblocking filtering to each of boundaries between neighboring ones of the sub-blocks; and applies the deblocking filtering to the boundary, based on a result of the determination.
    Type: Grant
    Filed: July 29, 2021
    Date of Patent: December 12, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Tadamasa Toma, Takahiro Nishi, Kiyofumi Abe, Yusuke Kato
  • Patent number: 11838508
    Abstract: A method for inverse quantization of a current block of a picture is performed by a decoder, and the picture comprises a luminance component and a chrominance component, wherein the luminance component and the chrominance component are partitioned into multiple blocks. The method includes: obtaining one or more existing quantization parameter (QP) values from a received bitstream, wherein the one or more existing QP values relate to a current block in the chrominance component; determining a QP value for the current block in the chrominance component based on the one or more existing QP values; and performing inverse quantization on the current block in the chrominance component by using the determined QP value.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: December 5, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Roman Igorevich Chernyak, Jianle Chen, Alexander Alexandrovich Karabutov, Sergey Yurievich Ikonin
  • Patent number: 11838556
    Abstract: The present technology relates to an image processing device and an image processing method which allow a deblocking filtering process to apply filtering appropriately. A pixel (p0i) of which the value is 255 (solid line) before a deblocking process changes greatly to 159 (dot line) after a conventional deblocking process. Therefore, a clipping process having a clipping value of 10 is performed in strong filtering, whereby the pixel (p0i) of which the value is 255 (solid line) before the deblocking process becomes 245 (bold line). Thus, a change in the pixel value occurring in the conventional technique can be suppressed as much as possible. This disclosure can be applied to an image processing device, for example.
    Type: Grant
    Filed: March 9, 2023
    Date of Patent: December 5, 2023
    Assignee: SONY GROUP CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11812065
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. For example, the processing circuitry generates first reconstructed samples of a block, and applies a filter to multiple color components of the first reconstructed samples of the block to determine offsets to be applied to one or more color components. Then, the processing circuitry generates second reconstructed samples of the block based on the offsets for the one or more color components and the first reconstructed samples of the block.
    Type: Grant
    Filed: March 7, 2022
    Date of Patent: November 7, 2023
    Assignee: Tencent America LLC
    Inventors: Yixin Du, Xin Zhao, Shan Liu
  • Patent number: 11805251
    Abstract: A method, computer program, and computer system is provided for video coding. Video data comprising a chroma component and a luma component is received. Luma samples are extracted from the luma component of the received video data. The chroma component is filtered based on the extracted luma samples using a cross-component adaptive loop filter (CC-ALF). Coefficients associated with the CC-ALF are constrained to be less than a sum of a bit-depth value associated with the luma samples and a positive offset value.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: October 31, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiang Li, Xin Zhao, Shan Liu, Guichun Li, Xiaozhong Xu, Yixin Du
  • Patent number: 11805249
    Abstract: A filter for video coding is provided, where the filter is configured for processing a block for generation of a filtered block, and the block comprises a plurality of pixels. The filter includes one or more processor configured to: obtain a quantization parameter (QP) of the block; obtain a threshold (THR) based on the QP; and obtain a look up table based on QP, so as to generate a filtered block based on the threshold and the look up table. The filter is provided allowing improving the efficiency for video coding.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: October 31, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sergey Yurievich Ikonin, Victor Alexeevich Stepin, Dmitry Yurievich Kuryshev, Jianle Chen, Roman Igorevich Chernyak
  • Patent number: 11792395
    Abstract: According to a disclosure of the present document, information associated with a deblocking filter for performing deblocking filtering may include chroma component filter parameter information associated with deblocking parameter offsets that are applied to a chroma component. The chroma component filter parameter information may be selectively signaled on the basis of a chroma tool offset presence flag. Therefore, an effect of increasing overall coding efficiency may be derived by signaling chroma component filter parameter information only in the case of not a monochrome color format.
    Type: Grant
    Filed: July 5, 2022
    Date of Patent: October 17, 2023
    Assignee: LG Electronics Inc.
    Inventors: Jangwon Choi, Jungah Choi, Jin Heo, Sunmi Yoo
  • Patent number: 11778177
    Abstract: A video decoder can be configured to apply a first stage adaptive loop filter (ALF) to a reconstructed sample by determining a first class index for the reconstructed sample, selecting a filter from a first set of filters based on the first class index, and applying the filter from the first set of filters to the reconstructed sample to determine a first intermediate sample value; apply a second stage ALF to the reconstructed sample by determining a second class index for the reconstructed sample; select a second filter from a second set of filters based on the second class index, applying the second filter to the reconstructed sample to determine a first sample modification value, and determining a second sample modification value based on the first intermediate sample value; and determine a filtered reconstructed sample based on the reconstructed sample and the first and second sample modification values.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: October 3, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Nan Hu, Vadim Seregin
  • Patent number: 11765348
    Abstract: A method and apparatus for processing a video signal according to the present invention derives a first prediction value of a chrominance block using a sample of a luminance block, calculates a compensation parameter based on a predetermined reference area, derives a second prediction value of a chrominance block, and reconstructs a chrominance block based on a second prediction value of a chrominance block.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: September 19, 2023
    Assignee: KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
    Inventors: Dong Gyu Sim, Sea Nae Park
  • Patent number: 11711517
    Abstract: The present disclosure provides systems and methods for processing video content. The method can include: receiving data representing a first block and a second block in a picture, the data comprising a plurality of chroma samples associated with the first block and a plurality of luma samples associated with the second block; determining an average value of the plurality of luma samples associated with the second block; determining a chroma scaling factor for the first block based on the average value; and processing the plurality of chroma samples associated with the first block using the chroma scaling factor.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: July 25, 2023
    Assignee: ALIBABA GROUP HOLDING LIMITED
    Inventors: Yan Ye, Jie Chen, Ru-Ling Liao
  • Patent number: 11706452
    Abstract: An image decoding device (31) includes a transform coefficient decoding unit (311) configured to decode a transform coefficient for a transform tree included in a coding unit. In the transform tree, the transform coefficient decoding unit splits a transform unit corresponding to luminance and then decodes the transform coefficient related to the luminance, and does not split the transform unit corresponding to chrominance and decodes the transform coefficient related to the chrominance.
    Type: Grant
    Filed: November 8, 2021
    Date of Patent: July 18, 2023
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tomohiro Ikai, Tomoko Aono, Yukinobu Yasugi, Tomonori Hashimoto
  • Patent number: 11706431
    Abstract: A method of decoding may comprise: receiving a bitstream comprising compressed video/image data; parsing or deriving, from the bitstream, an output layer set mode indicator in a video parameter set (VPS); identifying output layer set signaling based on the output layer set mode indicator; identifying one or more picture output layers based on the identified output layer set signaling; and decoding the identified one or more picture output layers.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: July 18, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger
  • Patent number: 11670035
    Abstract: Apparatus and method for non-local means filtering using a media processing block of a graphics processor. For example, one embodiment of a processor comprises: ray tracing circuitry to execute a first set of one or more commands to traverse rays through a bounding volume hierarchy (BVH) to identify BVH nodes and/or primitives intersected by the ray; shader execution circuitry to execute one or more shaders responsive to a second set of one or more commands to render a sequence of image frames based on the BVH nodes and/or primitives intersected by the ray; and a media processor comprising motion estimation circuitry to execute a third set of one or more commands to perform non-local means filtering to remove noise from the sequence of image frames based on a mean pixel value collected across the sequence of image frames.
    Type: Grant
    Filed: March 15, 2020
    Date of Patent: June 6, 2023
    Assignee: Intel Corporation
    Inventors: Attila Tamas Afra, Johannes Guenther
  • Patent number: 11652998
    Abstract: An example method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, that one or more samples of the video outside the current block are unavailable for a coding process of the conversion. The coding process comprises an adaptive loop filter (ALF) coding process. The method also includes performing, based on the determining, the conversion by using padded samples for the one or more samples of the video. The padded samples are generated by checking for availability of samples in an order.
    Type: Grant
    Filed: March 22, 2022
    Date of Patent: May 16, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Yue Wang
  • Patent number: 11652996
    Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that determines an offset of a quantization parameter for a chroma component of a coding region based on one of (i) a pixel value range of the chroma component, (ii) a complexity level of the chroma component, or (iii) a noise level of the chroma component. The processing circuitry performs a quantization process on a transform coefficient of the coding region based on the quantization parameter and the determined offset. The processing circuitry generates a video bitstream that includes the quantized transform coefficient.
    Type: Grant
    Filed: October 6, 2021
    Date of Patent: May 16, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Guichun Li, Xiang Li, Shan Liu
  • Patent number: 11647231
    Abstract: The present technology relates to an image processing device and an image processing method which allow a deblocking filtering process to apply filtering appropriately. A pixel (p0i) of which the value is 255 (solid line) before a deblocking process changes greatly to 159 (dot line) after a conventional deblocking process. Therefore, a clipping process having a clipping value of 10 is performed in strong filtering, whereby the pixel (p0i) of which the value is 255 (solid line) before the deblocking process becomes 245 (bold line). THUS, a change in the pixel value occurring in the conventional technique can be suppressed as much as possible. This disclosure can be applied to an image processing device, for example.
    Type: Grant
    Filed: May 19, 2021
    Date of Patent: May 9, 2023
    Assignee: SONY GROUP CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11575919
    Abstract: Provided are an image encoding/decoding method and device. The image decoding method performed by the image decoding device, according to the present disclosure, may comprise the steps of: determining a residual sample of a current block; and resetting the value of the residual sample on the basis of whether a color space transform is applied. The step for resetting the value of the residual block may be performed on the basis of a half value of a chroma residual sample value.
    Type: Grant
    Filed: May 19, 2022
    Date of Patent: February 7, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Jie Zhao, Seung Hwan Kim, Mehdi Salehifar
  • Patent number: 11570432
    Abstract: A decoder includes a memory and processing circuitry. The processing circuitry, in operation, changes values of pixels in a first block and a second block to filter a boundary therebetween, using clipping such that change amounts of the respective values are within respective clip widths. The clip widths for the pixels in the first block and the second block are selected based on block sizes of the first block and the second block. The pixels in the first block include a first pixel located at a first position, and the pixels in the second block include a second pixel located at a second position corresponding to the first position with respect to the boundary. The clip widths include a first clip width and a second clip width corresponding to the first pixel and the second pixel, respectively, and the first clip width is different from the second width.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: January 31, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Ryuichi Kanoh, Takahiro Nishi, Tadamasa Toma
  • Patent number: 11563974
    Abstract: This application relates to a method and apparatus, a storage medium, and a computer device for video encoding and decoding. The video encoding method includes: determining a sub-pixel interpolation mode, the sub-pixel interpolation mode comprising one of a direct sub-pixel interpolation mode or a sampled sub-pixel interpolation mode; acquiring motion estimation pixel precision corresponding to a current video frame; performing sub-pixel interpolation processing on a reference frame corresponding to the current video frame according to a resolution relationship between the current video frame and the reference frame, the motion estimation pixel precision, and the sub-pixel interpolation mode, to obtain a target reference frame; and encoding the current video frame according to the target reference frame, to obtain encoded data corresponding to the current video frame.
    Type: Grant
    Filed: July 23, 2021
    Date of Patent: January 24, 2023
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xinwei Gao, Xunan Mao, Chenchen Gu
  • Patent number: 11558644
    Abstract: Devices, systems and methods for digital video coding, which includes: determining whether a sample is located at sub-block transform boundaries in case that a sub-block transform is applied; applying deblocking filter process if it is determined that the sample is located at sub-block transform boundaries; and performing a conversion between the video and a bitstream representation of the video.
    Type: Grant
    Filed: July 7, 2021
    Date of Patent: January 17, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11553178
    Abstract: A method for analyzing an image for anomaly detection includes obtaining a first image. The method also includes generating a second image by auto-encoding the first image. The method additionally includes extracting first and second feature vectors from the first and second images, respectively. The method further includes filtering each of the first and second feature vectors by using a filtering vector generated based on first distance values between first respective elements of the first and second feature vectors. Additionally, the method includes determining whether there is an anomaly in the first image based on second distance values between second respective elements of the filtered first and second feature vectors.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: January 10, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jaeil Jung, Junik Jang, Jonghee Hong
  • Patent number: 11463701
    Abstract: A prediction image generation method is provided. The method derives a down-sampled luminance image and a down-sampled neighboring luminance image by down-sampling the luminance image of a target block and a neighboring luminance image based on information related to a down-sampling and indicating one of a plurality of position relationships between at least one luma pixel and a chroma pixel. The method derives a neighboring chrominance image, parameters derived from the down-sampled neighboring luminance image and the neighboring chrominance image, and the prediction image by using the down-sampled luminance image and the parameters. The position relationships include that a position of the chroma pixel is identical to a position of one of the at least one luma pixel and that the position of the chroma pixel is located in an intermediate of two of the at least one luma pixel on a left side of a 2×2 luma pixel block.
    Type: Grant
    Filed: May 20, 2021
    Date of Patent: October 4, 2022
    Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company Limited
    Inventors: Tomoko Aono, Tomohiro Ikai, Takeshi Chujoh
  • Patent number: 11451834
    Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry decodes coded information of a chroma coding block (CB) from a coded video bitstream. The coded information indicates that a cross-component filter is applied to the chroma CB and indicates a chroma subsampling format and a chroma sample type. The processing circuitry determines a filter shape of the cross-component filter based on at least one of the chroma subsampling format and the chroma sample type. The processing circuitry generates a first intermediate CB by applying a loop filter to the chroma CB and generates a second intermediate CB by applying the cross-component filter having the determined filter shape to the corresponding luma CB. The processing circuitry determines a filtered chroma CB based on the first intermediate CB and the second intermediate CB.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: September 20, 2022
    Assignee: Tencent America LLC
    Inventors: Xiang Li, Xin Zhao, Yixin Du, Liang Zhao, Shan Liu
  • Patent number: 11425388
    Abstract: Video processing methods and apparatuses include receiving input data associated with a current picture composed of multiple Coding Tree Units (CTUs) for encoding or decoding, partitioning the current picture into one or more slices including raster scan slices or rectangular slices, and for each slice in the current picture, encoding or decoding each slice by always processing CTUs within each slice in a raster scan order. Each slice includes an integer number of complete CTUs in the current picture that are exclusively contained in a single Network Access Layer (NAL) unit. Tile partition and tile concept may be removed to reduce the coding complexity of video processing.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: August 23, 2022
    Assignee: MEDIATEK INC.
    Inventors: Yu-Wen Huang, Lulin Chen, Chih-Wei Hsu
  • Patent number: 11375186
    Abstract: An encoder includes processing circuitry and a memory coupled to the processing circuitry. Using the memory, the processing circuitry is configured to: change values of pixels in a first block and a second block to filter a boundary between the first block and the second block, using clipping such that change amounts of the respective values do not exceed respective thresholds, the pixels in the first block and the second block being arranged along a line across the boundary. The pixels include type one pixels and type two pixels different from the type one pixels. The respective thresholds for the type one pixels in the first block and the second block are selected to be symmetrical or asymmetrical with respect to the boundary based on block sizes of the first block and the second block.
    Type: Grant
    Filed: October 4, 2019
    Date of Patent: June 28, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Ryuichi Kanoh, Takahiro Nishi, Tadamasa Toma
  • Patent number: 11356662
    Abstract: Systems, methods, and computer-readable media are provided for simplification of clipping value calculations for adaptive loop filtering. An example method can include obtaining video data including one or more pictures; obtaining a block of a picture from the one or more pictures; determining clipping values for a filter, the clipping values corresponding to a luma component in the picture and/or a chroma component in the picture, wherein each clipping value is determined by left shifting a first integer by a second integer, the second integer including a result of a bit depth value for a sample from the picture minus an offset value associated with a clipping index value; and applying the filter to the block.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: June 7, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Nan Hu, Vadim Seregin, Marta Karczewicz
  • Patent number: 11343494
    Abstract: A decoder for decoding a block of a current frame of a video from a bitstream and a corresponding encoder are provided. The decoder comprises a reference sample selection unit configured to select reference samples of a reconstructed part of the current frame, a filter unit configured to filter the reference samples, and a block generation unit configured to generate a prediction of the block based on the filtered reference samples, wherein the filter unit comprises a sharpening filter and/or a de-ringing filter.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: May 24, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventor: Sergey Yurievich Ikonin
  • Patent number: 11317122
    Abstract: The present disclosure provides systems and methods for processing video content using motion compensation interpolation. The methods include: in response to a target picture and a reference picture having different resolutions, applying a band-pass filter to the reference picture, to perform a motion compensated interpolation with reference down-sampling to generate a reference block; and encoding or decoding a block of the target picture using the reference block.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: April 26, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Jiancong Luo, Yan Ye, Mohammed Golam Sarwer
  • Patent number: 11317091
    Abstract: A method for deblocking a chroma block edge between a first chroma block of a first image block and a second chroma block of a second image block. The method includes a decision process which includes: determining a first chroma quantization parameter for the first chroma block based on a first luma quantization parameter of a first luma block of the first image block and a chroma QP mapping table for the first chroma block; determining a second chroma quantization parameter for the second chroma block based on a second luma quantization parameter of a second luma block of the second image block and a chroma QP mapping table for the second chroma block; determining an averaged and rounded chroma quantization parameter based on the first chroma quantization parameter and the second chroma quantization parameter; and determining a threshold parameter based on the averaged and rounded chroma quantization parameter.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: April 26, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Elena Alexandrovna Alshina, Semih Esenlik, Biao Wang, Han Gao, Roman Igorevich Chernyak
  • Patent number: 11317105
    Abstract: A method, apparatus, article of manufacture, and a memory structure for signaling extension functions used in decoding a sequence comprising a plurality of pictures, each picture processed at least in part according to a picture parameter set is disclosed. In one embodiment, the method comprises reading a first extension flag signaling a first extension function in the processing of the sequence and determining if the first extension flag has a first value. Further, the method reads a second extension flag signaling a second extension function in the processing of the sequence and performs the second extension function according to the read second extension flag only if the first extension flag has a first value.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: April 26, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11303936
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. For example, the processing circuitry generates first reconstructed samples of a block, and applies a filter to multiple color components of the first reconstructed samples of the block to determine offsets to be applied to one or more color components. Then, the processing circuitry generates second reconstructed samples of the block based on the offsets for the one or more color components and the first reconstructed samples of the block.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: April 12, 2022
    Assignee: Tencent America LLC
    Inventors: Yixin Du, Xin Zhao, Shan Liu
  • Patent number: 11277645
    Abstract: A method for adaptive loop filtering of a reconstructed picture in a video encoder is provided that includes determining whether or not sample adaptive offset (SAO) filtering is applied to the reconstructed picture, and using adaptive loop filtering with no offset for the reconstructed picture when the SAO filtering is determined to be applied to the reconstructed picture.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: March 15, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Madhukar Budagavi, Minhua Zhou
  • Patent number: 11272177
    Abstract: A method and device for encoding an image divided into blocks. The image contains two separate zones. The method implements the following: only in the event where the current block pertains to one of the zones of the image: encoding the current block using a prediction, the current block being predicted using a previously encoded and then decoded block located in the other zone of the image, the blocks of the other zone having been previously encoded and then decoded, and encoding information indicating the application of the prediction; and for any decoded block pertaining to the other zone of the image, storing the decoded block data.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: March 8, 2022
    Assignee: ORANGE
    Inventors: Felix Henry, Joel Jung, Bappaditya Ray
  • Patent number: 11265539
    Abstract: There is provided an encoding apparatus, an encoding method, a decoding apparatus, and a decoding method that make it possible to improve the performance of a filter process. The encoding apparatus and the decoding apparatus perform classification of classifying, according to a reliability degree determined according to a frequency distribution of inclination directions indicating directions of inclination of pixel values of a plurality of pixels in a frequency distribution generation region including a pixel of interest of a decoded image, the pixel of interest into any of a plurality of classes, and performs a filter process of applying, to the decoded image, a prediction formula for performing product sum calculation of tap coefficients of the class of the pixel of interest obtained by the classification and pixels of the decoded image. The present technology can be applied, for example, to a case in which encoding and decoding of an image are performed.
    Type: Grant
    Filed: May 7, 2019
    Date of Patent: March 1, 2022
    Assignee: SONY CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11228776
    Abstract: A method of decoding may comprise: receiving a bitstream comprising compressed video/image data; parsing or deriving, from the bitstream, an output layer set mode indicator in a video parameter set (VPS); identifying output layer set signaling based on the output layer set mode indicator; identifying one or more picture output layers based on the identified output layer set signaling; and decoding the identified one or more picture output layers.
    Type: Grant
    Filed: August 21, 2020
    Date of Patent: January 18, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger
  • Patent number: 11212438
    Abstract: An example method includes, receiving an encoded picture of 360-degree video data, the encoded picture of 360-degree video data being arranged in packed faces obtained from a projection of a sphere of the 360-degree video data; decoding the picture of encoded 360-degree video data to obtain a reconstructed picture of 360-degree video data, the reconstructed picture of 360-degree video data being arranged in the packed faces; padding the reconstructed picture of 360-degree video data to generate a padded reconstructed picture of 360-degree video data; in-loop filtering the padded reconstructed picture of 360-degree video data to generate a padded and filtered reconstructed picture of 360-degree video data; and storing the padded and filtered reconstructed picture of 360-degree video data in a reference picture memory for use in predicting subsequent pictures of 360-degree video data.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: December 28, 2021
    Assignee: Qualcomm Incorporated
    Inventors: Geert Van der Auwera, Muhammed Zeyd Coban, Fnu Hendry, Marta Karczewicz
  • Patent number: 11206429
    Abstract: An image decoding device (31) includes a transform coefficient decoding unit (311) configured to decode a transform coefficient for a transform tree included in a coding unit. In the transform tree, the transform coefficient decoding unit splits a transform unit corresponding to luminance and then decodes the transform coefficient related to the luminance, and does not split the transform unit corresponding to chrominance and decodes the transform coefficient related to the chrominance.
    Type: Grant
    Filed: January 19, 2021
    Date of Patent: December 21, 2021
    Assignees: SHARP KABUSHIKI KAISHA, FG INNOVATION COMPANY LIMITED
    Inventors: Tomohiro Ikai, Tomoko Aono, Yukinobu Yasugi, Tomonori Hashimoto
  • Patent number: 11202103
    Abstract: In various embodiments, a tunable VMAF application reduces an amount of influence that image enhancement operations have on perceptual video quality estimates. In operation, the tunable VMAF application computes a first value for a first visual quality metric based on reconstructed video content and a first enhancement gain limit. The tunable VMAF application computes a second value for a second visual quality metric based on the reconstructed video content and a second enhancement gain limit. Subsequently, the tunable VMAF application generates a feature value vector based on the first value for the first visual quality metric and the second value for the second visual quality metric. The tunable VMAF application executes a VMAF model based on the feature value vector to generate a tuned VMAF score that accounts, at least in part, for at least one image enhancement operation used to generate the reconstructed video content.
    Type: Grant
    Filed: January 25, 2021
    Date of Patent: December 14, 2021
    Assignee: NETFLIX, INC.
    Inventor: Zhi Li
  • Patent number: 11172234
    Abstract: The present invention relates to a deblocking filtering method, a method for inducing bs (boundary strength) therefor, and a method and an apparatus for encoding/decoding using the same. The method for inducing the bS of the present invention comprises the steps of: inducing a boundary of a deblocking filtering unit block as a unit block for applying the deblocking filtering; and setting the bS according to each bS setting unit block within the deblocking filtering unit block, wherein the bS setting step can set a bS value for a target boundary corresponding to a boundary of the deblocking filtering unit block as the bs setting unit block.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: November 9, 2021
    Assignee: LG Electronics Inc.
    Inventors: Seungwook Park, Jaehyun Lim, Yongjoon Jeon, Chulkeun Kim, Jungsun Kim, Naeri Park, Hendry Hendry, Byeongmoon Jeon, Joonyoung Park
  • Patent number: 11170481
    Abstract: A digital filter for filtering signals includes a processer and a memory. The processer receives a plurality of input signal values and a plurality of input aggregated values corresponding to the plurality of input signal values. The memory saves a signal value set and a statistical information set. The processer generates a check result according to the plurality of input signal values and the signal value set. The processer updates the statistical information set of the memory according to the check result, and decides whether to insert at least one new signal value into the signal value set of the memory, wherein the processer generates an output value according to the signal value set and the statistical information set of the memory.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: November 9, 2021
    Assignee: Etron Technology, Inc.
    Inventors: Chi-Feng Lee, Sih-Sian Wu, Liang-Gee Chen
  • Patent number: 11172198
    Abstract: An encoder includes processing circuitry and a memory coupled to the processing circuitry. The processing circuitry is configured to: select a first filter for a first block based at least on a block size of the first block, the first filter including a first set of filter coefficients; select a second filter for a second block based at least on a block size of the second block, the second filter including a second set of filter coefficients; and change values of pixels in the first block and the second block to filter a boundary between the first block and the second block. The first set of filter coefficients applied in the first block and the second set of filter coefficients applied in the second block are selected to be asymmetrical with respect to the boundary based on the block size of the first block and the second block.
    Type: Grant
    Filed: October 2, 2019
    Date of Patent: November 9, 2021
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Ryuichi Kanoh, Takahiro Nishi, Tadamasa Toma
  • Patent number: 11172216
    Abstract: A video processing method is provided to include performing a conversion between a coded representation of a video comprising one or more video regions and the video, wherein the coded representation includes side information applicable for in-loop reshaping (ILR) of some of the one or more video regions, wherein the side information provides parameters for a reconstruction of a video unit of a video region based on a representation of the video unit in a first domain and a second domain and/or scaling chroma residue of a chroma video unit, and wherein the side information for a current video region is determined according to a rule that disallows inheritance or prediction of the side information based on a temporal layer index of the current video region.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: November 9, 2021
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11159790
    Abstract: The present disclosure provides methods, apparatuses and systems for transcoding a video. One exemplary method for transcoding a video includes: receiving a model file issued by a machine learning framework; converting the model file to a file identifiable by a filter; setting one or more filtering parameters according to the file; and processing the video based on the filtering parameters. According to the embodiments of the present disclosure, no extra storage will be consumed in the process of video transcoding, and system resource consumption can be reduced without adding any extra system deployment costs.
    Type: Grant
    Filed: September 24, 2018
    Date of Patent: October 26, 2021
    Assignee: ALIBABA GROUP HOLDING LIMITED
    Inventors: Haohui Xu, Dawei Mei, Chang Zhou
  • Patent number: 11153594
    Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: October 19, 2021
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Yeping Su, David Singer, Hsi-Jung Wu
  • Patent number: 11128888
    Abstract: This application relates to a method and apparatus, a storage medium, and a computer device for video encoding and decoding. The video encoding method includes: acquiring a reference frame corresponding to a current frame to be encoded from a video input; determining a sub-pixel interpolation mode, the sub-pixel interpolation mode comprising one of a direct sub-pixel interpolation mode or a sampled sub-pixel interpolation mode; processing the reference frame according to resolution information of the current frame using an interpolation in the sub-pixel interpolation mode, to obtain a corresponding target reference frame; and encoding the current frame according to the target reference frame, to obtain encoded data corresponding to the current frame. By using the foregoing video encoding method, a reference frame corresponding to a current frame to be encoded can be flexibly selected, thereby effectively improving the utilization efficiency of reference frames.
    Type: Grant
    Filed: August 12, 2020
    Date of Patent: September 21, 2021
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xinwei Gao, Xunan Mao, Chenchen Gu
  • Patent number: 11115659
    Abstract: An image signal decoding method according to the present invention comprises the steps of: decoding information indicating whether a current block is encoded using a multi-mode intra prediction; when it is determined that the current block is encoded in the multi-mode intra prediction, dividing the current block into a plurality of partial blocks; and obtaining an intra prediction mode of each of the plurality of partial blocks.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: September 7, 2021
    Assignee: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Joo Hee Moon, Sung Won Lim, Dong Jae Won