Pre/post Filtering Patents (Class 375/240.29)
  • Patent number: 11563974
    Abstract: This application relates to a method and apparatus, a storage medium, and a computer device for video encoding and decoding. The video encoding method includes: determining a sub-pixel interpolation mode, the sub-pixel interpolation mode comprising one of a direct sub-pixel interpolation mode or a sampled sub-pixel interpolation mode; acquiring motion estimation pixel precision corresponding to a current video frame; performing sub-pixel interpolation processing on a reference frame corresponding to the current video frame according to a resolution relationship between the current video frame and the reference frame, the motion estimation pixel precision, and the sub-pixel interpolation mode, to obtain a target reference frame; and encoding the current video frame according to the target reference frame, to obtain encoded data corresponding to the current video frame.
    Type: Grant
    Filed: July 23, 2021
    Date of Patent: January 24, 2023
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xinwei Gao, Xunan Mao, Chenchen Gu
  • Patent number: 11558644
    Abstract: Devices, systems and methods for digital video coding, which includes: determining whether a sample is located at sub-block transform boundaries in case that a sub-block transform is applied; applying deblocking filter process if it is determined that the sample is located at sub-block transform boundaries; and performing a conversion between the video and a bitstream representation of the video.
    Type: Grant
    Filed: July 7, 2021
    Date of Patent: January 17, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11553178
    Abstract: A method for analyzing an image for anomaly detection includes obtaining a first image. The method also includes generating a second image by auto-encoding the first image. The method additionally includes extracting first and second feature vectors from the first and second images, respectively. The method further includes filtering each of the first and second feature vectors by using a filtering vector generated based on first distance values between first respective elements of the first and second feature vectors. Additionally, the method includes determining whether there is an anomaly in the first image based on second distance values between second respective elements of the filtered first and second feature vectors.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: January 10, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jaeil Jung, Junik Jang, Jonghee Hong
  • Patent number: 11463701
    Abstract: A prediction image generation method is provided. The method derives a down-sampled luminance image and a down-sampled neighboring luminance image by down-sampling the luminance image of a target block and a neighboring luminance image based on information related to a down-sampling and indicating one of a plurality of position relationships between at least one luma pixel and a chroma pixel. The method derives a neighboring chrominance image, parameters derived from the down-sampled neighboring luminance image and the neighboring chrominance image, and the prediction image by using the down-sampled luminance image and the parameters. The position relationships include that a position of the chroma pixel is identical to a position of one of the at least one luma pixel and that the position of the chroma pixel is located in an intermediate of two of the at least one luma pixel on a left side of a 2×2 luma pixel block.
    Type: Grant
    Filed: May 20, 2021
    Date of Patent: October 4, 2022
    Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company Limited
    Inventors: Tomoko Aono, Tomohiro Ikai, Takeshi Chujoh
  • Patent number: 11451834
    Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry decodes coded information of a chroma coding block (CB) from a coded video bitstream. The coded information indicates that a cross-component filter is applied to the chroma CB and indicates a chroma subsampling format and a chroma sample type. The processing circuitry determines a filter shape of the cross-component filter based on at least one of the chroma subsampling format and the chroma sample type. The processing circuitry generates a first intermediate CB by applying a loop filter to the chroma CB and generates a second intermediate CB by applying the cross-component filter having the determined filter shape to the corresponding luma CB. The processing circuitry determines a filtered chroma CB based on the first intermediate CB and the second intermediate CB.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: September 20, 2022
    Assignee: Tencent America LLC
    Inventors: Xiang Li, Xin Zhao, Yixin Du, Liang Zhao, Shan Liu
  • Patent number: 11425388
    Abstract: Video processing methods and apparatuses include receiving input data associated with a current picture composed of multiple Coding Tree Units (CTUs) for encoding or decoding, partitioning the current picture into one or more slices including raster scan slices or rectangular slices, and for each slice in the current picture, encoding or decoding each slice by always processing CTUs within each slice in a raster scan order. Each slice includes an integer number of complete CTUs in the current picture that are exclusively contained in a single Network Access Layer (NAL) unit. Tile partition and tile concept may be removed to reduce the coding complexity of video processing.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: August 23, 2022
    Assignee: MEDIATEK INC.
    Inventors: Yu-Wen Huang, Lulin Chen, Chih-Wei Hsu
  • Patent number: 11375186
    Abstract: An encoder includes processing circuitry and a memory coupled to the processing circuitry. Using the memory, the processing circuitry is configured to: change values of pixels in a first block and a second block to filter a boundary between the first block and the second block, using clipping such that change amounts of the respective values do not exceed respective thresholds, the pixels in the first block and the second block being arranged along a line across the boundary. The pixels include type one pixels and type two pixels different from the type one pixels. The respective thresholds for the type one pixels in the first block and the second block are selected to be symmetrical or asymmetrical with respect to the boundary based on block sizes of the first block and the second block.
    Type: Grant
    Filed: October 4, 2019
    Date of Patent: June 28, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Ryuichi Kanoh, Takahiro Nishi, Tadamasa Toma
  • Patent number: 11356662
    Abstract: Systems, methods, and computer-readable media are provided for simplification of clipping value calculations for adaptive loop filtering. An example method can include obtaining video data including one or more pictures; obtaining a block of a picture from the one or more pictures; determining clipping values for a filter, the clipping values corresponding to a luma component in the picture and/or a chroma component in the picture, wherein each clipping value is determined by left shifting a first integer by a second integer, the second integer including a result of a bit depth value for a sample from the picture minus an offset value associated with a clipping index value; and applying the filter to the block.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: June 7, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Nan Hu, Vadim Seregin, Marta Karczewicz
  • Patent number: 11343494
    Abstract: A decoder for decoding a block of a current frame of a video from a bitstream and a corresponding encoder are provided. The decoder comprises a reference sample selection unit configured to select reference samples of a reconstructed part of the current frame, a filter unit configured to filter the reference samples, and a block generation unit configured to generate a prediction of the block based on the filtered reference samples, wherein the filter unit comprises a sharpening filter and/or a de-ringing filter.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: May 24, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventor: Sergey Yurievich Ikonin
  • Patent number: 11317122
    Abstract: The present disclosure provides systems and methods for processing video content using motion compensation interpolation. The methods include: in response to a target picture and a reference picture having different resolutions, applying a band-pass filter to the reference picture, to perform a motion compensated interpolation with reference down-sampling to generate a reference block; and encoding or decoding a block of the target picture using the reference block.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: April 26, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Jiancong Luo, Yan Ye, Mohammed Golam Sarwer
  • Patent number: 11317091
    Abstract: A method for deblocking a chroma block edge between a first chroma block of a first image block and a second chroma block of a second image block. The method includes a decision process which includes: determining a first chroma quantization parameter for the first chroma block based on a first luma quantization parameter of a first luma block of the first image block and a chroma QP mapping table for the first chroma block; determining a second chroma quantization parameter for the second chroma block based on a second luma quantization parameter of a second luma block of the second image block and a chroma QP mapping table for the second chroma block; determining an averaged and rounded chroma quantization parameter based on the first chroma quantization parameter and the second chroma quantization parameter; and determining a threshold parameter based on the averaged and rounded chroma quantization parameter.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: April 26, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Anand Meher Kotra, Elena Alexandrovna Alshina, Semih Esenlik, Biao Wang, Han Gao, Roman Igorevich Chernyak
  • Patent number: 11317105
    Abstract: A method, apparatus, article of manufacture, and a memory structure for signaling extension functions used in decoding a sequence comprising a plurality of pictures, each picture processed at least in part according to a picture parameter set is disclosed. In one embodiment, the method comprises reading a first extension flag signaling a first extension function in the processing of the sequence and determining if the first extension flag has a first value. Further, the method reads a second extension flag signaling a second extension function in the processing of the sequence and performs the second extension function according to the read second extension flag only if the first extension flag has a first value.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: April 26, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11303936
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. For example, the processing circuitry generates first reconstructed samples of a block, and applies a filter to multiple color components of the first reconstructed samples of the block to determine offsets to be applied to one or more color components. Then, the processing circuitry generates second reconstructed samples of the block based on the offsets for the one or more color components and the first reconstructed samples of the block.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: April 12, 2022
    Assignee: Tencent America LLC
    Inventors: Yixin Du, Xin Zhao, Shan Liu
  • Patent number: 11277645
    Abstract: A method for adaptive loop filtering of a reconstructed picture in a video encoder is provided that includes determining whether or not sample adaptive offset (SAO) filtering is applied to the reconstructed picture, and using adaptive loop filtering with no offset for the reconstructed picture when the SAO filtering is determined to be applied to the reconstructed picture.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: March 15, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Madhukar Budagavi, Minhua Zhou
  • Patent number: 11272177
    Abstract: A method and device for encoding an image divided into blocks. The image contains two separate zones. The method implements the following: only in the event where the current block pertains to one of the zones of the image: encoding the current block using a prediction, the current block being predicted using a previously encoded and then decoded block located in the other zone of the image, the blocks of the other zone having been previously encoded and then decoded, and encoding information indicating the application of the prediction; and for any decoded block pertaining to the other zone of the image, storing the decoded block data.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: March 8, 2022
    Assignee: ORANGE
    Inventors: Felix Henry, Joel Jung, Bappaditya Ray
  • Patent number: 11265539
    Abstract: There is provided an encoding apparatus, an encoding method, a decoding apparatus, and a decoding method that make it possible to improve the performance of a filter process. The encoding apparatus and the decoding apparatus perform classification of classifying, according to a reliability degree determined according to a frequency distribution of inclination directions indicating directions of inclination of pixel values of a plurality of pixels in a frequency distribution generation region including a pixel of interest of a decoded image, the pixel of interest into any of a plurality of classes, and performs a filter process of applying, to the decoded image, a prediction formula for performing product sum calculation of tap coefficients of the class of the pixel of interest obtained by the classification and pixels of the decoded image. The present technology can be applied, for example, to a case in which encoding and decoding of an image are performed.
    Type: Grant
    Filed: May 7, 2019
    Date of Patent: March 1, 2022
    Assignee: SONY CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11228776
    Abstract: A method of decoding may comprise: receiving a bitstream comprising compressed video/image data; parsing or deriving, from the bitstream, an output layer set mode indicator in a video parameter set (VPS); identifying output layer set signaling based on the output layer set mode indicator; identifying one or more picture output layers based on the identified output layer set signaling; and decoding the identified one or more picture output layers.
    Type: Grant
    Filed: August 21, 2020
    Date of Patent: January 18, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger
  • Patent number: 11212438
    Abstract: An example method includes, receiving an encoded picture of 360-degree video data, the encoded picture of 360-degree video data being arranged in packed faces obtained from a projection of a sphere of the 360-degree video data; decoding the picture of encoded 360-degree video data to obtain a reconstructed picture of 360-degree video data, the reconstructed picture of 360-degree video data being arranged in the packed faces; padding the reconstructed picture of 360-degree video data to generate a padded reconstructed picture of 360-degree video data; in-loop filtering the padded reconstructed picture of 360-degree video data to generate a padded and filtered reconstructed picture of 360-degree video data; and storing the padded and filtered reconstructed picture of 360-degree video data in a reference picture memory for use in predicting subsequent pictures of 360-degree video data.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: December 28, 2021
    Assignee: Qualcomm Incorporated
    Inventors: Geert Van der Auwera, Muhammed Zeyd Coban, Fnu Hendry, Marta Karczewicz
  • Patent number: 11206429
    Abstract: An image decoding device (31) includes a transform coefficient decoding unit (311) configured to decode a transform coefficient for a transform tree included in a coding unit. In the transform tree, the transform coefficient decoding unit splits a transform unit corresponding to luminance and then decodes the transform coefficient related to the luminance, and does not split the transform unit corresponding to chrominance and decodes the transform coefficient related to the chrominance.
    Type: Grant
    Filed: January 19, 2021
    Date of Patent: December 21, 2021
    Assignees: SHARP KABUSHIKI KAISHA, FG INNOVATION COMPANY LIMITED
    Inventors: Tomohiro Ikai, Tomoko Aono, Yukinobu Yasugi, Tomonori Hashimoto
  • Patent number: 11202103
    Abstract: In various embodiments, a tunable VMAF application reduces an amount of influence that image enhancement operations have on perceptual video quality estimates. In operation, the tunable VMAF application computes a first value for a first visual quality metric based on reconstructed video content and a first enhancement gain limit. The tunable VMAF application computes a second value for a second visual quality metric based on the reconstructed video content and a second enhancement gain limit. Subsequently, the tunable VMAF application generates a feature value vector based on the first value for the first visual quality metric and the second value for the second visual quality metric. The tunable VMAF application executes a VMAF model based on the feature value vector to generate a tuned VMAF score that accounts, at least in part, for at least one image enhancement operation used to generate the reconstructed video content.
    Type: Grant
    Filed: January 25, 2021
    Date of Patent: December 14, 2021
    Assignee: NETFLIX, INC.
    Inventor: Zhi Li
  • Patent number: 11172234
    Abstract: The present invention relates to a deblocking filtering method, a method for inducing bs (boundary strength) therefor, and a method and an apparatus for encoding/decoding using the same. The method for inducing the bS of the present invention comprises the steps of: inducing a boundary of a deblocking filtering unit block as a unit block for applying the deblocking filtering; and setting the bS according to each bS setting unit block within the deblocking filtering unit block, wherein the bS setting step can set a bS value for a target boundary corresponding to a boundary of the deblocking filtering unit block as the bs setting unit block.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: November 9, 2021
    Assignee: LG Electronics Inc.
    Inventors: Seungwook Park, Jaehyun Lim, Yongjoon Jeon, Chulkeun Kim, Jungsun Kim, Naeri Park, Hendry Hendry, Byeongmoon Jeon, Joonyoung Park
  • Patent number: 11172198
    Abstract: An encoder includes processing circuitry and a memory coupled to the processing circuitry. The processing circuitry is configured to: select a first filter for a first block based at least on a block size of the first block, the first filter including a first set of filter coefficients; select a second filter for a second block based at least on a block size of the second block, the second filter including a second set of filter coefficients; and change values of pixels in the first block and the second block to filter a boundary between the first block and the second block. The first set of filter coefficients applied in the first block and the second set of filter coefficients applied in the second block are selected to be asymmetrical with respect to the boundary based on the block size of the first block and the second block.
    Type: Grant
    Filed: October 2, 2019
    Date of Patent: November 9, 2021
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Ryuichi Kanoh, Takahiro Nishi, Tadamasa Toma
  • Patent number: 11170481
    Abstract: A digital filter for filtering signals includes a processer and a memory. The processer receives a plurality of input signal values and a plurality of input aggregated values corresponding to the plurality of input signal values. The memory saves a signal value set and a statistical information set. The processer generates a check result according to the plurality of input signal values and the signal value set. The processer updates the statistical information set of the memory according to the check result, and decides whether to insert at least one new signal value into the signal value set of the memory, wherein the processer generates an output value according to the signal value set and the statistical information set of the memory.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: November 9, 2021
    Assignee: Etron Technology, Inc.
    Inventors: Chi-Feng Lee, Sih-Sian Wu, Liang-Gee Chen
  • Patent number: 11172216
    Abstract: A video processing method is provided to include performing a conversion between a coded representation of a video comprising one or more video regions and the video, wherein the coded representation includes side information applicable for in-loop reshaping (ILR) of some of the one or more video regions, wherein the side information provides parameters for a reconstruction of a video unit of a video region based on a representation of the video unit in a first domain and a second domain and/or scaling chroma residue of a chroma video unit, and wherein the side information for a current video region is determined according to a rule that disallows inheritance or prediction of the side information based on a temporal layer index of the current video region.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: November 9, 2021
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11159790
    Abstract: The present disclosure provides methods, apparatuses and systems for transcoding a video. One exemplary method for transcoding a video includes: receiving a model file issued by a machine learning framework; converting the model file to a file identifiable by a filter; setting one or more filtering parameters according to the file; and processing the video based on the filtering parameters. According to the embodiments of the present disclosure, no extra storage will be consumed in the process of video transcoding, and system resource consumption can be reduced without adding any extra system deployment costs.
    Type: Grant
    Filed: September 24, 2018
    Date of Patent: October 26, 2021
    Assignee: ALIBABA GROUP HOLDING LIMITED
    Inventors: Haohui Xu, Dawei Mei, Chang Zhou
  • Patent number: 11153594
    Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: October 19, 2021
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Yeping Su, David Singer, Hsi-Jung Wu
  • Patent number: 11128888
    Abstract: This application relates to a method and apparatus, a storage medium, and a computer device for video encoding and decoding. The video encoding method includes: acquiring a reference frame corresponding to a current frame to be encoded from a video input; determining a sub-pixel interpolation mode, the sub-pixel interpolation mode comprising one of a direct sub-pixel interpolation mode or a sampled sub-pixel interpolation mode; processing the reference frame according to resolution information of the current frame using an interpolation in the sub-pixel interpolation mode, to obtain a corresponding target reference frame; and encoding the current frame according to the target reference frame, to obtain encoded data corresponding to the current frame. By using the foregoing video encoding method, a reference frame corresponding to a current frame to be encoded can be flexibly selected, thereby effectively improving the utilization efficiency of reference frames.
    Type: Grant
    Filed: August 12, 2020
    Date of Patent: September 21, 2021
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xinwei Gao, Xunan Mao, Chenchen Gu
  • Patent number: 11115659
    Abstract: An image signal decoding method according to the present invention comprises the steps of: decoding information indicating whether a current block is encoded using a multi-mode intra prediction; when it is determined that the current block is encoded in the multi-mode intra prediction, dividing the current block into a plurality of partial blocks; and obtaining an intra prediction mode of each of the plurality of partial blocks.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: September 7, 2021
    Assignee: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Joo Hee Moon, Sung Won Lim, Dong Jae Won
  • Patent number: 11102514
    Abstract: A system for signaling extension functions used in decoding a sequence including a plurality of pictures, each picture processed at least in part according to a picture parameter set is disclosed. An extension presence signaling flag is read and used to determine whether flags signaling the performance of extension functions are to be read. The flags are only read if indicated by the extension presence signaling flag.
    Type: Grant
    Filed: May 13, 2019
    Date of Patent: August 24, 2021
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11064210
    Abstract: A processing for a first pixel in a picture comprises obtaining a lower limit of a first color component of the first pixel in a first color space based on a distance between a color of the first pixel and a first distorted version of the color in a second color space. An upper limit of the first color component in the first color 5 space is obtained based on a distance between the color and a second distorted version of the color in the second color space. A filtered value is obtained of the first color component and which is equal to or larger than the lower limit and equal to or lower than the upper limit. The processing results in filtered values that are cheaper to encode but that are visibly undistinguishable from the original colors of the pixels.
    Type: Grant
    Filed: July 17, 2017
    Date of Patent: July 13, 2021
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Jacob Ström, Kenneth Andersson, Per Hermansson, Jonatan Samuelsson, Per Wennersten
  • Patent number: 11051043
    Abstract: The present technology relates to an image processing device and an image processing method which allow a deblocking filtering process to apply filtering appropriately. A pixel (p0i) of which the value is 255 (solid line) before a deblocking process changes greatly to 159 (dot line) after a conventional deblocking process. Therefore, a clipping process having a clipping value of 10 is performed in strong filtering, whereby the pixel (p0i) of which the value is 255 (solid line) before the deblocking process becomes 245 (bold line). Thus, a change in the pixel value occurring in the conventional technique can be suppressed as much as possible. This disclosure can be applied to an image processing device, for example.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: June 29, 2021
    Assignee: SONY CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11039172
    Abstract: The present technology relates to an image processing device and an image processing method which allow a deblocking filtering process to apply filtering appropriately. A pixel (p0i) of which the value is 255 (solid line) before a deblocking process changes greatly to 159 (dot line) after a conventional deblocking process. Therefore, a clipping process having a clipping value of 10 is performed in strong filtering, whereby the pixel (p0i) of which the value is 255 (solid line) before the deblocking process becomes 245 (bold line). Thus, a change in the pixel value occurring in the conventional technique can be suppressed as much as possible. This disclosure can be applied to an image processing device, for example.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: June 15, 2021
    Assignee: SONY CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11019251
    Abstract: The present invention is directed to implementing at least one of speed-up of detection processing and reduction of misdetection. An information processing apparatus includes an acquisition unit configured to acquire a captured image, a first setting unit configured to set a plurality of detection areas of an object for the captured image, a second setting unit configured to set a condition for detecting an object on a first detection area and a second detection area set by the first setting unit, wherein the condition includes a detection size in the captured image, and a detection unit configured to detect an object satisfying the detection size set by the second setting unit from the plurality of detection areas set by the first setting unit.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: May 25, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masayuki Kobayashi, Hisashi Kawabayashi
  • Patent number: 10992942
    Abstract: A coding method by a computer is disclosed. The computer divides a block of a coding unit into a plurality of sub-blocks. The computer determines band positions of at least two first sub-blocks among the plurality of sub-blocks. The computer calculates among the plurality of sub-blocks, band positions of second sub-blocks other than the at least two first sub-blocks based on a positional relationship of the second sub-blocks with respect to the at least two first sub-blocks and the determined band positions for the at least two first sub-blocks in the block of the coding unit. A band offset is conducted for each of the sub-blocks by using the band positions determined or calculated for the at least two first sub-blocks and the second sub-blocks.
    Type: Grant
    Filed: April 23, 2020
    Date of Patent: April 27, 2021
    Assignee: SOCIONEXT INC.
    Inventor: Eiichi Sasaki
  • Patent number: 10979623
    Abstract: The present invention is directed to implementing at least one of speed-up of detection processing and reduction of misdetection. An information processing apparatus includes an acquisition unit configured to acquire a captured image, a first setting unit configured to set a plurality of detection areas of an object for the captured image, a second setting unit configured to set a condition for detecting an object on a first detection area and a second detection area set by the first setting unit, wherein the condition includes a detection size in the captured image, and a detection unit configured to detect an object satisfying the detection size set by the second setting unit from the plurality of detection areas set by the first setting unit.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: April 13, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masayuki Kobayashi, Hisashi Kawabayashi
  • Patent number: 10956815
    Abstract: Technical solutions are described for improving efficiency of training a resistive processing unit (RPU) array using a neural network training methodology. An example method includes reducing asymmetric RPUs from the RPU array by determining an asymmetric value of an RPU from the RPU array, and burning the RPU in response to the asymmetry value being above a predetermined threshold. The RPU can be burned by causing an electric voltage across the RPU to be above a predetermined limit. The method further includes initiating the training methodology for the RPU array after the asymmetric RPUs from the RPU array are reduced.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: March 23, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Tayfun Gokmen
  • Patent number: 10951910
    Abstract: In the case where image data of a super-high definition service is transmitted without scalable coding, image data suitable to own display capability in a receiver not supporting the super-high definition service can be easily obtained. A container in a predetermined format having a video stream including encoded image data is transmitted. Auxiliary information for downscaling a spatial and/or temporal resolution of the image data is inserted into the video stream. For example, the auxiliary information indicates a limit of accuracy for a motion vector included in the encoded image data. Further, for example, the auxiliary information identifies a picture to be selected at the time of downscaling the temporal resolution at a predetermined ratio.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: March 16, 2021
    Assignee: Saturn Licensing LLC
    Inventor: Ikuo Tsukagoshi
  • Patent number: 10944997
    Abstract: Aspects of the disclosure provide a method of video coding includes receiving input data associated with a first block and a second block of an image frame. The method further includes identifying a reference size and performing a deblocking process if it is determined that the deblocking process is to be performed. The preforming the deblocking process may include processing pixels adjacent to the block boundary using a first set of deblocking filter settings if a first block size of the first block and a second block size of the second block are greater than the reference size, and processing the pixels using a second set of deblocking filter settings if the first block size or the second block size is not greater than the reference size.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: March 9, 2021
    Assignee: MEDIATEK INC.
    Inventors: Han Huang, Shan Liu, Chih-Wei Hsu
  • Patent number: 10939102
    Abstract: A post processing apparatus includes a super-resolution (SR) filtering circuit and a loop restoration (LR) filtering circuit. The SR filtering circuit applies SR filtering to a processing result of a preceding circuit. The LR filtering circuit applies LR filtering to a processing result of the SR filtering circuit. Before the SR filtering circuit finishes SR filtering of all pixels of a frame that are generated by the preceding circuit, the LR filtering circuit starts LR filtering of pixels that are derived from applying SR filtering to pixels included in the frame.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: March 2, 2021
    Assignee: MEDIATEK INC.
    Inventors: Yung-Chang Chang, Chih-Ming Wang, Chia-Yun Cheng, Chi-Hung Chen, Kai-Chun Lin, Chih-Wen Yang, Hsuan-Wen Peng
  • Patent number: 10939137
    Abstract: An image decoding device (31) includes a transform coefficient decoding unit (311) configured to decode a transform coefficient for a transform tree included in a coding unit. In the transform tree, the transform coefficient decoding unit splits a transform unit corresponding to luminance and then decodes the transform coefficient related to the luminance, and does not split the transform unit corresponding to chrominance and decodes the transform coefficient related to the chrominance.
    Type: Grant
    Filed: April 23, 2018
    Date of Patent: March 2, 2021
    Assignees: SHARP KABUSHIKI KAISHA, FG INNOVATION COMPANY LIMITED
    Inventors: Tomohiro Ikai, Tomoko Aono, Yukinobu Yasugi, Tomonori Hashimoto
  • Patent number: 10931977
    Abstract: Systems, methods, and apparatuses are described for processing video. Video content comprising a plurality of frames may be received. A visual element of a first frame of the plurality of frames positioned in an oblique direction relative to one or more of a first axis and a second axis orthogonal to the first axis may be determined. One or more regions associated with the first frame and comprising the visual element may be determined. One or more encoded regions of the first frame may be generated based on partitioning the one or more regions comprising the visual element.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: February 23, 2021
    Assignee: Comcast Cable Communications, LLC
    Inventors: Dan Grois, Alexander Giladi
  • Patent number: 10929958
    Abstract: A method and an image processing device for image enhancement are proposed. The method includes the following steps. An input image is received. A curve set is applied on the input image to generate a resultant image, where the curve set includes a plurality pairs of weight functions and process functions, where a summation of a multiplication of the weight function and the process function in each of the pairs is zero, and where the weight function in each of the pairs is associated with low-pass filtering. An output image is generated according to the resultant image and the input image.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: February 23, 2021
    Assignee: Novatek Microelectronics Corp.
    Inventors: Wan-Ching Tsai, Shu-Chun Lin
  • Patent number: 10915732
    Abstract: Disclosed is an image processing method capable of processing facial data and non-facial data differentially. The method is carried out by an image processing device, and includes the following steps: determining a facial region, a non-facial region and a transitional region according to a face detection result of an image, in which the transitional region is between the facial region and the non-facial region; and executing different processes for the data of the facial region, the data of the non-facial region and the data of the transitional region respectively.
    Type: Grant
    Filed: May 7, 2019
    Date of Patent: February 9, 2021
    Assignee: REALTEK SEMICONDUCTOR CORPORATION
    Inventors: Kai Liu, Zhong-Yi Qiu, Wen-Tsung Huang
  • Patent number: 10917641
    Abstract: An encoder includes processing circuitry; and a memory coupled to the processing circuitry. Using the memory, the processing circuitry is configured to: change values of pixels in a first block and a second block to filter the boundary between the first block and the second block such that change amounts of the respective values are smaller than respective thresholds, the pixels being arranged along a line across the boundary; and encode a third block. The pixels in the first block include a first pixel located at a first position, and the pixels in the second block include a second pixel located at a second position corresponding to the first position with respect to the boundary. The thresholds include a first threshold and a second threshold corresponding to the first pixel and the second pixel, respectively. The first threshold is different from the second threshold.
    Type: Grant
    Filed: June 24, 2019
    Date of Patent: February 9, 2021
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Ryuichi Kanoh, Takahiro Nishi, Tadamasa Toma
  • Patent number: 10855984
    Abstract: Provided is an image processing apparatus which includes a setting unit assigning a control block, which is a control unit of a filter process that is locally performed with respect to an image, to an initial position of the image determined based on a predetermined reference point; a movement unit moving the control block, which has been assigned to the initial position of the image by the setting unit, up to a position in which the result of the filter process is improved; and a filter processing unit performing the filter process for the respective control blocks which has been moved by the movement unit.
    Type: Grant
    Filed: August 13, 2019
    Date of Patent: December 1, 2020
    Assignee: SONY CORPORATION
    Inventor: Kenji Kondo
  • Patent number: 10855985
    Abstract: A video coder may reconstruct a current picture of video data. A current region of the current picture is associated with a temporal index indicating a temporal layer to which the current region belongs. Furthermore, for each respective array of a plurality of arrays that correspond to different temporal layers, the video coder may store, in the respective array, sets of adaptive loop filtering (ALF) parameters used in applying ALF filters to samples of regions of pictures of the video data that are decoded prior to the current region and that are in the temporal layer corresponding to the respective array or a lower temporal layer than the temporal layer corresponding to the respective array. The video coder determines, based on a selected set of ALF parameters in the array corresponding to the temporal layer to which the current region belongs, an applicable set of ALF parameters.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: December 1, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Li Zhang, Wei-Jung Chien, Marta Karczewicz, Ye-Kui Wang
  • Patent number: 10834397
    Abstract: An image coding method for coding an input image per block to generate a coded image signal includes: predicting for each prediction unit which is an area obtained by partitioning a target block to generate a prediction image of the target block; comparing a transform unit which is an area obtained by partitioning the target block and is a processing unit for frequency transform with the prediction unit, to detect part of a boundary of the prediction unit, the boundary being located within the transform unit; performing boundary filtering on the detected part of the boundary in the generated prediction image; calculating a difference between a filtered prediction image and the input image to generate a difference image of the target block; and performing frequency transform on the difference image for each transform unit.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: November 10, 2020
    Assignee: SUN PATENT TRUST
    Inventors: Hisao Sasai, Takahiro Nishi, Youji Shibahara
  • Patent number: 10785530
    Abstract: A client device accesses a video input stream from an intermediate device for display. The client device analyzes the video input stream to determine that the video input stream matches a template corresponding to a screen portion. Based on the video input stream matching the template, a video output stream is generated and caused to be presented on a display. In some example embodiments, the analysis is performed while the client device is replacing video content received from a content source via the intermediate device. For example, commercials transmitted from a national content provider to a smart TV via a set-top box may be replaced with targeted commercials. During the replacement, menus generated by the set-top box may be detected and the replacement video altered by the smart TV to include the menus.
    Type: Grant
    Filed: December 16, 2016
    Date of Patent: September 22, 2020
    Assignee: Gracenote, Inc.
    Inventors: Markus K. Cremer, Peter Dunker, Steven D. Scherf, David Henry Pearce, Sherman Ling Fung Li, Wilson Harron, Konstantinos Antonios Dimitriou, Dewey Ho Lee
  • Patent number: 10785503
    Abstract: Disclosed is a prediction method adopting in-loop filtering. According to the present invention, a prediction method for encoding and decoding video comprises the following steps: generating a residual block of the current block through an inverse quantization and inverse transform; generating a prediction block of the current block through an intra-prediction; performing in-loop filtering on the current block in which the residual block and the prediction block are combined; and storing the current block, on which the in-loop filtering is performed, in a frame buffer for an intra-prediction of the next block to be encoded. As described above, prediction is performed using an in-loop filter during processes for encoding and decoding video, thereby improving the accuracy of prediction and reducing errors in prediction, thus improving the efficiency of video compression and reducing the amount of data to be transmitted.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: September 22, 2020
    Assignee: INTELLECTUAL DISCOVERY CO., LTD.
    Inventors: Je Chang Jeong, Ki Baek Kim, Dong Jin Jung
  • Patent number: 10764595
    Abstract: Provided is an image encoding method including extracting feature points from a picture; generating at least two clusters by performing feature point clustering on the extracted feature points; determining at least two split sections in the picture, the at least two split sections respectively corresponding to the at least two clusters; parallel-encoding the at least two split sections; and generating a bitstream including information about the at least two split sections. A size and a shape of each of the at least two split sections may be individually determined.
    Type: Grant
    Filed: June 13, 2018
    Date of Patent: September 1, 2020
    Assignees: SAMSUNG ELECTRONICS CO., LTD., INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
    Inventors: Sun-il Lee, Won Woo Ro, Kyungah Kim, Minsik Kim, Chan-yul Kim