Patents Examined by Irfan Habib
  • Patent number: 11363254
    Abstract: The method for intra frame prediction allows for the recovery of some intra directional modes that are otherwise rendered useless due to the classical padding process. Directional modes are recovered by filling pixel locations in the prediction unit with samples from the portion of the unit that is determined to have samples available for use using a counterpart directional mode to the one that is useless. When it is determined that reference samples are missing for a particular prediction unit or portion thereof given a particular directional mode, a determination is made about whether reference samples along another portion of the prediction unit are available. The other portion is the side of the prediction unit at an opposite end of the particular directional mode.
    Type: Grant
    Filed: September 9, 2020
    Date of Patent: June 14, 2022
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Fabien Racape, Franck Galpin, Tangi Poirier
  • Patent number: 11363262
    Abstract: A first aspect is a method for coding a group of pictures (GOP) that includes frames of a video. The method includes encoding, at least some of the frames of the GOP, using a first encoding pass to obtain encoding statistics; obtaining, using the encoding statistics, respective temporal dependency likelihoods (TDLs) for the at least some of the frames of the GOP, where the respective TDLs indicate contributions that the at least some of the frames make in reducing prediction errors of the GOP; obtaining a reference frame based on the respective TDLs; and using the reference frame in encoding at least some of the frames of the GOP in a second encoding pass.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: June 14, 2022
    Assignee: GOOGLE LLC
    Inventors: Ching Yin Derek Pang, Yeping Su, Yao-Chung Lin
  • Patent number: 11350088
    Abstract: Provided are an intra prediction method and apparatus, and a computer-readable storage medium. The method includes: acquiring a first reference sample set corresponding to the current processing block, wherein the first reference sample set includes at least one of a reference row adjacent to the current processing block and a reference column adjacent to the current processing block; selecting, based on a pre-set selection method, a second reference sample set from the first reference sample set, wherein the second reference sample set includes at least one reference sample in the reference row adjacent to the current processing block or the reference column adjacent to the current processing block; obtaining, based on the second reference sample set, a prediction value of the current processing block; and performing, based on the prediction value, intra prediction on the current processing block.
    Type: Grant
    Filed: June 23, 2021
    Date of Patent: May 31, 2022
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventors: Junyan Huo, Jianglin Wang, Yanzhuo Ma, Shuai Wan, Fuzheng Yang
  • Patent number: 11343524
    Abstract: A method of decoding an encoded video bitstream using at least one processor, including: obtaining from the encoded video bitstream a coded video sequence including a picture unit corresponding to a coded picture; obtaining a picture header (PH) network abstraction layer (NAL) unit included in the picture unit; obtaining at least one video coding layer (VCL) network abstraction layer (NAL) unit included in the picture unit; decoding the coded picture based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit obtained from the coded video sequence; and outputting the decoded picture, wherein the APS NAL unit is available to the at least one processor before the at least one VCL NAL unit.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: May 24, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger
  • Patent number: 11317085
    Abstract: Video coding methods are described for reducing latency in template-based inter coding. In some embodiments, a method is provided for coding a video that includes a current picture and at least one reference picture. For at least a current block in the current picture, a respective predicted value is generated (e.g. using motion compensated prediction) for each sample in a template region adjacent to the current block. Once the predicted values are generated for each sample in the template region, a process is invoked to determine a template-based inter prediction parameter by using predicted values in the template region and sample values the reference picture. This process can be invoked without waiting for reconstructed sample values in the template region. Template-based inter prediction of the current block is then performed using the determined template-based inter prediction parameter.
    Type: Grant
    Filed: March 22, 2019
    Date of Patent: April 26, 2022
    Assignee: VID SCALE, INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Patent number: 11317095
    Abstract: A method for encoding or decoding an image of a video sequence is provided. The method comprises obtaining a set of sample values associated with the image. The method comprises determining a relative location of the current sample value with respect to a virtual boundary. The virtual boundary is defined with respect to a block boundary between the first block of sample values and a second block of sample values. The virtual boundary is parallel with the block boundary and separated from the block boundary by at least one row or column of sample values included in the first block of sample values. The method comprises a filter strength value based on the determined relative location of the current sample value with respect to the virtual boundary. The method comprises filtering the current sample value based on the selected filter strength value.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: April 26, 2022
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth Andersson, Jacob Ström, Zhi Zhang, Jack Enhorn
  • Patent number: 11303919
    Abstract: A video decoding method performed by a decoding apparatus comprises deriving control points (CPs) for the current block; obtaining motion vectors for the CPs; deriving a motion vector of a sub-block or a sample unit in the current block on the basis of the obtained motion vectors; deriving a prediction sample for the current block on the basis of the derived motion vector; and generating a reconstruction sample on the basis of the prediction sample. The method enables effective performance of inter prediction through the motion vectors (transformation prediction), not only when an image in the current block is moved in a plane, but also when the image in the current block is rotated, zoomed in, zoomed out, or transformed into a parallelogram. Accordingly, the amount of data for the residual signal for the current block can be eliminated or reduced, and the overall coding efficiency can be improved.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: April 12, 2022
    Assignee: LG Electronics Inc.
    Inventors: Naeri Park, Jaehyun Lim, Junghak Nam
  • Patent number: 11297284
    Abstract: A video monitoring system includes a camera head, including an infrared illumination source and an image sensor. A mount is configured to hold the camera head in a fixed location and orientation above a crib, so that the image sensor captures images of the crib and an intervention region adjacent to the crib from a fixed perspective.
    Type: Grant
    Filed: May 14, 2020
    Date of Patent: April 5, 2022
    Assignee: UDISENSE INC.
    Inventors: Assaf Glazer, Tor Ivry, Amir Katz, Amnon Karni, Mark Prommel, Pil Ho Chung, Marco Perry, Oscar Frias, Gal Shkedi
  • Patent number: 11297341
    Abstract: A decoder is described, which receives an encoded data stream. The encoded data stream includes data representing a picture and a classification mode parameter. The classification mode parameter specifies a certain classification to be applied to samples in the picture, the certain classification selected from a plurality of classifications. The decoder decodes the encoded data stream to obtain a reconstructed picture and the classification mode parameter, classifies samples of the reconstructed picture into one of a plurality of classes using the certain classification specified by the classification mode parameter, and filters the samples of the reconstructed picture. A sample is filtered using a filter for the class into which the sample has been classified.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: April 5, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Johannes Erfurt, Lim Wang-Q, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11290711
    Abstract: A method and apparatus of video coding using history-based candidate derivation are disclosed. According to one method, a current block is inside a Shared Merge candidate list Region (SMR) or a history-based parallel processing region is received. The current block is encoded or decoded using a Merge candidate list. Only if the current block is one of first-coded N (N?0) blocks, one of last-coded N blocks, or one of selected N blocks, the history-based candidate list is updated after the current block is encoded or decoded. In one embodiment, Merge candidate list is pre-generated for the current block in the SMR and is separately generated for the current block in the history-based parallel processing region. In another method, if the current block is inside the SMR or the history-based parallel processing region, the current block is encoded or decoded using a history-based candidate list associated with the root CU.
    Type: Grant
    Filed: October 5, 2019
    Date of Patent: March 29, 2022
    Assignee: MEDIATEK INC.
    Inventors: Yu-Cheng Lin, Chen-Yen Lai, Chun-Chia Chen, Yu-Ling Hsiao, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu
  • Patent number: 11284100
    Abstract: A decoder includes circuitry configured to receive a bitstream; construct, for a current block, a motion vector candidate list including adding a global motion vector candidate to the motion vector candidate list; and reconstruct pixel data of the current block and using the motion vector candidate list. Related apparatus, systems, techniques and articles are also described.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: March 22, 2022
    Assignee: OP Solutions, LLC
    Inventors: Borivoje Furht, Hari Kalva, Velibor Adzic
  • Patent number: 11284088
    Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, whether a combined inter and intra prediction (CIIP) coding technique is to be applied to the current block based on a characteristic of the current block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: March 22, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11275227
    Abstract: A camera module for a vehicular vision system includes a camera housing having a rear camera housing portion, a front camera housing portion, and a lens barrel at the front camera housing portion. A lens assembly includes a plurality of optical elements arranged along an optical path for focusing images at an imager. The optical elements include barrel-mounted optical elements disposed in the lens barrel and an outermost optical element disposed at a removable cover element. The cover element is removably attached at an outer end of the lens barrel such that, when attached, the outermost optical element is at an appropriate location relative to the barrel-mounted optical elements for focusing by the plurality of optical elements of images at the imager.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: March 15, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Steven V. Byrne, Yuesheng Lu
  • Patent number: 11277624
    Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a block of a video and a bitstream representation of the video, whether a bi-prediction coding technique is applicable to the block based on a size of the block having a width W and a height H, W and H being positive integers. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: March 15, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11270125
    Abstract: A system for monitoring and recording and processing an activity includes one or more cameras for automatically recording video of the activity. A processor and memory associated and in communication with the camera is disposed near the location of the activity. The system may include AI logic configured to identify a user recorded within a video frame captured by the camera. The system may also detect and identify a user when the user is located within a predetermined area. The system may include a video processing engine configured to process images within the video frame to identify the user and may modify and format the video upon identifying the user and the activity. The system may include a communication module to communicate formatted video to a remote video processing system, which may further process the video and enable access to a mobile app of the user.
    Type: Grant
    Filed: April 19, 2021
    Date of Patent: March 8, 2022
    Assignee: Hole-In-One Media, Inc.
    Inventor: Kevin R. Imes
  • Patent number: 11272200
    Abstract: Aspects of the disclosure provide a method and an apparatus for video coding. In some examples, an apparatus includes processing circuitry that receives a bit stream that includes coded information representing a bin of a syntax element for a current block in a picture. The bin of the syntax element indicates whether a local illumination compensation (LIC) process is applied to code the current block. The processing circuitry selects a context model from multiple candidate context models applicable to coding of the syntax element, according to at least a coding characteristic of a region neighboring the current block, and decodes the coded information according to the selected context model to obtain the bin of the syntax element. The processing circuitry reconstructs the current block in response to the bin of the syntax element.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: March 8, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Cheung Auyeung, Xiang Li, Shan Liu
  • Patent number: 11272204
    Abstract: A motion compensation method includes determining one or more weighting coefficients of a predicted value of a target pixel to be processed according to at least one of a first parameter or a second parameter, and determining the predicted value of the target pixel according to the weighting coefficient. The target pixel is in a boundary pixel block of a current image block. The first parameter is a size of the current image block or a distance between the target pixel and a center position of the current image block. The second parameter is a size of an adjacent image block of the current image block or a distance between the target pixel and a center position of the adjacent image block.
    Type: Grant
    Filed: August 13, 2020
    Date of Patent: March 8, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Zhao Wang, Siwei Ma, Xiaozhen Zheng
  • Patent number: 11265579
    Abstract: Systems, methods, and apparatuses are described for processing video. Encoded video data may be determined from uncompressed video data. A chrominance component for a portion of the encoded video data may be determined that references another portion of the encoded video data. A luma component of the portion of the encoded video data may be determined to correspond with the luma component of the corresponding portion of the uncompressed video data.
    Type: Grant
    Filed: August 1, 2018
    Date of Patent: March 1, 2022
    Assignee: Comcast Cable Communications, LLC
    Inventors: Douglas Bay, David Leach
  • Patent number: 11240534
    Abstract: An example device for coding video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: code a first codeword representing a selected transform scheme of a set of transform candidates of a multiple transform selection (MTS) scheme for a current block of video data, the selected transform scheme being a secondary transform of a set of available secondary transforms to be applied in addition to a primary transform; code a second codeword representing the secondary transform from the set of available secondary transforms; and apply the primary transform and the secondary transform during coding of residual data for the current block. The second codeword may be a value for a low-frequency non-separable transform (LFNST) syntax element.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: February 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Amir Said, Marta Karczewicz
  • Patent number: 11234019
    Abstract: A prediction image generation apparatus for generating a prediction image by performing motion compensation on multiple reference images, the prediction image generation apparatus includes a prediction image generation unit configured to generate the prediction image with reference to a first reference image, a second reference image and a gradient correction term. A motion compensation unit (3091) having a motion compensation function using a bi-prediction gradient change (Bi-directional optical flow, BIO) prediction derives the gradient correction term with reference to each pixel value of a horizontal gradient image and a vertical gradient image.
    Type: Grant
    Filed: November 27, 2020
    Date of Patent: January 25, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tomohiro Ikai, Tomoyuki Yamamoto