Motion Vector Patents (Class 375/240.16)
  • Patent number: 11277621
    Abstract: A video coding block is intra-predicted on the basis of reference samples from a set of neighboring video coding blocks. A fitting plane is determined on the basis of the reference samples. The fitting plane defines a plurality of fitting samples. For a selected directional intra prediction mode, the sample values of the video coding block are predicted on the basis of the reference sample values and the fitting sample values.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: March 15, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Alexey Konstantinovich Filippov, Vasily Alexeevich Rufitskiy
  • Patent number: 11277624
    Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a block of a video and a bitstream representation of the video, whether a bi-prediction coding technique is applicable to the block based on a size of the block having a width W and a height H, W and H being positive integers. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: March 15, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11272178
    Abstract: A method for decoding a picture from a bitstream, includes decoding a first part of the bitstream to form an address mapping that maps a segment group index value to a segment group address; and decoding a second part of the bitstream. The second part of the bitstream includes code words representing the plurality of segment groups. Decoding the second part of the bitstream includes decoding a first segment group. Decoding the first segment group includes: 1) decoding a first segment group index value for the first segment group; 2) determining a first segment group address for the first segment group; 3) determining a first spatial location for the first segment group; and 4) decoding at least one sample value for the first segment group and assigning the at least one sample value to a location in the decoded picture given by the first spatial location.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: March 8, 2022
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Rickard Sjöberg, Mitra Damghanian, Martin Pettersson
  • Patent number: 11272193
    Abstract: Disclosed herein is a method for adaptive bidirectional optical flow estimation for inter prediction compensation during video encoding. The method aims to reduce complexity and/or cost of bidirectional optical flow (BIO) at a pixel level or a subblock level.
    Type: Grant
    Filed: March 15, 2018
    Date of Patent: March 8, 2022
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jeong-yeon Lim, Hyo Song Kim, Se-hoon Son, Jae-seob Shin, Sun-young Lee
  • Patent number: 11270151
    Abstract: A method and image processing circuit for performing searching operations regarding an image are provided, wherein the image includes a plurality of blocks. The method includes: utilizing a grouping circuit to divide the plurality of blocks into a plurality of groups, wherein a group within the plurality of groups corresponds to a searching region within a target image, the group includes NB reference blocks within the plurality of blocks, the searching region includes NB sub-regions, and NB is an integer greater than one; utilizing a searching circuit to search for the NB reference blocks in the NB sub-regions, respectively, to generate NB searching results respectively corresponding to the NB reference blocks; and utilizing a selecting circuit to select a searching result from the NB searching results, for utilizing the searching result to represent a portion or all of the NB searching results.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: March 8, 2022
    Assignee: Realtek Semiconductor Corp.
    Inventor: Guangyu San
  • Patent number: 11272205
    Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.
    Type: Grant
    Filed: November 22, 2020
    Date of Patent: March 8, 2022
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Patent number: 11272207
    Abstract: An apparatus comprises: a memory; and a processor coupled to the memory and configured to: obtain a current block of a video frame, obtain candidate MVs corresponding to neighboring blocks of the video frame, the neighboring blocks neighbor the current block, obtain precisions of the candidate MVs, perform first rounding of the precisions based on a rounding scheme, perform second rounding of the candidate MVs based on the first rounding, perform pruning of the candidate MVs, and generate a candidate list based on the second rounding and the pruning.
    Type: Grant
    Filed: May 17, 2018
    Date of Patent: March 8, 2022
    Assignee: Futurewei Technologies, Inc.
    Inventors: Shan Liu, Wei Wang
  • Patent number: 11272198
    Abstract: A method of video decoding performed by a video decoder includes receiving a coded video bitstream including a current picture. The method further includes determining a block size of a current block coded in the intra sub-partition (ISP) coding mode. The method further includes determining a direction and number of partitions of the current block based on the determined block size. The method further includes decoding the current block based on the determined direction and number of partitions of the current block.
    Type: Grant
    Filed: January 29, 2020
    Date of Patent: March 8, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Liang Zhao, Xiang Li, Shan Liu
  • Patent number: 11265569
    Abstract: A method of decoding motion information includes: identifying a type of omission motion information not included in a bitstream from among a plurality of pieces of motion information used to decode a current block that is inter predicted; obtaining the omission motion information by using a predetermined method; and decoding the current block based on the plurality of pieces of motion information including the obtained omission motion information.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: March 1, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jin-young Lee, Woong-il Choi
  • Patent number: 11265566
    Abstract: A decoder includes circuitry configured to receive a bitstream, extract a header including a list of reference frames available for global motion compensation, determine, using the header, a global motion model for a current block, the global motion relative to a reference frame contained in the list of reference frames, and decode the current block using the global motion model. Related apparatus, systems, techniques and articles are also described.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: March 1, 2022
    Assignee: OP SOLUTIONS, LLC
    Inventors: Borivoje Furht, Hari Kalva, Velibor Adzic
  • Patent number: 11265551
    Abstract: Improved systems and methods related to decoder-side motion vector derivation (DMVD), for example, in applying one or more constraints to motion information, such as a MV derived by DMVD, and/or a MV difference between an initial MV and an MV derived by DMVD. These techniques may be applied to any of the existing video codecs, such as HEVC (High Efficiency Video Coding), and/or may be an efficient coding tool in any future video coding standards. In one example, the block size used for DMVD can be restricted. In another example, FRUC bilateral matching can be simplified by not searching outside reference blocks indicated by the original motion vector.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: March 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Hsiao-Chiang Chuang, Marta Karczewicz
  • Patent number: 11265584
    Abstract: An example method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block decoding, based on a bitstream representation, the four sub-blocks, and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.
    Type: Grant
    Filed: November 5, 2020
    Date of Patent: March 1, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
  • Patent number: 11259046
    Abstract: Methods and Systems disclosed to counteract spatial distortions introduced by imaging processes of multi-directional video frames, where objects may be projected to spherical or equirectangular representations. Techniques provided to invert the spatial distortions in video frames used as reference picture data in predictive coding, by spatially transforming the image content of the reference picture data before this image content is being used for the prediction of input video data in prediction-based coders and decoders.
    Type: Grant
    Filed: February 15, 2017
    Date of Patent: February 22, 2022
    Assignee: Apple Inc.
    Inventors: Jae Hoon Kim, Chris Y. Chung, Dazhong Zhang, Hang Yuan, Hsi-Jung Wu, Jiefu Zhai, Xiaosong Zhou
  • Patent number: 11258989
    Abstract: A system may comprise a video data buffer configured to store input video frame data received from a source; and a video processor logically coupled to the video data buffer, wherein the video processor is configured to cause the stored video frame data to be output from the video data buffer at an output video frame rate, and vary the output video frame rate based on an amount of video frame data stored at the video data buffer.
    Type: Grant
    Filed: November 25, 2019
    Date of Patent: February 22, 2022
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Brian Edward Miller, Charles Vigue
  • Patent number: 11258531
    Abstract: A method includes determining a delivery performance of a data flow being transmitted from a first network equipment to a second network equipment over a network; determining whether the network is congested based on the determined delivery performance of the data flow being transmitted to the second network equipment; and pacing delivery of the data flow to the second network equipment by reducing a rate at which the data flow is delivered to the second network equipment when the network is determined to be congested.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: February 22, 2022
    Assignee: Opanga Networks, Inc.
    Inventors: Jeffrey Paul Harrang, John M. Burnette, David B. Gibbons, Ben Hadorn
  • Patent number: 11259041
    Abstract: An image decoding method performed by a decoding apparatus includes the steps of: acquiring motion prediction information on a current block from a bitstream; generating an affine MVP candidate list including affine motion vector predictor candidates for the current block; deriving CPMVPs for CPs of the current block on the basis of one affine MVP candidate among the affine MVP candidates included in the affine MVP candidate list; deriving CPMVDs for the CPs of the current block on the basis of the motion prediction information; deriving CPMVs for the CPs of the current block on the basis of the CPMVPs and the CPMVDs; and deriving prediction samples for the current block on the basis of the CPMVs.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: February 22, 2022
    Assignee: LG Electronics Inc.
    Inventor: Jaeho Lee
  • Patent number: 11259026
    Abstract: Methods and apparatus for parsing friendly and error resilient merge flag coding in video coding are provided. In some methods, in contrast to merging candidate list size dependent coding of the merge flag in the prior art, a merge flag is always encoded in the encoded bit stream for each inter-predicted prediction unit (PU) that is not encoded using skip mode. In some methods, in contrast to the prior art that allowed the merging candidate list to be empty, one or more zero motion vector merging candidates formatted according to the prediction type of the slice containing a PU are added to the merging candidate list if needed to ensure that the list is not empty and/or to ensure that the list contains a maximum number of merging candidates.
    Type: Grant
    Filed: May 6, 2020
    Date of Patent: February 22, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventor: Minhua Zhou
  • Patent number: 11259043
    Abstract: An image decoding method according to the present invention comprises the steps of: deriving a merge candidate of a current block from a neighboring block of the current block; adding the derived merge candidate to a merge candidate list; when the number of merge candidates previously added to the merge candidate list is less than a threshold value, adding at least one prediction area merge candidate included in a prediction area motion information table to the merge candidate list; deriving motion information about the current block on the basis of the merge candidate list; and performing motion compensation on the current block on the basis of the derived motion information.
    Type: Grant
    Filed: April 29, 2021
    Date of Patent: February 22, 2022
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Bae Keun Lee
  • Patent number: 11252431
    Abstract: A method for decoding a current block in a current picture of a video bitstream includes decoding, from the video bitstream, a first motion vector for the current block relative to a first reference block of a first reference picture having a first picture order count, and decoding, from the video bitstream, a second motion vector for the current block relative to a second reference block of a second reference picture having a second picture order count. A similarity metric is generated based on a comparison of the first motion vector and the second motion vector. The method further includes determining whether to refine the first motion vector based on the similarity metric, generating a first refined motion vector from the first motion vector, and performing motion compensation to derive a first reference block from the first reference picture using the first refined motion vector.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: February 15, 2022
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Du Liu, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
  • Patent number: 11252433
    Abstract: A decoder includes circuitry configured to receive a bitstream, extract a header, determine, using the header, a global motion model, and decode a current block of a current frame using the global motion model. Related apparatus, systems, techniques and articles are also described.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: February 15, 2022
    Assignee: OP Solutions, LLC
    Inventors: Borivoje Furht, Hari Kalva, Velibor Adzic
  • Patent number: 11252434
    Abstract: Reconstructing a coded current picture for video decoding including decoding picture partitioning information corresponding to the current picture; determining whether padding is applied to sub-regions of the current picture using the picture partitioning information; based on determining that padding is not applied, decoding the sub-regions without padding the sub-regions; based on determining that padding is applied, determining whether the padding includes wrap-around padding using the picture partitioning information; based on determining that the padding does not include wrap-around padding, applying repetition padding to the sub-regions, and decoding the sub-regions using the repetition padding; based on determining that the padding includes wrap-around padding, applying the wrap-around padding to the sub-regions, and decoding the sub-regions using the wrap-around padding; and reconstructing the current picture based on the decoded sub-regions.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: February 15, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Weiwei Feng, Shan Liu
  • Patent number: 11252442
    Abstract: An apparatus for video decoding includes processing circuitry. The processing circuitry decodes prediction information of a current block from a coded video bitstream. The prediction information is indicative of an intra block copy mode, the current block is one of a plurality of coding blocks in a coding tree block (CTB) with a right to left coding order being allowed within the current CTB. The processing circuitry determines a block vector that points to a reference block in a same picture as the current block. Then, the processing circuitry ensures the reference block being buffered in a reference sample memory based on at least a determination that a sample that is right of a leftmost sample of the reference block is buffered in the reference sample memory. Further, the processing circuitry reconstructs at least a sample of the current block based on reconstructed samples of the reference block.
    Type: Grant
    Filed: April 7, 2020
    Date of Patent: February 15, 2022
    Assignee: Tencent America LLC
    Inventors: Yeqing Wu, Xiaozhong Xu, Xiang Li, Shan Liu
  • Patent number: 11245923
    Abstract: Disclosed herein are representative embodiments of generating representative motion information that can be used during processing of a video frame. In one exemplary embodiment disclosed herein, a reference frame comprising a group of blocks is processed, and motion information for the group of blocks is compressed at least by buffering representative motion-vector information and representative reference-frame index information for the group of blocks. The representative reference-frame index information comprises reference-frame index information of a representative block of the group of blocks, and the representative reference-frame index information represents reference-frame index information for the group of blocks during processing of a current frame.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: February 8, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Bin Li, Jizheng Xu
  • Patent number: 11245924
    Abstract: A method and device for encoding and a method and device for decoding a signal including encoded data representing an image sub-divided into blocks, and information representing a correction block and a residual block. For a current block of the image, a first pixel is encoded from a prediction value obtained for the first pixel from at least one pixel of a previously rebuilt block. The prediction is corrected using at least one value of a pixel of the correction block. At least one current pixel of the current block is encoded from a prediction value obtained for the current pixel from at least one previously corrected pixel of the current block. The prediction is corrected by using at least one value of a pixel of the correction block, delivering a prediction block for the current block. The residual block is computed from the current block and the predictive block.
    Type: Grant
    Filed: May 18, 2018
    Date of Patent: February 8, 2022
    Assignee: ORANGE
    Inventors: Felix Henry, Mohsen Abdoli
  • Patent number: 11245892
    Abstract: A method of video processing includes maintaining tables, wherein each table includes a set of motion candidates and each motion candidate is associated with corresponding motion information; and performing a conversion between a first video block and a bitstream representation of a video including the first video block based on at least some of tables, the performing including checking motion candidates in a table in an order defined in a rule until a checking termination criteria is met.
    Type: Grant
    Filed: September 3, 2020
    Date of Patent: February 8, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11245920
    Abstract: A device for coding video data is configured to code a motion vector difference (MVD) value using a codeword prefix and a codeword suffix. Based on an absolute value, minus 2, of the MVD value being 131070 or greater, the codeword prefix of the MVD value is equal to 1111 1111 1111 1111 and the codeword suffix is coded using the fixed length code.
    Type: Grant
    Filed: August 21, 2020
    Date of Patent: February 8, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Muhammed Zeyd Coban, Hongtao Wang, Vadim Seregin, Marta Karczewicz
  • Patent number: 11240531
    Abstract: One example method of video processing includes implementing, by a processor, a decoder-side motion vector derivation (DMVD) scheme for motion vector refinement during a conversion between a current video block and a bitstream representation of the current video block by deriving parameters based on a deriving rule. The conversion may include compressing the current video block into the bitstream representation or uncompressing the bitstream representation into pixel values of the current video block.
    Type: Grant
    Filed: May 19, 2021
    Date of Patent: February 1, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
  • Patent number: 11240504
    Abstract: A method for decoding a block of a picture represented in a current HDR/WCG format is disclosed. The method comprises receiving a bitstream representative of a coded block of picture, an indication representative of a default d QP table (index_d QP_table), an indication representative of a QP offset (slice_qp_delta); determining a quantization parameter responsive to the current format based on the default d QP table and the QP offset; decoding the coded block of a picture using the determined QP. Corresponding encoding method, transmitting method, decoding device, encoding device and transmitting device are disclosed. Besides an embodiment relative to adapting generic codec parameters to any HDR/WCG format as done for d QP table is also disclosed.
    Type: Grant
    Filed: July 2, 2018
    Date of Patent: February 1, 2022
    Assignee: InterDigital Madison Patent Holdings, SAS
    Inventors: Edouard Francois, Christophe Chevance, Franck Hiron
  • Patent number: 11240529
    Abstract: A picture prediction method includes: determining motion vectors of W control points in a current picture block; obtaining motion vectors of P pixel units of the current picture block by using a motion model and the motion vectors of the W control points, where precision of the determined motion vectors of the W control points is 1/n of pixel precision, precision of the motion vector of each of the P pixel units is 1/N of the pixel precision, the motion vector of each of the P pixel units is used to determine a corresponding reference pixel unit in a reference picture of a corresponding pixel unit; and performing interpolation filtering on a pixel of the corresponding reference pixel unit by using an interpolation filter with a phase of Q, to obtain a predicted pixel value of each of the P pixel units.
    Type: Grant
    Filed: September 4, 2020
    Date of Patent: February 1, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Sixin Lin, Ruopu Huang, Haitao Yang
  • Patent number: 11238520
    Abstract: Contextual parameters of digital media content may be obtained. The digital media content may be associated with a content capture user and/or an end user. Editing parameters defining one or more editing attributes of an edited version of the digital media content may be received. Post-capture user profiles may be obtained. A set of post-capture users may be identified as potential matches for creating the edited version of the digital media content. The set of post-capture users may be presented to the content capture user and/or the end user for selection of one of the post-capture users to create the edited version of the digital media content. In response to the selection, a shipping label may be generated for shipment of the digital media content from an origin address associated with the content capture user and/or the end user to a destination address associated with the selected post-capture user.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: February 1, 2022
    Assignee: GoPro, Inc.
    Inventors: Logan Turley, Stephen Grove
  • Patent number: 11240527
    Abstract: An image decoding method performed by a decoding device according to the present disclosure comprises the steps of: obtaining motion prediction information relating to a current block from a bitstream; generating an affine MVP candidate list for the current block; deriving CPMVPs for CPs of the current block on the basis of the affine MVP candidate list; deriving CPMVDs for the CPs of the current block on the basis of the motion prediction information; deriving CPMVs for the CPs of the current block on the basis of the CPMVPs and the CPMVDs; and deriving prediction samples for the current block on the basis of the CPMVs.
    Type: Grant
    Filed: April 29, 2020
    Date of Patent: February 1, 2022
    Assignee: LG ELECTRONICS INC.
    Inventor: Jaeho Lee
  • Patent number: 11240520
    Abstract: The present invention includes obtaining block type identification information on a partition of the current macroblock when the current macroblock is intra-mixed, specifying a bock type of the current macroblock based on the block type identification information, obtaining an intra prediction mode of the current macroblock according to the block type of the partition of the current macroblock, and predicting the current macroblock using the intra prediction mode and a pixel value of a neighboring block.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: February 1, 2022
    Assignee: LG ELECTRONICS, INC.
    Inventors: Joon Young Park, Seung Wook Park, Jung Sun Kim, Young Hee Choi, Byeong Moon Jeon
  • Patent number: 11240497
    Abstract: A deblocking method for deblocking a boundary between a first block of samples, block P, and a second block of samples, block Q. The method includes determining whether at least one of the P block or the Q block is a combined intra-inter prediction block; and, as a result of determining that at least one of the P block or the Q block is a combined intra-inter prediction block, deblocking the boundary between the P block and the Q block.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: February 1, 2022
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth Andersson, Jack Enhorn, Ruoyang Yu, Zhi Zhang
  • Patent number: 11234007
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry decodes prediction information of a current block from a coded video bitstream. The prediction information is indicative of a subset of inter prediction modes associated with a merge flag being false. Then, the processing circuitry decodes at least an additional flag that is used for selecting a specific inter prediction mode from the subset of inter prediction modes. Further, the processing circuitry reconstructs samples of the current block according to the specific inter prediction mode.
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: January 25, 2022
    Assignee: Tencent America LLC
    Inventors: Meng Xu, Xiang Li, Xiaozhong Xu, Guichun Li, Shan Liu
  • Patent number: 11234019
    Abstract: A prediction image generation apparatus for generating a prediction image by performing motion compensation on multiple reference images, the prediction image generation apparatus includes a prediction image generation unit configured to generate the prediction image with reference to a first reference image, a second reference image and a gradient correction term. A motion compensation unit (3091) having a motion compensation function using a bi-prediction gradient change (Bi-directional optical flow, BIO) prediction derives the gradient correction term with reference to each pixel value of a horizontal gradient image and a vertical gradient image.
    Type: Grant
    Filed: November 27, 2020
    Date of Patent: January 25, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tomohiro Ikai, Tomoyuki Yamamoto
  • Patent number: 11228749
    Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image.
    Type: Grant
    Filed: May 4, 2020
    Date of Patent: January 18, 2022
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Balineedu Chowdary Adsumilli, David Newman
  • Patent number: 11228780
    Abstract: A method for inter prediction of a sample value of a current pixel of a plurality of pixels of a current block of a current frame of a video signal is proposed. The method (800) comprises: determining (801) a plurality of block-wise motion vectors related one-to-one to a plurality of blocks of the current frame; determining (803) a pixel-wise motion vector of the current pixel based on the plurality of block-wise motion vectors; determining one or more reference pixels in the reference frame based on the pixel-wise motion vector of the current pixel; and determining (805) an inter predicted sample value of the current pixel based on one or more sample values of the one or more reference pixels in the reference frame. Coding efficiency is thus improved.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: January 18, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Maxim Borisovitch Sychev, Georgy Aleksandrovich Zhulikov, Timofey Mikhailovich Solovyev
  • Patent number: 11228755
    Abstract: According to the present invention, provided is a method of processing a video signal, the method including: obtaining a transform coefficient of a current block from a bitstream according to a predetermined scanning order; determining an intra prediction mode of the current block on the basis of the transform coefficient; and performing intra prediction on the current block using the intra prediction mode and a neighboring sample adjacent to the current block.
    Type: Grant
    Filed: March 17, 2017
    Date of Patent: January 18, 2022
    Assignee: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Yung Lyul Lee, Nam Uk Kim
  • Patent number: 11228761
    Abstract: A method for video bitstream processing, comprising: determining that a first portion of a data unit of the video bitstream exceeds beyond one or multiple borders of a second portion of the data unit of the video bitstream; and performing at least one of: extended quad tree (EQT) partitioning, flexible tree (FT) partitioning, or generalized triple tree (GTT) partitioning of the first portion of the data unit based on the determination that the first portion exceeds beyond the border.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: January 18, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11223833
    Abstract: A method of preprocessing, prior to encoding with an external encoder, image data using a preprocessing network comprising a set of inter-connected learnable weights is provided. At the preprocessing network, image data from one or more images is received. The image data is processed using the preprocessing network to generate an output pixel representation for encoding with the external encoder. The preprocessing network is configured to take as an input encoder configuration data representing one or more configuration settings of the external encoder. The weights of the preprocessing network are dependent upon the one or more configuration settings of the external encoder.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: January 11, 2022
    Assignee: iSize Limited
    Inventors: Ioannis Andreopoulos, Aaron Chadha
  • Patent number: 11222426
    Abstract: The method for determining property feature segmentation includes: receiving a region image for a region; determining parcel data for the region; determining a final segmentation output based on the region image and parcel data using a trained segmentation module; optionally generating training data; and training a segmentation module using the training data S500.
    Type: Grant
    Filed: June 1, 2021
    Date of Patent: January 11, 2022
    Assignee: Cape Analytics, Inc.
    Inventors: Fabian Richter, Matthieu Portail, Jason Erickson
  • Patent number: 11223837
    Abstract: Methods of adaptive transform type based on transform unit (TU) size for enhancement layer (EL) coding and multiple motion candidates for EL coding based on corresponding base layer (BL) video data are provided. One method selects a transform type from multiple allowable transform types based on the TU size and applies the selected transform type to the transform units of the inter-layer prediction processed data. Another method derives multiple motion candidates for the EL video data coded in Merge mode or Inter mode based on motion information associated with the corresponding BL video data.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: January 11, 2022
    Assignee: MediaTek Inc.
    Inventors: Tzu-Der Chuang, Zhenzhong Chen, Shan Liu, Ching-Yeh Chen, Chih-Wei Hsu
  • Patent number: 11218713
    Abstract: The present invention relates to a video encoding method, a video decoding method, and a device using the same, and the video encoding method according to the present invention comprises the steps of: specifying a tile and a slice by partitioning an inputted picture; performing encoding on the basis of the tile and the slice; and transmitting the encoded video information, wherein the picture is partitioned into one or more tiles and one or more slices, and the restrictions for parallel processing can be applied to the tiles and the slices.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: January 4, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Hendry Hendry, Joonyoung Park, Yongjoon Jeon, Byeongmoon Jeon, Jungsun Kim, Jaehyun Lim, Chulkeun Kim, Naeri Park, Seungwook Park
  • Patent number: 11218695
    Abstract: Provided is in-loop filtering technology using a trained deep neural network (DNN) filter model. An image decoding method according to an embodiment includes receiving a bitstream of an encoded image, generating reconstructed data by reconstructing the encoded image, obtaining information about a content type of the encoded image from the bitstream, determining a deep neural network (DNN) filter model trained to perform in-loop filtering by using at least one computer, based on the information about the content type, and performing the in-loop filtering by applying the reconstructed data to the determined DNN filter model.
    Type: Grant
    Filed: February 6, 2018
    Date of Patent: January 4, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Young-o Park, Jae-hwan Kim, Jong-seok Lee, Sun-young Jeon, Jeong-hoon Park, Kwang-pyo Choi
  • Patent number: 11218663
    Abstract: In some embodiments, a method determines a combination of sub-bitstream chunks from a plurality of sub-bitstreams for a video. The combination of sub-bitstream chunks includes a quality measurement. The method exchanges a sub-bitstream chunk in the combination of sub-bitstream chunks with another sub-bitstream chunk from another sub-bitstream in the plurality of sub-bitstreams based on a relationship of a change in bitrate to a change in quality due to the exchanging. The method continues to exchange a sub-bitstream chunk in the combination of sub-bitstream chunks with another sub-bitstream chunk until the quality measurement of the combination of sub-bitstream chunks meets a target quality and outputs the combination of sub-bitstream chunks.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: January 4, 2022
    Assignee: HULU, LLC
    Inventors: Chen Liu, Wenhao Zhang, Xiaobo Liu, Deliang Fu
  • Patent number: 11218720
    Abstract: A video decoding method includes the steps of: generating a merge candidate list for a first block; selecting one among merge candidates included in the merge candidate list; and performing motion compensation for the first block based on motion information of the selected merge candidate. At this point, an inter-region merge candidate included in an inter-region motion information list may be added to the merge candidate list based on the number of spatial merge candidates and temporal merge candidates included in the merge candidate list.
    Type: Grant
    Filed: March 18, 2021
    Date of Patent: January 4, 2022
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Bae Keun Lee
  • Patent number: 11218727
    Abstract: A method of video decoding includes receiving a coded video bitstream including a current picture. The method includes determining a predetermined condition associated with signaling data included in the coded video bitstream. The method includes determining, based on the predetermined condition, a size of an index included in the signaling data for a candidate list of vector predictors based on a number of merge mode candidates and a number of intra block copy (IBC) candidates. The method includes constructing the candidate list with vector predictors. The method includes retrieving a vector predictor from the candidate list in accordance with the index that has a value that does not exceed the determined size of the index. The method further includes decoding the current block in accordance with the retrieved vector predictor.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: January 4, 2022
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Xiang Li, Shan Liu
  • Patent number: 11218721
    Abstract: A method and apparatus of Inter prediction for video coding using Multi-hypothesis (MH) are disclosed. If an MH mode is used for the current block: at least one MH candidate is derived using reduced reference data by adjusting at least one coding-control setting; an Inter candidate list is generated, where the Inter candidate list comprises said at least one MH candidate; and current motion information associated with the current block is encoded using the Inter candidate list at the video encoder side or the current motion information associated with the current block is decoded at the video decoder side using the Merge candidate list. The coding control setting may correspond to prediction direction setting, filter tap setting, block size of reference block to be fetched, reference picture setting or motion limitation setting.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: January 4, 2022
    Assignee: MEDIATEK INC.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang
  • Patent number: 11218696
    Abstract: A method of encoding a first image in a plurality of images of input video data, wherein the first image is divided into a plurality of pixel blocks comprises, for a current block of the first image: determining a motion speed for the current block with respect to a reference block correlated to the current block in a second image of the plurality of images, wherein the second image is distinct from the first image and was previously encoded according to an image encoding sequence for encoding the images of the plurality of images; determining an interpolation filter based on the motion speed; and using the interpolation filter for calculating fractional pixel values in the second image for a temporal prediction of pixels of the current block based on the reference block of the second image.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: January 4, 2022
    Assignee: ATEME
    Inventors: Katarina Dorovic, Elie Mora, Mathieu Monnier
  • Patent number: 11218708
    Abstract: A picture coding method includes: performing a first derivation process for deriving a first merging candidate which includes a candidate set of a prediction direction, a motion vector, and a reference picture index for use in coding of a current block; performing a second derivation process for deriving a second merging candidate; selecting a merging candidate to be used in the coding of the current block from among the first and second merging candidates; and attaching an index for identifying the selected merging candidate to the bitstream; wherein the first derivation process is performed so that a total number of the first merging candidates does not exceed a predetermined number, and the second derivation process is performed when the total number of the first merging candidates is less than a predetermined maximum number of merging candidates.
    Type: Grant
    Filed: October 16, 2012
    Date of Patent: January 4, 2022
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Kyoko Tanikawa, Hisao Sasai, Toru Matsunobu, Kengo Terada