Multiple Frame Prediction (epo) Patents (Class 375/E7.262)
  • Patent number: 12143591
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Grant
    Filed: July 26, 2022
    Date of Patent: November 12, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Martin Winken, Christian Bartnik, Philipp Helle, Mischa Siekmann, Jonathan Pfaff, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 12108032
    Abstract: According to an aspect of an invention, a method for signaling reference pictures in video coding is disclosed. The method comprises: decoding a number of entries in a reference picture list syntax structure; decoding a number of reference index active minus one syntax in a slice header, if the number of entries is greater than one; and deriving an active variable by using the number of reference index active minus one syntax.
    Type: Grant
    Filed: June 7, 2023
    Date of Patent: October 1, 2024
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Sachin G. Deshpande
  • Patent number: 12101458
    Abstract: A system and method for determining the performance of a video codec for real-time communication applications. A set of network conditions is used to simulate certain typical real-world network conditions. A coded video stream is transmitted from the transmitting end to the receiving end under these conditions. The end-to-end latency and received video fluency are measured along with a set of existing video quality measures by a video codec performance evaluation system including a network model and a video codec quality analyzer. The decodable frame ratio, latency and video fluency are used as the performance metrics for real-time communication video quality evaluation. The video codec performance evaluation system does not send any video data over a network when it determines the real-time communication quality of the video codec.
    Type: Grant
    Filed: January 5, 2023
    Date of Patent: September 24, 2024
    Assignee: Agora Lab, Inc.
    Inventors: Wei Dai, Sheng Zhong, Tao Duan, Zesen Zhuang, Xiajun Gu
  • Patent number: 12069298
    Abstract: An encoder calculates an indication to a previous reference picture having temporal identity of zero. The encoder creates a first set of indicators to the previous reference picture, to all reference pictures in a first reference picture set of the previous reference picture, and to all pictures following the previous reference picture in decoding order and precede the current picture in decoding order. The encoder sets a flag for picture order count cycle, when a long term reference picture (LTRP) has least significant bits (LSBs) of a picture order count, for which more than one picture in the first set share same value of the LSBs of picture order count as the LTRP. The decoder obtains LSB of a picture order count for a LTRP in a reference picture set of the current picture. The decoder concludes non-compliant bitstream based on indications provided by the flag.
    Type: Grant
    Filed: August 29, 2023
    Date of Patent: August 20, 2024
    Assignee: Telefonaktiebolaget L M Ericsson (publ)
    Inventors: Jonatan Samuelsson, Rickard Sjöberg
  • Patent number: 12062252
    Abstract: Methods, devices and computer-readable media for processing a compressed video to perform an inference task are disclosed. Processing the compressed video may include selecting a subset of frame encodings of the compressed video, or zero or more modalities (RGB, motion vectors, residuals) of a frame encoding, for further processing to perform the inference task. Pre-existing motion vector and/or residual information in frame encodings of the compressed video are leveraged to adaptively and efficiently perform the inference task. In some embodiments, the inference task is an action recognition task, such as a human action recognition task.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: August 13, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Irina Kezele, Mostafa Shahabinejad, Seyed shahabeddin Nabavi, Wentao Liu, Yuanhao Yu, Rui Xiang Chai, Jin Tang, Yang Wang
  • Patent number: 12028514
    Abstract: A method, performed by a decoding apparatus, of decoding motion information, including: obtaining change information indicating whether to change motion information of a neighboring block of a current block; based on the change information indicating to change the motion information, determining a prediction direction of the current block by changing a prediction direction of the neighboring block; based on the prediction direction of the neighboring block being a first uni-direction and the prediction direction of the current block being a second uni-direction or a bi-direction, selecting a reference picture of the second uni-direction of the current block from a second reference picture list; obtaining a motion vector of the second uni-direction of the current block; and reconstructing the current block using a reference block indicated by the motion vector of the second uni-direction of the current block.
    Type: Grant
    Filed: December 30, 2021
    Date of Patent: July 2, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Minwoo Park, Seungsoo Jeong, Minsoo Park, Kiho Choi, Woongil Choi, Yinji Piao
  • Patent number: 12022111
    Abstract: The present invention relates to a method and apparatus for processing a video signal, which can increase the accuracy of the motion vector prediction through motion vector scaling which takes a difference in the temporal distance between reference pictures into consideration. To this end, the present invention provides a video signal processing method and a video signal processing apparatus using the same, and the method comprises the steps of: scaling at least one neighboring partition motion vector for a motion vector prediction of the current partition; scaling the neighboring partition motion vector, which has been selected, when the reference picture of the neighboring partition motion vector is different from the reference picture of the current partition; acquiring a motion vector prediction value of the current partition using the scaled motion vector; and acquiring a motion vector of the current partition using the motion vector prediction value.
    Type: Grant
    Filed: January 28, 2022
    Date of Patent: June 25, 2024
    Assignee: LG Electronics Inc.
    Inventors: Joonyoung Park, Seungwook Park, Jaehyun Lim, Jungsun Kim, Younghee Choi, Jaewon Sung, Byeongmoon Jeon, Yongjoon Jeon
  • Patent number: 12015766
    Abstract: A video decoding method executed by a video decoding apparatus according to the present document comprises the steps of: parsing a flag associated with weighted prediction from a bitstream; on the basis of the flag, parsing a prediction weighted table syntax from the bitstream; and on the basis of the prediction weighted table syntax, executing a weighted prediction on a current block in a current picture to reconstruct the current picture, wherein on the basis of the value of the flag being 1, the prediction weighted table syntax may be parsed from a picture header of the bitstream, and on the basis of the value of the flag being 0, the prediction weighted table syntax may be parsed from a slice header of the bitstream.
    Type: Grant
    Filed: March 13, 2023
    Date of Patent: June 18, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Seethal Paluri, Hendry Hendry, Jie Zhao, Seunghwan Kim
  • Patent number: 11917187
    Abstract: Disclosed is a video signal processing method comprising the steps of: acquiring a merge index which indicates a candidate for prediction of a current block among a plurality of candidates for the prediction of the current block, which are included in a merge candidate list; acquiring motion information of the current block on the basis of motion information corresponding to the candidate indicated by the merge index; when the motion information of the current block includes a plurality of motion vectors corresponding to a list of different reference pictures, comparing picture order count (POC) differences between each of the reference pictures corresponding to the plurality of motion vectors and the current picture including the current block; correcting the plurality of motion vectors on the basis of a result of the comparison; and reconstructing the current block on the basis of the plurality of corrected motion vectors.
    Type: Grant
    Filed: December 23, 2022
    Date of Patent: February 27, 2024
    Assignee: HUMAX CO., LTD.
    Inventors: Jaehong Jung, Dongcheol Kim, Geonjung Ko, Juhyung Son, Jinsam Kwak
  • Patent number: 11856223
    Abstract: A method of generating an image signal from a plurality of images of a scene performs iterations that comprise generating (505) predicted images for a candidate set of images from a set of (previously) included images. A set of selected images is selected (509) from the set of candidate images in response to a prediction quality. For each selected image a subset of pixels is determined (511) in response to pixel prediction qualities for the pixels of the image, and a set of partial images corresponding to the selected images is generated (513) by selecting (511) a subset of pixels. The selected image is deleted from the candidate set and the partial image is added to the included set. The approach may provide a low complexity and low resource selection of image data representing a scene.
    Type: Grant
    Filed: February 12, 2020
    Date of Patent: December 26, 2023
    Assignee: Koninklijke Philips N.V.
    Inventors: Bart Kroon, Bartolomeus Wilhelmus Damianus Van Geest
  • Patent number: 11818392
    Abstract: An encoder calculates an indication to a previous reference picture having temporal identity of zero. The encoder creates a first set of indicators to the previous reference picture, to all reference pictures in a first reference picture set of the previous reference picture, and to all pictures following the previous reference picture in decoding order and precede the current picture in decoding order. The encoder sets a flag for picture order count cycle, when a long term reference picture (LTRP) has least significant bits (LSBs) of a picture order count, for which more than one picture in the first set share same value of the LSBs of picture order count as the LTRP. The decoder obtains LSB of a picture order count for a LTRP in a reference picture set of the current picture. The decoder concludes non-compliant bitstream based on indications provided by the flag.
    Type: Grant
    Filed: February 9, 2022
    Date of Patent: November 14, 2023
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Jonatan Samuelsson, Rickard Sjöberg
  • Patent number: 11800143
    Abstract: Disclosed herein is a method for adaptive bidirectional optical flow estimation for inter-screen prediction compensation during video encoding. The method aims to reduce complexity and/or cost of bidirectional optical flow (BIO) at a pixel level or a subblock level.
    Type: Grant
    Filed: March 7, 2022
    Date of Patent: October 24, 2023
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jeong-yeon Lim, Hyo Song Kim, Hyeong-duck Kim, Se-hoon Son, Jae-seob Shin, Gyeong-taek Lee, Sun-young Lee
  • Patent number: 11800144
    Abstract: Disclosed herein is a method for adaptive bidirectional optical flow estimation for inter-screen prediction compensation during video encoding. The method aims to reduce complexity and/or cost of bidirectional optical flow (BIO) at a pixel level or a subblock level.
    Type: Grant
    Filed: March 7, 2022
    Date of Patent: October 24, 2023
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jeong-yeon Lim, Hyo Song Kim, Hyeong-duck Kim, Se-hoon Son, Jae-seob Shin, Gyeong-taek Lee, Sun-young Lee
  • Patent number: 11800145
    Abstract: Disclosed herein is a method for adaptive bidirectional optical flow estimation for inter-screen prediction compensation during video encoding. The method aims to reduce complexity and/or cost of bidirectional optical flow (BIO) at a pixel level or a subblock level.
    Type: Grant
    Filed: March 7, 2022
    Date of Patent: October 24, 2023
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jeong-yeon Lim, Hyo Song Kim, Hyeong-duck Kim, Se-hoon Son, Jae-seob Shin, Gyeong-taek Lee, Sun-young Lee
  • Patent number: 11800142
    Abstract: Disclosed herein is a method for adaptive bidirectional optical flow estimation for inter-screen prediction compensation during video encoding. The method aims to reduce complexity and/or cost of bidirectional optical flow (BIO) at a pixel level or a subblock level.
    Type: Grant
    Filed: March 7, 2022
    Date of Patent: October 24, 2023
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jeong-yeon Lim, Hyo Song Kim, Hyeong-duck Kim, Se-hoon Son, Jae-seob Shin, Gyeong-taek Lee, Sun-young Lee
  • Patent number: 11652986
    Abstract: A video decoding method performed by a video decoding device according to this document comprises the steps of: parsing prediction weighted table syntax from a bitstream; parsing information on the number of reference pictures in a reference picture list from the prediction weighted table syntax; deriving weights for weighted prediction on the basis of the information on the number of reference pictures; deriving prediction samples of a current block by performing weighted prediction for the current block on the basis of the weights; and reconstructing a current picture on the basis of the prediction samples, wherein the prediction weighted table syntax may be parsed from a picture header of the bitstream.
    Type: Grant
    Filed: June 17, 2022
    Date of Patent: May 16, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Seethal Paluri, Hendry Hendry, Jie Zhao, Seunghwan Kim
  • Patent number: 11647181
    Abstract: A video decoding method executed by a video decoding apparatus according to the present document comprises the steps of: parsing a flag associated with weighted prediction from a bitstream; on the basis of the flag, parsing a prediction weighted table syntax from the bitstream; and on the basis of the prediction weighted table syntax, executing a weighted prediction on a current block in a current picture to reconstruct the current picture, wherein on the basis of the value of the flag being 1, the prediction weighted table syntax may be parsed from a picture header of the bitstream, and on the basis of the value of the flag being 0, the prediction weighted table syntax may be parsed from a slice header of the bitstream.
    Type: Grant
    Filed: June 16, 2022
    Date of Patent: May 9, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Seethal Paluri, Hendry Hendry, Jie Zhao, Seunghwan Kim
  • Patent number: 11641473
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: May 2, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Martin Winken, Christian Bartnik, Philipp Helle, Mischa Siekmann, Jonathan Pfaff, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11575927
    Abstract: Disclosed is a video signal processing method comprising the steps of: acquiring a merge index which indicates a candidate for prediction of a current block among a plurality of candidates for the prediction of the current block, which are included in a merge candidate list; acquiring motion information of the current block on the basis of motion information corresponding to the candidate indicated by the merge index; when the motion information of the current block includes a plurality of motion vectors corresponding to a list of different reference pictures, comparing picture order count (POC) differences between each of the reference pictures corresponding to the plurality of motion vectors and the current picture including the current block; correcting the plurality of motion vectors on the basis of a result of the comparison; and reconstructing the current block on the basis of the plurality of corrected motion vectors.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: February 7, 2023
    Assignee: HUMAX CO., LTD.
    Inventors: Jaehong Jung, Dongcheol Kim, Geonjung Ko, Juhyung Son, Jinsam Kwak
  • Patent number: 11558637
    Abstract: A system comprises a memory storage configured to store at least a portion of a frame of a video and a hardware motion estimation search processing unit configured to perform at least a portion of a motion estimation search for the video for a plurality of different block sizes. The hardware motion estimation search processing unit is configured to perform the motion estimation search using a plurality of source sub-blocks of a first block size to determine a first type of comparison evaluation values for the first block size. A combination of values included in the first type of comparison evaluation values is utilized to determine at least one second type of comparison evaluation values for a second block size, wherein the second block size is larger than the first block size.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: January 17, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Xianliang Zha, Harikrishna Madadi Reddy, Junqiang Lan, Sujith Srinivasan, Chung-Fu Lin, Guogang Hua
  • Patent number: 11539976
    Abstract: A data processing system for performing motion estimation in a sequence of frames having first and second frames each divided into respective sets of blocks of pixels, includes a vector generator configured to form motion vector candidates representing mappings of pixels between the first and second frames; and a vector processor configured to, for a search block of the first frame, identify a first motion vector candidate ending in a block of the second frame collocated with the search block and form an output vector for the search block which is substantially parallel to the first motion vector candidate and represents a mapping of pixels from the search block to the second frame.
    Type: Grant
    Filed: April 16, 2021
    Date of Patent: December 27, 2022
    Assignee: Imagination Technologies Limited
    Inventors: Steven Fishwick, Jonathan Diggins
  • Patent number: 11375227
    Abstract: A terminal performs video estimation by dividing an image frame of a video into a plurality of prediction units, and dividing the plurality of prediction units into a first type of prediction units and a second type of prediction units. A motion vector of a prediction unit of the first type is then obtained according to a first search algorithm. A motion vector of a prediction unit of the second type is obtained according to a second search algorithm. The second search algorithm is different from the first search algorithm. Then sub-pixel motion estimation is performed on the image frame according to the motion vector of the prediction unit of the first type and the motion vector of the prediction unit of the second type to generate a motion estimate result.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: June 28, 2022
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventor: Hongshun Zhang
  • Patent number: 8804825
    Abstract: A method for encoding pictures within a groups of pictures using prediction, where a first reference picture from a group of pictures and a second reference pictures from the subsequent group of pictures are used in predicting pictures in the group of pictures associated with the first reference picture. A plurality of anchor pictures in the group of pictures associated with the first reference picture may be predicted using both the first and second reference pictures to ensure a smooth transition between different groups of pictures within a video frame.
    Type: Grant
    Filed: January 11, 2006
    Date of Patent: August 12, 2014
    Assignee: Broadcom Corporation
    Inventors: Ashish Koul, Douglas Chin