Motion Vector Patents (Class 375/240.16)
  • Patent number: 10735760
    Abstract: A method of coding video data is provided to include resetting one or more tables including motion candidates before coding video blocks that are in a first video region of a picture in a video; coding a video block in the first video region, and determining whether to update the one or more tables using motion information derived for the video block; deriving motion information for a subsequent video block to the video block in the first video region; and coding the subsequent video block using the motion information derived for the subsequent video block; wherein one or more candidates from the one or more table are selectively checked during a motion candidate list construction process which is used to derive the motion information for the subsequent video block.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: August 4, 2020
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 10735722
    Abstract: Aspects of the disclosure provide an apparatus for video coding. The apparatus includes circuitry configured to reconstruct one or more blocks neighboring a first block that is non-square, and determine a range of reference samples required for an intra prediction of the first block based on a shape of the first block. The range includes samples having coordinates of x=[?1], y=[?1 to (dimension1*2+m)], and x=[0 to (dimension2*2+n)], y=[?1]. Dimension1 denotes a length of a first side of the first block, dimension2 denotes a length of a second side of the first block that is perpendicular to the first side of the first block, and m and n are integers greater or equal to 0. The circuitry is further configured to perform the intra prediction based on the reference samples in the determined range.
    Type: Grant
    Filed: June 17, 2019
    Date of Patent: August 4, 2020
    Assignee: Tencent America LLC
    Inventors: Liang Zhao, Shan Liu, Xin Zhao, Xiang Li
  • Patent number: 10735769
    Abstract: Techniques related to temporal noise reduction in captured video are discussed. Such techniques include performing motion estimation on a portion of a downsampled current frame performed during the downsampling of the current frame, replacing one or more of the resultant motion vectors based on confidence scores of the resultant motion vector, and blending the current frame and a temporally previous frame to generate a temporally filtered current frame. The temporally filtered current frame may be displayed to a user and/or encoded to generate a bitstream.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: August 4, 2020
    Assignee: Intel Corporation
    Inventors: Noam Levy, Liron Lvov, Noam Elron, Oskar Pelc, Shahar S. Yuval
  • Patent number: 10735746
    Abstract: The invention relates to a motion compensation performed under an inter-frame prediction. A fractional sample interpolation is applied on retrieved samples to generate fractional samples. The fractional sample interpolation comprises a plurality of filtering operations, and all of filtered results from the filtering operations are truncated down to a predetermined bit depth independent of the bit depth of the samples stored in the reference picture memory.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: August 4, 2020
    Assignee: NTT DOCOMO, INC.
    Inventor: Frank Jan Bossen
  • Patent number: 10735758
    Abstract: Aspects of the disclosure provide methods and apparatuses for video decoding. In some embodiments, an apparatus for video decoding includes processing circuitry. The processing circuitry decodes prediction information for a block in a current coded picture that is a part of a coded video sequence. The prediction information is indicative of a merge submode. Then, the processing circuitry constructs, in response to the merge submode, a candidate list of candidate motion vector predictors for the block. The candidate list includes one or more first candidates that are corner neighbors of the block and at least one second candidate that is a side neighbor of the block. Then, the processing circuitry reconstructs the block according to motion information associated with the second candidate.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: August 4, 2020
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Shan Liu, Stephan Wenger
  • Patent number: 10735747
    Abstract: Approaches to selection of motion vector (“MV”) precision during video encoding are presented. These approaches can facilitate compression that is effective in terms of rate-distortion performance and/or computational efficiency. For example, a video encoder determines an MV precision for a unit of video from among multiple MV precisions, which include one or more fractional-sample MV precisions and integer-sample MV precision. The video encoder can identify a set of MV values having a fractional-sample MV precision, then select the MV precision for the unit based at least in part on prevalence of MV values (within the set) having a fractional part of zero. Or, the video encoder can perform rate-distortion analysis, where the rate-distortion analysis is biased towards the integer-sample MV precision. Or, the video encoder can collect information about the video and select the MV precision for the unit based at least in part on the collected information.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: August 4, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Gary J. Sullivan, You Zhou, Chih-Lung Lin
  • Patent number: 10735737
    Abstract: A method includes: performing spatio-temporal analysis on each frame of a video frame sequence; determining, based on the spatio-temporal analysis, how well a first region of a first frame of the video frame sequence meets a human-perception criterion; assigning, based on the identification, a bit weight for an encoder to apply in encoding the first region; and encoding, using the encoder, at least the first frame based on the spatio-temporal analysis, wherein the first region is encoded using the assigned bit weight.
    Type: Grant
    Filed: March 9, 2017
    Date of Patent: August 4, 2020
    Assignee: GOOGLE LLC
    Inventor: Roberto Peon
  • Patent number: 10735759
    Abstract: An apparatus for video decoding includes processing circuitry that decodes prediction information for a current block in a current coded picture. The prediction information indicates a prediction mode that uses a motion vector predictor candidate list for reconstructing the current block. The processing circuitry includes a new motion vector predictor into the motion vector predictor candidate list. The new motion vector predictor is one of a first motion vector predictor and a second motion vector predictor. The first motion vector predictor is a first average result of a pair of existing motion vector predictors in the motion vector predictor candidate list and a temporal motion vector predictor (TMVP). The second motion vector predictor is a second average result of a pair of history-based motion vector predictors (HMVPs) in an HMVP buffer. The processing circuitry reconstructs the current block based on the motion vector predictor candidate list.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: August 4, 2020
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Xiang Li, Shan Liu
  • Patent number: 10733704
    Abstract: A method of increasing temporal resolution the method a) provides a current video having an initial spatial resolution and an initial temporal resolution, the current video has a temporally reduced video of an original video; b) repeatedly reduces the spatial resolution of the current video and the original video to produce a lowest spatial resolution current video and original video, the lowest spatial resolution current video having the initial temporal resolution; c) increases the temporal resolution of the lowest spatial resolution current video; d) increases the temporal resolution of the next higher spatial resolution current video; and e) repeats step (d) up to the initial spatial resolution. Steps c) and d) further include calculating enhancement data and using the enhancement data to enhance the increased temporal resolution of the current video, the calculating including using the respective reduced spatial resolution original video.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: August 4, 2020
    Assignee: Numeri, LTD
    Inventors: Ilan Bar-On, Oleg Kostenko
  • Patent number: 10728565
    Abstract: A video encoding method, a video encoding apparatus, a video decoding method, and a video decoding apparatus are provided. The video encoding method includes reconstructing a first layer image based on encoding information of the first layer image that is obtained from a bitstream, splitting a largest coding unit of a second layer image into coding units based on split information of the second layer image that is obtained from the bitstream, splitting the coding units into prediction units for prediction encoding, determining whether to use a coding tool for decoding a current prediction unit based on at least one among a prediction mode of the current prediction unit among the prediction units, size information of the current prediction unit, and color depth information of the current prediction unit, and decoding the current prediction unit, using the coding tool, in response to the determining to use the coding tool.
    Type: Grant
    Filed: April 7, 2014
    Date of Patent: July 28, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jin-young Lee, Min-woo Park, Ho-cheon Wey, Jae-won Yoon, Yong-jin Cho, Byeong-doo Choi
  • Patent number: 10728474
    Abstract: Image signal processing including generating image signal processing based encoding hints for motion estimation may include an image signal processor obtaining an input image portion of an input image from the input image signal, generating motion information for the input image portion, processing the input image portion based on the motion information, outputting processed image data, and outputting the motion information as encoding hints, such that the motion information is accessible by an encoder for generating an encoded output bitstream by obtaining the processed image data as source image data, obtaining the motion information, generating prediction data for encoding the source image data based on the motion information, generating encoded image data based on the prediction data, and including the encoded image data in an encoded output bitstream.
    Type: Grant
    Filed: May 25, 2017
    Date of Patent: July 28, 2020
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady, Sandeep Doshi
  • Patent number: 10728571
    Abstract: A video decoding method performed by a decoding device includes: deriving control points (CPs) for a current block; acquiring motion vectors for the CPs; deriving a sample-unit motion vector in the current block based on the acquired motion vectors; deriving a prediction sample for the current block based on the sample-unit motion vector; and generating a restoration sample based on the prediction sample, wherein coordinates of a bottom-right sample position of the current block are (0, 0), and coordinates of CPO among the CPs are (0, 0). Inter prediction is effectively performed through sample-unit motion vectors even when an image in a current block is planarly moved and variously changed, and since motion vectors for CPs are derived based on already-decoded neighboring blocks, an amount of information for the motion vectors for the CPs and for a residual signal for the current block is reduced, improving overall coding efficiency.
    Type: Grant
    Filed: July 15, 2016
    Date of Patent: July 28, 2020
    Assignee: LG Electronics Inc.
    Inventors: Eunyong Son, Moonmo Koo, Hyeongmoon Jang, Seungwook Park, Yongjoon Jeon
  • Patent number: 10721481
    Abstract: The invention relates to a motion compensation performed under an inter-frame prediction. A fractional sample interpolation is applied on retrieved samples to generate fractional samples. The fractional sample interpolation comprises a plurality of filtering operations, and all of filtered results from the filtering operations are truncated down to a predetermined bit depth independent of the bit depth of the samples stored in the reference picture memory.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: July 21, 2020
    Assignee: NTT DOCOMO, INC.
    Inventor: Frank Jan Bossen
  • Patent number: 10721468
    Abstract: An intra-prediction mode determination device is applied in a video coding device that recursively divides input video blocks into small blocks to perform coding by intra-prediction or inter-frame prediction, and includes a prediction mode selection unit and a number of bins adjustment unit that are provided in correspondence to only one of possible sizes of the small blocks. The prediction mode selection unit evaluates, with respect to each of the small blocks, the coding cost of a plurality of prediction mode candidates on the basis of a residual corresponding to the prediction mode candidates and the number of bins allocated to the prediction mode candidates, and selects an intra-prediction mode from the plurality of prediction mode candidates. The number of bins adjustment unit, when the prediction mode selection unit evaluates the coding cost, increases the number of bins corresponding to a specific prediction mode candidate.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: July 21, 2020
    Assignee: NEC CORPORATION
    Inventor: Seiya Shibata
  • Patent number: 10719942
    Abstract: Provided are an image processing system and an image processing method. An image processing method includes: constructing a plurality of grids on an image; extracting features of the image; estimating a grid motion vector of each of the plurality of grids, based on a first motion vector of each of the features; estimating a second motion vector of each feature based on the grid motion vector; and detecting a moving object based on a difference between the first motion vector and the second motion vector.
    Type: Grant
    Filed: December 14, 2017
    Date of Patent: July 21, 2020
    Assignee: HANWHA DEFENSE CO., LTD.
    Inventors: Ju Han Bae, Ki Seok Kim, Jae Hyuk Ju
  • Patent number: 10719509
    Abstract: Implementations provide an efficient system for calculating inner products between high-dimensionality vectors. An example method includes clustering database items represented as vectors, selecting a cluster center for each cluster, and storing the cluster center as an entry in a first layer codebook. The method also includes, for each database item, calculating a residual based on the cluster center for the cluster the database item is assigned to and projecting the residual into subspaces. The method also includes determining, for each of the subspaces, an entry in a second layer codebook for the subspace, and storing the entry in the first layer codebook and the respective entry in the second layer codebook for each of the subspaces as a quantized vector for the database item. The entry can be used to categorize an item represented by a query vector or to provide database items responsive to a query vector.
    Type: Grant
    Filed: October 11, 2016
    Date of Patent: July 21, 2020
    Assignee: GOOGLE LLC
    Inventors: Sanjiv Kumar, David Morris Simcha, Ananda Theertha Suresh, Ruiqi Guo, Xinnan Yu, Daniel Holtmann-Rice
  • Patent number: 10719924
    Abstract: A system for processing video. The system may include a video camera, a processing unit, and a video display, the video camera being configured to generate a plurality of consecutive luminance frames, including a last frame and a plurality of preceding frames. The processing unit may be configured to: shift the plurality of preceding frames, to register the preceding frames with the last frame to form a plurality of shifted frames, take a Fourier transform of each of the plurality of frames, to form a corresponding plurality of initial Fourier transform frames, iteratively update the plurality of Fourier transform frames by, on the (n+1)th iteration of a plurality of iterations, replacing each Fourier transform frame with a linear combination of the Fourier transform frames of the nth iteration, the Fourier transform frames of the 0th iteration being the initial Fourier transform frames.
    Type: Grant
    Filed: April 27, 2015
    Date of Patent: July 21, 2020
    Assignee: RAYTHEON COMPANY
    Inventors: David U. Fluckiger, Christopher J. Beardsley, Craig R. Franklin
  • Patent number: 10719717
    Abstract: Crowd behavior in a video feed may be analyzed based on movement of a human object identified in the video feed. An abnormal event may be triggered if the movement of the human object deviates from the analyzed crowd behavior. A camera may scan a face of the human object, if the abnormal event is triggered.
    Type: Grant
    Filed: March 23, 2015
    Date of Patent: July 21, 2020
    Assignee: MICRO FOCUS LLC
    Inventor: Qian Lin
  • Patent number: 10719927
    Abstract: An electronic device, method, and computer readable medium for multi-frame image processing using semantic saliency are provided. The electronic device includes a camera, a display, and a processor. The processor is coupled to the camera and the display. The processor receives a plurality of frames captured by the camera during a capture event; identifies a salient region in each of the plurality of frames; determines a reference frame from the plurality of frames based on the identified salient regions; fuses non-reference frames with the determined reference frame into a completed image output.
    Type: Grant
    Filed: January 4, 2018
    Date of Patent: July 21, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Raja Bala, Hamid R. Sheikh, John Glotzbach
  • Patent number: 10715811
    Abstract: Provided are a method and apparatus for determining a merge mode by using motion information of a previous prediction unit. The method of determining a merge mode includes obtaining a merge mode cost of a lower depth based on a merge mode cost of a coding unit of an upper depth obtained by using motion information of a merge mode of the coding unit of the upper depth corresponding to a merge mode of the coding unit of the lower depth.
    Type: Grant
    Filed: August 11, 2014
    Date of Patent: July 14, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jae-moon Kim, Sung-oh Kim, Ki-won Yoo, Hyung-ju Chun
  • Patent number: 10715813
    Abstract: A block prediction search method includes at least following steps: utilizing a data buffer to store bit-depth reduced sample values of a plurality of samples in a first pixel line; detecting occurrence of an edge in the first pixel line according to restored sample values derived from stored sample values in the data buffer; and determining a block prediction vector for a pixel group in a second pixel line different from the first pixel line, wherein the block prediction vector is determined based at least partly on a last edge count value indicative of a number of samples in the first pixel line that have gone by since the edge occurs.
    Type: Grant
    Filed: November 6, 2014
    Date of Patent: July 14, 2020
    Assignee: MEDIATEK INC.
    Inventors: Tung-Hsing Wu, Kun-Bin Lee
  • Patent number: 10715820
    Abstract: An inter-frame predictive encoding method is disclosed and comprises: dividing a frame to be encoded into a plurality of block to be encoded by an encoder; determining, for each block to be encoded, a forward encoding block and a backward encoding block corresponding to the block to be encoded; determining a first weighting parameter corresponding to the forward encoding block; determining an overall brightness-based second weighting parameter of a reference image containing the forward encoding block, and determining an overall brightness-based third weighting parameter of a reference image containing the backward encoding block; determining a fourth weighting parameter corresponding to the backward encoding block according to the first weighting parameter; determining a predictive actual weighting parameter of the block to be encoded according to the first, second, third, and fourth weighting parameters; performing predictive encoding on the block to be encoded by the predictive actual weighting parameter.
    Type: Grant
    Filed: August 9, 2017
    Date of Patent: July 14, 2020
    Assignee: BEIJING QIYI CENTURY SCIENCE & TECHNOLOGY CO., LTD.
    Inventor: Hongbo Zhu
  • Patent number: 10715818
    Abstract: An apparatus of video encoding is described herein. The apparatus includes an encoder and a hardware bit packing unit. The encoder comprises at least a fixed function dual hierarchical motion estimation search units, dual integer motion estimation search units, and a fractional motion estimation search unit. Moreover, the hardware bit packing unit is to pack bits as coded according to the final macroblock coding decision into a data format.
    Type: Grant
    Filed: April 10, 2017
    Date of Patent: July 14, 2020
    Assignee: Intel Corporation
    Inventors: James M. Holland, Fangwen Fu, Satya N. Yedidi, Srinivasan Embar Raghukrishnan
  • Patent number: 10715812
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. For example, processing circuitry decodes prediction information for a block in a current picture from a coded video bitstream. The prediction information is indicative of an inter prediction mode that signals an offset associated with one of base motion vector predictor candidates in a candidate list. The processing circuitry constructs the candidate list with one or more existing base motion vector predictor candidates and adds a new motion vector predictor into the candidate list when the new motion vector predictor satisfies a spacing requirement to the one or more existing base motion vector predictor candidates. The processing circuitry decodes an index of a specific base motion vector predictor candidate in the candidate list and the offset to determine a final motion vector, and reconstructs samples of the block according to the final motion vector.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: July 14, 2020
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Shan Liu, Xiang Li
  • Patent number: 10715826
    Abstract: A method of performing motion vector prediction for a current block in a picture is provided which includes: deriving a candidate for a motion vector predictor to code a current motion vector of the current block, from a first motion vector of a first block that is spatially adjacent or temporally adjacent to the current block; adding the derived candidate to a list of candidates; and deriving at least one motion vector predictor based on a selected candidate from the list of candidates, wherein the deriving of the candidate includes determining whether to derive the candidate from the first motion vector, based on a type of a current reference picture and a type of a first reference picture, the current reference picture being referred to from the current block using the current motion vector, the first reference picture being referred to from the first block using the first motion vector.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: July 14, 2020
    Assignee: SUN PATENT TRUST
    Inventors: Chong Soon Lim, Sue Mon Thet Naing, Takahiro Nishi, Hisao Sasai, Youji Shibahara, Toshiyasu Sugio, Kyoko Tanikawa, Toru Matsunobu, Kengo Terada
  • Patent number: 10715828
    Abstract: According to one embodiment, an image encoding method includes selecting a motion reference block from an already-encoded pixel block. The method includes selecting an available block including different motion information from the motion reference block, and selecting a selection block from the available block. The method includes generating a predicted image of the encoding target block using motion information of the selection block. The method includes encoding a prediction error between the predicted image and an original image. The method includes encoding selection information identifying the selection block by referring to a code table decided according to a number of the available block.
    Type: Grant
    Filed: September 7, 2017
    Date of Patent: July 14, 2020
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Taichiro Shiodera, Saori Asaka, Akiyuki Tanizawa, Takeshi Chujoh
  • Patent number: 10708614
    Abstract: An inter prediction method according to the present invention comprises: a step for deriving reference motion information related to a unit to be decoded in a current picture; and a step for performing motion compensation for the unit to be decoded, using the reference motion information that has been derived. According to the present invention, image encoding/decoding efficiency can be enhanced.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: July 7, 2020
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Sung Chang Lim, Hui Yong Kim, Se Yoon Jeong, Suk Hee Cho, Jong Ho Kim, Ha Hyun Lee, Jin Ho Lee, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn
  • Patent number: 10708597
    Abstract: Examples described herein generally relate to performing frame extrapolation in image frame rendering. A vertex mesh as a set of vertices is generated, and each vertex is mapped to a screen space position for defining a texture. One or more motion vectors for one or more regions in a first image frame of a stream of image frames can be determined. The screen space positions associated with at least a portion of the set of vertices within the texture can be modified based at least in part on the one or more motion vectors. A graphics processing unit (GPU) can render the first image frame into the texture. The extrapolated image frame is displayed after the first image frame and before a next image frame in the stream of image frames.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: July 7, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Andrew Zicheng Yeung, Michael George Boulton, Ashraf Ayman Michail, Matt Bronder, Jack Andrew Elliott, Matthew David Sandy
  • Patent number: 10708615
    Abstract: Disclosed are a method for inducing a prediction motion vector and an apparatus using the same. An image decoding method can include: a step of determining the information related to a plurality of spatial candidate prediction motion vectors from peripheral predicted blocks of a predicted target block; and a step of determining the information related to temporal candidate prediction motion vectors on the basis of the information related to the plurality of spatial candidate prediction motion vectors. Accordingly, the present invention can reduce complexity and can enhance coding efficiency when inducing the optimum prediction motion vector.
    Type: Grant
    Filed: December 10, 2018
    Date of Patent: July 7, 2020
    Assignees: Electronics and Telecommunications Research Institute, Industry-University Cooperation Foundation Korea Aerospace University
    Inventors: Sung Chang Lim, Hui Yong Kim, Jin Ho Lee, Jin Soo Choi, Jin Woong Kim, Jae Gon Kim, Sang Yong Lee, Un Ki Park
  • Patent number: 10701388
    Abstract: Systems and methods for integrated graphics rendering are disclosed. In certain embodiments, the systems and methods utilize a graphics engine, a video encoding engine, and remote client coding engine to render graphics over a network. The systems and methods involve the generation of per-pixel motion vectors, which are converted to per-block motion vectors at the graphics engine. The graphics engine injects these per-block motion vectors into a video encoding engine, such that the video encoding engine may convert those vectors into encoded video data for transmission to the remote client coding engine.
    Type: Grant
    Filed: March 1, 2019
    Date of Patent: June 30, 2020
    Assignee: ZENIMAX MEDIA INC.
    Inventor: Michael Kopietz
  • Patent number: 10701394
    Abstract: A method includes selecting a plurality of low-resolution frames associated with a video, performing a first motion estimation between a first frame and a second frame, performing a second motion estimation between a third frame and the second frame, generating a high-resolution frame representing the second frame based on the first motion estimation, the second motion estimation and the second frame using a sub-pixel convolutional neural network.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: June 30, 2020
    Assignee: Twitter, Inc.
    Inventors: Jose Caballero, Christian Ledig, Andrew Aitken, Alfredo Alejandro Acosta Diaz, Lucas Theis, Ferenc Huszar, Johannes Totz, Zehan Wang, Wenzhe Shi
  • Patent number: 10701392
    Abstract: A method and apparatus of motion vector reconstruction based on one MVP (motion vector predictor) and one MVD (motion vector difference) are disclosed. According to this method, input data associated with a video sequence including a current block in a current picture are received. Candidate reconstructed MV (motion vector) positions corresponding to all candidate sign pairs of the MVD are derived, where each candidate reconstructed MV position is derived as a vector sum of the MVP and the first magnitude and the second magnitude of the MVD with one candidate sign pair of the MVD. Template matching between the template for the current block and a corresponding template for each candidate reconstructed MV position is evaluated. A target candidate MV position among all candidate reconstructed MV positions is selected. The current block is encoded or decoded using a target candidate MV corresponding to the target candidate MV position.
    Type: Grant
    Filed: November 21, 2017
    Date of Patent: June 30, 2020
    Assignee: MEDIATEK INC.
    Inventor: Chih-Wei Hsu
  • Patent number: 10701390
    Abstract: Techniques and systems are provided for deriving one or more sets of affine motion parameters at a decoder. For example, the decoder can obtain video data from an encoded video bitstream. The video data includes at least a current picture and a reference picture. The decoder can determine a set of affine motion parameters for a current block of the current picture. The set of affine motion parameters can be used for performing motion compensation prediction for the current block. The set of affine motion parameters can be determined using a current affine template of the current block and a reference affine template of the reference picture.
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: June 30, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Xiang Li, Yi-Wen Chen, Jianle Chen, Hsiao-Chiang Chuang, Wei-Jung Chien, Yu-Chen Sun, Marta Karczewicz
  • Patent number: 10701389
    Abstract: A temporal merging motion information candidate generation unit derives, when information indicating whether or not to derive a temporal merging motion information candidate shared for all prediction blocks in a coding block is information indicating the derivation of a temporal merging motion information candidate shared for all the prediction blocks in the coding block, a temporal merging motion information candidate shared for all the prediction blocks in the coding block from a prediction block of a coded picture different from a picture having a prediction block subject to coding. A merging motion information candidate list construction unit generates a plurality of merging motion information candidates including a temporal merging motion information candidate.
    Type: Grant
    Filed: June 16, 2016
    Date of Patent: June 30, 2020
    Assignee: JVC KENWOOD CORPORATION
    Inventors: Hideki Takehara, Hiroya Nakamura, Shigeru Fukushima
  • Patent number: 10694218
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: January 28, 2019
    Date of Patent: June 23, 2020
    Assignee: GE VIDEO COMPRESSION, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Patent number: 10694189
    Abstract: Reference data is one type of data that the video accelerator may frequently be read from external memory. In various examples, the video accelerator can adaptively select inter-prediction modes based on the bandwidth to external memory that is available at any point in time. The video accelerator can determine the amount of bandwidth that is available, and when the bandwidth is insufficient for obtaining reference data for all possible inter-prediction modes, the video accelerator can select an inter-prediction mode based on the size of the reference window associated with the inter-prediction mode, the size being within an amount of data that can be read with the available bandwidth. The video accelerator can then obtain a reference window from external memory, and perform prediction using the selected inter-prediction mode and the reference window.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: June 23, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Kiran Kalkunte Seshadri, Asif Khan
  • Patent number: 10694206
    Abstract: Techniques for direct mode video coding/decoding techniques. According to one embodiment, various blocks in B frames may use motion vectors from different reference frames (P frames or B frames), according to what is referred to herein as a patchwork motion field. Different blocks of a given frame may use motion vectors inherited from different frames for purposes of computing a predicted block for the given frame.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: June 23, 2020
    Assignee: Cisco Technology, Inc.
    Inventors: Arild Fuldseth, Gisle Bjontegaard
  • Patent number: 10694165
    Abstract: The usual coding order according to which the reference view is coded prior to the dependent view, and within each view, a depth map is coded subsequent to the respective picture, may be maintained and does lead to a sacrifice of efficiency in performing inter-view redundancy removal by, for example, predicting motion data of the current picture of the dependent view from motion data of the current picture of the reference view. Rather, a depth map estimate of the current picture of the dependent view is obtained by warping the depth map of the current picture of the reference view into the dependent view, thereby enabling various methods of inter-view redundancy reduction more efficiently by bridging the gap between the views.
    Type: Grant
    Filed: May 9, 2014
    Date of Patent: June 23, 2020
    Assignee: GE VIDEO COMPRESSION, LLC
    Inventors: Heiko Schwarz, Thomas Wiegand
  • Patent number: 10694187
    Abstract: A video decoding method performed by a decoding device, according to the present invention, comprises the steps of: deriving at least one reference block for an object block; deriving a partitioned structure of the object block on the basis of a partitioned structure of the at least one reference block; partitioning the object block into a plurality of sub blocks on the basis of the derived partitioned structure; and generating recovered samples by decoding the plurality of sub blocks. According to the present invention, a partitioned structure of a current picture can be derived on the basis of a reference block of a neighboring picture, and thus the amount of data used in the additional information signaled for partitioning of the current picture can be reduced and overall coding efficiency can be improved.
    Type: Grant
    Filed: March 18, 2016
    Date of Patent: June 23, 2020
    Assignee: LG Electronics Inc.
    Inventors: Jaehyun Lim, Naeri Park
  • Patent number: 10687075
    Abstract: Techniques and tools for sub-block transform coding are described. For example, a video encoder adaptively switches between 8×8, 8×4, and 4×8 DCTs when encoding 8×8 prediction residual blocks; a corresponding video decoder switches between 8×8, 8×4, and 4×8 inverse DCTs during decoding. The video encoder may determine the transform sizes as well as switching levels (e.g., frame, macroblock, or block) in a closed loop evaluation of the different transform sizes and switching levels. The encoder and decoder may use different scan patterns for different transform sizes when scanning values from two-dimensional blocks into one-dimensional arrays, or vice versa. The encoder and decoder may use sub-block pattern codes to indicate the presence or absence of information for the sub-blocks of particular blocks.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: June 16, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Thomas W. Holcomb, Chih-Lung Lin
  • Patent number: 10687077
    Abstract: Techniques are directed to a device for decoding a current block of video data in a current coding picture. The device may include a memory configured to store video data. The device may also include a processor configured to generate a first prediction block for the current block of the video data in the current picture according to an intra-prediction mode and generate a second prediction block for the current block of the video data in the current picture the picture according to an inter-prediction mode. The processor may be configured to generate motion information propagated from the second prediction block of the picture to the first prediction block, and use the motion information to obtain a final prediction block, then generate a reconstructed block based on a combination of the final prediction block and a residual block.
    Type: Grant
    Filed: June 18, 2018
    Date of Patent: June 16, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Kai Zhang, Xiang Li, Jianle Chen, Li Zhang, Marta Karczewicz
  • Patent number: 10687070
    Abstract: A method for encoding a video sequence in a scalable video encoder to generate a scalable bitstream is provided that includes encoding the video sequence in a first layer encoder of the scalable video encoder to generate a first sub-bitstream, encoding the video sequence in a second layer encoder of the scalable video encoder to generate a second sub-bitstream, wherein portions of the video sequence being encoded in the second layer encoder are predicted using reference portions of the video sequence encoded in the first layer encoder, combining the first sub-bitstream and the second sub-bitstream in the scalable bitstream, and signaling an indication of a highest temporal level of the first sub-bitstream comprising at least one of the reference portions in the scalable bitstream.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: June 16, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Do-Kyoung Kwon, Madhukar Budagavi
  • Patent number: 10687037
    Abstract: A photographing apparatus is disclosed.
    Type: Grant
    Filed: April 11, 2017
    Date of Patent: June 16, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hyung-Ju Chun, Sung-Oh Kim, Hyun-Hee Park, Yong-Man Lee, Jae-Moon Kim, Seul-Ki Jang, Jong-Bum Choi, Jung-Jun Lee, Sung-Jun Lim, Kwang-Tai Kim, Soo-Hyung Kim, Dong-Hyun Yeom, Ki-Huk Lee
  • Patent number: 10687085
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: February 8, 2019
    Date of Patent: June 16, 2020
    Assignee: GE VIDEO COMPRESSION, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Patent number: 10681323
    Abstract: Methods, systems, and media for generating a summarized video using frame rate modification are provided. In some embodiments, a method for editing a video is provided, the method comprising: receiving, using a hardware processor, a video file; identifying a plurality of frames at a playback frame rate from the video file; generating an edited video file by extracting a subset of the plurality of frames, wherein the extracted frames in the subset of the plurality of frames are separated by a predetermined length in the plurality of frames and wherein extracting the subset of the plurality frames modifies a frame rate of at least a portion of the video file to an effective frame rate; storing the edited video file; and presenting the edited video file at the playback frame rate.
    Type: Grant
    Filed: August 14, 2017
    Date of Patent: June 9, 2020
    Assignee: Google LLC
    Inventor: Yan Tseytlin
  • Patent number: 10681364
    Abstract: The present invention relates to a video encoding method, a video decoding method, and a device using the same, and the video encoding method according to the present invention comprises the steps of: specifying a tile and a slice by partitioning an inputted picture; performing encoding on the basis of the tile and the slice; and transmitting the encoded video information, wherein the picture is partitioned into one or more tiles and one or more slices, and the restrictions for parallel processing can be applied to the tiles and the slices.
    Type: Grant
    Filed: August 27, 2018
    Date of Patent: June 9, 2020
    Assignee: LG ELECTRONICS INC.
    Inventors: Hendry Hendry, Joonyoung Park, Yongjoon Jeon, Byeongmoon Jeon, Jungsun Kim, Jaehyun Lim, Chulkeun Kim, Naeri Park, Seungwook Park
  • Patent number: 10681379
    Abstract: Techniques are described in which a decoder is configured to reorganize a first 2-dimensional coefficient block as a first 1-dimensional coefficient vector according to a coefficient scanning order and apply a first inverse transform to the first 1-dimensional coefficient vector to generate a second 1-dimensional coefficient vector. The first inverse transform is a non-separable transform. The decoder is further configured to reorganize the first 1-dimensional coefficient vector as a second 2-dimensional coefficient block and apply a second inverse transform to the second 2-dimensional coefficient block to generate a residual video block. The second inverse transform converts the second 2-dimensional coefficient block from a frequency domain to a pixel domain. The decoder is further configured to form a decoded video block, wherein forming the decoded video block comprises summing the residual video block with one or more predictive blocks.
    Type: Grant
    Filed: September 20, 2016
    Date of Patent: June 9, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Xin Zhao, Jianle Chen, Amir Said, Marta Karczewicz, Vadim Seregin
  • Patent number: 10674178
    Abstract: A method for segmenting images for estimating motion includes scanning block rows of an image to determine whether image blocks that are adjacent within a row are similar, and grouping similar image blocks into a row segment. If a block in a row is not similar to a preceding adjacent block, the block is used to initialize a new row segment. The method further includes calculating data for each row segment in an image, and using this data to determine whether a motion vector field for a row segment is consistent, whether discontinuities exist in a row segment that can be corrected, or whether discontinuities exist in a row segment that cannot be corrected, and correcting those row segment discontinuities that can be fixed to remove artifacts from a set of motion vectors associated with said row segment.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: June 2, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yonatan Winetraub, Omri Govrin
  • Patent number: 10674157
    Abstract: Methods and apparatus for parsing friendly and error resilient merge flag coding in video coding are provided. In some methods, in contrast to merging candidate list size dependent coding of the merge flag in the prior art, a merge flag is always encoded in the encoded bit stream for each inter-predicted prediction unit (PU) that is not encoded using skip mode. In some methods, in contrast to the prior art that allowed the merging candidate list to be empty, one or more zero motion vector merging candidates formatted according to the prediction type of the slice containing a PU are added to the merging candidate list if needed to ensure that the list is not empty and/or to ensure that the list contains a maximum number of merging candidates.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: June 2, 2020
    Assignee: Texas Instruments Incorporated
    Inventor: Minhua Zhou
  • Patent number: 10674185
    Abstract: A method for enhancing a region of interest in video frames of a video stream is described.
    Type: Grant
    Filed: October 7, 2016
    Date of Patent: June 2, 2020
    Assignee: Koninklijke KPN N.V.
    Inventors: Emmanuel Thomas, Ray Van Brandenburg, Mattijs Oskar Van Deventer