Patents by Inventor Detlev Marpe

Detlev Marpe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11546642
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: January 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11546618
    Abstract: The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with.
    Type: Grant
    Filed: April 23, 2021
    Date of Patent: January 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Detlev Marpe, Robert Skupin, Yago Sanchez De La Fuente, Gerhard Tech
  • Patent number: 11546641
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: June 29, 2016
    Date of Patent: January 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Patent number: 11546630
    Abstract: Video decoder and/or video encoder, configured to determine a set of search area location candidates in a reference picture of a video; match the set of search area location candidates with a current template area adjacent to a current block of a current picture to obtain a best matching search area location candidate; select, out of a search area positioned in the reference picture at the best matching search area location candidate, a set of one or more predictor blocks by matching the current template area against the search area; and predictively decode/encode the current block from/into a data stream based on the set of one or more predictor blocks.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: January 3, 2023
    Inventors: Gayathri Venugopal, Detlev Marpe, Thomas Wiegand
  • Publication number: 20220416810
    Abstract: Decomposing a value range of the respective syntax elements into a sequence of n partitions with coding the components of z laying within the respective partitions separately with at least one by VLC coding and with at least one by PIPE or entropy coding is used to greatly increase the compression efficiency at a moderate coding overhead since the coding scheme used may be better adapted to the syntax element statistics. Accordingly, syntax elements are decomposed into a respective number n of source symbols si with i=1 . . . n, the respective number n of source symbols depending on as to which of a sequence of n partitions into which a value range of the respective syntax elements is sub-divided, a value z of the respective syntax elements falls into, so that a sum of values of the respective number of source symbols si yields z, and, if n>1, for all i=1 . . . n?1, the value of si corresponds to a range of the ith partition.
    Type: Application
    Filed: June 24, 2022
    Publication date: December 29, 2022
    Inventors: Detlev Marpe, Tung Nguyen, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20220417538
    Abstract: A video decoder is configured to decode a plurality of video frames which are subdivided into a set of one or more slices. The decoder evaluates slice type information indicating whether a slice is encoded using an independent coding mode having no prediction of video content of a current frame on the basis of a video content of a previous frame, or using a single-predictive mode having a prediction of a block of pixels on the basis of one block of pixels of a previous frame, or using a bi-predictive mode having a prediction of a block of pixels on the basis of two or more blocks of pixels of one or more previous frames, to select a mode of operation for decoding a slice. The video decoder includes an arithmetic decoder for providing a decoded binary sequence on the basis of an encoded representation of the binary sequence.
    Type: Application
    Filed: August 31, 2022
    Publication date: December 29, 2022
    Inventors: Jan STEGEMANN, Heiner KIRCHHOFFER, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Patent number: 11533485
    Abstract: An entropy decoder is configured to, for horizontal and vertical components of motion vector differences, derive a truncated unary code from the data stream using context-adaptive binary entropy decoding with exactly one context per bin position of the truncated unary code, which is common for horizontal and vertical components of the motion vector differences, and an Exp-Golomb code using a constant equi-probability bypass mode to obtain the binarizations of the motion vector differences. A desymbolizer is configured to debinarize the binarizations of the motion vector difference syntax elements to obtain integer values of the horizontal and vertical components of the motion vector differences. A reconstructor is configured to reconstruct a video based on the integer values of the horizontal and vertical components of the motion vector differences.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: December 20, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand
  • Patent number: 11533486
    Abstract: The coding of a media signal is rendered more efficient by describing the media signal using a sequence of samples and sequentially encoding this sequence by selecting, for a current sample, a set of quantization levels out of a plurality of quantization level sets depending on indices encoded into the data stream for previous samples of the sequence of samples, quantizing the current sample onto one level of the set of quantization levels, and encoding a quantization index to the one level for the current sample into the data stream. In other words, scalar quantization of the individual samples of the sequence of samples is used, but it is rendered dependent on quantization indices encoded into the data stream for previous samples of the sequence of samples.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: December 20, 2022
    Assignee: Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V.
    Inventors: Heiko Schwarz, Thomas Wiegand, Phan Hoang Tung Nguyen, Detlev Marpe
  • Publication number: 20220400271
    Abstract: Scalable video coding is rendered more efficient by deriving/selecting a subblock subdivision to be used for enhancement layer prediction, among a set of possible subblock subdivisions of an enhancement layer block by evaluating the spatial variation of the base layer coding parameters over the base layer signal. By this measure, less of the signalization overhead has to be spent on signaling this subblock subdivision within the enhancement layer data stream, if any. The subblock subdivision thus selected may be used in predictively coding/decoding the enhancement layer signal.
    Type: Application
    Filed: June 23, 2022
    Publication date: December 15, 2022
    Inventors: Tobias HINZ, Haricharan LAKSHMAN, Jan STEGEMANN, Philipp HELLE, Mischa SIEKMANN, Karsten SUEHRING, Detlev MARPE, Heiko SCHWARZ, Christian BARTNIK, Ali Atef Ibrahim KHAIRAT ABDELHAMID, Heiner KIRCHHOFFER, Thomas WIEGAND
  • Publication number: 20220393986
    Abstract: Embodiments according to a first aspect of the present invention are based on the idea, that neural network parameters may be compressed more efficiently by using a non-constant quantizer, but varying same during coding the neural network parameters, namely by selecting a set of reconstruction levels depending on quantization indices decoded from, or respectively encoded, into the data stream for previous or respectively previously encoded neural network parameters. Embodiments according to a second aspect of the present invention are based on the idea that a more efficient neural network coding may be achieved when done in stages—called reconstruction layers to distinguish them from the layered composition of the neural network in neural layers—and if the parametrizations provided in these stages are then, neural network parameter-wise combined to yield a neural network parametrization improved compared to any of the stages.
    Type: Application
    Filed: June 17, 2022
    Publication date: December 8, 2022
    Inventors: Paul HAASE, Heiner KIRCHHOFFER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11516487
    Abstract: Various concepts which further improve multi-view/layer coding concepts, are described.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: November 29, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Robert Skupin, Karsten Suehring, Yago Sanchez De La Fuente, Gerhard Tech, Valeri George, Thomas Schierl, Detlev Marpe
  • Patent number: 11516474
    Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initial
    Type: Grant
    Filed: April 16, 2021
    Date of Patent: November 29, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand
  • Patent number: 11509916
    Abstract: The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with.
    Type: Grant
    Filed: April 23, 2021
    Date of Patent: November 22, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Detlev Marpe, Robert Skupin, Yago Sanchez De La Fuente, Gerhard Tech
  • Patent number: 11503339
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: November 15, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Tobias Hinz, Philipp Merkle, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20220360793
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Application
    Filed: July 26, 2022
    Publication date: November 10, 2022
    Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Patent number: 11477467
    Abstract: Scalable video coding is rendered more efficient by deriving/selecting a subblock subdivision to be used for enhancement layer prediction, among a set of possible subblock subdivisions of an enhancement layer block by evaluating the spatial variation of the base layer coding parameters over the base layer signal. By this measure, less of the signalization overhead has to be spent on signaling this subblock subdivision within the enhancement layer data stream, if any. The subblock subdivision thus selected may be used in predictively coding/decoding the enhancement layer signal.
    Type: Grant
    Filed: May 11, 2020
    Date of Patent: October 18, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Publication number: 20220321881
    Abstract: In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.
    Type: Application
    Filed: June 13, 2022
    Publication date: October 6, 2022
    Inventors: Jonathan PFAFF, Philipp HELLE, Dominique MANIRY, Thomas WIEGARD, Wojciech SAMEK, Stephan KALTENSTADLER, Heiko SCHWARZ, Detlev MARPE, Mischa SIEKMANN, Martin WINKEN
  • Publication number: 20220321886
    Abstract: A decoder configured to decode residual levels, and sequentially dequantize the residual levels by selecting a quantizer out of a set of default quantizers depending on a current transition state, and updating the current transition state depending on a current residual level's characteristic obtained by an application of a binary function onto the current residual level, and depending on a quantization mode information contained in the data stream. The current transition state transitions, according to a surjective mapping which depends on the quantization mode information, from a domain of combinations of a set of one or more transition states with the current residual level's characteristic onto the set of one or more transition states, wherein a cardinality of the set of one or more transition states differs depending on the quantization mode information.
    Type: Application
    Filed: June 13, 2022
    Publication date: October 6, 2022
    Inventors: Heiko SCHWARZ, Soenke SCHMIDT, Paul HAASE, Phan Hoang Tung NGUYEN, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11463694
    Abstract: Block-based coding of a picture is done by providing an intra-prediction coding concept according to which a certain block of the picture is intra-prediction coded using a certain intra-coding mode by partitioning the predetermined block into partitions which are, for reconstruction purposes, sequentially subject to spatial prediction using the intra-prediction coding mode signaled for the certain block followed by correcting the thus obtained predictor using a prediction residual so that for preceding partitions a reconstruction of the samples is available to the decoder at the time of processing the next, then current, partition.
    Type: Grant
    Filed: January 13, 2021
    Date of Patent: October 4, 2022
    Assignee: Fraumhofer-Gesellschaft zur Forderung der angewandten Forschung e.V.
    Inventors: Santiago De Luxán Hernández, Philipp Merkle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11457230
    Abstract: A video decoder is configured to decode a plurality of video frames which are subdivided into a set of one or more slices. The decoder evaluates slice type information indicating whether a slice is encoded using an independent coding mode having no prediction of video content of a current frame on the basis of a video content of a previous frame, or using a single-predictive mode having a prediction of a block of pixels on the basis of one block of pixels of a previous frame, or using a bi-predictive mode having a prediction of a block of pixels on the basis of two or more blocks of pixels of one or more previous frames, to select a mode of operation for decoding a slice. The video decoder includes an arithmetic decoder for providing a decoded binary sequence on the basis of an encoded representation of the binary sequence.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: September 27, 2022
    Assignee: Fraunhofer-Gesellschaft zur Forderung der angewandten Forschung e.V.
    Inventors: Jan Stegemann, Heiner Kirchhoffer, Detlev Marpe, Heiko Schwarz, Thomas Wiegand