Patents by Inventor Detlev Marpe

Detlev Marpe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11611761
    Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: March 21, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Martin Winken, Heiner Kirchhoffer, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230078680
    Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initial
    Type: Application
    Filed: September 9, 2022
    Publication date: March 16, 2023
    Inventors: Valeri GEORGE, Benjamin BROSS, Heiner KIRCHHOFFER, Detlev MARPE, Tung NGUYEN, Matthias PREISS, Mischa SIEKMANN, Jan STEGEMANN, Thomas WIEGAND
  • Patent number: 11606554
    Abstract: A video encoder is configured to encode, by block based predictive encoding, pictures of a video into coding data, wherein the block based predictive encoding includes an intra-picture prediction. The video encoder is configured to use, for the intra-picture prediction, for encoding a prediction block of a picture, a plurality of nearest reference samples of the picture directly neighboring the prediction block and a plurality of extended reference samples, each extended reference sample of the plurality of extended reference samples separated from the prediction block at least by one nearest reference sample of the plurality of reference samples. The video encoder is further configured to sequentially determine an availability or unavailability of each of the plurality of nearest reference samples and to substitute a nearest reference sample being determined as unavailable by a substitution sample. The video encoder is configured to use the substitution sample for the intra-picture prediction.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: March 14, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Benjamin Bross, Philipp Merkle, Simone Walter, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Paul Keydel
  • Publication number: 20230075514
    Abstract: Apparatus for generating a NN representation, configured to quantize an NN parameter onto a quantized value by determining a quantization parameter and a quantization value for the NN parameter so that from the quantization parameter, there is derivable a multiplier and a bit shift number. Additionally, the determining of the quantization parameter and the quantization value for the NN parameter is performed so that the quantized value of the NN parameter corresponds to a product between the quantization value and a factor, which depends on the multiplier, bit-shifted by a number of bits which depends on the bit shift number.
    Type: Application
    Filed: October 13, 2022
    Publication date: March 9, 2023
    Inventors: Simon WIEDEMANN, Talmaj MARINC, Wojciech SAMEK, Paul HAASE, Karsten MÜLLER, Heiner KIRCHHOFFER, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Publication number: 20230075174
    Abstract: The coding of a media signal is rendered more efficient by describing the media signal using a sequence of samples and sequentially encoding this sequence by selecting, for a current sample, a set of quantization levels out of a plurality of quantization level sets depending on indices encoded into the data stream for previous samples of the sequence of samples, quantizing the current sample onto one level of the set of quantization levels, and encoding a quantization index to the one level for the current sample into the data stream. In other words, scalar quantization of the individual samples of the sequence of samples is used, but it is rendered dependent on quantization indices encoded into the data stream for previous samples of the sequence of samples.
    Type: Application
    Filed: November 15, 2022
    Publication date: March 9, 2023
    Inventors: Heiko Schwarz, Thomas Wiegand, Phan Hoang Tung Nguyen, Detlev Marpe
  • Patent number: 11601648
    Abstract: A video decoder decodes a first indication (190) indicating whether transform coefficients of a first transform coefficient block (921) corresponding to a first color component are encoded into a data stream. The decoder also decodes a second indication (190) indicating whether transform coefficients of a second transform coefficient block (922) corresponding to a second color component are encoded into the data stream using context-adaptive entropy decoding with a context selected based on the first indication for the first transform coefficient block (921). The decoder further derives a block (84) of the picture by, separately for the first color component and the second color component, a reverse transformation of the first transform coefficient block (921 and the second transform block (922, respectively.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: March 7, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Paul Haase, Christian Rudat, Heiner Kirchhoffer, Phan Hoang Tung Nguyen, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11601672
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: March 7, 2023
    Assignee: Fraunhofer-Gesellschaft zur Forderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11595675
    Abstract: The entropy coding of a current part of a predetermined entropy slice is based on, not only, the respective probability estimations of the predetermined entropy slice as adapted using the previously coded part of the predetermined entropy slice, but also probability estimations as used in the entropy coding of a spatially neighboring, in entropy slice order preceding entropy slice at a neighboring part thereof. Thereby, the probability estimations used in entropy coding are adapted to the actual symbol statistics more closely, thereby lowering the coding efficiency decrease normally caused by lower-delay concepts. Temporal interrelationships are exploited additionally or alternatively.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: February 28, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Anastasia Henkel, Heiner Kirchhoffer, Detlev Marpe, Thomas Schierl
  • Patent number: 11595674
    Abstract: Reconstructing a second component signal relating to a second component of a multi-component picture from a spatially corresponding portion of a reconstructed first component signal and a correction signal derived from a data stream for the second component promises increased coding efficiency over a broader range of multi-component picture content. By including the spatially corresponding portion of the reconstructed first component signal into the reconstruction of the second component signal, any remaining inter-component redundancies/correlations present such as still present despite a possibly a priori performed component space transformation, or present because of having been introduced by such a priori performed component space transformation, for example, may readily be removed by way of the inter-component redundancy/correlation reduction of the second component signal.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: February 28, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tung Nguyen, Ali Atef Ibrahim Khairat Abdelhamid, Detlev Marpe
  • Publication number: 20230059366
    Abstract: Concepts are described, including encoding of a video into data stream and decoding of a data stream having a video encoded thereinto, using motion compensation prediction between pictures of equal resolution and pictures of different resolution, based on motion vectors at a half-sample resolution and on motion vectors at a different resolution using interpolation filters to obtain sub-sample values within a reference sample array. The interpolation filter is selected from two interpolation filter versions different in a higher edge preserving property, and the selection is depending on whether a current picture is equal in picture resolution to the reference sample array in horizontal and/or vertical dimension, and/or a constraint information in the data stream.
    Type: Application
    Filed: December 21, 2020
    Publication date: February 23, 2023
    Inventors: Benjamin BROSS, Yago SÁNCHEZ DE LA FUENTE, Robert SKUPIN, Martin WINKEN, Heiko SCHWARZ, Detlev MARPE, Thomas SCHIERL, Thomas WIEGAND
  • Patent number: 11589062
    Abstract: A subblock-based coding of transform coefficient blocks of the enhancement layer is rendered more efficient. To this end, the subblock subdivision of the respective transform coefficient block is controlled on the basis of the base layer residual signal or the base layer signal. In particular, by exploiting the respective base layer hint, the subblocks may be made longer along a spatial frequency axis transverse to edge extensions observable from the base layer residual signal or the base layer signal.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: February 21, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Patent number: 11582473
    Abstract: Various concepts which further improve multi-view/layer coding concepts, are described.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: February 14, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Robert Skupin, Karsten Suehring, Yago Sanchez De La Fuente, Gerhard Tech, Valeri George, Thomas Schierl, Detlev Marpe
  • Publication number: 20230039672
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Application
    Filed: October 7, 2022
    Publication date: February 9, 2023
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Philipp Merkle, Tobias Hinz, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230044030
    Abstract: A video decoder employs context-adaptive binary arithmetic coding for decoding a video from a data stream. The video decoder determines a parametrization for the context-adaptive binary arithmetic coding.
    Type: Application
    Filed: December 29, 2020
    Publication date: February 9, 2023
    Inventors: Phan Hoang Tung NGUYEN, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11575921
    Abstract: The coding efficiency of scalable video coding is increased by substituting missing spatial intra prediction parameter candidates in a spatial neighborhood of a current block of the enhancement layer by use of intra prediction parameters of a co-located block of the base layer signal. By this measure, the coding efficiency for coding the spatial intra prediction parameters is increased due to the improved prediction quality of the set of intra prediction parameters of the enhancement layer, or, more precisely stated, the increased likelihood, that appropriate predictors for the intra prediction parameters for an intra predicted block of the enhancement layer are available thereby increasing the likelihood that the signaling of the intra prediction parameter of the respective enhancement layer block may be performed, on average, with less bits.
    Type: Grant
    Filed: April 29, 2020
    Date of Patent: February 7, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Publication number: 20230036509
    Abstract: Apparatus for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from the data stream (12), a mode index (200), the mode index pointing to one out of a list (204) of matrix-based intra-prediction modes. Additionally, the apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighborhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix vector product (206) onto sample positions (104) of the predetermined block.
    Type: Application
    Filed: December 4, 2020
    Publication date: February 2, 2023
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230025784
    Abstract: Block-based coding of a picture is done by providing an intra-prediction coding concept according to which a certain block of the picture is intra-prediction coded using a certain intra-coding mode by partitioning the predetermined block into partitions which are, for reconstruction purposes, sequentially subject to spatial prediction using the intra-prediction coding mode signaled for the certain block followed by correcting the thus obtained predictor using a prediction residual so that for preceding partitions a reconstruction of the samples is available to the decoder at the time of processing the next, then current, partition.
    Type: Application
    Filed: October 3, 2022
    Publication date: January 26, 2023
    Inventors: Santiago De Luxán Hernández, Philipp Merkle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11553207
    Abstract: A video decoder and method for supporting a prediction mode for predicting blocks of a video is configured to predict each of the blocks by extrapolating a neighborhood of the respective block into the block along a direction which varies across the respective block.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: January 10, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Philipp Merkle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11553212
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: January 21, 2020
    Date of Patent: January 10, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Publication number: 20230007252
    Abstract: Decoder for decoding a transformed representation of a sample block from a data stream. If a first coded coefficient is located inside a predetermined subarea of the transform coefficient block and if the underlying transform is within a first set of available transforms, the decoder decodes coefficients along a first coefficient scan order. If the transform is within a second set of In available transforms, the decoder decodes coefficients located within the predetermined subarea along a second coefficient scan order, and infers that coefficients located outside the predetermined subarea are zero. The first coefficient scan order is so that coefficients outside the predetermined subarea are scanned between two transform coefficients located inside the predetermined subarea. The second coefficient scan order does not scan any coefficient outside the predetermined subarea between scanning the coefficients within the predetermined subarea.
    Type: Application
    Filed: November 25, 2020
    Publication date: January 5, 2023
    Inventors: Benjamin Bross, Santiago De Luxán Hernández, Heiko Schwarz, Detlev Marpe, Thomas Wiegand