Patents by Inventor Detlev Marpe

Detlev Marpe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11343517
    Abstract: Parallel processing concepts such as wavefront parallel processing, are realized with a reduced end-to-end delay by giving up the usual slice concept according to which slices are either coded/decoded completely independent from areas of the picture outside of the respective slice, or at least independent from areas outside the respective slice as far as the entropy coding is concerned, namely in favor of slices of different modes, namely ones called dependent slices which allow for interdependencies across slice boundaries, and others which do not, called normal slices, for example. Combined with the aspect or not, WPP processing concept is made more efficiently by using the slices' start syntax portions to locate WPP entry points.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: May 24, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Thomas Schierl, Valeri George, Anastasia Henkel, Detlev Marpe, Karsten Grüneberg, Robert Skupin
  • Patent number: 11336890
    Abstract: A video decoder for decoding an encoded video signal including encoded picture data and indication data of a picture of a video to reconstruct the picture of the video is provided. The video decoder includes an interface configured for receiving the encoded video signal, and a data decoder configured for reconstructing the picture of the video by decoding the encoded picture data using the indication data. The picture is partitioned into a plurality of coding areas. One or more coding areas of the plurality of coding areas include two or more coding tree units of the plurality of coding tree units, wherein each coding area of the one or more coding areas which includes two or more coding tree units exhibits a coding order for the two or more coding tree units of the coding area.
    Type: Grant
    Filed: January 4, 2021
    Date of Patent: May 17, 2022
    Assignee: Fraunhofer-Gesellschaft zur Forderung der angewandten Forschung e.V.
    Inventors: Valeri George, Tobias Hinz, Jackie Ma, Yago Sánchez De La Fuente, Robert Skupin, Thomas Schierl, Jens Brandenburg, Christian Lehmann, Adam Wieckowski, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11330242
    Abstract: Embodiments are described which exploit a finding, according to which a higher compression rate or better rate/distortion ratio may be achieved by adopting or predicting second coding parameters used for encoding a second view of the multi-view signal from first coding parameters used in encoding a first view of the multi-view signal. In other words, the inventors found out that the redundancies between views of a multi-view signal are not restricted to the views themselves, such as the video information thereof, but that the coding parameters in parallely encoding these views show similarities which may be exploited in order to further improve the coding rate.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: May 10, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Thomas Wiegand, Detlev Marpe, Karsten Mueller, Philipp Merkle, Gerhard Tech, Hunn Rhee, Heiko Schwarz
  • Publication number: 20220141474
    Abstract: A number of negatively affected (correctly received) packets due to packet loss is reduced by providing, and analyzing, error resilience in the packets of the sequence of packets and identifying, for each of runs of one or more lost packets of the sequence of packets, a first packet in the sequence of packets after the respective run of one or more lost packets, which carries a beginning of any of the tiles of the video data stream, and concurrently carries a slice, the slice header of which is contained in any of the packets of the sequence of packets not being lost. In particular, the side information overhead for transmitting the error resilience data is comparatively low compared to the reduction in negatively affected packets due to packet loss.
    Type: Application
    Filed: January 14, 2022
    Publication date: May 5, 2022
    Inventors: Karsten SUEHRING, Thomas SCHIERL, Detlev MARPE, Robert SKUPIN, Yago SANCHEZ DE LA FUENTE, Gerhard TECH
  • Publication number: 20220132169
    Abstract: Decoder for decoding a picture from a data stream, configured to check whether a plurality of coding parameters, which are contained in the data stream, relate to a predetermined portion of the picture and control a prediction residual transform mode and a quantization accuracy with respect to the predetermined portion, are indicative of a coding parameter setting corresponding to a lossless prediction residual coding. Responsive to the plurality of coding parameters being indicative of the coding parameter setting corresponding to the lossless prediction residual coding, the decoder is configured to set one or more predetermined coding options relating to one or more tools of the decoder for processing a prediction residual corrected predictive reconstruction with respect to the predetermined portion so that the one or more tools are disabled with respect to the predetermined portion.
    Type: Application
    Filed: January 4, 2022
    Publication date: April 28, 2022
    Inventors: Christian HELMRICH, Benjamin BROSS, Tung Hoang NGUYEN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220132108
    Abstract: Video codec for supporting temporal inter-prediction, configured to perform padding of an area of a referenced portion of a reference picture which extends beyond a border of the reference picture, which referenced portion is referenced by an inter predicted block of a current picture by selecting one of a plurality of intra-prediction modes, and padding the area using the selected intra-prediction mode.
    Type: Application
    Filed: January 5, 2022
    Publication date: April 28, 2022
    Inventors: Jens BRANDENBURG, Tobias HINZ, Adam WIECKOWSKI, Jackie MA, Valeri GEORGE, Christian LEHMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Robert SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Thomas SCHIERL
  • Publication number: 20220132167
    Abstract: A previously encoded or reconstructed version of a neighborhood of a predetermined block to be predicted is exploited so as to result into a more efficient predictive coding of the prediction block. In particular, a spectral decomposition of a region composed of this neighborhood and a first version of a predicted filling of the predetermined block results into a first spectrum which is subject to noise reduction and the thus resulting second spectrum may be subject to a spectral composition, thereby resulting in a modified version of this region including a second version of the predicted filling of the predetermined block. Owing to the exploitation of the already processed, i.e. encoded/reconstructed, neighborhood of the predetermined block, the second version of the predicted filling of the predetermined block tends to improve the coding efficiency.
    Type: Application
    Filed: September 2, 2021
    Publication date: April 28, 2022
    Inventors: Jonathan PFAFF, Martin WINKEN, Christian RUDAT, Heiko SCHWARZ, Thomas WIEGAND, Detlev MARPE
  • Publication number: 20220124372
    Abstract: Decoder for decoding a picture, wherein blocks into which the picture is subdivided are assigned to a set of prediction types, which include intra prediction and inter prediction. For each of predetermined intra-predicted blocks, the decoder is configured to derive, from the data stream, an information on a partitioning of the respective predetermined intra-predicted block into partitions. The decoder is configured to derive, from the data stream, for each partition of the respective predetermined intra-predicted block, a partition-specific prediction residual signal related to a spatial domain prediction residual signal of the respective partition of the respective predetermined intra-predicted block via a predetermined transform. The predetermined transform can be identified out of a set of transforms including a first transform and a second transform, which equals a concatenation of a primary transform and a secondary transform applied onto a subset of coefficients of the primary transform.
    Type: Application
    Filed: December 17, 2021
    Publication date: April 21, 2022
    Inventors: Santiago DE LUXÁN HERNÁNDEZ, Valeri GEORGE, Gayathri VENUGOPAL, Jens BRANDENBURG, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220116606
    Abstract: An apparatus configured to select a predetermined intra prediction mode out of a plurality of intra-prediction modes which includes a first set of intra-prediction modes and a second set of matrix-based intra-prediction modes. The apparatus is configured to select a subset of one or more secondary transforms dependent on the predetermined intra prediction mode so that the subset is nonempty in case of the predetermined intra prediction mode being contained in the first set of intra-prediction modes or in the second set of matrix-based intra-prediction modes. The apparatus is configured to derive a transformed version of a prediction residual for a predetermined block, which is related to a spatial domain version of the prediction residual of the predetermined block via a transform defined by a concatenation of a primary transform and a predetermined secondary transform out of the subset of secondary transforms.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220116618
    Abstract: A video decoder and a video encoder include a noise reduction operation including at least two denoising operations and adapting the second denoising operation in dependence of the difference before and after the first denoising operation, thus correcting the quality reduction occurred due to the application of the first denoising operation. Corresponding methods serve to encode and decode video signals.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Wang-Q LIM, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220109842
    Abstract: Wedgelet-based coding for coding blocks of varying size is rendered more efficient by the usage of a variable length coded syntax element having a prefix and a suffix, wherein the size of the suffix is dependent on the prefix and the size of the current coding block. By this measure, it is feasible to efficiently adapt the length of the variable-length coded syntax element which controls the bi-partitioning of the current coding block to the actual needs, namely the size, of the current coding block, and the variability of the bi-partitioning by varying the wedglet separation line, respectively. The greater the current coding block is, the longer the variable-length coded syntax element may be. This length dependency may even be sufficiently effective in terms of coding efficiency so that the variable length coded syntax element may be coded without context-adaptive entropy coding, but directly or using fixed-equal-probability binary entropy coding.
    Type: Application
    Filed: August 20, 2021
    Publication date: April 7, 2022
    Inventors: Philipp MERKLE, Detlev MARPE, Karsten Mueller
  • Patent number: 11297336
    Abstract: A higher coding efficiency for coding a significance map indicating positions of significant transform coefficients within a transform coefficient block is achieved by the scan order by which the sequentially extracted syntax elements indicating, for associated positions within the transform coefficient block, as to whether at the respective position a significant or insignificant transform coefficient is situated, are sequentially associated to the positions of the transform coefficient block, among the positions of the transform coefficient block depends on the positions of the significant transform coefficients indicated by previously associated syntax elements. Alternatively, the first-type elements may be context-adaptively entropy decoded using contexts which are individually selected for each of the syntax elements dependent on a number of significant transform coefficients in a neighborhood of the respective syntax element, indicated as being significant by any of the preceding syntax elements.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: April 5, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Heiko Schwarz, Tung Nguyen, Detlev Marpe, Thomas Wiegand
  • Patent number: 11297338
    Abstract: A video encoder encodes a video into a data stream, the video encoder being configured to vary a granularity at which a Quantization Parameter—QP—is applied depending on an association of frames of the video to temporally hierarchical layers at which the video is encoded into the data stream. The technology also concerns a respective decoder, a respective method for encoding and decoding, and a computer program for implementing the methods.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: April 5, 2022
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Christian Helmrich, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Adam Wieckowski, Mischa Siekmann, Benjamin Bross
  • Patent number: 11297341
    Abstract: A decoder is described, which receives an encoded data stream. The encoded data stream includes data representing a picture and a classification mode parameter. The classification mode parameter specifies a certain classification to be applied to samples in the picture, the certain classification selected from a plurality of classifications. The decoder decodes the encoded data stream to obtain a reconstructed picture and the classification mode parameter, classifies samples of the reconstructed picture into one of a plurality of classes using the certain classification specified by the classification mode parameter, and filters the samples of the reconstructed picture. A sample is filtered using a filter for the class into which the sample has been classified.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: April 5, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Johannes Erfurt, Lim Wang-Q, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20220103813
    Abstract: Apparatus configured to derive a set-selective syntax element indicating whether the predetermined block is to be predicted using one of a first set of intra-prediction modes comprising a DC intra prediction mode and angular prediction modes. If the set-selective syntax element indicates that the predetermined block is to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a list of most probable intra-prediction modes. If the set-selective syntax element indicates that the predetermined block is not to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a matrix-based intra-prediction mode. The list of most probable intra-prediction modes is formed such that the list of most probable intra-prediction modes is free of the DC intra prediction mode in case of the neighbouring blocks being predicted by any of the angular intra prediction modes.
    Type: Application
    Filed: December 13, 2021
    Publication date: March 31, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Bjoern STALLENBERGER, Michael SCHAEFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220103820
    Abstract: Decoder for block-based decoding of an encoded picture signal using transform decoding, configured to select for a predetermined block a selected transform mode, entropy decode a block to be dequantized, which is associated with the predetermined block according to the selected transform mode, from a data stream and dequantize the block to be dequantized using a quantization accuracy, which depends on the selected transform mode, to obtain a dequantized block.
    Type: Application
    Filed: December 10, 2021
    Publication date: March 31, 2022
    Inventors: Benjamin BROSS, Phan Hoang Tung NGUYEN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220094925
    Abstract: In an encoder and a decoder for Region Based Intra Block Copy, the encoder may be configured for block-based encoding a picture into a data stream, and the decoder may be configured for block-based decoding a picture from a data stream. The encoder and decoder may further be configured to determine for a current block of the picture a difference between a first predetermined block and a second predetermined block inside a block search area. The encoder may encode the difference into the data stream and the decoder may derive the difference from the data stream. According to the innovative principle, the encoder and the decoder may be configured to partition the block search area into multiple block search regions.
    Type: Application
    Filed: December 2, 2021
    Publication date: March 24, 2022
    Inventors: Gayathri VENUGOPAL, Santiago DE LUXÁN HERNÁNDEZ, Karsten MÜLLER, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11284065
    Abstract: A video decoder for decoding a video from a data stream using block-based predictive decoding, the video decoder supporting a set of primitive prediction modes for predicting blocks of a picture of the video, is configured to predict a predetermined block by a composed prediction signal by deriving, using a collection of one or more primitive prediction modes out of the set of primitive prediction modes, a collection of one or more primitive predictions for the predetermined block, and composing the composed prediction signal for the predetermined block by combining the collection of one or more primitive predictions.
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: March 22, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Thomas Wiegand, Detlev Marpe, Heiko Schwarz, Martin Winken, Christian Bartnik, Jonathan Pfaff, Philipp Helle, Mischa Siekmann
  • Patent number: 11277614
    Abstract: A decoder for decoding a data stream into which media data is coded has a mode switch configured to activate a low-complexity mode or a high-efficiency mode depending on the data stream, an entropy decoding engine configured to retrieve each symbol of a sequence of symbols by entropy decoding using a selected one of a plurality of entropy decoding schemes, a desymbolizer configured to desymbolize the sequence of symbols to obtain a sequence of syntax elements, a reconstructor configured to reconstruct the media data based on the sequence of syntax elements, selection depending on the activated low-complexity mode or the high-efficiency mode.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: March 15, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand, Christian Bartnik
  • Publication number: 20220078421
    Abstract: The present invention concerns an apparatus configured to partition a picture into leaf blocks using recursive multi-tree partitioning, block-based encode the picture into a data stream using the partitioning of the picture into the leaf blocks, wherein the apparatus is configured to, in partitioning the picture into the leaf blocks, for a predetermined block which extends beyond a boundary of the picture, reduce an available set of split modes depending on a position at which the boundary of the picture crosses the predetermined block in order to obtain a reduced set of one or more split modes, wherein the apparatus is configured to signal a selected split mode in the data stream.
    Type: Application
    Filed: September 20, 2021
    Publication date: March 10, 2022
    Inventors: Adam WIECKOWSKI, Valeri GEORGE, Tobias HINZ, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Jackie MA, Jens BRANDENBURG