Patents by Inventor Thomas Wiegand

Thomas Wiegand has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220132167
    Abstract: A previously encoded or reconstructed version of a neighborhood of a predetermined block to be predicted is exploited so as to result into a more efficient predictive coding of the prediction block. In particular, a spectral decomposition of a region composed of this neighborhood and a first version of a predicted filling of the predetermined block results into a first spectrum which is subject to noise reduction and the thus resulting second spectrum may be subject to a spectral composition, thereby resulting in a modified version of this region including a second version of the predicted filling of the predetermined block. Owing to the exploitation of the already processed, i.e. encoded/reconstructed, neighborhood of the predetermined block, the second version of the predicted filling of the predetermined block tends to improve the coding efficiency.
    Type: Application
    Filed: September 2, 2021
    Publication date: April 28, 2022
    Inventors: Jonathan PFAFF, Martin WINKEN, Christian RUDAT, Heiko SCHWARZ, Thomas WIEGAND, Detlev MARPE
  • Publication number: 20220124372
    Abstract: Decoder for decoding a picture, wherein blocks into which the picture is subdivided are assigned to a set of prediction types, which include intra prediction and inter prediction. For each of predetermined intra-predicted blocks, the decoder is configured to derive, from the data stream, an information on a partitioning of the respective predetermined intra-predicted block into partitions. The decoder is configured to derive, from the data stream, for each partition of the respective predetermined intra-predicted block, a partition-specific prediction residual signal related to a spatial domain prediction residual signal of the respective partition of the respective predetermined intra-predicted block via a predetermined transform. The predetermined transform can be identified out of a set of transforms including a first transform and a second transform, which equals a concatenation of a primary transform and a secondary transform applied onto a subset of coefficients of the primary transform.
    Type: Application
    Filed: December 17, 2021
    Publication date: April 21, 2022
    Inventors: Santiago DE LUXÁN HERNÁNDEZ, Valeri GEORGE, Gayathri VENUGOPAL, Jens BRANDENBURG, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220114455
    Abstract: Pruning and/or quantizing a machine learning predictor or, in other words, a machine learning model such as a neural network is rendered more efficient if the pruning and/or quantizing is performed using relevance scores which are determined for portions of the machine learning predictor on the basis of an activation of the portions of the machine learning predictor manifesting itself in one or more inferences performed by the machine learning (ML) predictor.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Wojciech SAMEK, Sebastian LAPUSCHKIN, Simon WIEDEMANN, Philipp SEEGERER, Seul-Ki YEOM, Klaus-Robert MUELLER, Thomas WIEGAND
  • Publication number: 20220116606
    Abstract: An apparatus configured to select a predetermined intra prediction mode out of a plurality of intra-prediction modes which includes a first set of intra-prediction modes and a second set of matrix-based intra-prediction modes. The apparatus is configured to select a subset of one or more secondary transforms dependent on the predetermined intra prediction mode so that the subset is nonempty in case of the predetermined intra prediction mode being contained in the first set of intra-prediction modes or in the second set of matrix-based intra-prediction modes. The apparatus is configured to derive a transformed version of a prediction residual for a predetermined block, which is related to a spatial domain version of the prediction residual of the predetermined block via a transform defined by a concatenation of a primary transform and a predetermined secondary transform out of the subset of secondary transforms.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220116618
    Abstract: A video decoder and a video encoder include a noise reduction operation including at least two denoising operations and adapting the second denoising operation in dependence of the difference before and after the first denoising operation, thus correcting the quality reduction occurred due to the application of the first denoising operation. Corresponding methods serve to encode and decode video signals.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Wang-Q LIM, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220109714
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Application
    Filed: December 14, 2021
    Publication date: April 7, 2022
    Inventors: Robert SKUPIN, Cornelius HELLGE, Thomas SCHIERL, Yago SÁNCHEZ DE LA FUENTE, Thomas WIEGAND, Dimitri PODBORSKI
  • Publication number: 20220108177
    Abstract: A concept for Federated Learning which is more efficient and/or robust is presented. Beyond this, concepts for specifying clients and/or measuring training data similarities in a manner more suitable for being applied in Federated Learning environments, are described.
    Type: Application
    Filed: November 15, 2021
    Publication date: April 7, 2022
    Inventors: Wojciech SAMEK, Felix SATTLER, Thomas WIEGAND, Klaus-Robert MÜLLER
  • Patent number: 11297338
    Abstract: A video encoder encodes a video into a data stream, the video encoder being configured to vary a granularity at which a Quantization Parameter—QP—is applied depending on an association of frames of the video to temporally hierarchical layers at which the video is encoded into the data stream. The technology also concerns a respective decoder, a respective method for encoding and decoding, and a computer program for implementing the methods.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: April 5, 2022
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Christian Helmrich, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Adam Wieckowski, Mischa Siekmann, Benjamin Bross
  • Patent number: 11297336
    Abstract: A higher coding efficiency for coding a significance map indicating positions of significant transform coefficients within a transform coefficient block is achieved by the scan order by which the sequentially extracted syntax elements indicating, for associated positions within the transform coefficient block, as to whether at the respective position a significant or insignificant transform coefficient is situated, are sequentially associated to the positions of the transform coefficient block, among the positions of the transform coefficient block depends on the positions of the significant transform coefficients indicated by previously associated syntax elements. Alternatively, the first-type elements may be context-adaptively entropy decoded using contexts which are individually selected for each of the syntax elements dependent on a number of significant transform coefficients in a neighborhood of the respective syntax element, indicated as being significant by any of the preceding syntax elements.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: April 5, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Heiko Schwarz, Tung Nguyen, Detlev Marpe, Thomas Wiegand
  • Patent number: 11297341
    Abstract: A decoder is described, which receives an encoded data stream. The encoded data stream includes data representing a picture and a classification mode parameter. The classification mode parameter specifies a certain classification to be applied to samples in the picture, the certain classification selected from a plurality of classifications. The decoder decodes the encoded data stream to obtain a reconstructed picture and the classification mode parameter, classifies samples of the reconstructed picture into one of a plurality of classes using the certain classification specified by the classification mode parameter, and filters the samples of the reconstructed picture. A sample is filtered using a filter for the class into which the sample has been classified.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: April 5, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Johannes Erfurt, Lim Wang-Q, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20220103820
    Abstract: Decoder for block-based decoding of an encoded picture signal using transform decoding, configured to select for a predetermined block a selected transform mode, entropy decode a block to be dequantized, which is associated with the predetermined block according to the selected transform mode, from a data stream and dequantize the block to be dequantized using a quantization accuracy, which depends on the selected transform mode, to obtain a dequantized block.
    Type: Application
    Filed: December 10, 2021
    Publication date: March 31, 2022
    Inventors: Benjamin BROSS, Phan Hoang Tung NGUYEN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220103813
    Abstract: Apparatus configured to derive a set-selective syntax element indicating whether the predetermined block is to be predicted using one of a first set of intra-prediction modes comprising a DC intra prediction mode and angular prediction modes. If the set-selective syntax element indicates that the predetermined block is to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a list of most probable intra-prediction modes. If the set-selective syntax element indicates that the predetermined block is not to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a matrix-based intra-prediction mode. The list of most probable intra-prediction modes is formed such that the list of most probable intra-prediction modes is free of the DC intra prediction mode in case of the neighbouring blocks being predicted by any of the angular intra prediction modes.
    Type: Application
    Filed: December 13, 2021
    Publication date: March 31, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Bjoern STALLENBERGER, Michael SCHAEFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220094925
    Abstract: In an encoder and a decoder for Region Based Intra Block Copy, the encoder may be configured for block-based encoding a picture into a data stream, and the decoder may be configured for block-based decoding a picture from a data stream. The encoder and decoder may further be configured to determine for a current block of the picture a difference between a first predetermined block and a second predetermined block inside a block search area. The encoder may encode the difference into the data stream and the decoder may derive the difference from the data stream. According to the innovative principle, the encoder and the decoder may be configured to partition the block search area into multiple block search regions.
    Type: Application
    Filed: December 2, 2021
    Publication date: March 24, 2022
    Inventors: Gayathri VENUGOPAL, Santiago DE LUXÁN HERNÁNDEZ, Karsten MÜLLER, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11283850
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Grant
    Filed: March 16, 2020
    Date of Patent: March 22, 2022
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Thomas Schierl, Yago Sánchez De La Fuente, Thomas Wiegand, Dimitri Podborski
  • Patent number: 11284065
    Abstract: A video decoder for decoding a video from a data stream using block-based predictive decoding, the video decoder supporting a set of primitive prediction modes for predicting blocks of a picture of the video, is configured to predict a predetermined block by a composed prediction signal by deriving, using a collection of one or more primitive prediction modes out of the set of primitive prediction modes, a collection of one or more primitive predictions for the predetermined block, and composing the composed prediction signal for the predetermined block by combining the collection of one or more primitive predictions.
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: March 22, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Thomas Wiegand, Detlev Marpe, Heiko Schwarz, Martin Winken, Christian Bartnik, Jonathan Pfaff, Philipp Helle, Mischa Siekmann
  • Patent number: 11277614
    Abstract: A decoder for decoding a data stream into which media data is coded has a mode switch configured to activate a low-complexity mode or a high-efficiency mode depending on the data stream, an entropy decoding engine configured to retrieve each symbol of a sequence of symbols by entropy decoding using a selected one of a plurality of entropy decoding schemes, a desymbolizer configured to desymbolize the sequence of symbols to obtain a sequence of syntax elements, a reconstructor configured to reconstruct the media data based on the sequence of syntax elements, selection depending on the activated low-complexity mode or the high-efficiency mode.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: March 15, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand, Christian Bartnik
  • Publication number: 20220078461
    Abstract: A video encoder according to embodiments is configured for encoding a plurality of pictures of a video by generating an encoded video signal, wherein each of the plurality of pictures includes original picture data. The video encoder includes a data encoder configured for generating the encoded video signal including encoded picture data, wherein the data encoder is configured to encode the plurality of pictures of the video into the encoded picture data. Moreover, the video encoder includes an output interface configured for outputting the encoded picture data of each of the plurality of pictures. Furthermore, a video decoders, systems, methods for encoding and decoding, computer programs and encoded video signals according to embodiments are provided.
    Type: Application
    Filed: November 19, 2021
    Publication date: March 10, 2022
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20220078421
    Abstract: The present invention concerns an apparatus configured to partition a picture into leaf blocks using recursive multi-tree partitioning, block-based encode the picture into a data stream using the partitioning of the picture into the leaf blocks, wherein the apparatus is configured to, in partitioning the picture into the leaf blocks, for a predetermined block which extends beyond a boundary of the picture, reduce an available set of split modes depending on a position at which the boundary of the picture crosses the predetermined block in order to obtain a reduced set of one or more split modes, wherein the apparatus is configured to signal a selected split mode in the data stream.
    Type: Application
    Filed: September 20, 2021
    Publication date: March 10, 2022
    Inventors: Adam WIECKOWSKI, Valeri GEORGE, Tobias HINZ, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Jackie MA, Jens BRANDENBURG
  • Publication number: 20220078396
    Abstract: An apparatus for presenting immersive media content is described. The apparatus obtains from a sender video data representing immersive content for a certain viewing direction and/or for a certain viewpoint, and displays the video data representing the immersive content for the certain viewing direction and/or for the certain viewpoint.
    Type: Application
    Filed: November 16, 2021
    Publication date: March 10, 2022
    Inventors: Serhan GÜL, Yago SÁNCHEZ DE LA FUENTE, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Patent number: 11265556
    Abstract: A higher coding efficiency for coding a significance map indicating positions of significant transform coefficients within a transform coefficient block is achieved by the scan order by which the sequentially extracted syntax elements indicating, for associated positions within the transform coefficient block, as to whether at the respective position a significant or insignificant transform coefficient is situated, are sequentially associated to the positions of the transform coefficient block, among the positions of the transform coefficient block depends on the positions of the significant transform coefficients indicated by previously associated syntax elements. Alternatively, the first-type elements may be context-adaptively entropy decoded using contexts which are individually selected for each of the syntax elements dependent on a number of significant transform coefficients in a neighborhood of the respective syntax element, indicated as being significant by any of the preceding syntax elements.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: March 1, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Heiko Schwarz, Tung Nguyen, Detlev Marpe, Thomas Wiegand