Patents by Inventor Thomas Wiegand

Thomas Wiegand has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11838504
    Abstract: Sub-picture extraction is rendered less complex by providing each slice with start position information which indicates a starting position from which onwards the picture is, along a coding path, encoded into the respective slice, relative to an onset position at which the coding path starts traversing a segment the starting position is located in. Alternatively or additionally, sub-picture extraction processes are treated like choosing one layer out of a multi-layer datastream.
    Type: Grant
    Filed: January 4, 2022
    Date of Patent: December 5, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Robert Skupin, Cornelius Hellge, Valeri George, Thomas Schierl, Yago Sánchez De La Fuente, Karsten Sühring, Thomas Wiegand
  • Publication number: 20230388558
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Application
    Filed: August 14, 2023
    Publication date: November 30, 2023
    Inventors: Philipp HELLE, Detlev MARPE, Simon OUDIN, Thomas WIEGAND
  • Publication number: 20230388518
    Abstract: A coding concept for encoding a picture uses a multi-layered convolutional neural network for determining a feature representation of the picture, the feature representation comprising first to third partial representations which have mutually different resolutions. Further, an encoder for encoding a picture determines a quantization of the picture using a polynomial function which provides an estimated distortion associated with the quantization.
    Type: Application
    Filed: August 11, 2023
    Publication date: November 30, 2023
    Inventors: Jonathan PFAFF, Michael SCHÄFER, Sophie PIENTKA, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230388496
    Abstract: An apparatus for decoding a picture is configured to partition the picture into coding blocks, using recursive multi-tree splitting. Splitting schemes for the multi-tree splitting are described. According to an embodiment, the decoder decodes a split direction flag from a data stream by context adaptive entropy decoding using a context which depends on whether, and discriminates between, a first number of criteria which would be fulfilled in case of a split direction indicated by the split direction flag being horizontal equals a second number of criteria which would be fulfilled in case of the split direction indicated by the split direction flag being vertical, the first number being greater than the second number, and the first number being smaller than the second number.
    Type: Application
    Filed: August 10, 2023
    Publication date: November 30, 2023
    Inventors: Adam WIECKOWSKI, Phan Hoang Tung NGUYEN, Detlev MARPE, Hieko SCHWARZ, Thomas WIEGAND
  • Publication number: 20230379471
    Abstract: Concepts are presented which achieve a more efficient coding of coefficients of a transform block by use of dependent quantization and context adaptive entropy coding or achieve a coding of coefficients of a transform block in a manner which allows a more efficient coding even if a usage of dependent quantization is combined with the usage of context adaptive entropy coding.
    Type: Application
    Filed: April 13, 2023
    Publication date: November 23, 2023
    Inventors: Heiko SCHWARZ, Thomas WIEGAND, Phan Hoang Tung NGUYEN, Detlev MARPE
  • Patent number: 11825091
    Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).
    Type: Grant
    Filed: February 1, 2023
    Date of Patent: November 21, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Paul Haase, Christian Rudat, Heiner Kirchhoffer, Phan Hoang Tung Nguyen, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230370596
    Abstract: A video encoder according to embodiments is provided. The video encoder is configured for encoding a plurality of pictures of a video by generating an encoded video signal, wherein each of the plurality of pictures has original picture data. The video encoder has a data encoder configured for generating the encoded video signal having encoded picture data, wherein the data encoder is configured to encode the plurality of pictures of the video into the encoded picture data. Moreover, the video encoder has an output interface configured for outputting the encoded picture data of each of the plurality of pictures. Furthermore, a video decoders, systems, methods for encoding and decoding, computer programs and encoded video signals according to embodiments are provided.
    Type: Application
    Filed: July 28, 2023
    Publication date: November 16, 2023
    Inventors: Robert Philipp SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Cornelius HELLGE, Thomas SCHIERL, Karsten SÜHRING, Thomas WIEGAND
  • Patent number: 11810019
    Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.
    Type: Grant
    Filed: November 3, 2022
    Date of Patent: November 7, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Simon Oudin, Martin Winken, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230353726
    Abstract: Wedgelet separation lines of neighboring blocks are predicted from each other by aligning the wedgelet separation lines of such neighboring blocks to each other, thereby reducing the side information coding rate that may be used.
    Type: Application
    Filed: April 7, 2023
    Publication date: November 2, 2023
    Inventors: Philipp MERKLE, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
  • Publication number: 20230353788
    Abstract: A previously encoded or reconstructed version of a neighborhood of a predetermined block to be predicted is exploited so as to result into a more efficient predictive coding of the prediction block. In particular, a spectral decomposition of a region composed of this neighborhood and a first version of a predicted filling of the predetermined block results into a first spectrum which is subject to noise reduction and the thus resulting second spectrum may be subject to a spectral composition, thereby resulting in a modified version of this region including a second version of the predicted filling of the predetermined block. Owing to the exploitation of the already processed, i.e. encoded/reconstructed, neighborhood of the predetermined block, the second version of the predicted filling of the predetermined block tends to improve the coding efficiency.
    Type: Application
    Filed: June 20, 2023
    Publication date: November 2, 2023
    Inventors: Jonathan PFAFF, Martin WINKEN, Christian RUDAT, Heiko SCHWARZ, Thomas WIEGAND, Detlev MARPE
  • Patent number: 11805241
    Abstract: Concepts are described which enable improved suitability of a respective codec for parallel processing at encoder and/or decoder.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: October 31, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Valeri George, Tobias Hinz, Jackie Ma, Jens Brandenburg, Christian Lehmann, Adam Wieckowski, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Thomas Schierl
  • Publication number: 20230345022
    Abstract: An apparatus (200) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus (200) is configured to generate an output video data stream from the input video data stream.
    Type: Application
    Filed: June 23, 2023
    Publication date: October 26, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, ROBERT SKUPIN, Thomas WIEGAND
  • Publication number: 20230345012
    Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.
    Type: Application
    Filed: June 30, 2023
    Publication date: October 26, 2023
    Inventors: Martin WINKEN, Heiner KIRCHHOFFER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230345051
    Abstract: A first aspect provides concepts for handling coded layer video sequence boundaries in multilayered video bitstreams having inter-layer references. A second aspect provides concepts for handling, signaling and deriving of picture output timing, e.g. with respect to an access unit specific signaling and an output layer specific signaling of a number of repetitions of a picture output.
    Type: Application
    Filed: June 9, 2021
    Publication date: October 26, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230345019
    Abstract: Concepts for a video coding are described. A first aspect provides a concept for determining an interlayer reference picture for inter-predicting a picture of a multi-layered video data stream. A second aspect provides a concept for the usage of an interlayer prediction tool in multi-layered video data streams. A third aspect is concerned with a determination of a maximum temporal sublayer of an OLS or a maximum temporal sublayer to be decoded.
    Type: Application
    Filed: June 8, 2021
    Publication date: October 26, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Patent number: 11800128
    Abstract: A video encoder for providing an encoded video representation, wherein the video encoder is configured to provide a video stream comprising encoded parameter information describing a plurality of encoding parameters, encoded video content information and one or more merge identifiers indicating whether and/or how the encoded video representation can be merged with another encoded video representation.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: October 24, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Yago Sánchez De La Fuente, Cornelius Hellge, Thomas Schierl, Karsten Sühring, Thomas Wiegand
  • Publication number: 20230336798
    Abstract: The present invention concerns file parsers, file generators encoders, decoders, clients, servers and methods using parameter sets for coded video sequences. Said parameter sets may have decoding parameter information and may be conveyed in-band or out-of band. Some embodiments provide solutions to problems being related with correctly initializing a decoder for decoding coded video sequences in open GOP switching scenarios. Some embodiments may provide for hierarchical track switching levels.
    Type: Application
    Filed: June 20, 2023
    Publication date: October 19, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Robert SKUPIN, Cornelius HELLGE, Thomas SCHIERL, Karsten GRUENEBERG, Thomas WIEGAND
  • Publication number: 20230328242
    Abstract: A picture in a data stream is subdivided into different size transform bocks. For a transform block, a transformation is selected by checking whether the block's size exceeds a threshold. If it does, a default technique is used to select the transformation. If it does not, a transformation is used from a list of transformations as identified by an index, the list including an identity transformation and non-identity transformations. A coefficients block in the data stream is decoded, and if the selected transformation is the identity transformation, then the coefficients block is used as a residual sample array, and if the selected transformation is not the identity transformation, the coefficients block is subjected to an inverse transformation corresponding to the selected transformation to obtain a residual sample array used to correct a prediction for the transform block.
    Type: Application
    Filed: June 13, 2023
    Publication date: October 12, 2023
    Inventors: Benjamin BROSS, Phan Hoang Tung NGUYEN, Paul KEYDEL, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Christian HELMRICH
  • Publication number: 20230328287
    Abstract: Apparatus (54) for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from a data stream (12), a mode index (200) using a binarization code (202). The mode index (200) points to one out of a list (204) of matrix-based intra-prediction modes. The apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighbourhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix-vector product (206) onto sample positions (104) of the predetermined block. The list (204) of matrix-based intra-prediction modes consists of an even number of matrix-based intra-prediction modes.
    Type: Application
    Filed: September 24, 2020
    Publication date: October 12, 2023
    Inventors: Jonathan PFAFF, Björn STALLENBERGER, Michael SCHAEFER, Philipp MERKLE, Tobias HINZ, Philipp HELLE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN
  • Publication number: 20230328271
    Abstract: Rendered portions of a renderable portion of a first view of a multi-view signal are introduced into a prediction loop of a multi-view encoder to form a reference signal for the block-based prediction of the encoder's view predictor may improve the prediction and thereby increasing the coding efficiency. The introduction may be performed by completely inserting the renderable portion into the prediction loop to form new reference pictures with their own reference picture indices in addition to reference pictures obtained by the reconstructed version of the multi-view signal of the block-based prediction. Alternatively, the rendered portion may be introduced into the prediction loop completely, but with replacing the normal prediction reference signal, i.e., the normally reconstructed signal as obtained by block-based prediction. Alternatively, it may be signaled within the data stream which portions of the renderable portion are used to replace respective portions in the normally reconstructed signal.
    Type: Application
    Filed: June 8, 2023
    Publication date: October 12, 2023
    Inventors: Sebastian BOSSE, Heiko SCHWARZ, Thomas WIEGAND, Heribert BRUST