Patents by Inventor Thomas Wiegand

Thomas Wiegand has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240251101
    Abstract: A method for decoding a block of a picture includes decoding, from a data stream, an intra-coding mode for the block, deriving a predictor for a prediction partition of the block using at least one already reconstructed samples neighboring the prediction partition and the intra-coding mode, deriving a prediction residual for each of the at least two transform partitions included in the prediction partition, and combining the predictor of the prediction partition and the prediction residual for each of the at least two transform partitions included in the prediction partition to reconstruct the prediction partition. The block is partitioned into multiple transform partitions based on a partition dimension flag, and the prediction partition includes at least two transform partitions of the multiple transform partitions.
    Type: Application
    Filed: March 8, 2024
    Publication date: July 25, 2024
    Inventors: Santiago DE LUXÁN HERNÁNDEZ, Benjamin BROSS, Phan Hoang Tung NGUYEN, Valeri GEORGE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 12047547
    Abstract: An apparatus for determining a measure for a distortion change of a first view synthesized from a second view, caused by a modification of a depth map of the second view from a first state to a second state, is configured—starting from a current synthesis state of the first view corresponding to a synthesis from the second view having the depth map modified to the second state in an already processed portion of the depth map and having the depth map unmodified at the first state in a yet to be processed portion of the depth map—to compute a possible successor synthesis state corresponding to a synthesis of the first view from the second view having the depth map modified to the second state in an already processed portion plus a currently processed portion and having the depth map unmodified at the first state in the yet to be processed portion without the currently processed portion; and to determine a distortion change of a distortion of the current synthesis state of the first view relative to an undistort
    Type: Grant
    Filed: May 25, 2022
    Date of Patent: July 23, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Gerhard Tech, Karsten Mueller, Thomas Wiegand
  • Publication number: 20240244240
    Abstract: A video data stream having a video encoded thereinto and is described. It includes first timing information on first coded picture buffer, CPB, removal times to be applied at decoder side in case of buffering a complete version of the video data stream, and second timing information on second CPB removal times to be applied at decoder side for buffering a reduced version of the video data stream, differing from the video data stream by removal of a portion of the video data stream from the complete version of the video data stream. Corresponding video encoders, video decoders, network nodes, apparatuses for managing the coded picture buffer, CPB, of a video decoder, and apparatuses for splicing together video data streams are also referred to.
    Type: Application
    Filed: February 28, 2024
    Publication date: July 18, 2024
    Inventors: Robert SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Cornelius HELLGE, Thomas SCHIERL, Karsten SÜHRING, Thomas WIEGAND
  • Patent number: 12041228
    Abstract: Apparatus configured to derive a set-selective syntax element indicating whether the predetermined block is to be predicted using one of a first set of intra-prediction modes comprising a DC intra prediction mode and angular prediction modes. If the set-selective syntax element indicates that the predetermined block is to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a list of most probable intra-prediction modes. If the set-selective syntax element indicates that the predetermined block is not to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a matrix-based intra-prediction mode. The list of most probable intra-prediction modes is formed such that the list of most probable intra-prediction modes is free of the DC intra prediction mode in case of the neighbouring blocks being predicted by any of the angular intra prediction modes.
    Type: Grant
    Filed: December 13, 2021
    Date of Patent: July 16, 2024
    Assignee: Fraunhofer-Gesellschaft Zur Foerderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Tobias Hinz, Philipp Helle, Philipp Merkle, Bjoern Stallenberger, Michael Schaefer, Benjamin Bross, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12041222
    Abstract: Apparatus for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from the data stream (12), a mode index (200), the mode index pointing to one out of a list (204) of matrix-based intra-prediction modes. Additionally, the apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighborhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix vector product (206) onto sample positions (104) of the predetermined block.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: July 16, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung derangewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Tobias Hinz, Philipp Helle, Philipp Merkle, Björn Stallenberger, Michael Schäfer, Benjamin Bross, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12041219
    Abstract: An apparatus for presenting immersive media content is described. The apparatus obtains from a sender video data representing immersive content for a certain viewing direction and/or for a certain viewpoint, and displays the video data representing the immersive content for the certain viewing direction and/or for the certain viewpoint.
    Type: Grant
    Filed: November 16, 2021
    Date of Patent: July 16, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Serhan Gül, Yago Sánchez De La Fuente, Cornelius Hellge, Thomas Schierl, Robert Skupin, Thomas Wiegand
  • Publication number: 20240236328
    Abstract: Concepts are described, including encoding, processing and decoding of a data stream having a video encoded thereinto, wherein the video comprises a plurality of pictures, wherein the data stream comprises a plurality of pictures in at least two layers, wherein the pictures of at least one layer are split into a predetermined layer-specific number of subpictures, one or more of the pictures or subpictures of one layer corresponds to one picture or subpictures in one or more other layer, and at least one of the subpictures comprises boundaries for boundary extension for motion compensation, and an indication that at least one of the boundaries of corresponding subpictures or corresponding pictures in different layers are aligned with each other.
    Type: Application
    Filed: March 27, 2024
    Publication date: July 11, 2024
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Patent number: 12034928
    Abstract: Decoder for decoding a transformed representation of a sample block from a data stream. If a first coded coefficient is located inside a predetermined subarea of the transform coefficient block and if the underlying transform is within a first set of available transforms, the decoder decodes coefficients along a first coefficient scan order. If the transform is within a second set of In available transforms, the decoder decodes coefficients located within the predetermined subarea along a second coefficient scan order, and infers that coefficients located outside the predetermined subarea are zero. The first coefficient scan order is so that coefficients outside the predetermined subarea are scanned between two transform coefficients located inside the predetermined subarea. The second coefficient scan order does not scan any coefficient outside the predetermined subarea between scanning the coefficients within the predetermined subarea.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: July 9, 2024
    Assignee: Fraunhofer-Gesellschaft Zur Förderung derangewandten Forschung e.V.
    Inventors: Benjamin Bross, Santiago De Luxán Hernández, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12028552
    Abstract: Video decoder configured to decode a video comprising a plurality of pictures from a video data stream by decoding each picture from one or more video coding units within an access unit of the video data stream which is associated with the respective picture; read a substitute coding unit type from a parameter set unit of the video data stream; for each predetermined video coding unit, read a coding unit type identifier (100) from the respective video coding unit; check whether the coding unit identifier identifies a coding unit type out of a first subset of one or more coding unit types (102) or out of a second subset of coding unit types (104), if the coding unit identifier identifies a coding unit type out of the first subset of one or more coding unit types, attribute the respective video coding unit to the substitute coding unit type; if the coding unit identifier identifies a coding unit type out of the second subset of coding unit types, attribute the respective video coding unit to the coding unit typ
    Type: Grant
    Filed: September 3, 2020
    Date of Patent: July 2, 2024
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Yago Sánchez De La Fuente, Karsten Sühring, Cornelius Hellge, Thomas Schierl, Robert Skupin, Thomas Wiegand
  • Publication number: 20240214612
    Abstract: Video codec concepts which allows more effective video composition/merging and/or a more effective implementation of gradual decoding refresh are described along with concepts of allowing video composition/merging being more effective, for instance, in terms of complexity of the composition/merging task.
    Type: Application
    Filed: March 6, 2024
    Publication date: June 27, 2024
    Inventors: Robert SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Cornelius HELLGE, Thomas SCHIERL, Karsten SUEHRING, Thomas WIEGAND
  • Patent number: 12022131
    Abstract: Interpolation between explicitly signaled CPB (or HRD) parameters at selected bit rates is used to achieve a good compromise between CPB parameter transmission capacity and CPB parametrization effectiveness and may be, particularly, made in an effective manner.
    Type: Grant
    Filed: May 19, 2023
    Date of Patent: June 25, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Yago Sánchez De La Fuente, Benjamin Bross, Robert Skupin, Cornelius Hellge, Thomas Schierl, Thomas Wiegand
  • Patent number: 12022120
    Abstract: A method, computer program, and apparatus for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k) and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal.
    Type: Grant
    Filed: September 24, 2020
    Date of Patent: June 25, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Björn Stallenberger, Michael Schafer, Philipp Merkle, Tobias Hinz, Philipp Helle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Benjamin Bross, Martin Winken, Mischa Siekmann
  • Publication number: 20240205385
    Abstract: Coding efficiency increases are achieved by using composed prediction signals to predict a predetermined block of a picture.
    Type: Application
    Filed: January 5, 2024
    Publication date: June 20, 2024
    Inventors: Thomas WIEGAND, Detlev MARPE, Heiko SCHWARZ, Martin WINKEN, Christian BARTNIK, Jonathan PFAFF, Philipp HELLE, Mischa SIEKMANN
  • Patent number: 12010353
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: August 14, 2023
    Date of Patent: June 11, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Patent number: 12010337
    Abstract: An encoder for hybrid video coding, the encoder for providing an encoded representation of a video sequence on the basis of an input video content, and the encoder configured to: determine one or more syntax elements related to a portion of the video sequence; select a processing scheme to be applied to the portion of the video sequence based a property described by on the one or more syntax elements, the processing scheme for acquiring a sample for a motion-compensated prediction at an integer and/or fractional location within the portion of the video sequence; encode an index indicating the selected processing scheme such that a given encoded index value represents different processing schemes depending on the property described by the one or more syntax elements; and provide, as the encoded representation of the video sequence, a bit stream including the one or more syntax elements and the encoded index.
    Type: Grant
    Filed: September 8, 2021
    Date of Patent: June 11, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Benjamin Bross, Martin Winken, Anastasia Henkel, Paul Keydel, Ivan Zupancic, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12010334
    Abstract: Information available from coding/decoding the base layer, i.e. base-layer hints, is exploited to render the motion-compensated prediction of the enhancement layer more efficient by more efficiently coding the enhancement layer motion parameters.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: June 11, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Publication number: 20240187653
    Abstract: Decoder for decoding a picture from a data stream, configured to check whether a plurality of coding parameters, which are contained in the data stream, relate to a predetermined portion of the picture and control a prediction residual transform mode and a quantization accuracy with respect to the predetermined portion, are indicative of a coding parameter setting corresponding to a lossless prediction residual coding. Responsive to the plurality of coding parameters being indicative of the coding parameter setting corresponding to the lossless prediction residual coding, the decoder is configured to set one or more predetermined coding options relating to one or more tools of the decoder for processing a prediction residual corrected predictive reconstruction with respect to the predetermined portion so that the one or more tools are disabled with respect to the predetermined portion.
    Type: Application
    Filed: February 14, 2024
    Publication date: June 6, 2024
    Inventors: Christian HELMRICH, Benjamin BROSS, Tung Hoang NGUYEN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20240187612
    Abstract: A decoder for block-based decoding of picture data of a picture is configured to decode a current block of the picture by determining first and second sets of luma in a neighborhood of the current block, the first set of luma samples having smaller luma values than the second set of luma samples, fitting a straight-line having a linear function through first and second pairs of luma-chroma samples, wherein the first and second pairs of luma-chroma samples are determined based on the first and second sets of luma samples, respectively, and on first and second corresponding chroma samples, respectively, in said neighborhood of the current block, and predicting chroma samples of the current block using luma samples of the current block and said linear function. The present invention further concerns a respective encoder and corresponding methods for encoding and decoding.
    Type: Application
    Filed: February 13, 2024
    Publication date: June 6, 2024
    Inventors: Christian HELMRICH, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 12003723
    Abstract: A picture in a data stream is subdivided into different size transform bocks. For a transform block, a transformation is selected by checking whether the block's size exceeds a threshold. If it does, a default technique is used to select the transformation. If it does not, a transformation is used from a list of transformations as identified by an index, the list including an identity transformation and non-identity transformations. A coefficients block in the data stream is decoded, and if the selected transformation is the identity transformation, then the coefficients block is used as a residual sample array, and if the selected transformation is not the identity transformation, the coefficients block is subjected to an inverse transformation corresponding to the selected transformation to obtain a residual sample array used to correct a prediction for the transform block.
    Type: Grant
    Filed: June 13, 2023
    Date of Patent: June 4, 2024
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Benjamin Bross, Phan Hoang Tung Nguyen, Paul Keydel, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Christian Helmrich
  • Publication number: 20240179340
    Abstract: A proposed intermediate way of handling the renderable portion of the first view results in more efficient coding. Instead of omitting the coding of the renderable portion completely, even more efficient coding of multi-view signals entails merely suppressing the coding of the residual signal within the renderable portion, whereas the prediction parameter coding still takes place from the non-renderable portion of the multi-view signal across the renderable portion so that prediction parameters for the renderable portion may be exploited for predicting parameters for the non-renderable portion. The additional coding rate for transmitting the prediction parameters for the renderable portion may be kept low as this merely aims at forming a continuation of the parameter history across the renderable portion to serve as a basis for prediction parameters of other portions of the multi-view signal.
    Type: Application
    Filed: December 21, 2023
    Publication date: May 30, 2024
    Inventors: Sebastian BOSSE, Heiko SCHWARZ, Thomas WIEGAND, Tobias HINZ