Patents by Inventor Mischa SIEKMANN

Mischa SIEKMANN has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250080735
    Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).
    Type: Application
    Filed: November 18, 2024
    Publication date: March 6, 2025
    Inventors: Paul HAASE, Christian RUDAT, Heiner KIRCHHOFFER, Phan Hoang Tung NGUYEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 12244864
    Abstract: A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)—and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal.
    Type: Grant
    Filed: May 12, 2024
    Date of Patent: March 4, 2025
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Björn Stallenberger, Michael Schafer, Philipp Merkle, Tobias Hinz, Philipp Helle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Benjamin Bross, Martin Winken, Mischa Siekmann
  • Publication number: 20250071292
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Application
    Filed: November 8, 2024
    Publication date: February 27, 2025
    Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Publication number: 20250071291
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Application
    Filed: November 8, 2024
    Publication date: February 27, 2025
    Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Publication number: 20250056040
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Application
    Filed: October 23, 2024
    Publication date: February 13, 2025
    Inventors: Jonathan PFAFF, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Mischa SIEKMANN, Martin WINKEN, Adam WIECKOWSKI, Wojciech SAMEK, Stephan KALTENSTADLER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20250030847
    Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding and include assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder or encoder, if the assigned set is the first set of intra-prediction modes, in sorting the assigned set, uses a second mapping which maps each intra-prediction mode of the second set of prediction modes onto a representative one in the first set of intra-prediction modes.
    Type: Application
    Filed: October 2, 2024
    Publication date: January 23, 2025
    Inventors: Jonathan PFAFF, Heiko SCHWARZ, Philipp HELLE, Michael SCHÄFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Björn STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Detlev MARPE, Thomas WIEGAND
  • Patent number: 12200216
    Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).
    Type: Grant
    Filed: October 17, 2023
    Date of Patent: January 14, 2025
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Paul Haase, Christian Rudat, Heiner Kirchhoffer, Phan Hoang Tung Nguyen, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12160606
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Grant
    Filed: January 9, 2023
    Date of Patent: December 3, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung, e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12160571
    Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points.
    Type: Grant
    Filed: May 4, 2023
    Date of Patent: December 3, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Heiko Schwarz, Philipp Helle, Michael Schäfer, Roman Rischke, Tobias Hinz, Philipp Merkle, Björn Stallenberger, Martin Winken, Mischa Siekmann, Detlev Marpe, Thomas Wiegand
  • Patent number: 12155867
    Abstract: A scalable video decoder is described which is configured to reconstruct a base layer signal from a coded data stream to obtain a reconstructed base layer signal; and reconstruct an enhancement layer signal including spatially or temporally predicting a portion of an enhancement layer signal, currently to be reconstructed, from an already reconstructed portion of the enhancement layer signal to obtain an enhancement layer internal prediction signal; forming, at the portion currently to be reconstructed, a weighted average of an inter-layer prediction signal obtained from the reconstructed base layer signal, and the enhancement layer internal prediction signal to obtain an enhancement layer prediction signal such that a weighting between the inter-layer prediction signal and the enhancement layer internal prediction signal varies over different spatial frequency components; and predictively reconstructing the enhancement layer signal using the enhancement layer prediction signal.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: November 26, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Patent number: 12143591
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Grant
    Filed: July 26, 2022
    Date of Patent: November 12, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Martin Winken, Christian Bartnik, Philipp Helle, Mischa Siekmann, Jonathan Pfaff, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20240373064
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Application
    Filed: July 17, 2024
    Publication date: November 7, 2024
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Tobias Hinz, Philipp Merkle, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20240373066
    Abstract: Information available from coding/decoding the base layer. i.e. base-layer hints, is exploited to render the motion-compensated prediction of the enhancement layer more efficient by more efficiently coding the enhancement layer motion parameters.
    Type: Application
    Filed: May 9, 2024
    Publication date: November 7, 2024
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Publication number: 20240364891
    Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initial
    Type: Application
    Filed: July 8, 2024
    Publication date: October 31, 2024
    Inventors: Valeri GEORGE, Benjamin BROSS, Heiner KIRCHHOFFER, Detlev MARPE, Tung NGUYEN, Matthias PREISS, Mischa SIEKMANN, Jan STEGEMANN, Thomas WIEGAND
  • Patent number: 12126812
    Abstract: An apparatus for determining visual activity information for a predetermined picture block of a video sequence including a plurality of video frames, the plurality of video frames including a current video frame and one or more timely-preceding video frames, wherein the one or more timely-preceding video frames precede the current video frame in time, is provided. The apparatus is configured to receive the predetermined picture block of each of the one or more timely-preceding video frames and the predetermined picture block of the current video frame. Moreover, the apparatus is configured to determine the visual activity information depending on the predetermined picture block of the current video frame and depending on the predetermined picture block of each of the one or more timely-preceding video frames and depending on a temporal high-pass filter.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: October 22, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Christian Helmrich, Sebastian Bosse, Mischa Siekmann, Soeren Becker, Johannes Erfurt, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20240323360
    Abstract: An apparatus includes at least one processor for decoding a block of a picture using intra-prediction that is configured to: decode, from a data stream, a mode index, the mode index indicating a matrix-based intra-prediction mode out of a plurality of matrix-based intra-prediction modes based on a size of the block, derive an input vector based on downsampling reference samples neighboring the block, determine a matrix based on the size of the block and the mode index, compute a respective output for each component of a matrix-vector product between the the input vector and the determined matrix, the respective output computed by performing, a right shift by a number of bits which is independent of the matrix-based intra-prediction mode indicated by the mode index, and for each component of the matrix-vector product, use the respective output to predict a respective sample of the block.
    Type: Application
    Filed: June 7, 2024
    Publication date: September 26, 2024
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20240314305
    Abstract: Apparatus configured to derive a set-selective syntax element indicating whether the predetermined block is to be predicted using one of a first set of intra-prediction modes comprising a DC intra prediction mode and angular prediction modes. If the set-selective syntax element indicates that the predetermined block is to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a list of most probable intra-prediction modes. If the set-selective syntax element indicates that the predetermined block is not to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a matrix-based intra-prediction mode. The list of most probable intra-prediction modes is formed such that the list of most probable intra-prediction modes is free of the DC intra prediction mode in case of the neighbouring blocks being predicted by any of the angular intra prediction modes.
    Type: Application
    Filed: May 23, 2024
    Publication date: September 19, 2024
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Bjoern STALLENBERGER, Michael SCHAEFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20240298033
    Abstract: A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)-and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal.
    Type: Application
    Filed: May 12, 2024
    Publication date: September 5, 2024
    Inventors: Jonathan PFAFF, Björn STALLENBERGER, Michael SCHAFER, Philipp MERKLE, Tobias HINZ, Philipp HELLE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN
  • Patent number: 12075091
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Grant
    Filed: October 7, 2022
    Date of Patent: August 27, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Tobias Hinz, Philipp Merkle, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12069267
    Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initial
    Type: Grant
    Filed: September 9, 2022
    Date of Patent: August 20, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand