Patents by Inventor Björn STALLENBERGER

Björn STALLENBERGER has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11997280
    Abstract: An apparatus includes an encoder, which receives image or video data, encodes the data and provides a bitstream representing the data. The encoder includes a CABAC encoder, which receives a binary valued syntax element associated with a block of the data to be encoded, and encodes, using a selected context model, the syntax element into coded bits for the bitstream. The syntax element includes a tool flag indicating whether or not certain coding tool, like linear weighted intra prediction, is employed when encoding a block of the data. For a block of the data which exhibits an aspect ratio larger than 2 and for a block of the data which exhibits an aspect ratio less than or equal to 2, and to which blocks the certain coding tool is applicable, first and second context models for encoding the tool flag are selected from a group of one or more first and second context models, respectively.
    Type: Grant
    Filed: August 30, 2021
    Date of Patent: May 28, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schäfer, Tobias Hinz, Björn Stallenberger, Philipp Merkle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20240114138
    Abstract: In transform coefficient coding, predetermined sets of transforms may be used. Embodiments of the present invention provide an encoder and a decoder for encoding a picture into/from a data stream using block-based prediction and block-based residual coding, the encoder and decoder supporting a set of transforms for the block-based residual coding. The encoder and decoder are configured to determine a transform candidate list of transforms for a current residual block out of the set of transforms based on a height and a width of the current residual block, and to encode/decode a prediction residual within the residual block using one selected transform out of the selectable list of transforms and selectively signal/derive the selected transform in/from the data stream.
    Type: Application
    Filed: December 6, 2023
    Publication date: April 4, 2024
    Inventors: Mischa SIEKMANN, Bjoern STALLENBERGER, Christian BARTNIK, Sebastian BOSSE, Jonathan PFAFF, Philipp HELLE, Jackie MA, Martin WINKEN, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Patent number: 11882284
    Abstract: In transform coefficient coding, predetermined sets of transforms may be used. Embodiments of the present invention provide an encoder and a decoder for encoding a picture into/from a data stream using block-based prediction and block-based residual coding, the encoder and decoder supporting a set of transforms for the block-based residual coding. The encoder and decoder are configured to determine a transform candidate list of transforms for a current residual block out of the set of transforms based on a height and a width of the current residual block, and to encode/decode a prediction residual within the residual block using one selected transform out of the selectable list of transforms and selectively signal/derive the selected transform in/from the data stream.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: January 23, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Mischa Siekmann, Bjoern Stallenberger, Christian Bartnik, Sebastian Bosse, Jonathan Pfaff, Philipp Helle, Jackie Ma, Martin Winken, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20230328287
    Abstract: Apparatus (54) for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from a data stream (12), a mode index (200) using a binarization code (202). The mode index (200) points to one out of a list (204) of matrix-based intra-prediction modes. The apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighbourhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix-vector product (206) onto sample positions (104) of the predetermined block. The list (204) of matrix-based intra-prediction modes consists of an even number of matrix-based intra-prediction modes.
    Type: Application
    Filed: September 24, 2020
    Publication date: October 12, 2023
    Inventors: Jonathan PFAFF, Björn STALLENBERGER, Michael SCHAEFER, Philipp MERKLE, Tobias HINZ, Philipp HELLE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN
  • Publication number: 20230276048
    Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points.
    Type: Application
    Filed: May 4, 2023
    Publication date: August 31, 2023
    Inventors: Jonathan PFAFF, Heiko SCHWARZ, Philipp HELLE, Michael SCHÄFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Björn STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230254508
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template ; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Application
    Filed: January 9, 2023
    Publication date: August 10, 2023
    Applicant: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230188720
    Abstract: Block based decoder configured to partition a picture (10) of more than one color component (101, 102) and of a color sampling format, according to which each color component (101, 102) is equally sampled, into blocks using a partitioning scheme according to which the picture (10) is equally partitioned with respect to each color component (101, 102). Additionally, the block based decoder is configured to decode a first color component (101) of the picture (10) in units of the blocks with selecting, for each of intra-predicted first color component blocks (18?11-18?1n) of the picture (10), one out of a first set (508) of intra-prediction modes.
    Type: Application
    Filed: April 1, 2021
    Publication date: June 15, 2023
    Inventors: Jonathan Pfaff, Tobias Hinz, Philipp Helle, Philipp Merkle, Björn Stallenberger, Michael Schäfer, Benjamin Bross, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11659169
    Abstract: There are disclosed techniques for block wise encoding and decoding. The techniques may be applied to encoders, decoders, and methods for encoding and/or decoding. In one example, there is provided a technique to decode (resp. decode) a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder (resp.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: May 23, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Heiko Schwarz, Philipp Helle, Michael Schäfer, Roman Rischke, Tobias Hinz, Philipp Merkle, Björn Stallenberger, Martin Winken, Mischa Siekmann, Detlev Marpe, Thomas Wiegand
  • Patent number: 11601672
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: March 7, 2023
    Assignee: Fraunhofer-Gesellschaft zur Forderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230039672
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Application
    Filed: October 7, 2022
    Publication date: February 9, 2023
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Philipp Merkle, Tobias Hinz, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230036509
    Abstract: Apparatus for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from the data stream (12), a mode index (200), the mode index pointing to one out of a list (204) of matrix-based intra-prediction modes. Additionally, the apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighborhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix vector product (206) onto sample positions (104) of the predetermined block.
    Type: Application
    Filed: December 4, 2020
    Publication date: February 2, 2023
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11503339
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: November 15, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Tobias Hinz, Philipp Merkle, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20220116606
    Abstract: An apparatus configured to select a predetermined intra prediction mode out of a plurality of intra-prediction modes which includes a first set of intra-prediction modes and a second set of matrix-based intra-prediction modes. The apparatus is configured to select a subset of one or more secondary transforms dependent on the predetermined intra prediction mode so that the subset is nonempty in case of the predetermined intra prediction mode being contained in the first set of intra-prediction modes or in the second set of matrix-based intra-prediction modes. The apparatus is configured to derive a transformed version of a prediction residual for a predetermined block, which is related to a spatial domain version of the prediction residual of the predetermined block via a transform defined by a concatenation of a primary transform and a predetermined secondary transform out of the subset of secondary transforms.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220103813
    Abstract: Apparatus configured to derive a set-selective syntax element indicating whether the predetermined block is to be predicted using one of a first set of intra-prediction modes comprising a DC intra prediction mode and angular prediction modes. If the set-selective syntax element indicates that the predetermined block is to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a list of most probable intra-prediction modes. If the set-selective syntax element indicates that the predetermined block is not to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a matrix-based intra-prediction mode. The list of most probable intra-prediction modes is formed such that the list of most probable intra-prediction modes is free of the DC intra prediction mode in case of the neighbouring blocks being predicted by any of the angular intra prediction modes.
    Type: Application
    Filed: December 13, 2021
    Publication date: March 31, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Bjoern STALLENBERGER, Michael SCHAEFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220058239
    Abstract: Apparatus for predicting a predetermined block of a picture using a plurality of reference samples The apparatus is configured to form a sample value vector out of the plurality of reference samples, derive from the sample value vector a further vector onto which the sample value vector is mapped by a predetermined invertible linear transform, compute a matrix-vector product between the further vector and a predetermined prediction matrix so as to obtain a prediction vector, and predict samples of the predetermined block on the basis of the prediction vector.
    Type: Application
    Filed: November 5, 2021
    Publication date: February 24, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20210392331
    Abstract: An apparatus includes an encoder, which receives image or video data, encodes the data and provides a bitstream representing the data. The encoder includes a CABAC encoder, which receives a binary valued syntax element associated with a block of the data to be encoded, and encodes, using a selected context model, the syntax element into coded bits for the bitstream. The syntax element includes a tool flag indicating whether or not certain coding tool, like linear weighted intra prediction, is employed when encoding a block of the data. For a block of the data which exhibits an aspect ratio larger than 2 and for a block of the data which exhibits an aspect ratio less than or equal to 2, and to which blocks the certain coding tool is applicable, first and second context models for encoding the tool flag are selected from a group of one or more first and second context models, respectively.
    Type: Application
    Filed: August 30, 2021
    Publication date: December 16, 2021
    Inventors: Jonathan PFAFF, Philipp HELLE, Michael SCHÄFER, Tobias HINZ, Björn STALLENBERGER, Philipp MERKLE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20210314618
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Application
    Filed: June 17, 2021
    Publication date: October 7, 2021
    Inventors: Jonathan PFAFF, Philipp HELLE, Michael SCHAEFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Bjoern STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20210218960
    Abstract: There are disclosed techniques for block wise encoding and decoding. The techniques may be applied to encoders, decoders, and methods for encoding and/or decoding. In one example, there is provided a technique to decode (resp. decode) a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder (resp.
    Type: Application
    Filed: March 11, 2021
    Publication date: July 15, 2021
    Inventors: Jonathan PFAFF, Heiko SCHWARZ, Philipp HELLE, Michael SCHÄFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Björn STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20210084301
    Abstract: In transform coefficient coding, predetermined sets of transforms may be used. Embodiments of the present invention provide an encoder and a decoder for encoding a picture into/from a data stream using block-based prediction and block-based residual coding, the encoder and decoder supporting a set of transforms for the block-based residual coding. The encoder and decoder are configured to determine a transform candidate list of transforms for a current residual block out of the set of transforms based on a height and a width of the current residual block, and to encode/decode a prediction residual within the residual block using one selected transform out of the selectable list of transforms and selectively signal/derive the selected transform in/from the data stream.
    Type: Application
    Filed: September 28, 2020
    Publication date: March 18, 2021
    Inventors: Mischa SIEKMANN, Bjoern STALLENBERGER, Christian BARTNIK, Sebastian BOSSE, Jonathan PFAFF, Philipp HELLE, Jackie MA, Martin WINKEN, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Publication number: 20210014531
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Application
    Filed: September 25, 2020
    Publication date: January 14, 2021
    Inventors: Jonathan PFAFF, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Mischa SIEKMANN, Martin WINKEN, Adam WIECKOWSKI, Wojciech SAMEK, Stephan KALTENSTADLER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND