Patents by Inventor Markus Multrus

Markus Multrus has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250149047
    Abstract: A downmixer for downmixing a multi-channel signal having at least two channels, includes: a weighting value estimator for estimating band-wise weighting values for the at least two channels; a spectral weighter for weighting spectral domain representations of the at least two channels using the band-wise weighting values; a converter for converting weighted spectral domain representations of the at least two channels into time representations of the at least two channels; and a mixer for mixing the time representations of the at least two channels to obtain a downmix signal.
    Type: Application
    Filed: January 13, 2025
    Publication date: May 8, 2025
    Inventors: Franz REUTELHUBER, Bernd EDLER, Eleni FOTOPOULOU, Markus MULTRUS, Pallavi MABEN, Sascha DISCH
  • Publication number: 20250124935
    Abstract: An audio encoder for encoding an audio signal includes: a first encoding processor for encoding a first audio signal portion in a frequency domain, wherein the first encoding processor includes: a time frequency converter for converting the first audio signal portion into a frequency domain representation having spectral lines up to a maximum frequency of the first audio signal portion; a spectral encoder for encoding the frequency domain representation; a second encoding processor for encoding a second different audio signal portion in the time domain; a cross-processor for calculating, from the encoded spectral representation of the first audio signal portion, initialization data of the second encoding processor, so that the second encoding processing is initialized to encode the second audio signal portion immediately following the first audio signal portion in time in the audio signal; a controller configured for analyzing the audio signal and for determining, which portion of the audio signal is the firs
    Type: Application
    Filed: December 20, 2024
    Publication date: April 17, 2025
    Inventors: Sascha DISCH, Martin DIETZ, Markus MULTRUS, Guillaume FUCHS, Emmanuel RAVELLI, Matthias NEUSINGER, Markus SCHNELL, Benjamin SCHUBERT, Bernhard GRILL
  • Patent number: 12277941
    Abstract: There are disclosed several examples of encoding and decoding technique. In particular, an audio synthesizer for generating a synthesis signal from a downmix signal, includes: an input interface for receiving the downmix signal, the downmix signal having a number of downmix channels and side information, the side information including channel level and correlation information of an original signal, the original signal having a number of original channels; and a synthesis processor for generating, according to at least one mixing rule, the synthesis signal using: channel level and correlation information of the original signal; and covariance information associated with the downmix signal.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: April 15, 2025
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Alexandre Bouthéon, Guillaume Fuchs, Markus Multrus, Fabian Küch, Oliver Thiergart, Stefan Bayer, Sascha Disch, Jürgen Herre
  • Patent number: 12273519
    Abstract: Embodiments of the present invention provide an encoder including a quantization stage, an entropy encoder, a residual quantization stage and a coded signal former. The quantization stage is configured to quantize an input signal using a dead zone in order to obtain a plurality of quantized values. The entropy encoder is configured to encode the plurality of quantized values using an entropy encoding scheme in order to obtain a plurality of entropy encoded values. The residual quantization stage is configured to quantize a residual signal caused by the quantization stage, wherein the residual quantization stage is configured to determine at least one quantized residual value in dependence on the dead zone of the quantization stage. The coded signal former is configured to form a coded signal from the plurality of entropy encoded values and the at least one quantized residual value.
    Type: Grant
    Filed: July 8, 2020
    Date of Patent: April 8, 2025
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Guillaume Fuchs, Benjamin Schubert, Grzegorz Pietrzyk, Markus Multrus, Bernhard Grill
  • Patent number: 12266372
    Abstract: There are disclosed several examples of encoding and decoding technique. In particular, an audio synthesizer for generating a synthesis signal from a downmix signal, includes: an input interface for receiving the downmix signal, the downmix signal having a number of downmix channels and side information, the side information including channel level and correlation information of an original signal, the original signal having a number of original channels; and a synthesis processor for generating, according to at least one mixing rule, the synthesis signal using: channel level and correlation information of the original signal; and covariance information associated with the downmix signal.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: April 1, 2025
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Alexandre Bouthéon, Guillaume Fuchs, Markus Multrus, Fabian Küch, Oliver Thiergart, Stefan Bayer, Sascha Disch, Jürgen Herre
  • Patent number: 12266371
    Abstract: A multi-channel audio encoder for providing an encoded audio representation on the basis of an input audio representation is provided. The multi-channel audio encoder is configured to switch between a parametric multi-channel encoding of a plurality of channels and an individual encoding of a plurality of channels in dependence on characteristics of the input audio representation.
    Type: Grant
    Filed: October 1, 2021
    Date of Patent: April 1, 2025
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Emmanuel Ravelli, Eleni Fotopoulou, Markus Multrus, Guillaume Fuchs
  • Publication number: 20250087223
    Abstract: An audio signal representation generator is provide for generating an output audio signal representation from an input audio signal that includes a sequence of input audio signal frames. Each input audio signal frame includes a sequence of input audio signal samples. The audio signal representation generator includes a format definer that defines a first multi-dimensional audio signal representation of the input audio signal, and a learnable layer that processes the first multidimensional audio signal representation of the input audio signal, or a processed version of the first multi-dimensional audio signal representation, to generate the output audio signal representation of the input audio signal.
    Type: Application
    Filed: September 18, 2024
    Publication date: March 13, 2025
    Inventors: Nicola PIA, Kishan GUPTA, Srikanth KORSE, Markus MULTRUS, Guillaume FUCHS
  • Patent number: 12243541
    Abstract: An apparatus for encoding a multi-channel signal having at least two channels, has: a downmixer for calculating a downmix signal from the multi-channel signal; a parameter calculator for calculating a side gain from a first channel of the at least two channels and a second channel of the at least two channels and for calculating a residual gain from the first channel and the second channel; and an output interface for generating an output signal, the output signal having information on the downmix signal, and on the side gain and the residual gain.
    Type: Grant
    Filed: August 10, 2022
    Date of Patent: March 4, 2025
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Jan Buethe, Guillaume Fuchs, Wolfgang Jaegers, Franz Reutelhuber, Juergen Herre, Eleni Fotopoulou, Markus Multrus, Srikanth Korse
  • Publication number: 20250069608
    Abstract: An audio encoder has a first information sink oriented encoding branch such as a spectral domain encoding branch, a second information source or SNR oriented encoding branch such as an LPC-domain encoding branch, and a switch for switching between the first and second encoding branches, the second encoding branch having a converter into a specific domain different from the spectral domain such as an LPC analysis stage generating an excitation signal, and the second encoding branch having a specific domain coding branch such as LPC domain processing branch, and a specific spectral domain coding branch such as LPC spectral domain processing branch, and an additional switch for switching between the specific domain coding branch and the specific spectral domain coding branch. An audio decoder has a first domain decoder, a second domain decoder, and a third domain decoder as well as two cascaded switches for switching between the decoders.
    Type: Application
    Filed: November 7, 2024
    Publication date: February 27, 2025
    Inventors: Bernhard GRILL, Roch LEFEBVRE, Bruno BESSETTE, Jimmy LAPIERRE, Philippe GOURNAY, Redwan SALAMI, Stefan BAYER, Guillaume FUCHS, Stefan GEYERSBERGER, Ralf GEIGER, Johannes HILPERT, Ulrich KRAEMER, Jérémie LECOMTE, Markus MULTRUS, Max NEUENDORF, Harald POPP, Nikolaus RETTELBACH
  • Publication number: 20250061903
    Abstract: An audio encoder has a first information sink oriented encoding branch such as a spectral domain encoding branch, a second information source or SNR oriented encoding branch such as an LPC-domain encoding branch, and a switch for switching between the first and second encoding branches, the second encoding branch having a converter into a specific domain different from the spectral domain such as an LPC analysis stage generating an excitation signal, and the second encoding branch having a specific domain coding branch such as LPC domain processing branch, and a specific spectral domain coding branch such as LPC spectral domain processing branch, and an additional switch for switching between the specific domain coding branch and the specific spectral domain coding branch. An audio decoder has a first domain decoder, a second domain decoder, and a third domain decoder as well as two cascaded switches for switching between the decoders.
    Type: Application
    Filed: November 7, 2024
    Publication date: February 20, 2025
    Inventors: Bernhard GRILL, Roch LEFEBVRE, Bruno BESSETTE, Jimmy LAPIERRE, Philippe GOURNAY, Redwan SALAMI, Stefan BAYER, Guillaume FUCHS, Stefan GEYERSBERGER, Ralf GEIGER, Johannes HILPERT, Ulrich KRAEMER, Jérémie LECOMTE, Markus MULTRUS, Max NEUENDORF, Harald POPP, Nikolaus RETTELBACH
  • Publication number: 20250061902
    Abstract: An audio encoder has a first information sink oriented encoding branch such as a spectral domain encoding branch, a second information source or SNR oriented encoding branch such as an LPC-domain encoding branch, and a switch for switching between the first and second encoding branches, the second encoding branch having a converter into a specific domain different from the spectral domain such as an LPC analysis stage generating an excitation signal, and the second encoding branch having a specific domain coding branch such as LPC domain processing branch, and a specific spectral domain coding branch such as LPC spectral domain processing branch, and an additional switch for switching between the specific domain coding branch and the specific spectral domain coding branch. An audio decoder has a first domain decoder, a second domain decoder, and a third domain decoder as well as two cascaded switches for switching between the decoders.
    Type: Application
    Filed: November 7, 2024
    Publication date: February 20, 2025
    Inventors: Bernhard GRILL, Roch LEFEBVRE, Bruno BESSETTE, Jimmy LAPIERRE, Philippe GOURNAY, Redwan SALAMI, Stefan BAYER, Guillaume FUCHS, Stefan GEYERSBERGER, Ralf GEIGER, Johannes HILPERT, Ulrich KRAEMER, Jérémie LECOMTE, Markus MULTRUS, Max NEUENDORF, Harald POPP, Nikolaus RETTELBACH
  • Patent number: 12230285
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for encoding entropy the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Grant
    Filed: April 5, 2024
    Date of Patent: February 18, 2025
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Markus Multrus, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Patent number: 12230281
    Abstract: A downmixer for downmixing a multi-channel signal having at least two channels, includes: a weighting value estimator for estimating band-wise weighting values for the at least two channels; a spectral weighter for weighting spectral domain representations of the at least two channels using the band-wise weighting values; a converter for converting weighted spectral domain representations of the at least two channels into time representations of the at least two channels; and a mixer for mixing the time representations of the at least two channels to obtain a downmix signal.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: February 18, 2025
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Franz Reutelhuber, Bernd Edler, Eleni Fotopoulou, Markus Multrus, Pallavi Maben, Sascha Disch
  • Patent number: 12205603
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Grant
    Filed: April 5, 2024
    Date of Patent: January 21, 2025
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Markus Multrus, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Patent number: 12198708
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Grant
    Filed: April 5, 2024
    Date of Patent: January 14, 2025
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Markus Multrus, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Patent number: 12198707
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Grant
    Filed: April 5, 2024
    Date of Patent: January 14, 2025
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Markus Multrus, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Publication number: 20250014584
    Abstract: An audio generator is provided for generating an audio signal from a bitstream that represents the audio signal that is subdivided in a sequence of frames. The audio generator includes a first data provisioner that provides, for a given frame, first data derived from an input signal; and a first processing block that, for the given frame, receives the first data and to output first output data in the given frame.
    Type: Application
    Filed: September 18, 2024
    Publication date: January 9, 2025
    Inventors: Nicola PIA, Kishan GUPTA, Srikanth KORSE, Markus MULTRUS, Guillaume FUCHS
  • Publication number: 20240428806
    Abstract: An apparatus for encoding directional audio coding parameters including diffuseness parameters and direction parameters includes: a parameter calculator for calculating the diffuseness parameters with a first time or frequency resolution and for calculating the direction parameters with a second time or frequency resolution; and a quantizer and encoder processor for generating a quantized and encoded representation of the diffuseness parameters and the direction parameters.
    Type: Application
    Filed: September 3, 2024
    Publication date: December 26, 2024
    Inventors: Guillaume FUCHS, Jürgen HERRE, Fabian KÜCH, Stefan DÖHLA, Markus MULTRUS, Oliver THIERGART, Oliver WÜBBOLT, Florin GHIDO, Stefan BAYER, Wolfgang JAEGERS
  • Publication number: 20240428812
    Abstract: Embodiments according to the invention are related to methods and apparatuses for spectrotemporally improved spectral gap filling in audio coding using a filtering. Embodiments according to the invention are related to methods and apparatuses for spectrotemporally improved spectral gap filling in audio coding using different noise filling methods. Embodiments according to the invention are related to methods and apparatuses for spectrotemporally improved spectral gap filling in audio coding using a tilt.
    Type: Application
    Filed: June 23, 2024
    Publication date: December 26, 2024
    Applicant: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Christian HELMRICH, Eleni FOTOPOULOU, Richard FÜG, Goran MARKOVIC, Markus MULTRUS, Franz REUTELHUBER
  • Publication number: 20240420714
    Abstract: An encoder for providing an audio stream on the basis of a transform-domain representation of an input audio signal includes a quantization error calculator configured to determine a multi-band quantization error over a plurality of frequency bands of the input audio signal for which separate band gain information is available. The encoder also includes an audio stream provider for providing the audio stream such that the audio stream includes information describing an audio content of the frequency bands and information describing the multi-band quantization error. A decoder for providing a decoded representation of an audio signal on the basis of an encoded audio stream representing spectral components of frequency bands of the audio signal includes a noise filler for introducing noise into spectral components of a plurality of frequency bands to which separate frequency band gain information is associated on the basis of a common multi-band noise intensity value.
    Type: Application
    Filed: August 29, 2024
    Publication date: December 19, 2024
    Applicant: Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung e.V.
    Inventors: Nikolaus RETTELBACH, Bernhard GRILL, Guillaume FUCHS, Stefan GEYERSBERGER, Markus MULTRUS, Harald POPP, Juergen HERRE, Stefan WABNIK, Gerald SCHULLER, Jens HIRSCHFELD