Patents by Inventor Markus Multrus

Markus Multrus has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11990146
    Abstract: An apparatus for providing a processed audio signal representation on the basis of input audio signal representation configured to apply an un-windowing, in order to provide the processed audio signal representation on the basis of the input audio signal representation. The apparatus is configured to adapt the un-windowing in dependence on one or more signal characteristics and/or in dependence on one or more processing parameters used for a provision of the input audio signal representation.
    Type: Grant
    Filed: May 4, 2021
    Date of Patent: May 21, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Stefan Bayer, Pallavi Maben, Emmanuel Ravelli, Guillaume Fuchs, Eleni Fotopoulou, Markus Multrus
  • Patent number: 11990142
    Abstract: There are disclosed several examples of encoding and decoding technique. In particular, an audio synthesizer for generating a synthesis signal from a downmix signal includes: an input interface for receiving the downmix signal, the downmix signal having a number of downmix channels and side information, the side information including channel level and correlation information of an original signal, the original signal having a number of original channels; and a synthesis processor for generating, according to at least one mixing rule, the synthesis signal using: channel level and correlation information of the original signal; and covariance information associated with the downmix signal.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: May 21, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Alexandre Bouthéon, Guillaume Fuchs, Markus Multrus, Fabian Küch, Oliver Thiergart, Stefan Bayer, Sascha Disch, Jürgen Herre
  • Patent number: 11978459
    Abstract: In multichannel audio coding, improved computational efficiency is achieved by computing comparison parameters for ITD compensation between any two channels in the frequency domain for a parametric audio encoder. This may mitigate negative effects on encoder parameter estimates.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: May 7, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jan Büthe, Eleni Fotopoulou, Srikanth Korse, Pallavi Maben, Markus Multrus, Franz Reutelhuber
  • Publication number: 20240127832
    Abstract: There are disclosed techniques for generating an audio signal and training an audio generator. An audio decoder generates an audio signal from a bitstream and comprises: a first data provisioner to provide first data having multiple channels; a first processing block to output first output data having multiple channels, and a second processing block. The first processing block comprises: a learnable layer to receive the bitstream and, for the given frame, output target data representing the audio signal in the given frame with multiple channels and multiple samples for the given frame; a conditioning learnable layer to process the target data to obtain conditioning feature parameters for the given frame; and a styling element applying the conditioning feature parameters to the first data. The second processing block combines the channels of the second data to obtain the audio signal.
    Type: Application
    Filed: October 27, 2023
    Publication date: April 18, 2024
    Inventors: Ahmed Mustafa Mahmoud Ahmed, Nicola PIA, Jan Buethe, Srikanth Korse, Kishan Gupta, Markus Multrus, Guillaume Fuchs
  • Publication number: 20240112685
    Abstract: In multichannel audio coding, improved computational efficiency is achieved by computing comparison parameters for ITD compensation between any two channels in the frequency domain for a parametric audio encoder. This may mitigate negative effects on encoder parameter estimates.
    Type: Application
    Filed: September 8, 2023
    Publication date: April 4, 2024
    Inventors: Jan BÜTHE, Eleni FOTOPOULOU, Srikanth KORSE, Pallavi MABEN, Markus MULTRUS, Franz REUTELHUBER
  • Patent number: 11948590
    Abstract: An apparatus for providing a processed audio signal representation on the basis of input audio signal representation configured to apply an un-windowing, in order to provide the processed audio signal representation on the basis of the input audio signal representation. The apparatus is configured to adapt the un-windowing in dependence on one or more signal characteristics and/or in dependence on one or more processing parameters used for a provision of the input audio signal representation.
    Type: Grant
    Filed: May 5, 2021
    Date of Patent: April 2, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Stefan Bayer, Pallavi Maben, Emmanuel Ravelli, Guillaume Fuchs, Eleni Fotopoulou, Markus Multrus
  • Patent number: 11942101
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Grant
    Filed: April 14, 2023
    Date of Patent: March 26, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Markus Multrus, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Publication number: 20240096337
    Abstract: An encoder for providing an audio stream on the basis of a transform-domain representation of an input audio signal includes a quantization error calculator configured to determine a multi-band quantization error over a plurality of frequency bands of the input audio signal for which separate band gain information is available. The encoder also includes an audio stream provider for providing the audio stream such that the audio stream includes information describing an audio content of the frequency bands and information describing the multi-band quantization error. A decoder for providing a decoded representation of an audio signal on the basis of an encoded audio stream representing spectral components of frequency bands of the audio signal includes a noise filler for introducing noise into spectral components of a plurality of frequency bands to which separate frequency band gain information is associated on the basis of a common multi-band noise intensity value.
    Type: Application
    Filed: November 29, 2023
    Publication date: March 21, 2024
    Applicant: Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung e.V.
    Inventors: Nikolaus RETTELBACH, Bernhard GRILL, Guillaume FUCHS, Stefan GEYERSBERGER, Markus MULTRUS, Harald POPP, Juergen HERRE, Stefan WABNIK, Gerald SCHULLER, Jens HIRSCHFELD
  • Publication number: 20240096338
    Abstract: An encoder for providing an audio stream on the basis of a transform-domain representation of an input audio signal includes a quantization error calculator configured to determine a multi-band quantization error over a plurality of frequency bands of the input audio signal for which separate band gain information is available. The encoder also includes an audio stream provider for providing the audio stream such that the audio stream includes information describing an audio content of the frequency bands and information describing the multi-band quantization error. A decoder for providing a decoded representation of an audio signal on the basis of an encoded audio stream representing spectral components of frequency bands of the audio signal includes a noise filler for introducing noise into spectral components of a plurality of frequency bands to which separate frequency band gain information is associated on the basis of a common multi-band noise intensity value.
    Type: Application
    Filed: November 29, 2023
    Publication date: March 21, 2024
    Applicant: Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung e.V.
    Inventors: Nikolaus RETTELBACH, Bernhard GRILL, Guillaume FUCHS, Stefan GEYERSBERGER, Markus MULTRUS, Harald POPP, Juergen HERRE, Stefan WABNIK, Gerald SCHULLER, Jens HIRSCHFELD
  • Patent number: 11937075
    Abstract: An apparatus for generating a sound field description using an input signal having a mono-signal or a multi-channel signal comprises: an input signal analyzer for analyzing the input signal to derive direction data and diffuseness data; a low-order components generator for generating a low-order sound field description from the input signal up to a predetermined order and mode; a mid-order components generator for generating a mid-order sound field description above the predetermined order or at the predetermined order and above the predetermined mode and below or at a first truncation order using a synthesis of at least one direct portion and of at least one diffuse portion using the direction data and the diffuseness data; and a high-order components generator for generating a high-order sound field description having a component above the first truncation order using a synthesis of at least one direct portion.
    Type: Grant
    Filed: May 27, 2021
    Date of Patent: March 19, 2024
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWAND FORSCHUNG E.V
    Inventors: Guillaume Fuchs, Oliver Thiergart, Srikanth Korse, Stefan Döhla, Markus Multrus, Fabian Küch, Alexandre Bouthéon, Andrea Eichenseer, Stefan Bayer
  • Patent number: 11935549
    Abstract: An apparatus for encoding an audio signal includes: a core encoder for core encoding first audio data in a first spectral band; a parametric coder for parametrically coding second audio data in a second spectral band being different from the first spectral band, wherein the parametric coder includes: an analyzer for analyzing first audio data in the first spectral band to obtain a first analysis result and for analyzing second audio data in the second spectral band to obtain a second analysis result; a compensator for calculating a compensation value using the first analysis result and the second analysis result; and a parameter calculated for calculating a parameter from the second audio data in the second spectral band using the compensation value.
    Type: Grant
    Filed: August 11, 2022
    Date of Patent: March 19, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Sascha Disch, Franz Reutelhuber, Jan Büthe, Markus Multrus, Bernd Edler
  • Patent number: 11929084
    Abstract: An audio encoder for encoding an audio signal has: a first encoding processor for encoding a first audio signal portion in a frequency domain, having: a time frequency converter for converting the first audio signal portion into a frequency domain representation; an analyzer for analyzing the frequency domain representation to determine first spectral portions to be encoded with a first spectral resolution and second regions to be encoded with a second resolution; and a spectral encoder for encoding the first spectral portions with the first spectral resolution and encoding the second portions with the second resolution; a second encoding processor for encoding a second different audio signal portion in the time domain; a controller for analyzing and determining, which portion of the audio signal is the first audio signal portion encoded in the frequency domain and which portion is the second audio signal portion encoded in the time domain; and an encoded signal former for forming an encoded audio signal havi
    Type: Grant
    Filed: January 23, 2023
    Date of Patent: March 12, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Sascha Disch, Martin Dietz, Markus Multrus, Guillaume Fuchs, Emmanuel Ravelli, Matthias Neusinger, Markus Schnell, Benjamin Schubert, Bernhard Grill
  • Patent number: 11922961
    Abstract: An audio decoder for providing a decoded audio information on the basis of an encoded audio information includes a linear-prediction-domain decoder configured to provide a first decoded audio information on the basis of an audio frame encoded in a linear prediction domain, a frequency domain decoder configured to provide a second decoded audio information on the basis of an audio frame encoded in a frequency domain, and a transition processor. The transition processor is configured to obtain a zero-input-response of a linear predictive filtering, wherein an initial state of the linear predictive filtering is defined depending on the first decoded audio information and the second decoded audio information, and modify the second decoded audio information depending on the zero-input-response, to obtain a smooth transition between the first and the modified second decoded audio information.
    Type: Grant
    Filed: September 20, 2021
    Date of Patent: March 5, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Emmanuel Ravelli, Guillaume Fuchs, Sascha Disch, Markus Multrus, Grzegorz Pietrzyk, Benjamin Schubert
  • Publication number: 20240071395
    Abstract: An apparatus for encoding a first channel and a second channel of an audio input signal including two or more channels to obtain an encoded audio signal according to an embodiment includes a normalizer configured to determine a normalization value for the audio input signal depending on the first channel of the audio input signal and depending on the second channel of the audio input signal. Moreover, the apparatus includes an encoding unit configured to generate a processed audio signal having a first channel and a second channel. The encoding unit is configured to encode the processed audio signal to obtain the encoded audio signal.
    Type: Application
    Filed: October 30, 2023
    Publication date: February 29, 2024
    Inventors: Emmanuel RAVELLI, Markus SCHNELL, Stefan DOEHLA, Wolfgang JAEGERS, Martin DIETZ, Christian HELMRICH, Goran MARKOVIC, Eleni FOTOPOULOU, Markus MULTRUS, Stefan BAYER, Guillaume FUCHS, Juergen HERRE
  • Patent number: 11915712
    Abstract: An audio encoder for encoding an audio signal includes: a first encoding processor for encoding a first audio signal portion in a frequency domain, wherein the first encoding processor includes: a time frequency converter for converting the first audio signal portion into a frequency domain representation having spectral lines up to a maximum frequency of the first audio signal portion; a spectral encoder for encoding the frequency domain representation; a second encoding processor for encoding a second different audio signal portion in the time domain; a cross-processor for calculating, from the encoded spectral representation of the first audio signal portion, initialization data of the second encoding processor, so that the second encoding processing is initialized to encode the second audio signal portion immediately following the first audio signal portion in time in the audio signal; a controller configured for analyzing the audio signal and for determining, which portion of the audio signal is the firs
    Type: Grant
    Filed: November 1, 2021
    Date of Patent: February 27, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Sascha Disch, Martin Dietz, Markus Multrus, Guillaume Fuchs, Emmanuel Ravelli, Matthias Neusinger, Markus Schnell, Benjamin Schubert, Bernhard Grill
  • Publication number: 20240046941
    Abstract: An audio decoder for providing a decoded audio information on the basis of an encoded audio information includes a linear-prediction-domain decoder configured to provide a first decoded audio information on the basis of an audio frame encoded in a linear prediction domain, a frequency domain decoder configured to provide a second decoded audio information on the basis of an audio frame encoded in a frequency domain, and a transition processor. The transition processor is configured to obtain a zero-input-response of a linear predictive filtering, wherein an initial state of the linear predictive filtering is defined depending on the first decoded audio information and the second decoded audio information, and modify the second decoded audio information depending on the zero-input-response, to obtain a smooth transition between the first and the modified second decoded audio information.
    Type: Application
    Filed: October 19, 2023
    Publication date: February 8, 2024
    Applicant: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Emmanuel Ravelli, Guillaume Fuchs, Sascha Disch, Markus Multrus, Grzegorz Pietrzyk, Benjamin Schubert
  • Publication number: 20240040330
    Abstract: An apparatus for generating a sound field description using an input signal having a mono-signal or a multi-channel signal includes: an input signal analyzer for analyzing the input signal to derive direction data and diffuseness data; a low-order components generator for generating a low-order sound field description from the input signal up to a predetermined order and mode; a mid-order components generator for generating a mid-order sound field description above the predetermined order or at the predetermined order and above the predetermined mode and below or at a first truncation order using a synthesis of at least one direct portion and of at least one diffuse portion using the direction data and the diffuseness data; and a high-order components generator for generating a high-order sound field description having a component above the first truncation order using a synthesis of at least one direct portion.
    Type: Application
    Filed: October 6, 2023
    Publication date: February 1, 2024
    Inventors: Guillaume FUCHS, Oliver THIERGART, Srikanth KORSE, Stefan DÖHLA, Markus MULTRUS, Fabian KÜCH, Alexandre BOUTHÉON, Andrea EICHENSEER, Stefan BAYER
  • Patent number: 11887609
    Abstract: An apparatus for estimating an inter-channel time difference between a first channel signal and a second channel signal, includes: a calculator for calculating a cross-correlation spectrum for a time block from the first channel signal in the time block and the second channel signal in the time block; a spectral characteristic estimator for estimating a characteristic of a spectrum of the first channel signal or the second channel signal for the time block; a smoothing filter for smoothing the cross-correlation spectrum over time using the spectral characteristic to obtain a smoothed cross-correlation spectrum; and a processor for processing the smoothed cross-correlation spectrum to obtain the inter-channel time difference.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: January 30, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Stefan Bayer, Eleni Fotopoulou, Markus Multrus, Guillaume Fuchs, Emmanuel Ravelli, Markus Schnell, Stefan Doehla, Wolfgang Jaegers, Martin Dietz, Goran Markovic
  • Patent number: 11881228
    Abstract: According to an aspect of the present invention an encoder for encoding an audio signal has an analyzer configured for deriving prediction coefficients and a residual signal from a frame of the audio signal. The encoder has a formant information calculator configured for calculating a speech related spectral shaping information from the prediction coefficients, a gain parameter calculator configured for calculating a gain parameter from an unvoiced residual signal and the spectral shaping information and a bitstream former configured for forming an output signal based on an information related to a voiced signal frame, the gain parameter or a quantized gain parameter and the prediction coefficients.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: January 23, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e. V.
    Inventors: Guillaume Fuchs, Markus Multrus, Emmanuel Ravelli, Markus Schnell
  • Publication number: 20240013794
    Abstract: An apparatus for providing a processed audio signal representation on the basis of input audio signal representation configured to apply an un-windowing, in order to provide the processed audio signal representation on the basis of the input audio signal representation. The apparatus is configured to adapt the un-windowing in dependence on one or more signal characteristics and/or in dependence on one or more processing parameters used for a provision of the input audio signal representation.
    Type: Application
    Filed: September 25, 2023
    Publication date: January 11, 2024
    Inventors: Stefan BAYER, Pallavi MABEN, Emmanuel RAVELLI, Guillaume FUCHS, Eleni FOTOPOULOU, Markus MULTRUS