Patents by Inventor Nikolaus Rettelbach

Nikolaus Rettelbach has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11961530
    Abstract: An apparatus for decoding data segments representing a time-domain data stream, a data segment being encoded in the time domain or in the frequency domain, a data segment being encoded in the frequency domain having successive blocks of data representing successive and overlapping blocks of time-domain data samples. The apparatus includes a time-domain decoder for decoding a data segment being encoded in the time domain and a processor for processing the data segment being encoded in the frequency domain and output data of the time-domain decoder to obtain overlapping time-domain data blocks. The apparatus further includes an overlap/add-combiner for combining the overlapping time-domain data blocks to obtain a decoded data segment of the time-domain data stream.
    Type: Grant
    Filed: January 10, 2023
    Date of Patent: April 16, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e. V.
    Inventors: Ralf Geiger, Max Neuendorf, Yoshikazu Yokotani, Nikolaus Rettelbach, Juergen Herre, Stefan Geyersberger
  • Publication number: 20240119953
    Abstract: The invention provides an audio encoder including a combination of a linear predictive coding filter having a plurality of linear predictive coding coefficients and a time-frequency converter, wherein the combination is configured to filter and to convert a frame of the audio signal into a frequency domain in order to output a spectrum based on the frame and on the linear predictive coding coefficients; a low frequency emphasizer configured to calculate a processed spectrum based on the spectrum, wherein spectral lines of the processed spectrum representing a lower frequency than a reference spectral line are emphasized; and a control device configured to control the calculation of the processed spectrum by the low frequency emphasizer depending on the linear predictive coding coefficients of the linear predictive coding filter.
    Type: Application
    Filed: December 5, 2023
    Publication date: April 11, 2024
    Inventors: Stefan DOEHLA, Bernhard GRILL, Christian HELMRICH, Nikolaus RETTELBACH
  • Patent number: 11955131
    Abstract: An apparatus for encoding a multi-channel signal having at least three channels includes an iteration processor, a channel encoder and an output interface. The iteration processor is configured to calculate inter-channel correlation values between each pair of the at least three channels, for selecting a pair including a highest value or including a value above a threshold, and for processing the selected pair using a multi-channel processing operation to derive first multi-channel parameters for the selected pair and to derive first processed channels. The iteration processor is configured to perform the calculating, the selecting and the processing using at least one of the processed channels to derive second multi-channel parameters and second processed channels. The channel encoder is configured to encode channels resulting from an iteration processing to obtain encoded channels.
    Type: Grant
    Filed: October 18, 2022
    Date of Patent: April 9, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Sascha Dick, Florian Schuh, Nikolaus Rettelbach, Tobias Schwegler, Richard Fueg, Johannes Hilpert, Matthias Neusinger
  • Patent number: 11942101
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Grant
    Filed: April 14, 2023
    Date of Patent: March 26, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Markus Multrus, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Publication number: 20240096337
    Abstract: An encoder for providing an audio stream on the basis of a transform-domain representation of an input audio signal includes a quantization error calculator configured to determine a multi-band quantization error over a plurality of frequency bands of the input audio signal for which separate band gain information is available. The encoder also includes an audio stream provider for providing the audio stream such that the audio stream includes information describing an audio content of the frequency bands and information describing the multi-band quantization error. A decoder for providing a decoded representation of an audio signal on the basis of an encoded audio stream representing spectral components of frequency bands of the audio signal includes a noise filler for introducing noise into spectral components of a plurality of frequency bands to which separate frequency band gain information is associated on the basis of a common multi-band noise intensity value.
    Type: Application
    Filed: November 29, 2023
    Publication date: March 21, 2024
    Applicant: Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung e.V.
    Inventors: Nikolaus RETTELBACH, Bernhard GRILL, Guillaume FUCHS, Stefan GEYERSBERGER, Markus MULTRUS, Harald POPP, Juergen HERRE, Stefan WABNIK, Gerald SCHULLER, Jens HIRSCHFELD
  • Publication number: 20240096338
    Abstract: An encoder for providing an audio stream on the basis of a transform-domain representation of an input audio signal includes a quantization error calculator configured to determine a multi-band quantization error over a plurality of frequency bands of the input audio signal for which separate band gain information is available. The encoder also includes an audio stream provider for providing the audio stream such that the audio stream includes information describing an audio content of the frequency bands and information describing the multi-band quantization error. A decoder for providing a decoded representation of an audio signal on the basis of an encoded audio stream representing spectral components of frequency bands of the audio signal includes a noise filler for introducing noise into spectral components of a plurality of frequency bands to which separate frequency band gain information is associated on the basis of a common multi-band noise intensity value.
    Type: Application
    Filed: November 29, 2023
    Publication date: March 21, 2024
    Applicant: Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung e.V.
    Inventors: Nikolaus RETTELBACH, Bernhard GRILL, Guillaume FUCHS, Stefan GEYERSBERGER, Markus MULTRUS, Harald POPP, Juergen HERRE, Stefan WABNIK, Gerald SCHULLER, Jens HIRSCHFELD
  • Publication number: 20240062768
    Abstract: An audio decoder for providing a decoded audio signal representation on the basis of an encoded audio signal representation is configured to adjust decoding parameters in dependence on a configuration information, to decode one or more audio frames using a current configuration information, to compare a configuration information in a configuration structure associated with one or more frames to be decoded by the current configuration information, and to make a transition to perform decoding using the configuration information in the configuration structure associated with the one or more frames to be decoded as a new configuration information if the configuration information in the configuration structure associated with the one or more frames to be decoded, or a relevant portion thereof, is different from the current configuration information, and to consider a stream identifier information included in the configuration structure when comparing the configuration information.
    Type: Application
    Filed: October 23, 2023
    Publication date: February 22, 2024
    Inventors: Max NEUENDORF, Matthias FELIX, Matthias HILDENBRAND, Lukas SCHUSTER, Ingo HOFMANN, Bernd HERRMANN, Nikolaus RETTELBACH
  • Patent number: 11869521
    Abstract: An encoder for providing an audio stream on the basis of a transform-domain representation of an input audio signal includes a quantization error calculator configured to determine a multi-band quantization error over a plurality of frequency bands of the input audio signal for which separate band gain information is available. The encoder also includes an audio stream provider for providing the audio stream such that the audio stream includes information describing an audio content of the frequency bands and information describing the multi-band quantization error. A decoder for providing a decoded representation of an audio signal on the basis of an encoded audio stream representing spectral components of frequency bands of the audio signal includes a noise filler for introducing noise into spectral components of a plurality of frequency bands to which separate frequency band gain information is associated on the basis of a common multi-band noise intensity value.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: January 9, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Nikolaus Rettelbach, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Markus Multrus, Harald Popp, Juergen Herre, Stefan Wabnik, Gerald Schuller, Jens Hirschfeld
  • Patent number: 11854561
    Abstract: The invention provides an audio encoder including a combination of a linear predictive coding filter having a plurality of linear predictive coding coefficients and a time-frequency converter, wherein the combination is configured to filter and to convert a frame of the audio signal into a frequency domain in order to output a spectrum based on the frame and on the linear predictive coding coefficients; a low frequency emphasizer configured to calculate a processed spectrum based on the spectrum, wherein spectral lines of the processed spectrum representing a lower frequency than a reference spectral line are emphasized; and a control device configured to control the calculation of the processed spectrum by the low frequency emphasizer depending on the linear predictive coding coefficients of the linear predictive coding filter.
    Type: Grant
    Filed: November 22, 2022
    Date of Patent: December 26, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Stefan Doehla, Bernhard Grill, Christian Helmrich, Nikolaus Rettelbach
  • Publication number: 20230402045
    Abstract: An audio encoder has a first information sink oriented encoding branch such as a spectral domain encoding branch, a second information source or SNR oriented encoding branch such as an LPC-domain encoding branch, and a switch for switching between the first and second encoding branches, the second encoding branch having a converter into a specific domain different from the spectral domain such as an LPC analysis stage generating an excitation signal, and the second encoding branch having a specific domain coding branch such as LPC domain processing branch, and a specific spectral domain coding branch such as LPC spectral domain processing branch, and an additional switch for switching between the specific domain coding branch and the specific spectral domain coding branch. An audio decoder has a first domain decoder, a second domain decoder, and a third domain decoder as well as two cascaded switches for switching between the decoders.
    Type: Application
    Filed: August 16, 2023
    Publication date: December 14, 2023
    Inventors: Bernhard GRILL, Roch LEFEBVRE, Bruno BESSETTE, Jimmy LAPIERRE, Philippe GOURNAY, Redwan SALAMI, Stefan BAYER, Guillaume FUCHS, Stefan GEYERSBERGER, Ralf GEIGER, Johannes HILPERT, Ulrich KRAEMER, Jérémie LECOMTE, Markus MULTRUS, Max NEUENDORF, Harald POPP, Nikolaus RETTELBACH
  • Patent number: 11837247
    Abstract: An audio decoder for providing a decoded audio signal representation on the basis of an encoded audio signal representation is configured to adjust decoding parameters in dependence on a configuration information, to decode one or more audio frames using a current configuration information, to compare a configuration information in a configuration structure associated with one or more frames to be decoded by the current configuration information, and to make a transition to perform decoding using the configuration information in the configuration structure associated with the one or more frames to be decoded as a new configuration information if the configuration information in the configuration structure associated with the one or more frames to be decoded, or a relevant portion thereof, is different from the current configuration information, and to consider a stream identifier information included in the configuration structure when comparing the configuration information.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: December 5, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Max Neuendorf, Matthias Felix, Matthias Hildenbrand, Lukas Schuster, Ingo Hofmann, Bernd Herrmann, Nikolaus Rettelbach
  • Publication number: 20230377586
    Abstract: An apparatus for decoding an encoded multichannel signal of a current frame to obtain three or more current audio output channels is provided. A multichannel processor is adapted to select two decoded channels from three or more decoded channels depending on first multichannel parameters. Moreover, the multichannel processor is adapted to generate a first group of two or more processed channels based on the selected channels. A noise filling module is adapted to identify for at least one of the selected channels, one or more frequency bands, within which all spectral lines are quantized to zero, and to generate a mixing channel using, depending on side information, a proper subset of three or more previous audio output channels that have been decoded, and to fill the spectral lines of frequency bands, within which all spectral lines are quantized to zero, with noise generated using spectral lines of the mixing channel.
    Type: Application
    Filed: July 11, 2023
    Publication date: November 23, 2023
    Inventors: Sascha DICK, Christian HELMRICH, Nikolaus RETTELBACH, Florian SCHUH, Richard FUEG, Frederik NAGEL
  • Patent number: 11823690
    Abstract: An audio encoder has a first information sink oriented encoding branch such as a spectral domain encoding branch, a second information source or SNR oriented encoding branch such as an LPC-domain encoding branch, and a switch for switching between the first and second encoding branches, the second encoding branch having a converter into a specific domain different from the spectral domain such as an LPC analysis stage generating an excitation signal, and the second encoding branch having a specific domain coding branch such as LPC domain processing branch, and a specific spectral domain coding branch such as LPC spectral domain processing branch, and an additional switch for switching between the specific domain coding branch and the specific spectral domain coding branch. An audio decoder has a first domain decoder, a second domain decoder, and a third domain decoder as well as two cascaded switches for switching between the decoders.
    Type: Grant
    Filed: September 20, 2022
    Date of Patent: November 21, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Bernhard Grill, Roch Lefebvre, Bruno Bessette, Jimmy Lapierre, Philippe Gournay, Redwan Salami, Stefan Bayer, Guillaume Fuchs, Stefan Geyersberger, Ralf Geiger, Johannes Hilpert, Ulrich Kraemer, Jérémie Lecomte, Markus Multrus, Max Neuendorf, Harald Popp, Nikolaus Rettelbach
  • Publication number: 20230343356
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Application
    Filed: June 27, 2023
    Publication date: October 26, 2023
    Inventors: Frederik NAGEL, Sascha DISCH, Max NEUENDORF, Stefan BAYER, Marc GAYER, Markus LOHWASSER, Nikolaus RETTELBACH, Ulrich KRAEMER
  • Publication number: 20230343358
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Application
    Filed: June 27, 2023
    Publication date: October 26, 2023
    Inventors: Frederik NAGEL, Sascha DISCH, Max NEUENDORF, Stefan BAYER, Marc GAYER, Markus LOHWASSER, Nikolaus RETTELBACH, Ulrich KRAEMER
  • Publication number: 20230343352
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Application
    Filed: June 27, 2023
    Publication date: October 26, 2023
    Inventors: Frederik NAGEL, Sascha DISCH, Max NEUENDORF, Stefan BAYER, Marc GAYER, Markus LOHWASSER, Nikolaus RETTELBACH, Ulrich KRAEMER
  • Publication number: 20230343353
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Application
    Filed: June 27, 2023
    Publication date: October 26, 2023
    Inventors: Frederik NAGEL, Sascha DISCH, Max NEUENDORF, Stefan BAYER, Marc GAYER, Markus LOHWASSER, Nikolaus RETTELBACH, Ulrich KRAEMER
  • Publication number: 20230343357
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Application
    Filed: June 27, 2023
    Publication date: October 26, 2023
    Inventors: Frederik NAGEL, Sascha DISCH, Max NEUENDORF, Stefan BAYER, Marc GAYER, Markus LOHWASSER, Nikolaus RETTELBACH, Ulrich KRAEMER
  • Publication number: 20230343354
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Application
    Filed: June 27, 2023
    Publication date: October 26, 2023
    Inventors: Frederik NAGEL, Sascha DISCH, Max NEUENDORF, Stefan BAYER, Marc GAYER, Markus LOHWASSER, Nikolaus RETTELBACH, Ulrich KRAEMER
  • Patent number: RE49801
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: January 16, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Frederik Nagel, Sascha Disch, Max Neuendorf, Stefan Bayer, Marc Gayer, Markus Lohwasser, Nikolaus Rettelbach, Ulrich Kraemer