Patents by Inventor Nikolaus Rettelbach

Nikolaus Rettelbach has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230343355
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Application
    Filed: June 27, 2023
    Publication date: October 26, 2023
    Inventors: Frederik NAGEL, Sascha DISCH, Max NEUENDORF, Stefan BAYER, Marc GAYER, Markus LOHWASSER, Nikolaus RETTELBACH, Ulrich KRAEMER
  • Publication number: 20230335150
    Abstract: An apparatus for generating a bandwidth extended signal from an input signal includes a patch generator and a combiner. The input signal is represented for first and second bands by first and second resolution data, respectively, the second resolution being lower than the first. The patch generator generates first and second patches from the first band of the input signal according to first and second patching algorithms, respectively. A spectral density of the second patch generated using the second patching algorithm is higher than a spectral density of a first patch generated using the first patching algorithm. The combiner combines both patches and the first band of the input signal to obtain the bandwidth extended signal. The apparatus scales the input signal according to the first and second patching algorithms or scales the first and second patches, so that the bandwidth extended signal fulfills a spectral envelope criterion.
    Type: Application
    Filed: June 27, 2023
    Publication date: October 19, 2023
    Inventors: Frederik NAGEL, Sascha DISCH, Max NEUENDORF, Stefan BAYER, Marc GAYER, Markus LOHWASSER, Nikolaus RETTELBACH, Ulrich KRAEMER
  • Publication number: 20230335146
    Abstract: An audio decoder decodes a bit stream of encoded audio data, which bit stream represents a sequence of audio sample values and includes a plurality of frames, wherein each frame includes associated encoded audio sample values. The audio decoder includes a determiner configured to determine whether a frame of the encoded audio data is a special frame including encoded audio sample values associated with the special frame and additional information, wherein the additional information include encoded audio sample values of a number of frames preceding the special frame, wherein the encoded audio sample values of the preceding frames are encoded using the same codec configuration as the special frame, wherein the number of preceding frames is sufficient to initialize the decoder to be in a position to decode the audio sample values associated with the special frame if the special frame is the first frame upon start-up of the decoder.
    Type: Application
    Filed: April 26, 2023
    Publication date: October 19, 2023
    Inventors: Daniel FISCHER, Bernd CZELHAN, Max NEUENDORF, Nikolaus RETTELBACH, Ingo HOFMANN, Harald FUCHS, Stefan DOEHLA, Nikolaus FAERBER
  • Publication number: 20230326470
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Application
    Filed: April 14, 2023
    Publication date: October 12, 2023
    Inventors: Markus Multrus, Bemhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Publication number: 20230319301
    Abstract: An encoder/decoder is based on a combination of two audio or video channels to obtain a first combination signal as a mid-signal and a residual signal derivable using a predicted side signal derived from the mid-signal. A decoder uses the prediction residual signal, the first combination signal, a prediction direction indicator and prediction information to derive decoded first channel and second channel signals. A real-to-imaginary transform can be applied for estimating the imaginary part of the spectrum of the first combination signal. The prediction signal used in the derivation of the prediction residual signal, the real-valued first combination signal is multiplied by a real portion of the complex prediction information and the estimated imaginary part of the first combination signal is multiplied by an imaginary portion of the complex prediction information.
    Type: Application
    Filed: April 25, 2023
    Publication date: October 5, 2023
    Inventors: Julien ROBILLIARD, Matthias NEUSINGER, Christian HELMRICH, Johannes HILPERT, Nikolaus RETTELBACH, Sascha DISCH, Bernd EDLER
  • Publication number: 20230260524
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Application
    Filed: April 14, 2023
    Publication date: August 17, 2023
    Inventors: Markus Multrus, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Patent number: 11727944
    Abstract: An apparatus for decoding an encoded multichannel signal of a current frame to obtain three or more current audio output channels is provided. A multichannel processor is adapted to select two decoded channels from three or more decoded channels depending on first multichannel parameters. Moreover, the multichannel processor is adapted to generate a first group of two or more processed channels based on the selected channels. A noise filling module is adapted to identify for at least one of the selected channels, one or more frequency bands, within which all spectral lines are quantized to zero, and to generate a mixing channel using, depending on side information, a proper subset of three or more previous audio output channels that have been decoded, and to fill the spectral lines of frequency bands, within which all spectral lines are quantized to zero, with noise generated using spectral lines of the mixing channel.
    Type: Grant
    Filed: July 1, 2020
    Date of Patent: August 15, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Sascha Dick, Christian Helmrich, Nikolaus Rettelbach, Florian Schuh, Richard Fueg, Frederik Nagel
  • Patent number: 11682404
    Abstract: An audio encoder has a first information sink oriented encoding branch such as a spectral domain encoding branch, a second information source or SNR oriented encoding branch such as an LPC-domain encoding branch, and a switch for switching between the first and second encoding branches, the second encoding branch having a converter into a specific domain different from the spectral domain such as an LPC analysis stage generating an excitation signal, and the second encoding branch having a specific domain coding branch such as LPC domain processing branch, and a specific spectral domain coding branch such as LPC spectral domain processing branch, and an additional switch for switching between the specific domain coding branch and the specific spectral domain coding branch. An audio decoder has a first domain decoder, a second domain decoder, and a third domain decoder as well as two cascaded switches for switching between the decoders.
    Type: Grant
    Filed: September 20, 2022
    Date of Patent: June 20, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Bernhard Grill, Roch Lefebvre, Bruno Bessette, Jimmy Lapierre, Philippe Gournay, Redwan Salami, Stefan Bayer, Guillaume Fuchs, Stefan Geyersberger, Ralf Geiger, Johannes Hilpert, Ulrich Kraemer, Jérémie Lecomte, Markus Multrus, Max Neuendorf, Harald Popp, Nikolaus Rettelbach
  • Patent number: 11676611
    Abstract: An audio encoder has a first information sink oriented encoding branch such as a spectral domain encoding branch, a second information source or SNR oriented encoding branch such as an LPC-domain encoding branch, and a switch for switching between the first and second encoding branches, the second encoding branch having a converter into a specific domain different from the spectral domain such as an LPC analysis stage generating an excitation signal, and the second encoding branch having a specific domain coding branch such as LPC domain processing branch, and a specific spectral domain coding branch such as LPC spectral domain processing branch, and an additional switch for switching between the specific domain coding branch and the specific spectral domain coding branch. An audio decoder has a first domain decoder, a second domain decoder, and a third domain decoder as well as two cascaded switches for switching between the decoders.
    Type: Grant
    Filed: September 20, 2022
    Date of Patent: June 13, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Bernhard Grill, Roch Lefebvre, Bruno Bessette, Jimmy Lapierre, Philippe Gournay, Redwan Salami, Stefan Bayer, Guillaume Fuchs, Stefan Geyersberger, Ralf Geiger, Johannes Hilpert, Ulrich Kraemer, Jérémie Lecomte, Markus Multrus, Max Neuendorf, Harald Popp, Nikolaus Rettelbach
  • Patent number: 11670314
    Abstract: An audio decoder decodes a bit stream of encoded audio data, which bit stream represents a sequence of audio sample values and includes a plurality of frames, wherein each frame includes associated encoded audio sample values. The audio decoder includes a determiner configured to determine whether a frame of the encoded audio data is a special frame including encoded audio sample values associated with the special frame and additional information, wherein the additional information include encoded audio sample values of a number of frames preceding the special frame, wherein the encoded audio sample values of the preceding frames are encoded using the same codec configuration as the special frame, wherein the number of preceding frames is sufficient to initialize the decoder to be in a position to decode the audio sample values associated with the special frame if the special frame is the first frame upon start-up of the decoder.
    Type: Grant
    Filed: March 22, 2022
    Date of Patent: June 6, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Daniel Fischer, Bernd Czelhan, Max Neuendorf, Nikolaus Rettelbach, Ingo Hofmann, Harald Fuchs, Stefan Doehla, Nikolaus Faerber
  • Patent number: 11670310
    Abstract: An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: June 6, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Markus Multrus, Bernhard Grill, Guillaume Fuchs, Stefan Geyersberger, Nikolaus Rettelbach, Virgilio Bacigalupo
  • Publication number: 20230154475
    Abstract: An apparatus for decoding data segments representing a time-domain data stream, a data segment being encoded in the time domain or in the frequency domain, a data segment being encoded in the frequency domain having successive blocks of data representing successive and overlapping blocks of time-domain data samples. The apparatus includes a time-domain decoder for decoding a data segment being encoded in the time domain and a processor for processing the data segment being encoded in the frequency domain and output data of the time-domain decoder to obtain overlapping time-domain data blocks. The apparatus further includes an overlap/add-combiner for combining the overlapping time-domain data blocks to obtain a decoded data segment of the time-domain data stream.
    Type: Application
    Filed: January 10, 2023
    Publication date: May 18, 2023
    Inventors: Ralf GEIGER, Max NEUENDORF, Yoshikazu YOKOTANI, Nikolaus RETTELBACH, Juergen HERRE, Stefan GEYERSBERGER
  • Publication number: 20230134993
    Abstract: An apparatus for encoding a multi-channel signal having at least three channels includes an iteration processor, a channel encoder and an output interface. The iteration processor is configured to calculate inter-channel correlation values between each pair of the at least three channels, for selecting a pair including a highest value or including a value above a threshold, and for processing the selected pair using a multi-channel processing operation to derive first multi-channel parameters for the selected pair and to derive first processed channels. The iteration processor is configured to perform the calculating, the selecting and the processing using at least one of the processed channels to derive second multi-channel parameters and second processed channels. The channel encoder is configured to encode channels resulting from an iteration processing to obtain encoded channels.
    Type: Application
    Filed: October 18, 2022
    Publication date: May 4, 2023
    Inventors: Sascha DICK, Florian SCHUH, Nikolaus RETTELBACH, Tobias SCHWEGLER, Richard FUEG, Johannes HILPERT, Matthias NEUSINGER
  • Publication number: 20230087652
    Abstract: The invention provides an audio encoder including a combination of a linear predictive coding filter having a plurality of linear predictive coding coefficients and a time-frequency converter, wherein the combination is configured to filter and to convert a frame of the audio signal into a frequency domain in order to output a spectrum based on the frame and on the linear predictive coding coefficients; a low frequency emphasizer configured to calculate a processed spectrum based on the spectrum, wherein spectral lines of the processed spectrum representing a lower frequency than a reference spectral line are emphasized; and a control device configured to control the calculation of the processed spectrum by the low frequency emphasizer depending on the linear predictive coding coefficients of the linear predictive coding filter.
    Type: Application
    Filed: November 22, 2022
    Publication date: March 23, 2023
    Inventors: Stefan DOEHLA, Bernhard GRILL, Christian HELMRICH, Nikolaus RETTELBACH
  • Patent number: RE49464
    Abstract: An encoder/decoder is based on a combination of two audio or video channels to obtain a first combination signal as a mid-signal and a residual signal derivable using a predicted side signal derived from the mid-signal. A decoder uses the prediction residual signal, the first combination signal, a prediction direction indicator and prediction information to derive decoded first channel and second channel signals. A real-to-imaginary transform can be applied for estimating the imaginary part of the spectrum of the first combination signal. The prediction signal used in the derivation of the prediction residual signal, the real-valued first combination signal is multiplied by a real portion of the complex prediction information and the estimated imaginary part of the first combination signal is multiplied by an imaginary portion of the complex prediction information.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: March 14, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Julien Robilliard, Matthias Neusinger, Christian Helmrich, Johannes Hilpert, Nikolaus Rettelbach, Sascha Disch, Bernd Edler
  • Patent number: RE49469
    Abstract: An encoder/decoder is based on a combination of two audio or video channels to obtain a first combination signal as a mid-signal and a residual signal derivable using a predicted side signal derived from the mid-signal. A decoder uses the prediction residual signal, the first combination signal, a prediction direction indicator and prediction information to derive decoded first channel and second channel signals. A real-to-imaginary transform can be applied for estimating the imaginary part of the spectrum of the first combination signal. The prediction signal used in the derivation of the prediction residual signal, the real-valued first combination signal is multiplied by a real portion of the complex prediction information and the estimated imaginary part of the first combination signal is multiplied by an imaginary portion of the complex prediction information.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: March 21, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Julien Robilliard, Matthias Neusinger, Christian Helmrich, Johannes Hilpert, Nikolaus Rettelbach, Sascha Disch, Bernd Edler
  • Patent number: RE49492
    Abstract: An encoder/decoder is based on a combination of two audio or video channels to obtain a first combination signal as a mid-signal and a residual signal derivable using a predicted side signal derived from the mid-signal. A decoder uses the prediction residual signal, the first combination signal, a prediction direction indicator and prediction information to derive decoded first channel and second channel signals. A real-to-imaginary transform can be applied for estimating the imaginary part of the spectrum of the first combination signal. The prediction signal used in the derivation of the prediction residual signal, the real-valued first combination signal is multiplied by a real portion of the complex prediction information and the estimated imaginary part of the first combination signal is multiplied by an imaginary portion of the complex prediction information.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: April 11, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Julien Robilliard, Matthias Neusinger, Christian Helmrich, Johannes Hilpert, Nikolaus Rettelbach, Sascha Disch, Bernd Edler
  • Patent number: RE49511
    Abstract: An encoder/decoder is based on a combination of two audio or video channels to obtain a first combination signal as a mid-signal and a residual signal derivable using a predicted side signal derived from the mid-signal. A decoder uses the prediction residual signal, the first combination signal, a prediction direction indicator and prediction information to derive decoded first channel and second channel signals. A real-to-imaginary transform can be applied for estimating the imaginary part of the spectrum of the first combination signal. The prediction signal used in the derivation of the prediction residual signal, the real-valued first combination signal is multiplied by a real portion of the complex prediction information and the estimated imaginary part of the first combination signal is multiplied by an imaginary portion of the complex prediction information.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: April 25, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Julien Robilliard, Matthias Neusinger, Christian Helmrich, Johannes Hilpert, Nikolaus Rettelbach, Sascha Disch, Bernd Edler
  • Patent number: RE49549
    Abstract: An encoder/decoder is based on a combination of two audio or video channels to obtain a first combination signal as a mid-signal and a residual signal derivable using a predicted side signal derived from the mid-signal. A decoder uses the prediction residual signal, the first combination signal, a prediction direction indicator and prediction information to derive decoded first channel and second channel signals. A real-to-imaginary transform can be applied for estimating the imaginary part of the spectrum of the first combination signal. The prediction signal used in the derivation of the prediction residual signal, the real-valued first combination signal is multiplied by a real portion of the complex prediction information and the estimated imaginary part of the first combination signal is multiplied by an imaginary portion of the complex prediction information.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: June 6, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Julien Robilliard, Matthias Neusinger, Christian Helmrich, Johannes Hilpert, Nikolaus Rettelbach, Sascha Disch, Bernd Edler
  • Patent number: RE49717
    Abstract: An encoder/decoder is based on a combination of two audio or video channels to obtain a first combination signal as a mid-signal and a residual signal derivable using a predicted side signal derived from the mid-signal. A decoder uses the prediction residual signal, the first combination signal, a prediction direction indicator and prediction information to derive decoded first channel and second channel signals. A real-to-imaginary transform can be applied for estimating the imaginary part of the spectrum of the first combination signal. The prediction signal used in the derivation of the prediction residual signal, the real-valued first combination signal is multiplied by a real portion of the complex prediction information and the estimated imaginary part of the first combination signal is multiplied by an imaginary portion of the complex prediction information.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: October 24, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Julien Robilliard, Matthias Neusinger, Christian Helmrich, Johannes Hilpert, Nikolaus Rettelbach, Sascha Disch, Bernd Edler