Patents by Inventor Jan Plogsties

Jan Plogsties has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240129687
    Abstract: A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is separately processed with an early part and a late reverberation of the room impulse response, and the processed early part of the audio signal and the reverberated signal are combined. A transition from the early part to the late reverberation in the room impulse response is reached when a correlation measure reaches a threshold, the threshold being set dependent on the correlation measure for a selected one of the early reflections in the early part of the room impulse response.
    Type: Application
    Filed: December 5, 2023
    Publication date: April 18, 2024
    Inventors: Simone NEUKAM, Jan PLOGSTIES
  • Patent number: 11949957
    Abstract: A method and a system for virtual reality, augmented reality, mixed reality, or 360-degree Video environment is disclosed. The system receives Video Streams associated to audio and video scenes to be reproduced and Audio Streams associated to audio and video scenes to be reproduced. There are provided a Video decoder which decodes signal from the Video Stream for the representation of the audio and video scene; an Audio decoder which decodes signal from the Audio Stream for the representation of the audio and video scene to the user; and a region of interest processor deciding, based e.g. on the user's viewport, head orientation, movement data, or metadata, whether an Audio information message is to be reproduced. At the decision, the reproduction of the Audio information message is caused.
    Type: Grant
    Filed: February 20, 2023
    Date of Patent: April 2, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Adrian Murtaza, Harald Fuchs, Bernd Czelhan, Jan Plogsties
  • Patent number: 11910182
    Abstract: A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is processed with an early part of the room impulse response separate from a late reverberation of the room impulse response, wherein the processing of the late reverberation has generating a scaled reverberated signal, the scaling being dependent on the audio signal. The processed early part of the audio signal and the scaled reverberated signal are combined.
    Type: Grant
    Filed: August 5, 2022
    Date of Patent: February 20, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Simone Neukam, Jan Plogsties
  • Patent number: 11900955
    Abstract: An apparatus for generating loudspeaker signals includes an object metadata processor configured to receive metadata, to calculate a second position of the audio object depending on the first position of the audio object and on a size of a screen if the audio object is indicated in the metadata as being screen-related, to feed the first position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being not screen-related, and to feed the second position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being screen-related. The apparatus further includes an object renderer configured to receive an audio object and to generate the loudspeaker signals depending on the audio object and on position information.
    Type: Grant
    Filed: November 18, 2022
    Date of Patent: February 13, 2024
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Simone Fueg, Jan Plogsties, Sascha Dick, Johannes Hilpert, Julien Robilliard, Achim Kuntz, Andreas Hoelzer
  • Patent number: 11856388
    Abstract: A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is separately processed with an early part and a late reverberation of the room impulse response, and the processed early part of the audio signal and the reverberated signal are combined. A transition from the early part to the late reverberation in the room impulse response is reached when a correlation measure reaches a threshold, the threshold being set dependent on the correlation measure for a selected one of the early reflections in the early part of the room impulse response.
    Type: Grant
    Filed: February 4, 2022
    Date of Patent: December 26, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Simone Neukam, Jan Plogsties
  • Publication number: 20230396856
    Abstract: Audio data processor, having: a receiver interface for receiving encoded audio data and metadata related to the encoded audio data; a metadata parser for parsing the metadata to determine an audio data manipulation possibility; an interaction interface for receiving an interaction input and for generating, from the interaction input, interaction control data related to the audio data manipulation possibility; and a data stream generator for obtaining the interaction control data and the encoded audio data and the metadata and for generating an output data stream, the output data stream having the encoded audio data, at least a portion of the metadata, and the interaction control data.
    Type: Application
    Filed: July 5, 2023
    Publication date: December 7, 2023
    Inventors: Stephan SCHREINER, Simone NEUKAM, Harald FUCHS, Jan PLOGSTIES, Stefan DOEHLA
  • Publication number: 20230370684
    Abstract: A method and a system for virtual reality, augmented reality, mixed reality, or 360-degree Video environment is disclosed. The system receives Video Streams associated to audio and video scenes to be reproduced and Audio Streams associated to audio and video scenes to be reproduced. There are provided a Video decoder which decodes signal from the Video Stream for the representation of the audio and video scene; an Audio decoder which decodes signal from the Audio Stream for the representation of the audio and video scene to the user; and a region of interest processor deciding, based e.g. on the user’s viewport, head orientation, movement data, or metadata, whether an Audio information message is to be reproduced. At the decision, the reproduction of the Audio information message is caused.
    Type: Application
    Filed: February 20, 2023
    Publication date: November 16, 2023
    Inventors: Adrian MURTAZA, Harald FUCHS, Bernd CZELHAN, Jan PLOGSTIES
  • Publication number: 20230370799
    Abstract: An apparatus for playing back an audio object associated with a position includes a distance calculator for calculating distances of the position to speakers or for reading the distances of the position to the speakers. The distance calculator is configured to take a solution with a smallest distance. The apparatus is configured to play back the audio object using the speaker corresponding to the solution.
    Type: Application
    Filed: February 27, 2023
    Publication date: November 16, 2023
    Inventors: Simone NEUKAM, Jan PLOGSTIES, Max NEUENDORF, Juergen HERRE, Bernhard GRILL
  • Patent number: 11743668
    Abstract: An audio decoder device for decoding a compressed input audio signal having at least one core decoder having one or more processors for generating a processor output signal based on a processor input signal, wherein a number of output channels of the processor output signal is higher than a number of input channels of the processor input signal, wherein each of the one or more processors has a decorrelator and a mixer, wherein a core decoder output signal having a plurality of channels has the processor output signal, and wherein the core decoder output signal is suitable for a reference loudspeaker setup; at least one format converter device configured to convert the core decoder output signal into an output audio signal, which is suitable for a target loudspeaker setup; and a control device configured to control at least one or more processors in such way that the decorrelator of the processor may be controlled independently from the mixer of the processor, wherein the control device is configured to contro
    Type: Grant
    Filed: November 11, 2021
    Date of Patent: August 29, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Christian Ertel, Johannes Hilpert, Andreas Hoelzer, Achim Kuntz, Jan Plogsties, Michael Kratschmer
  • Patent number: 11743553
    Abstract: Audio data processor, having: a receiver interface for receiving encoded audio data and metadata related to the encoded audio data; a metadata parser for parsing the metadata to determine an audio data manipulation possibility; an interaction interface for receiving an interaction input and for generating, from the interaction input, interaction control data related to the audio data manipulation possibility; and a data stream generator for obtaining the interaction control data and the encoded audio data and the metadata and for generating an output data stream, the output data stream having the encoded audio data, at least a portion of the metadata, and the interaction control data.
    Type: Grant
    Filed: May 20, 2022
    Date of Patent: August 29, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Stephan Schreiner, Simone Neukam, Harald Fuchs, Jan Plogsties, Stefan Doehla
  • Patent number: 11632641
    Abstract: An apparatus for playing back an audio object associated with a position includes a distance calculator for calculating distances of the position to speakers or for reading the distances of the position to the speakers. The distance calculator is configured to take a solution with a smallest distance. The apparatus is configured to play back the audio object using the speaker corresponding to the solution.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: April 18, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Simone Neukam, Jan Plogsties, Max Neuendorf, Juergen Herre, Bernhard Grill
  • Patent number: 11617016
    Abstract: A method and a system for virtual reality, augmented reality, mixed reality, or 360-degree Video environment is disclosed. The system receives Video Streams associated to audio and video scenes to be reproduced and Audio Streams associated to audio and video scenes to be reproduced. There are provided a Video decoder which decodes signal from the Video Stream for the representation of the audio and video scene; an Audio decoder which decodes signal from the Audio Stream for the representation of the audio and video scene to the user; and a region of interest processor deciding, based e.g. on the user's viewport, head orientation, movement data, or metadata, whether an Audio information message is to be reproduced. At the decision, the reproduction of the Audio information message is caused.
    Type: Grant
    Filed: April 7, 2021
    Date of Patent: March 28, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Adrian Murtaza, Harald Fuchs, Bernd Czelhan, Jan Plogsties
  • Publication number: 20230032120
    Abstract: A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is processed with an early part of the room impulse response separate from a late reverberation of the room impulse response, wherein the processing of the late reverberation has generating a scaled reverberated signal, the scaling being dependent on the audio signal. The processed early part of the audio signal and the scaled reverberated signal are combined.
    Type: Application
    Filed: August 5, 2022
    Publication date: February 2, 2023
    Inventors: Simone NEUKAM, Jan PLOGSTIES
  • Patent number: 11527254
    Abstract: An apparatus for generating loudspeaker signals includes an object metadata processor configured to receive metadata, to calculate a second position of the audio object depending on the first position of the audio object and on a size of a screen if the audio object is indicated in the metadata as being screen-related, to feed the first position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being not screen-related, and to feed the second position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being screen-related. The apparatus further includes an object renderer configured to receive an audio object and to generate the loudspeaker signals depending on the audio object and on position information.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: December 13, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Simone Fueg, Jan Plogsties, Sascha Dick, Johannes Hilpert, Julien Robilliard, Achim Kuntz, Andreas Hoelzer
  • Patent number: 11445323
    Abstract: A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is processed with an early part of the room impulse response separate from a late reverberation of the room impulse response, wherein the processing of the late reverberation has generating a scaled reverberated signal, the scaling being dependent on the audio signal. The processed early part of the audio signal and the scaled reverberated signal are combined.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: September 13, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Simone Neukam, Jan Plogsties
  • Publication number: 20220286756
    Abstract: Audio data processor, having: a receiver interface for receiving encoded audio data and metadata related to the encoded audio data; a metadata parser for parsing the metadata to determine an audio data manipulation possibility; an interaction interface for receiving an interaction input and for generating, from the interaction input, interaction control data related to the audio data manipulation possibility; and a data stream generator for obtaining the interaction control data and the encoded audio data and the metadata and for generating an output data stream, the output data stream having the encoded audio data, at least a portion of the metadata, and the interaction control data.
    Type: Application
    Filed: May 20, 2022
    Publication date: September 8, 2022
    Inventors: Stephan SCHREINER, Simone NEUKAM, Harald FUCHS, Jan PLOGSTIES, Stefan DOEHLA
  • Publication number: 20220261215
    Abstract: There are disclosed techniques, systems, methods and instructions for a virtual reality, VR, augmented reality, AR, mixed reality, MR, or 360-degree video environment. In one example, the system includes at least one media video decoder configured to decode video signals from video streams for the representation of VR, AR, MR or 360-degree video environment scenes to a user. The system includes at least one audio decoder configured to decode audio signals from at least one audio stream. The system is configured to request at least one audio stream and/or one audio element of an audio stream and/or one adaptation set to a server on the basis of at least the user's current viewport and/or head orientation and/or movement data and/or interaction metadata and/or virtual positional data.
    Type: Application
    Filed: May 2, 2022
    Publication date: August 18, 2022
    Inventors: Adrian MURTAZA, Harald FUCHS, Bernd CZELHAN, Jan PLOGSTIES, Matteo AGNELLI, Ingo HOFMANN
  • Patent number: 11418904
    Abstract: A downmixer for providing a downmix signal on the basis of a plurality of input signals is configured to determine a magnitude value of a spectral domain value of the downmix signal on the basis of a loudness information of the input signals. The downmixer is configured to determine a phase value of the spectral domain value of the downmix signal and the downmixer is configured to apply the phase value in order to obtain a complex valued number representation of the spectral domain value of the downmix signal on the basis of the magnitude value of the spectral domain value of the downmix signal. An audio encoder uses such a downmixer. A method for downmixing and a computer program are also described.
    Type: Grant
    Filed: October 2, 2020
    Date of Patent: August 16, 2022
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Aleksandr Karapetyan, Felix Wolf, Jan Plogsties
  • Patent number: 11381886
    Abstract: Audio data processor, having: a receiver interface for receiving encoded audio data and metadata related to the encoded audio data; a metadata parser for parsing the metadata to determine an audio data manipulation possibility; an interaction interface for receiving an interaction input and for generating, from the interaction input, interaction control data related to the audio data manipulation possibility; and a data stream generator for obtaining the interaction control data and the encoded audio data and the metadata and for generating an output data stream, the output data stream having the encoded audio data, at least a portion of the metadata, and the interaction control data.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: July 5, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Stephan Schreiner, Simone Neukam, Harald Fuchs, Jan Plogsties, Stefan Doehla
  • Patent number: 11354084
    Abstract: There are disclosed techniques, systems, methods and instructions for a virtual reality, VR, augmented reality, AR, mixed reality, MR, or 360-degree video environment. In one example, the system includes at least one media video decoder configured to decode video signals from video streams for the representation of VR, AR, MR or 360-degree video environment scenes to a user. The system includes at least one audio decoder configured to decode audio signals from at least one audio stream. The system is configured to request at least one audio stream and/or one audio element of an audio stream and/or one adaptation set to a server on the basis of at least the user's current viewport and/or head orientation and/or movement data and/or interaction metadata and/or virtual positional data.
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: June 7, 2022
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Adrian Murtaza, Harald Fuchs, Bernd Czelhan, Jan Plogsties, Matteo Agnelli, Ingo Hofmann