Patents by Inventor Juha O. MERIMAA

Juha O. MERIMAA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240098444
    Abstract: In one aspect, a computer-implemented method, includes obtaining object audio and metadata that spatially describes the object audio, converting the object audio to Ambisonics audio based on the metadata, encoding, in a first bit stream, the Ambisonics audio, and encoding, in a second bit stream, at least a subset of the metadata.
    Type: Application
    Filed: August 23, 2023
    Publication date: March 21, 2024
    Inventors: Sina Zamani, Moo Young Kim, Dipanjan Sen, Sang Uk Ryu, Juha O. Merimaa, Symeon Delikaris Manias
  • Publication number: 20240096335
    Abstract: In one aspect, a computer-implemented method, includes obtaining object audio and metadata that spatially describes the object audio, converting the object audio to time-frequency domain Ambisonics audio based on the metadata, and encoding the time-frequency domain Ambisonics audio and a subset of the metadata as one or more bitstreams to be stored in computer-readable memory or transmitted to a remote device.
    Type: Application
    Filed: August 23, 2023
    Publication date: March 21, 2024
    Inventors: Sina Zamani, Moo Young Kim, Dipanjan Sen, Sang Uk Ryu, Juha O. Merimaa, Symeon Delikaris Manias
  • Patent number: 11937063
    Abstract: A method performed by a programmed processor of an audio system, the method includes receiving a sound track that has a track length, producing a binaural audio version of a sound track, the binaural audio version having an extended track length performing a fading operation upon the binaural audio version to gradually reduce a signal level of the binaural audio version to below a signal threshold level at a time along the extended track length that corresponds to an end time of the track length of the sound track; and storing the binaural audio version having the track length of the sound track in memory for later transmission to an audio playback device for driving one or more speakers.
    Type: Grant
    Filed: May 5, 2022
    Date of Patent: March 19, 2024
    Assignee: Apple Inc.
    Inventors: Juha O. Merimaa, Abdullah Fahim, Andrey D. Del Pozo, Joshua D. Atkins
  • Patent number: 11841899
    Abstract: A device with microphones can generate microphone signals during an audio recording. The device can store, in an electronic audio data file, the microphone signals, and metadata that includes impulse responses of the microphones. Other aspects are described and claimed.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: December 12, 2023
    Assignee: Apple Inc.
    Inventors: Jonathan D. Sheaffer, Symeon Delikaris Manias, Gaetan R. Lorho, Peter A. Raffensperger, Eric A. Allamanche, Frank Baumgarte, Dipanjan Sen, Joshua D. Atkins, Juha O. Merimaa
  • Patent number: 11805382
    Abstract: A binaural sound reproduction system, and methods of using the binaural sound reproduction system to dynamically re-center a frame of reference for a virtual sound source, are described. The binaural sound reproduction system may include a reference device, e.g., a mobile device, having a reference sensor to provide reference orientation data corresponding to a direction of the reference device, and a head-mounted device, e.g., headphones, having a device sensor to provide device orientation data corresponding to a direction of the head-mounted device. The system may use the reference orientation data to determine whether the head-mounted device is being used in a static or dynamic use case, and may adjust an audio output to render the virtual sound source in an adjusted source direction based on the determined use case. Other embodiments are also described and claimed.
    Type: Grant
    Filed: February 16, 2022
    Date of Patent: October 31, 2023
    Assignee: Apple Inc.
    Inventors: Darius A. Satongar, Afrooz Family, Sylvain J. Choisel, Juha O. Merimaa
  • Publication number: 20230276190
    Abstract: A plurality of microphone signals of a microphone array may be obtained. An environment change may be detected based on the microphone signals. In response, a reverberation time environment may be determined. The reverberation may be used to modify a playback audio signal.
    Type: Application
    Filed: January 19, 2023
    Publication date: August 31, 2023
    Inventors: Benjamin BERNARD, Prateek MURGAI, Juha O. MERIMAA, Jonathan D. SHEAFFER, Soenke PELZER
  • Publication number: 20230104111
    Abstract: One or more acoustic parameters of a current acoustic environment of a user may be determined based on sensor signals captured by one or more sensors of the device. One or more preset acoustic parameters may be determined based on the one or more acoustic parameters of the current acoustic environment of the user and an acoustic environment of an audio file comprising audio signals that is determined based on the audio signals of the audio file or metadata of the audio file. The audio signals may be spatially rendered by applying spatial filters that include the one or more preset acoustic parameters to the audio signals, resulting in binaural audio signals. The binaural audio signals may be used to drive speakers of a headset. Other aspects are described and claimed.
    Type: Application
    Filed: August 19, 2022
    Publication date: April 6, 2023
    Inventors: Prateek Murgai, John E. Arthur, Joshua D. Atkins, Juha O. Merimaa, Dipanjan Sen, Brandon J. Rice, Alexander Singh Alvarado, Jonathan D. Sheaffer, Benjamin Bernard, David E. Romblom
  • Patent number: 11546687
    Abstract: Spatial filters are generated that map response of an audio capture device to head related transfer functions (HRTFs) for different positions of the audio capture device relative to the HRTFs. A current set of spatial filters are determined based on the plurality of spatial filters and a head position of a user. The microphone signals are convolved with the current set of spatial filters, resulting in a left audio channel and right audio channel that form output binaural audio channels. The binaural audio channels can be used to drive speakers of a headphone set to generate sound that is perceived to have a spatial quality. Other aspects are described and claimed.
    Type: Grant
    Filed: August 2, 2021
    Date of Patent: January 3, 2023
    Assignee: APPLE INC.
    Inventors: Symeon Delikaris Manias, Shai Messingher Lang, Juha O. Merimaa
  • Publication number: 20220405043
    Abstract: A method performed by an audio source device that is communicatively coupled with an audio output device, the method includes obtaining an audio signal; receiving a volume adjustment; applying the volume adjustment to the audio signal; applying dynamic range compression on the volume adjusted audio signal; and applying an inverse volume adjustment to the compressed audio signal, where the inverse volume adjusted audio signal is to be transmitted to the audio output device.
    Type: Application
    Filed: June 22, 2021
    Publication date: December 22, 2022
    Inventors: Hilary K. Mogul, Eric J. Day, Hannes Breitschaedel, Juha O. Merimaa
  • Publication number: 20220394406
    Abstract: A method performed by a programmed processor of an audio system, the method includes receiving a sound track that has a track length, producing a binaural audio version of a sound track, the binaural audio version having an extended track length performing a fading operation upon the binaural audio version to gradually reduce a signal level of the binaural audio version to below a signal threshold level at a time along the extended track length that corresponds to an end time of the track length of the sound track; and storing the binaural audio version having the track length of the sound track in memory for later transmission to an audio playback device for driving one or more speakers.
    Type: Application
    Filed: May 5, 2022
    Publication date: December 8, 2022
    Inventors: Juha O. Merimaa, Abdullah Fahim, Andrey D. Del Pozo, Joshua D. Atkins
  • Publication number: 20220329965
    Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.
    Type: Application
    Filed: June 22, 2022
    Publication date: October 13, 2022
    Inventors: Antti J. Vanne, Darius A. Satongar, James W. Vandyke, Juha O. Merimaa, Martin E. Johnson, Tomi A. Huttunen
  • Patent number: 11430451
    Abstract: A first layer of data having a first set of Ambisonic audio components can be decoded where the first set of Ambisonic audio components is generated based on ambience and one or more object-based audio signals. A second layer of data is decoded having at least one of the one or more object-based audio signals. One of the object-based audio signals is subtracted from the first set of Ambisonic audio components. The resulting Ambisonic audio components are rendered to generate a first set of audio channels. The one or more object-based audio signals are spatially rendered to generate a second set of audio channels. Other aspects are described and claimed.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: August 30, 2022
    Assignee: APPLE INC.
    Inventors: Dipanjan Sen, Frank Baumgarte, Juha O. Merimaa
  • Publication number: 20220262373
    Abstract: A first layer of data having a first set of Ambisonic audio components can be decoded where the first set of Ambisonic audio components is generated based on ambience and one or more object-based audio signals. A second layer of data is decoded having at least one of the one or more object-based audio signals. One of the object-based audio signals is subtracted from the first set of Ambisonic audio components. The resulting Ambisonic audio components are rendered to generate a first set of audio channels. The one or more object-based audio signals are spatially rendered to generate a second set of audio channels. Other aspects are described and claimed.
    Type: Application
    Filed: May 9, 2022
    Publication date: August 18, 2022
    Inventors: Dipanjan Sen, Frank Baumgarte, Juha O. Merimaa
  • Patent number: 11417347
    Abstract: A binaural room impulse response (BRIR) can be generated based on a position of a listener's head, and a plurality of head related impulse responses (HRIRs). Each of the plurality of HRIRs are selected for a respective one of a plurality of acoustic reflections which, when taken together, approximate reverberation of a room. Each of the acoustic reflections have a direction and a delay. The BRIR filter is applied to source audio to generate binaural audio output.
    Type: Grant
    Filed: May 10, 2021
    Date of Patent: August 16, 2022
    Assignee: APPLE INC.
    Inventors: Martin E. Johnson, Juha O. Merimaa
  • Patent number: 11375333
    Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.
    Type: Grant
    Filed: September 16, 2020
    Date of Patent: June 28, 2022
    Assignee: APPLE INC.
    Inventors: Antti J. Vanne, Darius A. Satongar, James W. Vandyke, Juha O. Merimaa, Martin E. Johnson, Tomi A. Huttunen
  • Publication number: 20220174449
    Abstract: A binaural sound reproduction system, and methods of using the binaural sound reproduction system to dynamically re-center a frame of reference for a virtual sound source, are described. The binaural sound reproduction system may include a reference device, e.g., a mobile device, having a reference sensor to provide reference orientation data corresponding to a direction of the reference device, and a head-mounted device, e.g., headphones, having a device sensor to provide device orientation data corresponding to a direction of the head-mounted device. The system may use the reference orientation data to determine whether the head-mounted device is being used in a static or dynamic use case, and may adjust an audio output to render the virtual sound source in an adjusted source direction based on the determined use case. Other embodiments are also described and claimed.
    Type: Application
    Filed: February 16, 2022
    Publication date: June 2, 2022
    Inventors: Darius A. Satongar, Afrooz Family, Sylvain J. Choisel, Juha O. Merimaa
  • Patent number: 11265670
    Abstract: A binaural sound reproduction system, and methods of using the binaural sound reproduction system to dynamically re-center a frame of reference for a virtual sound source, are described. The binaural sound reproduction system may include a reference device, e.g., a mobile device, having a reference sensor to provide reference orientation data corresponding to a direction of the reference device, and a head-mounted device, e.g., headphones, having a device sensor to provide device orientation data corresponding to a direction of the head-mounted device. The system may use the reference orientation data to determine whether the head-mounted device is being used in a static or dynamic use case, and may adjust an audio output to render the virtual sound source in an adjusted source direction based on the determined use case. Other embodiments are also described and claimed.
    Type: Grant
    Filed: May 1, 2020
    Date of Patent: March 1, 2022
    Assignee: APPLE INC.
    Inventors: Darius A. Satongar, Afrooz Family, Sylvain J. Choisel, Juha O. Merimaa
  • Publication number: 20210398545
    Abstract: A binaural room impulse response (BRIR) can be generated based on a position of a listener's head, and a plurality of head related impulse responses (HRIRs). Each of the plurality of HRIRs are selected for a respective one of a plurality of acoustic reflections which, when taken together, approximate reverberation of a room. Each of the acoustic reflections have a direction and a delay. The BRIR filter is applied to source audio to generate binaural audio output.
    Type: Application
    Filed: May 10, 2021
    Publication date: December 23, 2021
    Inventors: Martin E. Johnson, Juha O. Merimaa
  • Patent number: 11202164
    Abstract: Methods and apparatus for predictive head-tracked binaural audio rendering in which a rendering device renders multiple audio streams for different possible head locations based on head tracking data received from a headset, for example audio streams for the last known location and one or more predicted or possible locations, and transmits the multiple audio streams to the headset. The headset then selects and plays one of the audio streams that is closest to the actual head location based on current head tracking data. If none of the audio streams closely match the actual head location, two closest audio streams may be mixed. Transmitting multiple audio streams to the headset and selecting or mixing an audio stream on the headset may mitigate or eliminate perceived head tracking latency.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: December 14, 2021
    Assignee: Apple Inc.
    Inventors: Juha O. Merimaa, Christopher T. Eubank, Martin E. Johnson, Stuart J. Wood, Deepak Natarajan
  • Patent number: 11070933
    Abstract: A computer system having an electronic device determines a listener position within a computer-generated reality (CGR) setting that is to be aurally experienced by a user of the electronic device through at least one speaker. The system determines a source position of a virtual sound source within the CGR setting and determines a characteristic of a virtual object within the CGR setting, where the characteristic include a geometry of an edge of the virtual object. The system determines at least one edge-diffraction filter parameter for an edge-diffraction filter based on 1) the listener position, 2) the source position, and 3) the geometry. The system applies the edge-diffraction filter to an input audio signal to produce a filtered audio signal that accounts for edge-diffraction of sound produced by the virtual sound source within the CGR setting.
    Type: Grant
    Filed: July 29, 2020
    Date of Patent: July 20, 2021
    Assignee: APPLE INC.
    Inventors: Dirk Schroeder, Jonathan D. Sheaffer, Soenke Pelzer, Juha O. Merimaa