Patents by Inventor Juha O. MERIMAA
Juha O. MERIMAA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240098444Abstract: In one aspect, a computer-implemented method, includes obtaining object audio and metadata that spatially describes the object audio, converting the object audio to Ambisonics audio based on the metadata, encoding, in a first bit stream, the Ambisonics audio, and encoding, in a second bit stream, at least a subset of the metadata.Type: ApplicationFiled: August 23, 2023Publication date: March 21, 2024Inventors: Sina Zamani, Moo Young Kim, Dipanjan Sen, Sang Uk Ryu, Juha O. Merimaa, Symeon Delikaris Manias
-
Publication number: 20240096335Abstract: In one aspect, a computer-implemented method, includes obtaining object audio and metadata that spatially describes the object audio, converting the object audio to time-frequency domain Ambisonics audio based on the metadata, and encoding the time-frequency domain Ambisonics audio and a subset of the metadata as one or more bitstreams to be stored in computer-readable memory or transmitted to a remote device.Type: ApplicationFiled: August 23, 2023Publication date: March 21, 2024Inventors: Sina Zamani, Moo Young Kim, Dipanjan Sen, Sang Uk Ryu, Juha O. Merimaa, Symeon Delikaris Manias
-
Patent number: 11937063Abstract: A method performed by a programmed processor of an audio system, the method includes receiving a sound track that has a track length, producing a binaural audio version of a sound track, the binaural audio version having an extended track length performing a fading operation upon the binaural audio version to gradually reduce a signal level of the binaural audio version to below a signal threshold level at a time along the extended track length that corresponds to an end time of the track length of the sound track; and storing the binaural audio version having the track length of the sound track in memory for later transmission to an audio playback device for driving one or more speakers.Type: GrantFiled: May 5, 2022Date of Patent: March 19, 2024Assignee: Apple Inc.Inventors: Juha O. Merimaa, Abdullah Fahim, Andrey D. Del Pozo, Joshua D. Atkins
-
Patent number: 11841899Abstract: A device with microphones can generate microphone signals during an audio recording. The device can store, in an electronic audio data file, the microphone signals, and metadata that includes impulse responses of the microphones. Other aspects are described and claimed.Type: GrantFiled: June 11, 2020Date of Patent: December 12, 2023Assignee: Apple Inc.Inventors: Jonathan D. Sheaffer, Symeon Delikaris Manias, Gaetan R. Lorho, Peter A. Raffensperger, Eric A. Allamanche, Frank Baumgarte, Dipanjan Sen, Joshua D. Atkins, Juha O. Merimaa
-
Patent number: 11805382Abstract: A binaural sound reproduction system, and methods of using the binaural sound reproduction system to dynamically re-center a frame of reference for a virtual sound source, are described. The binaural sound reproduction system may include a reference device, e.g., a mobile device, having a reference sensor to provide reference orientation data corresponding to a direction of the reference device, and a head-mounted device, e.g., headphones, having a device sensor to provide device orientation data corresponding to a direction of the head-mounted device. The system may use the reference orientation data to determine whether the head-mounted device is being used in a static or dynamic use case, and may adjust an audio output to render the virtual sound source in an adjusted source direction based on the determined use case. Other embodiments are also described and claimed.Type: GrantFiled: February 16, 2022Date of Patent: October 31, 2023Assignee: Apple Inc.Inventors: Darius A. Satongar, Afrooz Family, Sylvain J. Choisel, Juha O. Merimaa
-
Publication number: 20230276190Abstract: A plurality of microphone signals of a microphone array may be obtained. An environment change may be detected based on the microphone signals. In response, a reverberation time environment may be determined. The reverberation may be used to modify a playback audio signal.Type: ApplicationFiled: January 19, 2023Publication date: August 31, 2023Inventors: Benjamin BERNARD, Prateek MURGAI, Juha O. MERIMAA, Jonathan D. SHEAFFER, Soenke PELZER
-
Publication number: 20230104111Abstract: One or more acoustic parameters of a current acoustic environment of a user may be determined based on sensor signals captured by one or more sensors of the device. One or more preset acoustic parameters may be determined based on the one or more acoustic parameters of the current acoustic environment of the user and an acoustic environment of an audio file comprising audio signals that is determined based on the audio signals of the audio file or metadata of the audio file. The audio signals may be spatially rendered by applying spatial filters that include the one or more preset acoustic parameters to the audio signals, resulting in binaural audio signals. The binaural audio signals may be used to drive speakers of a headset. Other aspects are described and claimed.Type: ApplicationFiled: August 19, 2022Publication date: April 6, 2023Inventors: Prateek Murgai, John E. Arthur, Joshua D. Atkins, Juha O. Merimaa, Dipanjan Sen, Brandon J. Rice, Alexander Singh Alvarado, Jonathan D. Sheaffer, Benjamin Bernard, David E. Romblom
-
Patent number: 11546687Abstract: Spatial filters are generated that map response of an audio capture device to head related transfer functions (HRTFs) for different positions of the audio capture device relative to the HRTFs. A current set of spatial filters are determined based on the plurality of spatial filters and a head position of a user. The microphone signals are convolved with the current set of spatial filters, resulting in a left audio channel and right audio channel that form output binaural audio channels. The binaural audio channels can be used to drive speakers of a headphone set to generate sound that is perceived to have a spatial quality. Other aspects are described and claimed.Type: GrantFiled: August 2, 2021Date of Patent: January 3, 2023Assignee: APPLE INC.Inventors: Symeon Delikaris Manias, Shai Messingher Lang, Juha O. Merimaa
-
Publication number: 20220405043Abstract: A method performed by an audio source device that is communicatively coupled with an audio output device, the method includes obtaining an audio signal; receiving a volume adjustment; applying the volume adjustment to the audio signal; applying dynamic range compression on the volume adjusted audio signal; and applying an inverse volume adjustment to the compressed audio signal, where the inverse volume adjusted audio signal is to be transmitted to the audio output device.Type: ApplicationFiled: June 22, 2021Publication date: December 22, 2022Inventors: Hilary K. Mogul, Eric J. Day, Hannes Breitschaedel, Juha O. Merimaa
-
Publication number: 20220394406Abstract: A method performed by a programmed processor of an audio system, the method includes receiving a sound track that has a track length, producing a binaural audio version of a sound track, the binaural audio version having an extended track length performing a fading operation upon the binaural audio version to gradually reduce a signal level of the binaural audio version to below a signal threshold level at a time along the extended track length that corresponds to an end time of the track length of the sound track; and storing the binaural audio version having the track length of the sound track in memory for later transmission to an audio playback device for driving one or more speakers.Type: ApplicationFiled: May 5, 2022Publication date: December 8, 2022Inventors: Juha O. Merimaa, Abdullah Fahim, Andrey D. Del Pozo, Joshua D. Atkins
-
Publication number: 20220329965Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.Type: ApplicationFiled: June 22, 2022Publication date: October 13, 2022Inventors: Antti J. Vanne, Darius A. Satongar, James W. Vandyke, Juha O. Merimaa, Martin E. Johnson, Tomi A. Huttunen
-
Patent number: 11430451Abstract: A first layer of data having a first set of Ambisonic audio components can be decoded where the first set of Ambisonic audio components is generated based on ambience and one or more object-based audio signals. A second layer of data is decoded having at least one of the one or more object-based audio signals. One of the object-based audio signals is subtracted from the first set of Ambisonic audio components. The resulting Ambisonic audio components are rendered to generate a first set of audio channels. The one or more object-based audio signals are spatially rendered to generate a second set of audio channels. Other aspects are described and claimed.Type: GrantFiled: September 26, 2019Date of Patent: August 30, 2022Assignee: APPLE INC.Inventors: Dipanjan Sen, Frank Baumgarte, Juha O. Merimaa
-
Publication number: 20220262373Abstract: A first layer of data having a first set of Ambisonic audio components can be decoded where the first set of Ambisonic audio components is generated based on ambience and one or more object-based audio signals. A second layer of data is decoded having at least one of the one or more object-based audio signals. One of the object-based audio signals is subtracted from the first set of Ambisonic audio components. The resulting Ambisonic audio components are rendered to generate a first set of audio channels. The one or more object-based audio signals are spatially rendered to generate a second set of audio channels. Other aspects are described and claimed.Type: ApplicationFiled: May 9, 2022Publication date: August 18, 2022Inventors: Dipanjan Sen, Frank Baumgarte, Juha O. Merimaa
-
Patent number: 11417347Abstract: A binaural room impulse response (BRIR) can be generated based on a position of a listener's head, and a plurality of head related impulse responses (HRIRs). Each of the plurality of HRIRs are selected for a respective one of a plurality of acoustic reflections which, when taken together, approximate reverberation of a room. Each of the acoustic reflections have a direction and a delay. The BRIR filter is applied to source audio to generate binaural audio output.Type: GrantFiled: May 10, 2021Date of Patent: August 16, 2022Assignee: APPLE INC.Inventors: Martin E. Johnson, Juha O. Merimaa
-
Patent number: 11375333Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.Type: GrantFiled: September 16, 2020Date of Patent: June 28, 2022Assignee: APPLE INC.Inventors: Antti J. Vanne, Darius A. Satongar, James W. Vandyke, Juha O. Merimaa, Martin E. Johnson, Tomi A. Huttunen
-
Publication number: 20220174449Abstract: A binaural sound reproduction system, and methods of using the binaural sound reproduction system to dynamically re-center a frame of reference for a virtual sound source, are described. The binaural sound reproduction system may include a reference device, e.g., a mobile device, having a reference sensor to provide reference orientation data corresponding to a direction of the reference device, and a head-mounted device, e.g., headphones, having a device sensor to provide device orientation data corresponding to a direction of the head-mounted device. The system may use the reference orientation data to determine whether the head-mounted device is being used in a static or dynamic use case, and may adjust an audio output to render the virtual sound source in an adjusted source direction based on the determined use case. Other embodiments are also described and claimed.Type: ApplicationFiled: February 16, 2022Publication date: June 2, 2022Inventors: Darius A. Satongar, Afrooz Family, Sylvain J. Choisel, Juha O. Merimaa
-
Patent number: 11265670Abstract: A binaural sound reproduction system, and methods of using the binaural sound reproduction system to dynamically re-center a frame of reference for a virtual sound source, are described. The binaural sound reproduction system may include a reference device, e.g., a mobile device, having a reference sensor to provide reference orientation data corresponding to a direction of the reference device, and a head-mounted device, e.g., headphones, having a device sensor to provide device orientation data corresponding to a direction of the head-mounted device. The system may use the reference orientation data to determine whether the head-mounted device is being used in a static or dynamic use case, and may adjust an audio output to render the virtual sound source in an adjusted source direction based on the determined use case. Other embodiments are also described and claimed.Type: GrantFiled: May 1, 2020Date of Patent: March 1, 2022Assignee: APPLE INC.Inventors: Darius A. Satongar, Afrooz Family, Sylvain J. Choisel, Juha O. Merimaa
-
Publication number: 20210398545Abstract: A binaural room impulse response (BRIR) can be generated based on a position of a listener's head, and a plurality of head related impulse responses (HRIRs). Each of the plurality of HRIRs are selected for a respective one of a plurality of acoustic reflections which, when taken together, approximate reverberation of a room. Each of the acoustic reflections have a direction and a delay. The BRIR filter is applied to source audio to generate binaural audio output.Type: ApplicationFiled: May 10, 2021Publication date: December 23, 2021Inventors: Martin E. Johnson, Juha O. Merimaa
-
Patent number: 11202164Abstract: Methods and apparatus for predictive head-tracked binaural audio rendering in which a rendering device renders multiple audio streams for different possible head locations based on head tracking data received from a headset, for example audio streams for the last known location and one or more predicted or possible locations, and transmits the multiple audio streams to the headset. The headset then selects and plays one of the audio streams that is closest to the actual head location based on current head tracking data. If none of the audio streams closely match the actual head location, two closest audio streams may be mixed. Transmitting multiple audio streams to the headset and selecting or mixing an audio stream on the headset may mitigate or eliminate perceived head tracking latency.Type: GrantFiled: September 25, 2018Date of Patent: December 14, 2021Assignee: Apple Inc.Inventors: Juha O. Merimaa, Christopher T. Eubank, Martin E. Johnson, Stuart J. Wood, Deepak Natarajan
-
Patent number: 11070933Abstract: A computer system having an electronic device determines a listener position within a computer-generated reality (CGR) setting that is to be aurally experienced by a user of the electronic device through at least one speaker. The system determines a source position of a virtual sound source within the CGR setting and determines a characteristic of a virtual object within the CGR setting, where the characteristic include a geometry of an edge of the virtual object. The system determines at least one edge-diffraction filter parameter for an edge-diffraction filter based on 1) the listener position, 2) the source position, and 3) the geometry. The system applies the edge-diffraction filter to an input audio signal to produce a filtered audio signal that accounts for edge-diffraction of sound produced by the virtual sound source within the CGR setting.Type: GrantFiled: July 29, 2020Date of Patent: July 20, 2021Assignee: APPLE INC.Inventors: Dirk Schroeder, Jonathan D. Sheaffer, Soenke Pelzer, Juha O. Merimaa