Patents by Inventor Martin E. Johnson

Martin E. Johnson has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230077689
    Abstract: A multimedia device having a housing that includes a display screen, two tweeters, two mid-range drivers, and two woofers, which are integrated into the housing. Both woofers are disposed at a first distance from a center vertical axis of the housing in opposite horizontal directions, both tweeters are disposed at a second distance from the center vertical axis in the opposite horizontal directions, and both mid-range drivers are disposed at a third distance from the center vertical axis in opposite horizontal directions. In addition, both the first and second distances are greater than the third distance.
    Type: Application
    Filed: August 15, 2022
    Publication date: March 16, 2023
    Inventors: Daniel K. Boothe, Martin E. Johnson, Ismael H. Nawfal, Timothy J. Valentine, Stuart M. Nevill, Chanjuan Feng
  • Patent number: 11595754
    Abstract: Audio processing for a headworn device can include obtaining ear geometry of a user. A frequency response or transfer function can be determined, based on the ear geometry of the user and a model of the headworn device, where the frequency response or transfer function characterizes an effect of a path between a speaker of the headworn device and an ear canal entrance of the user on sound. An equalization filter profile can be generated based on the based on the frequency response or transfer function. The equalization filter profile can be applied to an audio signal, and the audio signal can be used to drive the speaker of the headworn device.
    Type: Grant
    Filed: April 17, 2020
    Date of Patent: February 28, 2023
    Assignee: APPLE INC.
    Inventors: Martin E. Johnson, Darius A. Satongar, Antti J. Vanne, Tomi A. Huttunen
  • Publication number: 20230020542
    Abstract: A computer system outputs audio content via one or more audio output devices. If the audio content includes information that enables spatialization of the audio content, the system outputs the audio content in a simulated three-dimensional environment, including, if the audio content corresponds to a first category of content, causing the one or more audio output devices to simulate production of the audio content in a first virtual space, and if the audio content corresponds to a second category of content, causing the one or more audio output devices to simulate production of the audio content in a second virtual space that has different simulated acoustic properties than simulated acoustic properties of the first virtual space.
    Type: Application
    Filed: September 16, 2022
    Publication date: January 19, 2023
    Inventors: Darius A. Satongar, Per HÃ¥kan Linus Persson, Sean B. Kelly, Martin E. Johnson, Tony S. Verma, Peter D. Callaway, Jae Woo Chang, Daniel K. Boothe, Sean A. Ramprashad, Patrick Miauton, Christopher M. Garrido, Mitchell R. Lerner, Charles C. Hoyt
  • Publication number: 20220394407
    Abstract: A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatial rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatial rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.
    Type: Application
    Filed: June 4, 2021
    Publication date: December 8, 2022
    Inventors: Sean A. Ramprashad, Peter D. Callaway, Jae Woo Chang, Martin E. Johnson, Daniel K. Boothe, Kostyantyn Komarov, Patrick Miauton, Christopher M. Garrido, Austin W. Shyu, Karthick Santhanam
  • Publication number: 20220391169
    Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.
    Type: Application
    Filed: August 18, 2022
    Publication date: December 8, 2022
    Inventors: Stuart John WOOD, Martin E. JOHNSON, Darius A. SATONGAR
  • Publication number: 20220329965
    Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.
    Type: Application
    Filed: June 22, 2022
    Publication date: October 13, 2022
    Inventors: Antti J. Vanne, Darius A. Satongar, James W. Vandyke, Juha O. Merimaa, Martin E. Johnson, Tomi A. Huttunen
  • Publication number: 20220322024
    Abstract: An audio system and a method of determining an audio filter based on a position of an audio device of the audio system, are described. The audio system receives an image of the audio device being worn by a user and determines, based on the image and a known geometric relationship between a datum on the audio device and an electroacoustic transducer of the audio device, a relative position between the electroacoustic transducer and an anatomical feature of the user. The audio filter is determined based on the relative position. The audio filter can be applied to an audio input signal to render spatialized sound to the user through the electroacoustic transducer, or the audio filter can be applied to a microphone input signal to capture speech of the user by the electroacoustic transducer. Other aspects are also described and claimed.
    Type: Application
    Filed: March 28, 2022
    Publication date: October 6, 2022
    Inventors: Vignesh Ganapathi Subramanian, Antti J. Vanne, Olivier Soares, Andrew R. Harvey, Martin E. Johnson, Theo Auclair
  • Publication number: 20220279305
    Abstract: Disclosed are systems and methods for automatically transitioning between communication modes of wearable audio output devices based solely on acoustic analysis. The audio output devices may operate in one of three electroacoustic modes. In the transparency mode, an audio output device may pass through the speech signal of a nearby user. In the peer-to-peer mode, the audio output device may establish a direct low-latency radio frequency (RF) link to another audio output device. In the telephony mode, the audio output device may communicate with another audio output device using networked telephony. The disclosed methods and systems perform acoustic analysis of the near-field speech signal of a local wearer of the audio output device and the far-field speech signal of a remote talker to determine the best mode for the audio output device to use and to seamlessly transition between the modes as the acoustic environment between the wearers changes.
    Type: Application
    Filed: February 22, 2022
    Publication date: September 1, 2022
    Inventors: Jonathan D. Sheaffer, Martin E. Johnson, Andrew P. Bright
  • Patent number: 11432096
    Abstract: An audio system that adjusts one or more beam patterns emitted by one or more loudspeaker arrays based on the preferences of users/listeners is described. The audio system includes an audio receiver that contains a listener location estimator, a listener identifier, and a voice command processor. Inputs from the listener location estimator, the listener identifier, and the voice command processor are fed into an array processor. The array processor drives the one or more loudspeaker arrays to emit beam patterns into the listening area based on inputs from each of these devices. By examining the location, preferred usage settings, and voice commands from listeners, the generated beam patterns are customized to the explicit and implicit preferences of the listeners with minimal direct input. Other embodiments are also described.
    Type: Grant
    Filed: March 8, 2019
    Date of Patent: August 30, 2022
    Assignee: APPLE INC.
    Inventors: John J. Baker, Martin E. Johnson, Afrooz Family, Michael B. Howes, Craig M. Stanley, Brad G. Boozer
  • Patent number: 11429342
    Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.
    Type: Grant
    Filed: April 12, 2021
    Date of Patent: August 30, 2022
    Assignee: Apple Inc.
    Inventors: Stuart John Wood, Martin E. Johnson, Darius A. Satongar
  • Patent number: 11432095
    Abstract: Virtualizing speakers for a headphone set can include determining a location of a display. Locations of one or more virtual speakers can be assigned based on the location of the display. A first virtual speaker can be located at the display. A position of a head of a user can be tracked. Audio content can be spatialized with a spatial renderer to generate spatialized audio signals, based on the tracked position of the head and the locations of the virtual speakers. Other aspects are also described and claimed.
    Type: Grant
    Filed: April 13, 2020
    Date of Patent: August 30, 2022
    Assignee: APPLE INC.
    Inventors: Darius A. Satongar, Martin E. Johnson
  • Patent number: 11417347
    Abstract: A binaural room impulse response (BRIR) can be generated based on a position of a listener's head, and a plurality of head related impulse responses (HRIRs). Each of the plurality of HRIRs are selected for a respective one of a plurality of acoustic reflections which, when taken together, approximate reverberation of a room. Each of the acoustic reflections have a direction and a delay. The BRIR filter is applied to source audio to generate binaural audio output.
    Type: Grant
    Filed: May 10, 2021
    Date of Patent: August 16, 2022
    Assignee: APPLE INC.
    Inventors: Martin E. Johnson, Juha O. Merimaa
  • Patent number: 11399255
    Abstract: A directivity adjustment device that maintains a constant direct-to-reverberant ratio based on the detected location of a listener in relation to the speaker array is described. The directivity adjustment device may include a distance estimator, a directivity compensator, and an array processor. The distance estimator detects the distance between the speaker array and the listener. Based on this detected distance, the directivity compensator calculates a directivity index form a beam produced by the speaker array that maintains a predefined direct-to-reverberant sound energy ratio. The array processor receives the calculated directivity index and processes each channel of a piece of sound program content to produce a set of audio signals that drive one or more of the transducers in the speaker array to generate a beam pattern with the calculated directivity index.
    Type: Grant
    Filed: April 6, 2021
    Date of Patent: July 26, 2022
    Assignee: APPLE INC.
    Inventors: Martin E. Johnson, Ronald N. Isaac, Afrooz Family
  • Publication number: 20220210562
    Abstract: In a device or method for rendering a sound program for headphones, a location is received for placing the sound program with respect to first and second ear pieces. If the location is between the first ear piece and the second ear piece, the sound program is filtered to produce low-frequency and high-frequency portions. The high-frequency portion is panned according to the location to produce first and second high-frequency signals. The low-frequency portion and the first high-frequency signal are combined to produce a first headphone driver signal to drive the first ear piece. A second headphone driver signal is similarly produced. The sound program may be a stereo sound program. The device or method may also provide for a location that is between the first ear piece and a near-field boundary. Other aspects are also described.
    Type: Application
    Filed: March 15, 2022
    Publication date: June 30, 2022
    Inventors: Martin E. Johnson, Afrooz Family, Darius A. Satongar, Jonathan D. Sheaffer, Lance F. Reichert, Peter V. Jupin
  • Patent number: 11375333
    Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.
    Type: Grant
    Filed: September 16, 2020
    Date of Patent: June 28, 2022
    Assignee: APPLE INC.
    Inventors: Antti J. Vanne, Darius A. Satongar, James W. Vandyke, Juha O. Merimaa, Martin E. Johnson, Tomi A. Huttunen
  • Publication number: 20220180667
    Abstract: The present disclosure generally relates techniques for audio-assisted enrollment of biometric features. In some embodiments, methods and devices for assisting users with enrollment of biometric features, using spatial audio cues, are described.
    Type: Application
    Filed: August 23, 2021
    Publication date: June 9, 2022
    Inventors: Sawyer I. COHEN, Justin D. CROSBY, Ruchir M. DAVE, Martin E. JOHNSON, Benjamin J. POPE, Darius A. SATONGAR
  • Publication number: 20220174399
    Abstract: Loudspeakers are described that may reduce comb filtering effects perceived by a listener by either 1) moving transducers closer to a sound reflective surface (e.g., a baseplate, a tabletop or a floor) through vertical (height) or rotational adjustments of the transducers or 2) guiding sound produced by the transducers to be released into the listening area proximate to the reflective surface through the use of horns and openings that are at a prescribed distance from the reflective surface. The reduction of this distance between the reflective surface and the point at which sound emitted by the transducers is released into the listening area may lead to shorter reflected path that reduces comb filtering effects caused by reflected sounds that are delayed relative to the direct sound. Accordingly, the loudspeakers shown and described may be placed on reflective surfaces without severe audio coloration caused by reflected sounds.
    Type: Application
    Filed: February 17, 2022
    Publication date: June 2, 2022
    Applicant: Apple, Inc.
    Inventors: Martin E. Johnson, Simon K. Porter, Suzanne Hardy, John H. Sheerin
  • Patent number: 11315277
    Abstract: A device and a method of using the device to determine a user-specific head-related transfer function (HRTF), are described. The device can determine first geometric data corresponding to visible features of a pinna of a user in an image, and second geometric data corresponding to hidden features of the pinna obfuscated by the visible features in the image. The first geometric data and the second geometric data are combined in a geometric model that describes a shape of the pinna, and the user-specific HRTF is determined based on the geometric model. The user-specific HRTF is used to render spatial audio to the user. Other aspects are also described and claimed.
    Type: Grant
    Filed: September 4, 2019
    Date of Patent: April 26, 2022
    Assignee: APPLE INC.
    Inventors: Peter Victor Jupin, Yacine Azmi, Martin E. Johnson, Darius A. Satongar, Jonathan D. Sheaffer
  • Patent number: 11290805
    Abstract: Loudspeakers are described that may reduce comb filtering effects perceived by a listener by either 1) moving transducers closer to a sound reflective surface (e.g., a baseplate, a tabletop or a floor) through vertical (height) or rotational adjustments of the transducers or 2) guiding sound produced by the transducers to be released into the listening area proximate to the reflective surface through the use of horns and openings that are at a prescribed distance from the reflective surface. The reduction of this distance between the reflective surface and the point at which sound emitted by the transducers is released into the listening area may lead to shorter reflected path that reduces comb filtering effects caused by reflected sounds that are delayed relative to the direct sound. Accordingly, the loudspeakers shown and described may be placed on reflective surfaces without severe audio coloration caused by reflected sounds.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: March 29, 2022
    Assignee: APPLE INC.
    Inventors: Martin E. Johnson, Simon K. Porter, Suzanne Hardy, John H. Sheerin
  • Patent number: 11284195
    Abstract: In a device or method for rendering a sound program for headphones, a location is received for placing the sound program with respect to first and second ear pieces. If the location is between the first ear piece and the second ear piece, the sound program is filtered to produce low-frequency and high-frequency portions. The high-frequency portion is panned according to the location to produce first and second high-frequency signals. The low-frequency portion and the first high-frequency signal are combined to produce a first headphone driver signal to drive the first ear piece. A second headphone driver signal is similarly produced. The sound program may be a stereo sound program. The device or method may also provide for a location that is between the first ear piece and a near-field boundary. Other aspects are also described.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: March 22, 2022
    Assignee: APPLE INC.
    Inventors: Martin E. Johnson, Afrooz Family, Darius A. Satongar, Jonathan D. Sheaffer, Lance F. Reichert, Peter V. Jupin