Patents by Inventor Martin E. Johnson

Martin E. Johnson has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200322718
    Abstract: A multi-way speaker array is disclosed that includes rings of transducers of different types. The rings of transducers may encircle the cabinet of the speaker array such that the speaker array is rotationally symmetric. The distance between rings of transducers may be based on a logarithmic scale. By separating rings of transducers using logarithmic spacing, denser transducer spacing at short wavelengths is achieved while limiting the number of transducers needed for longer wavelengths by spacing them in larger and larger logarithmic increments. Transducers with overlapping frequency ranges may be used in the speaker array to avoid initial dips or shortfalls in directivity for corresponding beam patterns.
    Type: Application
    Filed: June 18, 2020
    Publication date: October 8, 2020
    Inventors: Martin E. Johnson, Gordon R. Dix, Michael B. Howes, Gary P. Geaves, Tom-Davy William Jendrik Saux
  • Patent number: 10798511
    Abstract: Processing input audio channels for generating spatial audio can include receiving a plurality of microphone signals that capture a sound field. Each microphone signal can be transformed into a frequency domain signal. From each frequency domain signal, a direct component and a diffuse component can be extracted. The direct component can be processed with a parametric renderer. The diffuse component can be processed with a linear renderer. The components can be combined, resulting in a spatial audio output. The levels of the components can be adjusted to match a direct to diffuse ratio (DDR) of the output with the DDR of the captured sound field. Other aspects are also described and claimed.
    Type: Grant
    Filed: April 8, 2019
    Date of Patent: October 6, 2020
    Assignee: APPLE INC.
    Inventors: Jonathan D. Sheaffer, Juha O. Merimaa, Jason Wung, Martin E. Johnson, Peter A. Raffensperger, Joshua D. Atkins, Symeon Delikaris Manias, Mehrez Souden
  • Patent number: 10798482
    Abstract: A multi-way speaker array is disclosed that includes rings of transducers of different types. The rings of transducers may encircle the cabinet of the speaker array such that the speaker array is rotationally symmetric. The distance between rings of transducers may be based on a logarithmic scale. By separating rings of transducers using logarithmic spacing, denser transducer spacing at short wavelengths is achieved while limiting the number of transducers needed for longer wavelengths by spacing them in larger and larger logarithmic increments. Transducers with overlapping frequency ranges may be used in the speaker array to avoid initial dips or shortfalls in directivity for corresponding beam patterns.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: October 6, 2020
    Assignee: Apple Inc.
    Inventors: Martin E. Johnson, Gordon R. Dix, Michael B. Howes, Gary P. Geaves, Tom-Davy William Jendrik Saux
  • Patent number: 10771742
    Abstract: A system for enhancing audio including a plurality of sensors, an output device, and a processor in communication with the plurality of sensors and the output device. The processor is configured to process data captured by the plurality of sensors, and based on that, modify an output of the output device. The processor also is configured to determine whether there are a plurality of users associated with a video conferencing session, determine which user of the plurality of users is speaking, and enhance the audio or video output of the speaking user on the output device.
    Type: Grant
    Filed: July 15, 2019
    Date of Patent: September 8, 2020
    Assignee: APPLE INC.
    Inventors: Aleksandar Pance, Brett Bilbrey, Darby E. Hadley, Martin E. Johnson, Ronald Nadim Isaac
  • Patent number: 10728690
    Abstract: An iterative method for finding which user characteristic data should be used for pruning a database of available HRTFs before selecting an HRTF from the database for a target user (target listener.) The selected HRTF is expected to be the one that is more suitable for target user. This is also referred to as having “personalized” the HRTF selection process for the target user. This is not about computing a suitable HRTF but rather how to use the user characteristic data to improve the chances of selecting the most appropriate one from a database of available HRTFs. Other aspects are also described and claimed.
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: July 28, 2020
    Assignee: APPLE INC.
    Inventors: Darius A. Satongar, Jonathan D. Sheaffer, Martin E. Johnson, Peter V. Jupin
  • Publication number: 20200236489
    Abstract: Methods and apparatus for predictive head-tracked binaural audio rendering in which a rendering device renders multiple audio streams for different possible head locations based on head tracking data received from a headset, for example audio streams for the last known location and one or more predicted or possible locations, and transmits the multiple audio streams to the headset. The headset then selects and plays one of the audio streams that is closest to the actual head location based on current head tracking data. If none of the audio streams closely match the actual head location, two closest audio streams may be mixed. Transmitting multiple audio streams to the headset and selecting or mixing an audio stream on the headset may mitigate or eliminate perceived head tracking latency.
    Type: Application
    Filed: September 25, 2018
    Publication date: July 23, 2020
    Applicant: Apple Inc.
    Inventors: Juha O. Merimaa, Christopher T. Eubank, Martin E. Johnson, Stuart J. Wood, Deepak Natarajan
  • Publication number: 20200221216
    Abstract: Loudspeakers are described that may reduce comb filtering effects perceived by a listener by either 1) moving transducers closer to a sound reflective surface (e.g., a baseplate, a tabletop or a floor) through vertical (height) or rotational adjustments of the transducers or 2) guiding sound produced by the transducers to be released into the listening area proximate to the reflective surface through the use of horns and openings that are at a prescribed distance from the reflective surface. The reduction of this distance between the reflective surface and the point at which sound emitted by the transducers is released into the listening area may lead to shorter reflected path that reduces comb filtering effects caused by reflected sounds that are delayed relative to the direct sound. Accordingly, the loudspeakers shown and described may be placed on reflective surfaces without severe audio coloration caused by reflected sounds.
    Type: Application
    Filed: March 18, 2020
    Publication date: July 9, 2020
    Inventors: Martin E. Johnson, Simon K. Porter, Suzanne Hardy, John H. Sheerin
  • Publication number: 20200213735
    Abstract: An audio system is described that includes one or more speaker arrays that emit sound corresponding to one or more pieces of sound program content into associated zones within a listening area. Using parameters of the audio system (e.g., locations of the speaker arrays and the audio sources), the zones, the users, the pieces of sound program content, and the listening area, one or more beam pattern attributes may be generated. The beam pattern attributes define a set of beams that are used to generate audio beams for channels of sound program content to be played in each zone. The beam pattern attributes may be updated as changes are detected within the listening environment. By adapting to these changing conditions, the audio system is capable of reproducing sound that accurately represents each piece of sound program content in various zones.
    Type: Application
    Filed: February 24, 2020
    Publication date: July 2, 2020
    Inventors: Afrooz Family, Anthony P. Bidmead, Erik L. Wang, Gary P. Geaves, Martin E. Johnson, Matthew I. Brown, Michael B. Howes, Sylvain J. Choisel, Tomlinson M. Holman
  • Patent number: 10652650
    Abstract: Loudspeakers are described that may reduce comb filtering effects perceived by a listener by either 1) moving transducers closer to a sound reflective surface (e.g., a baseplate, a tabletop or a floor) through vertical (height) or rotational adjustments of the transducers or 2) guiding sound produced by the transducers to be released into the listening area proximate to the reflective surface through the use of horns and openings that are at a prescribed distance from the reflective surface. The reduction of this distance between the reflective surface and the point at which sound emitted by the transducers is released into the listening area may lead to shorter reflected path that reduces comb filtering effects caused by reflected sounds that are delayed relative to the direct sound. Accordingly, the loudspeakers shown and described may be placed on reflective surfaces without severe audio coloration caused by reflected sounds.
    Type: Grant
    Filed: September 29, 2015
    Date of Patent: May 12, 2020
    Assignee: Apple Inc.
    Inventors: Martin E. Johnson, Simon K. Porter, Suzanne Hardy, John H. Sheerin
  • Patent number: 10652687
    Abstract: A presence of a person within a camera field of view of an electronic device is determined by digitally processing images captured by a camera. A position of a body member of the person with respect to the electronic device is also computed by digitally processing the camera captured images. A crosstalk cancellation (XTC) signal is adjusted based on the computed position of the body member. Adjusting the XTC signal includes adjusting a first predetermined model location, which includes a location at which a user should be in order to achieve a desired virtual acoustics effect. Processing program audio based on the adjusted XTC signal, to generate audio signals that drive speakers. Other aspects are also described and claimed.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: May 12, 2020
    Assignee: APPLE INC.
    Inventors: Darius A. Satongar, Joshua D. Atkins, Justin D. Crosby, Lance F. Reichert, Martin E. Johnson, Sawyer Cohen
  • Publication number: 20200104620
    Abstract: The present disclosure generally relates techniques for audio-assisted enrollment of biometric features. In some embodiments, methods and devices for assisting users with enrollment of biometric features, using spatial audio cues, are described.
    Type: Application
    Filed: June 28, 2019
    Publication date: April 2, 2020
    Inventors: Sawyer I. COHEN, Justin D. CROSBY, Ruchir M. DAVE, Martin E. JOHNSON, Benjamin J. POPE, Darius A. SATONGAR
  • Patent number: 10609484
    Abstract: An audio system is described that includes one or more speaker arrays that emit sound corresponding to one or more pieces of sound program content into associated zones within a listening area. Using parameters of the audio system (e.g., locations of the speaker arrays and the audio sources), the zones, the users, the pieces of sound program content, and the listening area, one or more beam pattern attributes may be generated. The beam pattern attributes define a set of beams that are used to generate audio beams for channels of sound program content to be played in each zone. The beam pattern attributes may be updated as changes are detected within the listening environment. By adapting to these changing conditions, the audio system is capable of reproducing sound that accurately represents each piece of sound program content in various zones.
    Type: Grant
    Filed: August 23, 2017
    Date of Patent: March 31, 2020
    Assignee: Apple Inc.
    Inventors: Afrooz Family, Anthony P. Bidmead, Erik L. Wang, Gary P. Geaves, Martin E. Johnson, Matthew I. Brown, Michael B. Howes, Sylvain J. Choisel, Tomlinson M. Holman
  • Publication number: 20200097248
    Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.
    Type: Application
    Filed: August 28, 2019
    Publication date: March 26, 2020
    Inventors: Stuart John WOOD, Martin E. JOHNSON, Darius A. SATONGAR
  • Publication number: 20200084560
    Abstract: A presence of a person within a camera field of view of an electronic device is determined by digitally processing images captured by a camera. A position of a body member of the person with respect to the electronic device is also computed by digitally processing the camera captured images. A crosstalk cancellation (XTC) signal is adjusted based on the computed position of the body member. Adjusting the XTC signal includes adjusting a first predetermined model location, which includes a location at which a user should be in order to achieve a desired virtual acoustics effect. Processing program audio based on the adjusted XTC signal, to generate audio signals that drive speakers. Other aspects are also described and claimed.
    Type: Application
    Filed: September 10, 2018
    Publication date: March 12, 2020
    Inventors: Darius A. Satongar, Joshua D. Atkins, Justin D. Crosby, Lance F. Reichert, Martin E. Johnson, Sawyer Cohen
  • Patent number: 10542365
    Abstract: An audio system is provided that efficiently detects speaker arrays and configures the speaker arrays to output sound. In this system, a computing device may record the addresses and/or types of speaker arrays on a shared network while a camera captures video of a listening area, including the speaker arrays. The captured video may be analyzed to determine the location of the speaker arrays, one or more users, and/or the audio source in the listening area. While capturing the video, the speaker arrays may be driven to sequentially emit a series of test sounds into the listening area and a user may be prompted to select which speaker arrays in the captured video emitted each of the test sounds. Based on these inputs from the user, the computing device may determine an association between the speaker arrays on the shared network and the speaker arrays in the captured video.
    Type: Grant
    Filed: August 18, 2014
    Date of Patent: January 21, 2020
    Assignee: APPLE INC.
    Inventors: Afrooz Family, Martin E. Johnson, Baptiste P. Paquier
  • Patent number: 10524080
    Abstract: An audio processing system has one or more processors that process an audio signal on three paths. The first path has a direct gain and a direct virtual source algorithm operating on the audio signal. The second path has a plurality of early reflection gains operating on the audio signal. Operation with the early reflection gains produces a plurality of early reflections. Each of the early reflection signals may be subjected to a delay and may be processed according to an early reflections virtual source algorithm. The third path has a reverb gain and binaural reverb filters operating on the audio signal. The third path also has a crosstalk canceler. A mixer combines left and right channel outputs of each of the first path, second path and third path. The mixer produces a left loudspeaker signal and a right loudspeaker signal.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: December 31, 2019
    Assignee: APPLE INC.
    Inventors: Martin E. Johnson, Darius A. Satongar, Stuart J. Wood, Lance F. Reichert, Juha O. Merimaa, Joshua D. Atkins
  • Patent number: 10402151
    Abstract: A system for enhancing audio including a computer and an output device. The computer includes a sensor configured to determine a user location relative to the computer. The sensor is also configured to gather environment data corresponding to an environment of the computer. The computer also includes a processor in communication with the sensor and configured to process the user location and the environment data and adjust at least one of an audio output or a video output. The output device is in communication with the processor and is configured to output at least one of the audio output or the video output.
    Type: Grant
    Filed: May 11, 2017
    Date of Patent: September 3, 2019
    Assignee: Apple Inc.
    Inventors: Aleksandar Pance, Brett Bilbrey, Darbey E. Hadley, Martin E. Johnson, Ronald Nadim Isaac
  • Patent number: 10390131
    Abstract: A microphone array included in a portable electronic device is used to generate various virtual studio microphones by combining one or more microphone signals to produce one or more acoustic pickup beams. An error is determined in a position of the microphone array relative to an audio source to be recorded. An interface is displayed to instruct a user on repositioning the microphone array relative to the instrument and the instrument is recorded using the repositioned microphone array.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: August 20, 2019
    Assignee: Apple Inc.
    Inventors: Jonathan D. Sheaffer, Darius A. Satongar, Joshua D. Atkins, Martin E. Johnson
  • Publication number: 20190222950
    Abstract: Image analysis of a video signal is performed to produce first metadata, and audio analysis of a multi-channel sound track associated with the video signal is performed to produce second metadata. A number of time segments of the sound track are processed, wherein each time segment is processed by either (i) spatial filtering of the audio signals or (ii) spatial rendering of the audio signals, not both, wherein for each time segment a decision was made to select between the spatial filtering or the spatial rendering, in accordance with the first and second metadata. A mix of the processed sound track and the video signal is generated. Other embodiments are also described and claimed.
    Type: Application
    Filed: January 4, 2019
    Publication date: July 18, 2019
    Inventors: Jonathan D. Sheaffer, Joshua D. Atkins, Martin E. Johnson, Stuart J. Wood
  • Publication number: 20190208347
    Abstract: An audio system that adjusts one or more beam patterns emitted by one or more loudspeaker arrays based on the preferences of users/listeners is described. The audio system includes an audio receiver that contains a listener location estimator, a listener identifier, and a voice command processor. Inputs from the listener location estimator, the listener identifier, and the voice command processor are fed into an array processor. The array processor drives the one or more loudspeaker arrays to emit beam patterns into the listening area based on inputs from each of these devices. By examining the location, preferred usage settings, and voice commands from listeners, the generated beam patterns are customized to the explicit and implicit preferences of the listeners with minimal direct input. Other embodiments are also described.
    Type: Application
    Filed: March 8, 2019
    Publication date: July 4, 2019
    Inventors: John J. Baker, Martin E. Johnson, Afrooz Family, Michael B. Howes, Craig M. Stanley, Brad G. Boozer