Patents by Inventor Martin E. Johnson

Martin E. Johnson has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10986461
    Abstract: A directivity adjustment device that maintains a constant direct-to-reverberant ratio based on the detected location of a listener in relation to the speaker array is described. The directivity adjustment device may include a distance estimator, a directivity compensator, and an array processor. The distance estimator detects the distance between the speaker array and the listener. Based on this detected distance, the directivity compensator calculates a directivity index form a beam produced by the speaker array that maintains a predefined direct-to-reverberant sound energy ratio. The array processor receives the calculated directivity index and processes each channel of a piece of sound program content to produce a set of audio signals that drive one or more of the transducers in the speaker array to generate a beam pattern with the calculated directivity index.
    Type: Grant
    Filed: July 9, 2018
    Date of Patent: April 20, 2021
    Assignee: Apple Inc.
    Inventors: Martin E. Johnson, Ronald N. Isaac, Afrooz Family
  • Patent number: 10979806
    Abstract: An audio system having a depth capturing device and a microphone array to respectively detect a point cloud and a local sound field, is described. The point cloud includes points corresponding to objects in a source space, and the local sound field includes sounds received in respective directions from the source space. The audio system includes one or more processors to generate a global sound field based on distances to the points and directions of the sounds. The global sound field includes virtual sound sources emitting respective sounds at respective points. A speaker can render the virtual sound sources to a user in a virtual space that corresponds to the source space.
    Type: Grant
    Filed: April 19, 2019
    Date of Patent: April 13, 2021
    Assignee: Apple Inc.
    Inventors: Martin E. Johnson, Jonathan D. Sheaffer
  • Patent number: 10976989
    Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: April 13, 2021
    Assignee: Apple Inc.
    Inventors: Stuart John Wood, Martin E. Johnson, Darius A. Satongar
  • Publication number: 20210084414
    Abstract: In a device or method for rendering a sound program for headphones, a location is received for placing the sound program with respect to first and second ear pieces. If the location is between the first ear piece and the second ear piece, the sound program is filtered to produce low-frequency and high-frequency portions. The high-frequency portion is panned according to the location to produce first and second high-frequency signals. The low-frequency portion and the first high-frequency signal are combined to produce a first headphone driver signal to drive the first ear piece. A second headphone driver signal is similarly produced. The sound program may be a stereo sound program. The device or method may also provide for a location that is between the first ear piece and a near-field boundary. Other aspects are also described.
    Type: Application
    Filed: November 30, 2020
    Publication date: March 18, 2021
    Inventors: Martin E. Johnson, Afrooz Family, Darius A. Satongar, Jonathan D. Sheaffer, Lance F. Reichert, Peter V. Jupin
  • Patent number: 10880649
    Abstract: In a device or method for rendering a sound program for headphones, a location is received for placing the sound program with respect to first and second ear pieces. If the location is between the first ear piece and the second ear piece, the sound program is filtered to produce low-frequency and high-frequency portions. The high-frequency portion is panned according to the location to produce first and second high-frequency signals. The low-frequency portion and the first high-frequency signal are combined to produce a first headphone driver signal to drive the first ear piece. A second headphone driver signal is similarly produced. The sound program may be a stereo sound program. The device or method may also provide for a location that is between the first ear piece and a near-field boundary. Other aspects are also described.
    Type: Grant
    Filed: August 27, 2018
    Date of Patent: December 29, 2020
    Assignee: APPLE INC.
    Inventors: Martin E. Johnson, Afrooz Family, Darius A. Satongar, Jonathan D. Sheaffer, Lance F. Reichert, Peter V. Jupin
  • Publication number: 20200389623
    Abstract: A system for enhancing audio including a plurality of sensors, an output device, and a processor in communication with the plurality of sensors and the output device. The processor is configured to process data captured by the plurality of sensors, and based on that, modify an output of the output device. The processor also is configured to determine whether there are a plurality of users associated with a video conferencing session, determine which user of the plurality of users is speaking, and enhance the audio or video output of the speaking user on the output device.
    Type: Application
    Filed: August 25, 2020
    Publication date: December 10, 2020
    Inventors: Aleksandar Pance, Brett Bilbrey, Darby E. Hadley, Martin E. Johnson, Ronald Nadim Isaac
  • Patent number: 10848889
    Abstract: Image analysis of a video signal is performed to produce first metadata, and audio analysis of a multi-channel sound track associated with the video signal is performed to produce second metadata. A number of time segments of the sound track are processed, wherein each time segment is processed by either (i) spatial filtering of the audio signals or (ii) spatial rendering of the audio signals, not both, wherein for each time segment a decision was made to select between the spatial filtering or the spatial rendering, in accordance with the first and second metadata. A mix of the processed sound track and the video signal is generated. Other embodiments are also described and claimed.
    Type: Grant
    Filed: January 4, 2019
    Date of Patent: November 24, 2020
    Assignee: APPLE INC.
    Inventors: Jonathan D. Sheaffer, Joshua D. Atkins, Martin E. Johnson, Stuart J. Wood
  • Publication number: 20200322718
    Abstract: A multi-way speaker array is disclosed that includes rings of transducers of different types. The rings of transducers may encircle the cabinet of the speaker array such that the speaker array is rotationally symmetric. The distance between rings of transducers may be based on a logarithmic scale. By separating rings of transducers using logarithmic spacing, denser transducer spacing at short wavelengths is achieved while limiting the number of transducers needed for longer wavelengths by spacing them in larger and larger logarithmic increments. Transducers with overlapping frequency ranges may be used in the speaker array to avoid initial dips or shortfalls in directivity for corresponding beam patterns.
    Type: Application
    Filed: June 18, 2020
    Publication date: October 8, 2020
    Inventors: Martin E. Johnson, Gordon R. Dix, Michael B. Howes, Gary P. Geaves, Tom-Davy William Jendrik Saux
  • Patent number: 10798482
    Abstract: A multi-way speaker array is disclosed that includes rings of transducers of different types. The rings of transducers may encircle the cabinet of the speaker array such that the speaker array is rotationally symmetric. The distance between rings of transducers may be based on a logarithmic scale. By separating rings of transducers using logarithmic spacing, denser transducer spacing at short wavelengths is achieved while limiting the number of transducers needed for longer wavelengths by spacing them in larger and larger logarithmic increments. Transducers with overlapping frequency ranges may be used in the speaker array to avoid initial dips or shortfalls in directivity for corresponding beam patterns.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: October 6, 2020
    Assignee: Apple Inc.
    Inventors: Martin E. Johnson, Gordon R. Dix, Michael B. Howes, Gary P. Geaves, Tom-Davy William Jendrik Saux
  • Patent number: 10798511
    Abstract: Processing input audio channels for generating spatial audio can include receiving a plurality of microphone signals that capture a sound field. Each microphone signal can be transformed into a frequency domain signal. From each frequency domain signal, a direct component and a diffuse component can be extracted. The direct component can be processed with a parametric renderer. The diffuse component can be processed with a linear renderer. The components can be combined, resulting in a spatial audio output. The levels of the components can be adjusted to match a direct to diffuse ratio (DDR) of the output with the DDR of the captured sound field. Other aspects are also described and claimed.
    Type: Grant
    Filed: April 8, 2019
    Date of Patent: October 6, 2020
    Assignee: APPLE INC.
    Inventors: Jonathan D. Sheaffer, Juha O. Merimaa, Jason Wung, Martin E. Johnson, Peter A. Raffensperger, Joshua D. Atkins, Symeon Delikaris Manias, Mehrez Souden
  • Patent number: 10771742
    Abstract: A system for enhancing audio including a plurality of sensors, an output device, and a processor in communication with the plurality of sensors and the output device. The processor is configured to process data captured by the plurality of sensors, and based on that, modify an output of the output device. The processor also is configured to determine whether there are a plurality of users associated with a video conferencing session, determine which user of the plurality of users is speaking, and enhance the audio or video output of the speaking user on the output device.
    Type: Grant
    Filed: July 15, 2019
    Date of Patent: September 8, 2020
    Assignee: APPLE INC.
    Inventors: Aleksandar Pance, Brett Bilbrey, Darby E. Hadley, Martin E. Johnson, Ronald Nadim Isaac
  • Patent number: 10728690
    Abstract: An iterative method for finding which user characteristic data should be used for pruning a database of available HRTFs before selecting an HRTF from the database for a target user (target listener.) The selected HRTF is expected to be the one that is more suitable for target user. This is also referred to as having “personalized” the HRTF selection process for the target user. This is not about computing a suitable HRTF but rather how to use the user characteristic data to improve the chances of selecting the most appropriate one from a database of available HRTFs. Other aspects are also described and claimed.
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: July 28, 2020
    Assignee: APPLE INC.
    Inventors: Darius A. Satongar, Jonathan D. Sheaffer, Martin E. Johnson, Peter V. Jupin
  • Publication number: 20200236489
    Abstract: Methods and apparatus for predictive head-tracked binaural audio rendering in which a rendering device renders multiple audio streams for different possible head locations based on head tracking data received from a headset, for example audio streams for the last known location and one or more predicted or possible locations, and transmits the multiple audio streams to the headset. The headset then selects and plays one of the audio streams that is closest to the actual head location based on current head tracking data. If none of the audio streams closely match the actual head location, two closest audio streams may be mixed. Transmitting multiple audio streams to the headset and selecting or mixing an audio stream on the headset may mitigate or eliminate perceived head tracking latency.
    Type: Application
    Filed: September 25, 2018
    Publication date: July 23, 2020
    Applicant: Apple Inc.
    Inventors: Juha O. Merimaa, Christopher T. Eubank, Martin E. Johnson, Stuart J. Wood, Deepak Natarajan
  • Publication number: 20200221216
    Abstract: Loudspeakers are described that may reduce comb filtering effects perceived by a listener by either 1) moving transducers closer to a sound reflective surface (e.g., a baseplate, a tabletop or a floor) through vertical (height) or rotational adjustments of the transducers or 2) guiding sound produced by the transducers to be released into the listening area proximate to the reflective surface through the use of horns and openings that are at a prescribed distance from the reflective surface. The reduction of this distance between the reflective surface and the point at which sound emitted by the transducers is released into the listening area may lead to shorter reflected path that reduces comb filtering effects caused by reflected sounds that are delayed relative to the direct sound. Accordingly, the loudspeakers shown and described may be placed on reflective surfaces without severe audio coloration caused by reflected sounds.
    Type: Application
    Filed: March 18, 2020
    Publication date: July 9, 2020
    Inventors: Martin E. Johnson, Simon K. Porter, Suzanne Hardy, John H. Sheerin
  • Publication number: 20200213735
    Abstract: An audio system is described that includes one or more speaker arrays that emit sound corresponding to one or more pieces of sound program content into associated zones within a listening area. Using parameters of the audio system (e.g., locations of the speaker arrays and the audio sources), the zones, the users, the pieces of sound program content, and the listening area, one or more beam pattern attributes may be generated. The beam pattern attributes define a set of beams that are used to generate audio beams for channels of sound program content to be played in each zone. The beam pattern attributes may be updated as changes are detected within the listening environment. By adapting to these changing conditions, the audio system is capable of reproducing sound that accurately represents each piece of sound program content in various zones.
    Type: Application
    Filed: February 24, 2020
    Publication date: July 2, 2020
    Inventors: Afrooz Family, Anthony P. Bidmead, Erik L. Wang, Gary P. Geaves, Martin E. Johnson, Matthew I. Brown, Michael B. Howes, Sylvain J. Choisel, Tomlinson M. Holman
  • Patent number: 10652687
    Abstract: A presence of a person within a camera field of view of an electronic device is determined by digitally processing images captured by a camera. A position of a body member of the person with respect to the electronic device is also computed by digitally processing the camera captured images. A crosstalk cancellation (XTC) signal is adjusted based on the computed position of the body member. Adjusting the XTC signal includes adjusting a first predetermined model location, which includes a location at which a user should be in order to achieve a desired virtual acoustics effect. Processing program audio based on the adjusted XTC signal, to generate audio signals that drive speakers. Other aspects are also described and claimed.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: May 12, 2020
    Assignee: APPLE INC.
    Inventors: Darius A. Satongar, Joshua D. Atkins, Justin D. Crosby, Lance F. Reichert, Martin E. Johnson, Sawyer Cohen
  • Patent number: 10652650
    Abstract: Loudspeakers are described that may reduce comb filtering effects perceived by a listener by either 1) moving transducers closer to a sound reflective surface (e.g., a baseplate, a tabletop or a floor) through vertical (height) or rotational adjustments of the transducers or 2) guiding sound produced by the transducers to be released into the listening area proximate to the reflective surface through the use of horns and openings that are at a prescribed distance from the reflective surface. The reduction of this distance between the reflective surface and the point at which sound emitted by the transducers is released into the listening area may lead to shorter reflected path that reduces comb filtering effects caused by reflected sounds that are delayed relative to the direct sound. Accordingly, the loudspeakers shown and described may be placed on reflective surfaces without severe audio coloration caused by reflected sounds.
    Type: Grant
    Filed: September 29, 2015
    Date of Patent: May 12, 2020
    Assignee: Apple Inc.
    Inventors: Martin E. Johnson, Simon K. Porter, Suzanne Hardy, John H. Sheerin
  • Publication number: 20200104620
    Abstract: The present disclosure generally relates techniques for audio-assisted enrollment of biometric features. In some embodiments, methods and devices for assisting users with enrollment of biometric features, using spatial audio cues, are described.
    Type: Application
    Filed: June 28, 2019
    Publication date: April 2, 2020
    Inventors: Sawyer I. COHEN, Justin D. CROSBY, Ruchir M. DAVE, Martin E. JOHNSON, Benjamin J. POPE, Darius A. SATONGAR
  • Patent number: 10609484
    Abstract: An audio system is described that includes one or more speaker arrays that emit sound corresponding to one or more pieces of sound program content into associated zones within a listening area. Using parameters of the audio system (e.g., locations of the speaker arrays and the audio sources), the zones, the users, the pieces of sound program content, and the listening area, one or more beam pattern attributes may be generated. The beam pattern attributes define a set of beams that are used to generate audio beams for channels of sound program content to be played in each zone. The beam pattern attributes may be updated as changes are detected within the listening environment. By adapting to these changing conditions, the audio system is capable of reproducing sound that accurately represents each piece of sound program content in various zones.
    Type: Grant
    Filed: August 23, 2017
    Date of Patent: March 31, 2020
    Assignee: Apple Inc.
    Inventors: Afrooz Family, Anthony P. Bidmead, Erik L. Wang, Gary P. Geaves, Martin E. Johnson, Matthew I. Brown, Michael B. Howes, Sylvain J. Choisel, Tomlinson M. Holman
  • Publication number: 20200097248
    Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.
    Type: Application
    Filed: August 28, 2019
    Publication date: March 26, 2020
    Inventors: Stuart John WOOD, Martin E. JOHNSON, Darius A. SATONGAR