Virtual Positioning Patents (Class 381/310)
  • Patent number: 10425722
    Abstract: A sound system for a vehicle is provided, which includes an engine and an audio device for an internal space of a cabin, as sound sources disposed at given positions of the vehicle. The system includes an engine sound localizer configured to localize a first sound generated by the engine to cause a vehicle driver inside the cabin to hear the first sound from a first position, an audio sound localizer configured to localize a second sound generated by the audio device to cause the driver to hear the second sound from a second position, a traveling state detector configured to detect a traveling state of the vehicle, and a controller configured to cause the audio sound localizer to change, when a given traveling state is detected by the traveling state detector, the second position in a direction away from the first position.
    Type: Grant
    Filed: May 4, 2018
    Date of Patent: September 24, 2019
    Assignee: Mazda Motor Corporation
    Inventors: Isao Toda, Kenji Asada, Katsumasa Sogame, Hironobu Hashiguchi
  • Patent number: 10425763
    Abstract: In some embodiments, virtualization methods for generating a binaural signal in response to channels of a multi-channel audio signal, which apply a binaural room impulse response (BRIR) to each channel including by using at least one feed-back delay network (FDN) to apply a common late reverberation to a downmix of the channels. In some embodiments, input signal channels are processed in a first processing path to apply to each channel a direct response and early reflection portion of a single-channel BRIR for the channel, and the downmix of the channels is processed in a second processing path including at least one FDN which applies the common late reverberation. Typically, the common late reverberation emulates collective macro attributes of late reverberation portions of at least some of the single-channel BRIRs. Other aspects are headphone virtualizers configured to perform any embodiment of the method.
    Type: Grant
    Filed: December 18, 2014
    Date of Patent: September 24, 2019
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Kuan-Chieh Yen, Dirk Jeroen Breebaart, Grant A. Davidson, Rhonda Wilson, David M. Cooper, Zhiwei Shuang
  • Patent number: 10419870
    Abstract: Personalized HRTFs for each of plural computer game participants are convolved with functions representing the acoustics of a physical room in which each participant is located or representing the acoustics of a virtual space in the game environment. Head-tracking of each participant may be employed as the game is played and the HRTFs established accordingly. As the game progresses, the location of each player's character within the virtual game space with respect to the other players is tracked and audio adjusted accordingly. If desired, audio can be down-mixed from, e.g., 5.1 audio and then up-rendered for each player by the game console or by the players' local game interface, e.g., a computer game head-worn visor assembly.
    Type: Grant
    Filed: April 12, 2018
    Date of Patent: September 17, 2019
    Assignees: Sony Corporation, Sony Interactive Entertainment LLC
    Inventors: James R. Milne, True Xiong, Charles David McCoy, Gregory Peter Carlsson
  • Patent number: 10405122
    Abstract: Provided is a stereophonic sound reproducing apparatus that applies a multi-rendering scheme to a channel sound signal and an object sound signal to enhance a stereophonic effect. A stereophonic sound reproducing method performed by the stereophonic sound reproducing apparatus may include receiving a channel sound signal based on a channel, an object sound signal based on an object, and metadata, and reproducing the channel sound signal based on a preset rendering scheme and reproducing, based on the metadata including a rendering scheme determined using the object sound signal, each object sound signal using the determined rendering scheme.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: September 3, 2019
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Dae Young Jang, Yong Ju Lee, Jae-hyoun Yoo, Sang Won Suh
  • Patent number: 10397725
    Abstract: A system for creating a perception of directionality to an audio signal, the system including: a processor with an associated memory, the associated memory containing instructions, which when executed cause the processor to: identify an audio signal and an orientation to be applied to the audio signal; calculate intermediate values to reduce the dimensions of the audio signal and orientation; provide the intermediate values into a neural network, to produce a first and second orienting audio outputs; and provide the first orienting audio output to a first speaker and the second orienting audio output to a second speaker.
    Type: Grant
    Filed: July 17, 2018
    Date of Patent: August 27, 2019
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventor: Sunil Bharitkar
  • Patent number: 10390166
    Abstract: A device includes a mixer configured to mix first ambisonic data and second ambisonic data to generate mixed ambisonic data. The first ambisonic data and the second ambisonic data correspond to different spatial orders. The device also includes ambisonic adjustment circuitry configured to adjust the mixed ambisonic data based on position data to generate an adjusted mixed ambisonic output.
    Type: Grant
    Filed: September 25, 2017
    Date of Patent: August 20, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Gang Chen, Vasudev Nayak, Shankar Thagadur Shivappa, S M Akramus Salehin, Nils Gunther Peters
  • Patent number: 10341799
    Abstract: Embodiments are described for designing a filter in a magnitude domain performing an impedance filtering function over a frequency domain to compensate for directional cues for the left and right ears of the listener as a function of virtual source angles during headphone virtual sound reproduction. The filter is derived by obtaining blocked ear canal and open ear canal transfer functions for loudspeakers placed in a room, obtaining an open ear canal transfer function for a headphone placed on a listening subject, and dividing the loudspeaker transfer functions by the headphone transfer function to invert a headphone response at the entrance of the ear canal and map the ear canal function from the headphone to free field.
    Type: Grant
    Filed: October 28, 2015
    Date of Patent: July 2, 2019
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Sunil Bharitkar, Louis D. Fielder
  • Patent number: 10334386
    Abstract: Systems, methods, and apparatus to calibrate sounds fields are disclosed. An example implementation involves a playback device detecting a change in a strength of a wireless signal received by the playback device via a wireless network interface. Based on the detected change of the wireless signal, the playback device generates localization data. The playback device also generates an analog audio signal based on at least (i) a digital audio signal and (ii) the generated localization information and plays the generated analog audio signal.
    Type: Grant
    Filed: May 26, 2016
    Date of Patent: June 25, 2019
    Assignee: Sonos, Inc.
    Inventors: Jonathon Reilly, Niels Van Erven
  • Patent number: 10324531
    Abstract: One illustrative system disclosed herein includes a computing device in communication with a display device and a sensor. The display device is configured to display a plurality of content and the sensor is configured to detect a field of view of a user of the computing device relative to the display device. The sensor can transmit a signal associated with the field of view to a processor in communication with the sensor. The processor is configured to determine a direction of the field of view of the user based on the signal. The processor is also configured to determine that a content displayed by the display device and associated with a haptic effect is within the field of view of the user. The processor is also configured to determine a haptic effect associated with the content and transmit a haptic signal associated with the haptic effect. The illustrative system also includes a haptic output device configured to receive the haptic signal and output the haptic effect.
    Type: Grant
    Filed: December 27, 2016
    Date of Patent: June 18, 2019
    Assignee: Immersion Corporation
    Inventors: Danny A. Grant, William S. Rihn
  • Patent number: 10313819
    Abstract: Various implementations include computer-implemented methods and related systems for controlling the phantom center image of an audio output in an automobile. In one implementation, a method includes: receiving at least one user interface command to modify a phantom center image of audio output from the audio system in the automobile, wherein the phantom center image of the audio output includes a designated position of sound produced by a set of speakers in the audio system other than physical locations of the set of speakers in the audio system; and adjusting a perceived location of the phantom center image of the audio output from the audio system based upon the at least one user interface command to modify the phantom center image of the audio output.
    Type: Grant
    Filed: June 18, 2018
    Date of Patent: June 4, 2019
    Assignee: BOSE CORPORATION
    Inventors: Michael Scott Dublin, Charles Terence Henry Oswald, Eduardo T. Salvador, Jeffery Robert Vautin
  • Patent number: 10298911
    Abstract: Technologies are generally described for visualizing spatial relationships and other relationships. In one example, a method includes capturing, by a system comprising a processor, a stereoscopic image based on a view area from a reference point determined by the system. The stereoscopic image comprises objects. The method also includes determining respective depth indication data for a set of the objects based on respective depths of the set of the objects. The method also includes converting the stereoscopic image to a monocular image and initiating a presentation of the monocular image to a viewing device. The respective depths are respective distances determined between the reference point and the set of the objects. The monocular image comprises the depth indication data for the set of the objects and simulates depth perception.
    Type: Grant
    Filed: February 5, 2015
    Date of Patent: May 21, 2019
    Assignee: Empire Technology Development LLC
    Inventors: Gary Stephen Shuster, Charles Marion Curry
  • Patent number: 10200807
    Abstract: A method comprising: receiving audio input from multiple microphones; receiving position information for the multiple microphones; selecting in dependence upon positions of the microphones, at least a first microphone as a source of audio input forming a first output; selecting in dependence upon positions of the microphones, at least a second microphone as a source of audio input forming a second output; and enabling live rendering of audio by providing the first output for rendering via a left loudspeaker and the second output for rendering via a right loudspeaker.
    Type: Grant
    Filed: November 7, 2017
    Date of Patent: February 5, 2019
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Miikka Vilermo, Arto Lehtiniemi, Jussi Leppänen
  • Patent number: 10165368
    Abstract: Methods and systems for headset with automatic source detection and volume control may include in an audio headset: receiving one or more audio signals carrying audio channels; and processing the audio channels to generate stereo signals for output to a left and a right speaker of the audio headset. The processing may include: determining a quantity of the audio channels carried in the received audio signals by comparing a level of a channel of the received audio signals to a threshold during a determined time period; adjusting a level of one or more of the audio channels based on the quantity of the audio channels carried in the received audio signals; and combining the audio channels to generate the stereo signals. The processing may include adjusting gain and/or phase of the audio channels carried in the received audio signals such that a perceived location of a listener is changed.
    Type: Grant
    Filed: September 16, 2015
    Date of Patent: December 25, 2018
    Assignee: Voyetra Turtle Beach, Inc.
    Inventors: Richard Kulavik, Shobha Devi Kuruba Buchannagari
  • Patent number: 10149086
    Abstract: When the elevation of the input channel differs from the standard elevation and an elevation rendering parameter corresponding to the standard elevation is used, audio image distortion occurs. A method of rendering audio signals, according to an embodiment of the present invention, reduces the audio image distortion even when the elevation of the input channel differs from the standard elevation, comprises the steps of: receiving a multi-channel signal comprising a plurality of input channels to be converted into a plurality of output channels; obtaining elevation rendering parameters for a height input channel having a standard elevation angle so that each output channel provides an audio image having a sense of elevation; and updating the elevation rendering parameters for a height input channel having a set elevation angle other than the standard elevation angle.
    Type: Grant
    Filed: March 30, 2015
    Date of Patent: December 4, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sang-bae Chon, Sun-min Kim
  • Patent number: 10148242
    Abstract: An electronic device for reproducing data and a method thereof are provided. The electronic device includes a memory; and a processor. The processor is configured to determine a spatial characteristic of a space where content is reproduced, store the spatial characteristic in the memory, and change a sound of the content based on the spatial characteristic when the content is reproduced.
    Type: Grant
    Filed: October 1, 2015
    Date of Patent: December 4, 2018
    Assignee: Samsung Electronics Co., Ltd
    Inventor: Jae-Hoon Kim
  • Patent number: 10123147
    Abstract: Methods and apparatuses pertaining to enhanced audio effect realization for virtual reality may involve receiving data in a virtual reality setting. The data may be related to audio samples from one or more sound sources, motions of the one or more sound sources, and motions of a user. Physics simulation may be performed for realization of one or more audio effects based on the received data. Signal processing may be performed using a result of the physics simulation. Audio outputs may be provided using a result of the signal processing.
    Type: Grant
    Filed: January 18, 2017
    Date of Patent: November 6, 2018
    Assignee: MEDIATEK INC.
    Inventors: Xin-Wei Shih, Yiou-Wen Cheng
  • Patent number: 10091575
    Abstract: A method and system for obtaining an audio signal. In one embodiment, the method comprises receiving a first sound signal at a first microphone arranged at a first height vertically above a substantially flat surface; receiving a second sound signal at a second microphone arranged at a second height vertically above the substantially flat surface; processing a signal provided by the first microphone using a low pass filter; processing a signal provided by the second microphone using a high pass filter; adding the signals processed by the low pass filter and the high pass filter to form a sum signal; and outputting the sum signal as an audio signal.
    Type: Grant
    Filed: July 1, 2015
    Date of Patent: October 2, 2018
    Assignee: Cisco Technology, Inc.
    Inventors: Johan Ludvig Nielsen, Gisle Langen Enstad
  • Patent number: 10085108
    Abstract: A method for visualizing a directional sound activity of a multichannel audio signal, wherein the multichannel audio signal comprises time-dependent input audio signals, comprising determining a directional sound activity vector from virtual sound sources determined from an active directional vector and a reactive directional vector determined from time-frequency representations of different input audio signals for each one of a plurality of time-frequency tiles; determining a contribution of each one of said directional sound activity vectors within sub-divisions of space on the basis of directivity information related to each sub-divisions of space and directional sound activity level within said sub-division of space by summing said contributions; displaying a visualization of the directional sound activity of the multichannel audio signal by a graphical representation of directional sound activity level within said sub-division of space.
    Type: Grant
    Filed: September 19, 2017
    Date of Patent: September 25, 2018
    Assignee: A-VOLUTE
    Inventors: Raphael Nicolas Greff, Hong Cong Tuyen Pham
  • Patent number: 10080095
    Abstract: A camera input can be used by the computer to support audio spatialization or to improve audio spatialization of an application that already supports it. A computer system may to support audio spatialization, for example, by modifying the relative latency or relative amplitude of the rendered audio packets. If a sound is intended, for example, to be located on the left side of the user, then the audio channel that is rendered on the headset speaker located on the user's left ear may have a somewhat decreased latency and increased amplitude compared to the other audio channel.
    Type: Grant
    Filed: August 26, 2016
    Date of Patent: September 18, 2018
    Assignee: Intel Corporation
    Inventors: Nikos Kaburlasos, Scott W. Cheng, Devon Worrell
  • Patent number: 10031207
    Abstract: A compensation filter is operable to receive a received signal in response to a transmitted signal, the received signal having a time duration. The compensation filter is operable to generate a compensated signal. The compensation filter changes shape of an associated transfer function during the time duration of the received signal to result in the compensated signal having an improved spectral flatness throughout the time duration of the received signal. The compensation filter can be used in a sonar system. A method, which can be used in a sonar system, uses the compensation filter.
    Type: Grant
    Filed: March 3, 2016
    Date of Patent: July 24, 2018
    Assignee: Raytheon Company
    Inventor: Andrew Wilby
  • Patent number: 10009705
    Abstract: Embodiments herein are primarily described in the context of a system, a method, and a non-transitory computer readable medium for producing a sound with enhanced spatial detectability and a crosstalk simulation. The audio processing system receives a left and right input channel of an audio input signal, and performs an audio processing to generate an output audio signal. The system generates left and right spatially enhanced signals by gain adjusting side subband components and mid subband components of the left and right input channels. The audio processing system generates left and right crosstalk channels such as by applying a filter and time delay to the left and right input channels, and mixes the spatially enhanced channels with the crosstalk channels. In some embodiments, the system includes high/low frequency enhancement channels and passthrough channels derived from the input channels, which can be mixed with the output audio signal.
    Type: Grant
    Filed: January 12, 2017
    Date of Patent: June 26, 2018
    Assignee: Boomcloud 360, Inc.
    Inventors: Zachary Seldess, James Tracey, Alan Kraemer
  • Patent number: 9986363
    Abstract: An electronic inertial measurement unit (IMU) coupled to headtracking headphones. The IMU may track any movement of the user's head, such as the pitch, yaw, roll angles, acceleration, and elevation and record this information as position data. The position data may be transmitted to tools that use routing schemes contained within authoring applications to decode user orientation and create high quality interactive multichannel biphonic audio without any additional processing or filtering. If horizontal, vertical, and tilt orientating audio is required, the MI emitters may be moved around (giving them x,y,z coordinates) within a cube representing a three dimensional space to generate “M1 Cube Format” audio. For horizontal orienting audio, fewer mono bus outputs may be used to generate “M1 Cube Format” audio.
    Type: Grant
    Filed: March 3, 2017
    Date of Patent: May 29, 2018
    Assignee: Mach 1, Corp.
    Inventors: Dra{umlaut over (z)}en Bo{umlaut over (s)}njak, Dylan J. Marcus
  • Patent number: 9979829
    Abstract: Embodiments are described for a soundfield system that receives a transmitting soundfield, wherein the transmitting soundfield includes a sound source at a location in the transmitting soundfield. The system determines a rotation angle for rotating the transmitting soundfield based on a desired location for the sound source. The transmitting soundfield is rotated by the determined angle and the system obtains a listener's soundfield based on the rotated transmitting soundfield. The listener's soundfield is transmitted for rendering to a listener.
    Type: Grant
    Filed: March 13, 2014
    Date of Patent: May 22, 2018
    Assignee: Dolby Laboratories Licensing Corporation
    Inventor: Richard J. Cartwright
  • Patent number: 9973874
    Abstract: The methods and apparatus described herein optimally represent full 3D audio mixes (e.g., azimuth, elevation, and depth) as “sound scenes” in which the decoding process facilitates head tracking. Sound scene rendering can be performed for the listener's orientation (e.g., yaw, pitch, roll) and 3D position (e.g., x, y, z), and can be modified for a change in the listener's orientation or 3D position. As described below, the ability to render an audio object in both the near-field and far-field enables the ability to fully render depth of not just objects, but any spatial audio mix decoded with active steering/panning, such as Ambisonics, matrix encoding, etc., thereby enabling full translational head tracking (e.g., user movement) beyond simple rotation in the horizontal plane, or 6-degrees-of-freedom (6-DOF) tracking and rendering.
    Type: Grant
    Filed: June 16, 2017
    Date of Patent: May 15, 2018
    Assignee: DTS, Inc.
    Inventors: Edward Stein, Martin Walsh, Guangji Shi, David Corsello
  • Patent number: 9970779
    Abstract: The present invention relates to a method for providing a route guidance service for visually impaired people, the method comprising the steps of: when a predetermined application is selected through a user input, transmitting a request for a route guidance service together with location information acquired through the GPS of a user terminal simultaneously with execution of the selected application; servicing, by a route guidance server, search path information corresponding to an input destination on the basis of the location information received from the user terminal according to the route guidance service request from the user terminal; broadcasting, by the user terminal, an inquiry signal through a Bluetooth device search request, identifying an earphone by a device which transmits a response signal to the broadcasted inquiry signal, and performing paging with the identified earphone; and recognizing a user's walking direction on the basis of the search path information through outputting a signal by gy
    Type: Grant
    Filed: December 24, 2014
    Date of Patent: May 15, 2018
    Assignee: UNIST (ULSAN NATIONAL INSTITUTE OF SCIENCE AND TECHNOLOGY)
    Inventors: Nam Hun Kim, Dong Hwan Song, Yun Jae Lee, Kyoung In Beak, Hyun Seo Nam
  • Patent number: 9967691
    Abstract: A stereophonic sound recording method, apparatus and a terminal pertain to the field of audio and video technologies. The method includes acquiring an initial gesture parameter of the terminal when recording starts, where the terminal is equipped with two or more microphones; acquiring a current gesture parameter of the terminal in a recording process; acquiring a gesture change parameter of the terminal when it is determined, according to the current gesture parameter and initial gesture parameter of the terminal, that a gesture of the terminal changes; acquiring, according to the gesture change parameter of the terminal, a weight factor corresponding to the gesture change parameter of the terminal; and separately writing, according to the weight factor corresponding to the gesture change parameter of the terminal, audio data collected by the two or more microphones into a left channel and a right channel.
    Type: Grant
    Filed: February 29, 2016
    Date of Patent: May 8, 2018
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Li Liu, Qing Chang
  • Patent number: 9942687
    Abstract: Rendering audio for applications implemented in an MR or AR system, in a 3D environment. A method includes determining a location of a user device in the 3D environment. The method further includes accessing a set of spatial mapping data to obtain spatial mapping data for the determined location. The spatial mapping data includes spatial mapping of free-space points in the 3D environment. Data for each free-space point includes data related to audio characteristics at that free-space point. The spatial mapping data is based on data provided by users in the 3D environment. The method further includes applying the spatial mapping data for the determined location to one or more acoustic simulation filters. The method further includes using the one or more acoustic simulation filters with the spatial mapping data applied, rendering audio output for one or more applications implemented in the MR or AR system to a user.
    Type: Grant
    Filed: September 11, 2017
    Date of Patent: April 10, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Chemistruck, Hakon Strande, Ashutosh Vidyadhar Tatake, Noel Richard Cross
  • Patent number: 9936327
    Abstract: A method for mapping a plurality of input channels of an input channel configuration to output channels of an output channel configuration includes providing a set of rules associated with each input channel of the plurality of input channels, wherein the rules define different mappings between the associated input channel and a set of output channels. For each input channel of the plurality of input channels, a rule associated with the input channel is accessed, determination is made whether the set of output channels defined in the accessed rule is present in the output channel configuration, and the accessed rule is selected if the set of output channels defined in the accessed rule is present in the output channel configuration. The input channels are mapped to the output channels according to the selected rule.
    Type: Grant
    Filed: January 19, 2016
    Date of Patent: April 3, 2018
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Juergen Herre, Fabian Kuech, Michael Kratschmer, Achim Kuntz, Christoph Faller
  • Patent number: 9891884
    Abstract: A method for performing the following operations (not necessarily in the following order): (i) receiving by an augmented reality system, a series of images corresponding to views of the real world; (ii) processing, by the augmented reality system, the series of images to determine presence of a first object; (iii) determining, by the augmented reality system, that the first object meets a first set of conditions such that the first object belongs to a first object category; and (iv) responsive to the determination that the first object belongs to the first object category, providing an audio response in the form of one at least one of the following types of audio responses: communicating a predefined sound to an augmented reality user and/or changing audio characteristic(s) of a sound not generated by the augmented reality system which is being experienced by the augmented reality user.
    Type: Grant
    Filed: January 27, 2017
    Date of Patent: February 13, 2018
    Assignee: International Business Machines Corporation
    Inventors: Aaron K. Baughman, Nicholas A. McCrory, Diwesh Pandey, Rohit Pandey
  • Patent number: 9877116
    Abstract: A method of operating a hearing device comprising a first antenna, a first transceiver coupled to the first antenna, an acoustic output transducer, a microphone, and a processing unit, the processing unit being coupled to the first transceiver, the acoustic output transducer, and the microphone, the method includes: pairing the hearing device with an audio system; initiating detection of hearing device motion; sending position data indicative of a position of the hearing device to the audio system; wirelessly receiving a first audio stream based on the position data; converting the first audio stream to a first wireless input signal; mixing the first wireless input signal with an audio input signal from the microphone of the hearing device to form a mixed signal; processing the mixed signal to form an output signal; and converting the output signal to an audio output signal.
    Type: Grant
    Filed: December 18, 2014
    Date of Patent: January 23, 2018
    Assignee: GN Hearing A/S
    Inventor: Jesper Udesen
  • Patent number: 9843883
    Abstract: Provided is an improved method for source-independent sound field rotation for virtual and augmented reality applications. The method provides sound field rotation for any type of audio recording source without requiring special processing for different audio formats. The method provides an effective approach to rotate any audio source while preserving directional sound source information.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: December 12, 2017
    Assignee: QOSOUND, INC.
    Inventor: Huan-Yu Su
  • Patent number: 9813837
    Abstract: In some embodiments, methods for generating an object based audio program including screen-elated metadata indicative of at least one warping degree parameter for at least one audio object, or generating a speaker channel-based program including by warping audio content of an object based audio program to a degree determined at least in part by at least one warping degree parameter, or methods for decoding or rendering any such audio program. Other aspects are systems configured to perform such audio signal generation, decoding, or rendering, and audio processing units (e.g., decoders or encoders) including a buffer memory which stores at least one segment of any such audio program.
    Type: Grant
    Filed: November 11, 2014
    Date of Patent: November 7, 2017
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Charles Q. Robinson, Nicolas R. Tsingos, Freddie Sanchez
  • Patent number: 9788120
    Abstract: An audio playback device which plays back an audio object including an audio signal and playback position information indicating a position in a three-dimensional space at which a sound image of the audio signal is localized, includes: at least one speaker array; a converting unit which converts playback position information to corrected playback position information which is information indicating a position of the sound image on a two-dimensional coordinate system based on a position of the at least one speaker array; and a signal processing unit which localizes the sound image of the audio signal included in the audio object according to the corrected playback position information.
    Type: Grant
    Filed: December 7, 2015
    Date of Patent: October 10, 2017
    Assignee: Socionext Inc.
    Inventors: Shuji Miyasaka, Kazutaka Abe, Anh Tuan Tran, Yong Hwee Sim, Zong Xian Liu
  • Patent number: 9769589
    Abstract: Aspects of the present disclosure relate to techniques for processing a source audio signal in order to localize sounds. In particular, aspects of the present disclosure relate to sound localization techniques which externalize sounds for headphone audio, such as a virtual surround sound headphone system. In various implementations, room reverberations and other acoustic effects of the environment may be more accurately modeled using improved room reverberation models. For example, in some implementations, the underlying source signal may be filtered with a filter representing a room impulse response that is a combination of a stereo room impulse response and a mono room impulse response. By way of further example, in some implementations the source signal may be filtered with a combined impulse response filter that is derived from binaural recordings of simulated impulses recorded in a desired reverberant environment.
    Type: Grant
    Filed: September 26, 2014
    Date of Patent: September 19, 2017
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Frederick Umminger, Scott Wardle
  • Patent number: 9729995
    Abstract: An apparatus for generating a plurality of audio channels for a first speaker setup is characterized by an imaginary speaker determiner, an energy distribution calculator, a processor and a renderer. The imaginary speaker determiner is configured to determine a position of an imaginary speaker not contained in the first speaker setup to obtain a second speaker setup containing the imaginary speaker. The energy distribution calculator is configured to calculate an energy distribution from the imaginary speaker to the other speakers in the second speaker setup. The processor is configured to repeat the energy distribution to obtain a downmix information for a downmix from the second speaker setup to the first speaker setup. The renderer is configured to generate the plurality of audio channels using the downmix information.
    Type: Grant
    Filed: July 5, 2016
    Date of Patent: August 8, 2017
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Christian Borss, Christian Ertel, Johannes Hilpert, Achim Kuntz, Michael Fischer, Florian Schuh, Bernhard Grill
  • Patent number: 9712936
    Abstract: In general, techniques and devices are described for motion compensation. An example a device configured to compensate motion. The device includes a memory configured to store audio data associated with a three-dimensional (3D) soundfield and one or more processors. The one or more processors are configured to receive motion information indicating one or more movements associated with a capture of one or more audio objects of a three-dimensional (3D) soundfield by a microphone array, and to adjust virtual positioning information associated with one or more microphones of a microphone array to compensate one or more movements associated with a capture of one or more audio objects of the 3D soundfield by the microphone array. The one or more processors may also be configured to generate a motion-compensated bitstream based on the adjusted virtual positioning information.
    Type: Grant
    Filed: September 24, 2015
    Date of Patent: July 18, 2017
    Assignee: QUALCOMM Incorporated
    Inventor: Nils GĂĽnther Peters
  • Patent number: 9694285
    Abstract: According to one embodiment of the technology described herein, a audio headset system is provided, comprising: a speaker; a signal processor configured to process source audio received from an audio source, to produce processed audio from the source audio, and to output the processed audio to the speaker; and a control unit configured to control operation of the signal processor according to an audio profile, wherein the audio profile causes the signal processor to selectively mix, delay, phase shift, and equalize the source audio, thereby producing processed audio.
    Type: Grant
    Filed: June 6, 2016
    Date of Patent: July 4, 2017
    Assignee: Performance Designed Products LLC
    Inventors: Antonio Meneses, Gerard Lambert Block, Scott Michael Terrell, Thomas John Roberts
  • Patent number: 9648436
    Abstract: An augmented reality sound systems is disclosed. An augmented reality sound system includes a at least one microphone for receiving ambient sound and a memory storing one or more augmented reality sound profiles and a respective set of processing parameters. The system further includes a processor coupled to the memory and configured to generate augmented ambient sound from the ambient sound by reproducing the ambient sound in conjunction with processed sound superimposed over the ambient sound as directed by one or more of the set of processing parameters retrieved from the memory based on a selected augmented reality sound profile.
    Type: Grant
    Filed: September 1, 2015
    Date of Patent: May 9, 2017
    Assignee: Doppler Labs, Inc.
    Inventors: Noah Kraft, Richard Fritz Lanman, III, Jeff Baker, Gints Klimanis, Anthony Parks, Daniel C. Wiggins
  • Patent number: 9554227
    Abstract: An audio signal processing apparatus including an index estimation unit that receives three-dimensional image information as an input and generates index information for applying a three-dimensional effect to an audio object in at least one direction of right, left, up, down, front, and back directions, based on the three-dimensional image information; and a rendering unit for applying a three-dimensional effect to the audio object in at least one direction of right, left, up, down, front, and back directions, based on the index information.
    Type: Grant
    Filed: July 30, 2012
    Date of Patent: January 24, 2017
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sun-min Kim, Young-woo Lee, Yoon-jae Lee
  • Patent number: 9549276
    Abstract: Disclosed are an audio apparatus and an audio providing method thereof. The audio providing method includes receiving an audio signal including a plurality of channels, applying an audio signal having a channel, from among the plurality of channels, giving a sense of elevation to a filter to generate a plurality of virtual audio signals to be respectively output to a plurality of speakers, applying a combination gain value and a delay value to the plurality of virtual audio signals so that the plurality of virtual audio signals respectively output through the plurality of speakers form a sound field having a plane wave, and respectively outputting the plurality of virtual audio signals, to which the combination gain value and the delay value are applied, through the plurality of speakers. The filter processes the audio signal to have a sense of elevation.
    Type: Grant
    Filed: March 28, 2014
    Date of Patent: January 17, 2017
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sang-bae Chon, Sun-min Kim, Hyun Jo, Jeong-su Kim
  • Patent number: 9454967
    Abstract: An apparatus and method for generating a wave field synthesis (WFS) signal in consideration of a height of a speaker are disclosed. The WFS signal generation apparatus may include a waveform propagation distance determination unit to determine a propagation distance of a waveform propagate from a sound source based on a height of a speaker, and a WFS signal generation unit to generate a WFS signal corresponding to the speaker using the propagation distance of the waveform.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: September 27, 2016
    Assignee: Electronics and Telecommunications Research Instit
    Inventors: Jae-Hyoun Yoo, Keun Woo Choi, Jeong Il Seo, Kyeong Ok Kang
  • Patent number: 9454971
    Abstract: Higher Order Ambisonics (HOA) represents a complete sound field in the vicinity of a sweet spot, independent of loudspeaker set-up. The high spatial resolution requires a high number of HOA coefficients. In the invention, dominant sound directions are estimated and the HOA signal representation is decomposed into dominant directional signals in time domain and related direction information, and an ambient component in HOA domain, followed by compression of the ambient component by reducing its order. The reduced-order ambient component is transformed to the spatial domain, and is perceptually coded together with the directional signals. At receiver side, the encoded directional signals and the order-reduced encoded ambient component are perceptually decompressed, the perceptually decompressed ambient signals are transformed to an HOA domain representation of reduced order, followed by order extension.
    Type: Grant
    Filed: May 6, 2013
    Date of Patent: September 27, 2016
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Alexander Kruger, Sven Kordon, Johannes Boehm, Johann-Markus Batke
  • Patent number: 9420392
    Abstract: A virtual reality system is operated by, detecting a spatial position of a head of a first person who is wearing virtual reality glasses and headphones, displaying a virtual object within a virtual environment from a virtual direction of view by the virtual reality glasses. The virtual direction of view is specified depending on the detected spatial position of the head. An acoustic recording is reproduced by the headphones. A speech sound of a second person is detected a microphone device and converted into a speech signal. The speech signal is also reproduced by the headphones, the left and right loudspeakers of the headphones being operated depending on the detected spatial position of the head such that the speech signal is reproduced by the loudspeakers as if the speech sound were to pass to the first person without the headphones being worn.
    Type: Grant
    Filed: June 3, 2015
    Date of Patent: August 16, 2016
    Assignee: AUDI AG
    Inventors: Marcus Kuehne, Thomas Zuchtriegel
  • Patent number: 9402144
    Abstract: An apparatus for changing an audio scene has a direction determiner and an audio scene processing apparatus. The audio scene has at least one audio object having an audio signal and associated meta data. The direction determiner determines a direction of a position of the audio object with respect to a reference point based on the meta data of the audio object. Further, the audio scene processing device processes the audio signal, a processed audio signal derived from the audio signal or the meta data of the audio object based on a determined directional function and the determined direction of the position of the audio object.
    Type: Grant
    Filed: December 20, 2012
    Date of Patent: July 26, 2016
    Assignee: IOSONO GmbH
    Inventors: Frank Melchior, Robert Steffens, Andreas Partzsch, Uwe Michaelis
  • Patent number: 9397771
    Abstract: Representations of spatial audio scenes using higher-order Ambisonics HOA technology typically require a large number of coefficients per time instant. This data rate is too high for most practical applications that require real-time transmission of audio signals. According to the invention, the compression is carried out in spatial domain instead of HOA domain. The (N+1)2 input HOA coefficients are transformed into (N+1)2 equivalent signals in spatial domain, and the resulting (N+1)2 time-domain signals are input to a bank of parallel perceptual codecs. At decoder side, the individual spatial-domain signals are decoded, and the spatial-domain coefficients are transformed back into HOA domain in order to recover the original HOA representation.
    Type: Grant
    Filed: December 21, 2011
    Date of Patent: July 19, 2016
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peter Jax, Johann-Markus Batke, Johannes Boehm, Sven Kordon
  • Patent number: 9377941
    Abstract: A method consistent with certain implementations involves in an audio system having an array of a plurality of loudspeakers and a stored speaker map identifying the geometric relationship between the plurality of loudspeakers and a listening position, identifying a location on the speaker map of a Source Origin of a sound; selecting a method of localizing the Source Origin from a plurality of methods of localizing the Source Origin utilizing the array of loudspeakers; and reproducing the sound emanating from the Source Origin using the selected method. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.
    Type: Grant
    Filed: September 1, 2011
    Date of Patent: June 28, 2016
    Assignee: SONY CORPORATION
    Inventors: Andy Nguyen, Ted Dunn, Lobrenzo Wingo, Djung Nguyen, Nobukazu Sugiyama
  • Patent number: 9358454
    Abstract: According to one embodiment of the technology described herein, a audio headset system is provided, comprising: a speaker; a signal processor configured to process source audio received from an audio source, to produce processed audio from the source audio, and to output the processed audio to the speaker; and a control unit configured to control operation of the signal processor according to an audio profile, wherein the audio profile causes the signal processor to selectively mix, delay, phase shift, and equalize the source audio, thereby producing processed audio.
    Type: Grant
    Filed: September 12, 2013
    Date of Patent: June 7, 2016
    Assignee: Performance Designed Products LLC
    Inventors: Antonio Meneses, Gerard Lambert Block, Scott Michael Terrell, Thomas John Roberts
  • Patent number: 9271103
    Abstract: A device may be configured to sense its own orientation with respect to a coordinate system, and to also sense the orientation of a user's head with respect to the device. The device may then determine whether the device orientation has changed with respect to the coordinate system and/or whether the head orientation has changed with respect to the device. Audio signal generation in the device may then be controlled based on the determination. For example, the position of a simulated sound source may be changed in a 3-D audio field based on determined changes in device and/or head orientation. The audio signal may then be transmitted from the device to an apparatus configured to generate sound based on the audio signal (e.g., headphones).
    Type: Grant
    Filed: March 29, 2012
    Date of Patent: February 23, 2016
    Assignee: Intel Corporation
    Inventor: Kevin C. Wells
  • Patent number: 9271081
    Abstract: A method for sound field reproduction into a listening area of spatially encoded first audio input signals according to sound field description data using an ensemble of physical loudspeakers. The method includes computing reproduction subspace description data from loudspeaker positioning data describing the subspace in which virtual sources can be reproduced with the physically available setup. Then, second and third audio input signals with associated sound field description data, in which second audio input signals include spatial components of the first audio input signals located within the reproducible subspace and third audio input signals include spatial components of the first audio input signals located outside of the reproducible subspace. A spatial analysis is performed on second audio input signals to extract fourth audio input signals corresponding to localizable sources within the reproducible subspace with associated source positioning data.
    Type: Grant
    Filed: August 25, 2011
    Date of Patent: February 23, 2016
    Assignee: SoniceMotion AG
    Inventors: Etienne Corteel, Matthias Rosenthal
  • Patent number: 9264813
    Abstract: A speaker system includes a first array of transducers in a speaker enclosure and, and at least a second array of transducers in the speaker enclosure. The second array is a low-frequency array and the first array is a high-frequency array. The transducers in the first array are configured to have an operating frequency region covering at least the frequency ranges of the first array and the second array, and the transducers in the second are configured to have an operating frequency region covering at least the frequency ranges of the first array and the second array. The speaker system further includes an input port, and a controller operatively coupled with the input port. The controller is configured to provide an electronic-audio signal to the transducers such that the first array and the second array are tuned to different center frequencies and are a two stage dipole beamforming array.
    Type: Grant
    Filed: March 1, 2011
    Date of Patent: February 16, 2016
    Assignee: Logitech, Europe S.A.
    Inventors: Jason Riggs, Jason N. Linse, Rong Hu, Joy E. Lyons