Virtual Positioning Patents (Class 381/310)
  • Patent number: 11405738
    Abstract: Disclosed is an apparatus and method for processing a multichannel audio signal. A multichannel audio signal processing method may include: generating an N-channel audio signal of N channels by down-mixing an M-channel audio signal of M channels; and generating a stereo audio signal by performing binaural rendering of the N-channel audio signal.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: August 2, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Yong Ju Lee, Jeong Il Seo, Seung Kwon Beack, Kyeong Ok Kang, Jin Woong Kim, Jae Hyoun Yoo
  • Patent number: 11386913
    Abstract: Methods (700, 800, 900), systems (200, 300, 400, 500, 600) and computer program products are provided. Location metadata (620) associated with an audio object is received (801). The location metadata defines a position of the audio object in an audio scene. It is estimated (630, 802), based on the location metadata, whether the audio object includes dialog. A value representative of a result of the estimation is assigned (803) to an object type parameter (231). In some example embodiments, audio objects are selected (661, 662, 804) based on values of their respective of object type parameters. In some example embodiments, at least one of the selected audio objects is submitted to dialog enhancement (690, 807).
    Type: Grant
    Filed: July 26, 2018
    Date of Patent: July 12, 2022
    Assignee: Dolby Laboratories Licensing Corporation
    Inventor: Mark William Gerrard
  • Patent number: 11337020
    Abstract: An apparatus comprising means for: obtaining an indication of a position of at least one user in real space; mapping the position of the user in real space to a position of the user in a sound space; and controlling an output audio signal, for rendering a sound scene via multiple audio channels, to provide rendering of a first sub-set of sound sources via at least a first sub-set of the multiple audio output channels and rendering a second sub-set of sound sources via at least a second sub-set of the multiple audio output channels, wherein an allocation of a plurality of sound sources to the first sub-set of sound sources or the second sub-set of sound sources is dependent upon at least a position of the user in the sound space; wherein an allocation of the multiple audio output channels to the first sub-set of the multiple audio output channels or the second sub-set of the multiple audio output channels is dependent upon available audio paths for the multiple audio output channels.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: May 17, 2022
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Jussi Leppänen, Lasse Laaksonen, Arto Lehtiniemi, Antti Eronen
  • Patent number: 11336998
    Abstract: Techniques for estimating a direction of arrival of sound in an environment are discussed. First and second audio data are received from a first pair of audio sensors associated with a vehicle. A first region of ambiguity associated with the first pair of audio sensors is determined based on the first and second audio data. Third and fourth audio data are received from a second pair of audio sensors. A second region of ambiguity associated with the second pair of audio sensors is determined based on the third and fourth audio data. The regions of ambiguity can be further based on confidence levels associated with sensor or audio data. An area of intersection of the first region of ambiguity and the second region of ambiguity can be determined. A direction of arrival of an audio event can be determined based on the area of intersection.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: May 17, 2022
    Assignee: Zoox, Inc.
    Inventors: Venkata Subrahmanyam Chandra Sekhar Chebiyyam, Nam Gook Cho, Nathan Duarte, Subasingha Shaminda Subasingha
  • Patent number: 11330372
    Abstract: Example embodiments disclosed herein relate to orientation-aware surround sound playback. A method for processing audio on an electronic device that includes a plurality of loudspeakers is disclosed, the loudspeakers arranged in more than one dimension of the electronic device. The method includes, responsive to receipt of a plurality of received audio streams, generating a rendering component associated with the plurality of received audio streams, determining an orientation dependent component of the rendering component, processing the rendering component by updating the orientation dependent component according to an orientation of the loudspeakers and dispatching the received audio streams to the plurality of loudspeakers for playback based on the processed rendering component. Corresponding system and computer program products are also disclosed.
    Type: Grant
    Filed: November 19, 2020
    Date of Patent: May 10, 2022
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Xuejing Sun, Guilin Ma, Xiguang Zheng
  • Patent number: 11317236
    Abstract: An example device includes a memory configured to store at least one spatial component and at least one audio source within a plurality of audio streams. The device also includes one or more processors coupled to the memory. The one or more processors are configured to receive, from motion sensors, rotation information. The one or more processors are configured to rotate the at least one spatial component based on the rotation information to form at least one rotated spatial component. The one or more processors are also configured to reconstruct ambisonic signals from the at least one rotated spatial component and the at least one audio source, wherein the at least one spatial component describes spatial characteristics associated with the at least one audio source in a spherical harmonic domain representation.
    Type: Grant
    Filed: November 18, 2020
    Date of Patent: April 26, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Ferdinando Olivieri, Taher Shahbazi Mirzahasanloo, Nils Günther Peters
  • Patent number: 11310616
    Abstract: A method for decoding a bitstream by an apparatus, includes obtaining a decoded audio signal and metadata from the bitstream, the metadata comprising scene orientation information; and rendering the decoded audio signal based on the scene orientation information, wherein the scene orientation information is information for a direction of a video scene related to the decoded audio signal.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: April 19, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Tung Chin Lee, Sejin Oh
  • Patent number: 11308707
    Abstract: Provided is an automatic grading method including calculating a first strain ratio between a three-dimensional (3D) source avatar and a 3D target avatar, determining a mapping relationship between 3D source garment draped over the source avatar and a body portion of the source avatar, converting the source garment into 3D target garment draped over the target avatar, based on the first strain ratio and the mapping relationship, and outputting a two-dimensional (2D) target pattern constituting the target garment.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: April 19, 2022
    Assignee: CLO VIRTUAL FASHION INC.
    Inventor: Seungwoo Oh
  • Patent number: 11302339
    Abstract: An apparatus for spatial audio signal decoding associated with a plurality of speaker nodes (201, 203, 205, 207, 209) placed within a three dimensional space, the apparatus comprising at least one processor and at least one memory including a computer program code. The at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to determine a non-overlapping virtual surface arrangement (400), the virtual surface arrangement (400) comprising a plurality of virtual surfaces (421, 423, 431, 433) with corners positioned at at least three speaker nodes of the plurality of speaker nodes (201, 203, 205, 207, 209) and sides connecting pairs of corners configured to be non-intersecting with at least one defined virtual plane within the three dimensional space.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: April 12, 2022
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Mikko-Ville Laitinen, Juha Tapio Vilkamo, Tapani Pihlajakuja, Antti Johannes Eronen
  • Patent number: 11290836
    Abstract: A electronic device displays an image that has sound. One or more processors process the sound for the image into binaural sound for a user. The binaural sound has a sound localization point (SLP) with a coordinate location that occurs behind the image while the image is located a near-field distance from a head of the user.
    Type: Grant
    Filed: October 5, 2020
    Date of Patent: March 29, 2022
    Inventors: Glen A. Norris, Philip Scott Lyren
  • Patent number: 11284194
    Abstract: One or more embodiments include techniques for generating audio for a speaker system worn by a listener. The speaker system analyzes an audio input signal to determine that a sound component of the audio input signal has an apparent location that is at a vertical distance from a listener. The speaker system selects an externally facing speaker included in the speaker system that faces at least partially upward or at least partially downward based on the vertical distance from the listener. The speaker system transmits the sound component to the externally facing speaker.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: March 22, 2022
    Assignee: Harman International Industries, Incorporated
    Inventors: Stefan Marti, Joseph Verbeke
  • Patent number: 11284213
    Abstract: An audio system processes a multi-channel input audio signal into a stereo signal for left and right speakers, while preserving the spatial sense of the sound field of the input audio signal. The multi-channel input audio signal includes a first left-right channel pair including a left input channel and a right input channel, and a second left-right channel pair including a left peripheral input channel and a right peripheral input channel. Subband spatial processing may be applied to the first and second left-right channel pairs. A first crosstalk processing is applied to the first left-right channel pair to generate first crosstalk processed channels. A second crosstalk processing is applied to the second left-right channel pair to generate second crosstalk processed channels. A left output channel and a right output channel are generated from the first and second crosstalk processed channels. The crosstalk processing may include crosstalk cancellation or crosstalk simulation.
    Type: Grant
    Filed: October 9, 2020
    Date of Patent: March 22, 2022
    Assignee: Boomcloud 360 Inc.
    Inventor: Zachary Seldess
  • Patent number: 11240596
    Abstract: The present disclosure relates to systems and methods for directing the audio output of a wearable device having a plurality of speakers. In one implementation, the system may include an image sensor configured to capture one or more images from an environment of the user of the wearable apparatus, a plurality of speakers, and at least one processing device. The at least one processing device may be configured to analyze the one or more images to determine at least one indicator of head orientation of the user of the wearable apparatus, select at least one of the plurality of speakers based on the at least one indicator of head orientation, and output the audio to the user of the wearable apparatus via the selected at least one of the plurality of speakers.
    Type: Grant
    Filed: February 11, 2020
    Date of Patent: February 1, 2022
    Assignee: OrCam Technologies Ltd.
    Inventors: Yonatan Wexler, Amnon Shashua
  • Patent number: 11240621
    Abstract: A specification of a mesh of filters may be defined on a grid in a three-dimensional space presented in a user interface. A plurality of sound tracks may be determined, wherein each of the sound tracks is associated with a corresponding sound source that may be represented in the three-dimensional space along with a listener. Responsive to user configuration of a position of the listener and/or positions of the sound sources in the three-dimensional space, a plurality of filters may be selected based on the mesh of filters and the positions of the sound sources and the listener in the three-dimensional space. Each of the filters may be applied to a corresponding one of the plurality of sound tracks to generate a plurality of filtered sound tracks and the three-dimensional sound may be generated based on the plurality of filtered sound tracks.
    Type: Grant
    Filed: April 9, 2021
    Date of Patent: February 1, 2022
    Assignee: LI CREATIVE TECHNOLOGIES, INC.
    Inventors: Qi Li, Yin Ding, Jorel Olan, Jason Thai
  • Patent number: 11234095
    Abstract: An audio system (e.g., of an artificial reality headset) determines a position of the headset relative to a position of a head of a user wearing the headset. The determination is based in part on an image of a portion of the head from a tracking camera (e.g., eye tracking and/or face tracking) on the headset. The audio system adjusts an acoustic parameter based in part on the determined position of the headset. The audio system performs an action that uses the adjusted acoustic parameter.
    Type: Grant
    Filed: May 21, 2020
    Date of Patent: January 25, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Sang-Ik Cho, Pablo Francisco Faundez Hoffmann, Karol Constantine Hatzilias, Gregory Olegovic Andreev
  • Patent number: 11190897
    Abstract: An electronic device identifies a location of a physical object that is away from a listener. The electronic device convolves sound so the sound externally localizes as binaural sound to the physical object. The sound plays to the listener through earphones so the listener hears the sound as emanating from the physical object.
    Type: Grant
    Filed: June 27, 2020
    Date of Patent: November 30, 2021
    Inventors: Glen A. Norris, Philip Scott Lyren
  • Patent number: 11134356
    Abstract: A speech providing device includes a memory that stores instructions, and a processor that executes the instructions. The instructions cause the processor to perform acquiring a position of a user and a direction that the user is facing, and providing a speech corresponding to an area existing in a direction that the user is facing on the basis of the position of the user, to the user.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: September 28, 2021
    Assignees: Yamaha Corporation, Fujitsu Limited
    Inventors: Jun Usui, Yukio Tada, Takahiro Asano, Toru Kamiwada, Hiroki Uchida, Tomomi Yokoyama
  • Patent number: 11115773
    Abstract: An audio system and a method of using the audio system to generate a head-related transfer function (HRTF) map, are described. The audio system can determine one or more HRTF and corresponding HRTF locations along an azimuthal path of an azimuth extending around a head of a user. The HRTFs or HRTF locations can be measured, and other HRTFs or HRTF locations can be interpolated or extrapolated. The HRTF map can include the HRTFs assigned to HRTF locations along the azimuth. HRTFs from the HRTF map are used to render spatial audio to the user. Other aspects are also described and claimed.
    Type: Grant
    Filed: September 4, 2019
    Date of Patent: September 7, 2021
    Assignee: APPLE INC.
    Inventors: Darius A. Satongar, Martin E. Johnson, Peter Victor Jupin, Jonathan D. Sheaffer
  • Patent number: 11109179
    Abstract: The present technology relates to a signal processing device, method, and program that can improve encoding efficiency. A signal processing device includes: an acquisition unit that acquires reverb information including at least one of space reverb information specific to a space around an audio object or object reverb information specific to the audio object and an audio object signal of the audio object; and a reverb processing unit that generates a signal of a reverb component of the audio object on the basis of the reverb information and the audio object signal. The present technology can be applied to a signal processing device.
    Type: Grant
    Filed: October 5, 2018
    Date of Patent: August 31, 2021
    Assignee: Sony Corporation
    Inventors: Hiroyuki Honma, Minoru Tsuji, Toru Chinen
  • Patent number: 11096006
    Abstract: The disclosed computer-implemented method may include capturing, via a headset microphone of a speaker's artificial reality device, voice input of a speaker in communication with a listener in an artificial reality environment. The method may include detecting a pose of the speaker within the artificial reality environment and determining a position of the speaker relative to a position of the listener within the artificial reality environment. The method may further include processing, based on the pose and the relative position of the speaker within the artificial reality environment, the voice input to create a directivity-attuned voice signal for the listener, and delivering the directivity-attuned voice signal to an artificial reality device of the listener. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: November 4, 2019
    Date of Patent: August 17, 2021
    Assignee: Facebook Technologies, LLC
    Inventor: Philip Robinson
  • Patent number: 11089422
    Abstract: A sound signal processor includes a memory storing instructions and a processor configured to implement the stored instructions to execute a plurality of tasks, the tasks including a receiving task configured to receive audio information, a sound source position setting task configured to set position information of a sound source based on the received audio information, and a sound image localization processing task configured to calculate an output level of a sound signal of the sound source for a plurality of speakers to thereby perform sound image localization processing of the sound source to localize a sound image of the sound source in a sound image localization position based on the set position information.
    Type: Grant
    Filed: April 1, 2020
    Date of Patent: August 10, 2021
    Assignee: YAMAHA CORPORATION
    Inventors: Akihiko Suyama, Ryotaro Aoki, Tatsuya Fukuyama
  • Patent number: 11062714
    Abstract: The present invention relates to an ambisonic encoder for a sound wave having a plurality of reflections. The ambisonic encoder according to the invention makes it possible to improve the sensation of immersion in a 3D audio scene. The complexity of encoding of the reflections of sound sources for an ambisonic encoder according to the invention is less than the complexity of encoding of the reflections of sound sources of an ambisonic encoder according to the prior art. The ambisonic encoder according to the invention makes it possible to encode a greater number of reflections of a sound source in real time. The ambisonic encoder according to the invention makes it possible to reduce the power consumption related to ambisonic encoding, and to increase the life of a battery of a mobile device used for said application.
    Type: Grant
    Filed: October 18, 2019
    Date of Patent: July 13, 2021
    Assignee: Mimi Hearing Technologies Gmbh
    Inventor: Pierre Berthet
  • Patent number: 11057729
    Abstract: A communication device includes a processor; a radio interface for connection to a radio unit; and an output interface; wherein the processor is configured to: obtain a first position signal indicative of first position of a first source; obtain a user position signal indicative of position of the user; obtain a direction signal indicative of a head direction of the user; determine a first angle between the head direction and a first direction from the user to the first source; determine a first filter function based on the first angle; apply the first filter function to a first audio signal for provision of a first left output signal and a first right output signal; and output a left signal and a right signal, wherein the left signal is based on the first left output signal, and wherein the right signal is based on the first right output signal.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: July 6, 2021
    Assignee: GN Hearing A/S
    Inventors: Casper Silbo Raft, Søren Christian Voigt Pedersen
  • Patent number: 11044555
    Abstract: An apparatus, electronic device, method and computer program wherein the apparatus includes: processing circuitry; and memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, enable the apparatus to perform: obtaining spatial information relating to a captured sound field from a first set of microphones; obtaining one or more signals from a second set of microphones where the one or more signals relate to the captured sound field; and using the obtained spatial information from the first set of microphones to process the one or more signals obtained from the second set of microphones; wherein the first set of microphones is provided within an electronic device and the second set of microphones is provided external to the electronic device.
    Type: Grant
    Filed: June 20, 2017
    Date of Patent: June 22, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Juha Vilkamo, Jussi Virolainen
  • Patent number: 10984197
    Abstract: An information transmission device includes: a determining unit that determines a situation of an interlocutor who interacts with a user; and a transmission unit that transmits, to the user, information to be provided according to the situation of the interlocutor determined by the determining unit. In a further modification of the invention, the determining unit may determine a situation related to a body or conversation of the interlocutor as the situation of the interlocutor.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: April 20, 2021
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Masahiro Sato, Kengo Tokuchi
  • Patent number: 10979846
    Abstract: An apparatus for audio signal rendering, the apparatus including at least one processor configured to: receive at least one microphone audio signal captured by at least one microphone within a capture environment; receive at least one projection audio signal, wherein the at least one projection audio signal is a room-impulse-response filtered at least one microphone audio signal within the capture environment; receive at least one residual audio signal, wherein the at least one residual audio signal is a result of removing the at least one projection audio signal from at least one audio signal captured by a microphone array within the capture environment; and generate at least two volumetric audio signals based on the at least one microphone audio signal, the at least one projection audio signal and the at least one residual audio signal.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: April 13, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppanen, Tapani Pihlajakuja
  • Patent number: 10959035
    Abstract: The present invention provides for an apparatus, system, and method for generating a head related audio transfer function in real time. Specifically, the present invention utilizes unique structural components including a tragus structure and an antihelix structure in connection with a microphone in order to communicate the location of a sound in three dimensional space to a user. The invention also utilizes an audio processor to digitally process the head related audio transfer function. The system may also be utilized to pan the directionality of audio sources within a virtual environment at least partially in response to movement of a user.
    Type: Grant
    Filed: August 2, 2019
    Date of Patent: March 23, 2021
    Assignee: BONGIOVI ACOUSTICS LLC
    Inventors: Joseph G. Butera, III, Mark J. Harpster, Ryan J. Copt, Litang Gu
  • Patent number: 10953327
    Abstract: The present invention is directed to systems, methods and apparatus for processing media content for reproduction by a first apparatus. The method includes obtaining pose information indicative of a position and/or orientation of a user. The pose information is transmitted to a second apparatus that provides the media content. The media content is rendered based on the pose information to obtain rendered media content. The rendered media content is transmitted to the first apparatus for reproduction. The present invention may include a first apparatus for reproducing media content and a second apparatus storing the media content. The first apparatus is configured to obtain pose information indicative and transmit the pose information to the second apparatus; and the second apparatus is adapted to: render the media content based on the pose information to obtain rendered media content; and transmit the rendered media content to the first apparatus for reproduction.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: March 23, 2021
    Assignees: Dolby Laboratories Licensing Corporation, Dolby International AB
    Inventors: Christof Fersch, Nicolas R. Tsingos
  • Patent number: 10950253
    Abstract: A vocal feedback device comprising: a microphone; a fundamental frequency accentuator electrically connected to the microphone, a delay circuit electrically connected to the fundamental frequency accentuator, and a speaker electrically connected to the delay circuit. The device configured to convert vocal utterances received at the microphone into an electrical signal, impose a time delay before transmitting the electrical signal, after the time delay, transmit the electrical signal to the speaker, and convert the electrical signal to an audio signal using the speaker, the audio signal being a replication of the vocal utterances.
    Type: Grant
    Filed: February 8, 2019
    Date of Patent: March 16, 2021
    Assignee: Board of Regents, The University of Texas System
    Inventors: Eric A. Freudenthal, Lluvia Mendiola, Vannesa Mueller, Celete Orozco, Kendra Rosales
  • Patent number: 10929608
    Abstract: An information transmission device includes: a determining unit that determines a situation of an interlocutor who interacts with a user; and a transmission unit that transmits, to the user, information to be provided according to the situation of the interlocutor determined by the determining unit. In a further modification of the invention, the determining unit may determine a situation related to a body or conversation of the interlocutor as the situation of the interlocutor.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: February 23, 2021
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Masahiro Sato, Kengo Tokuchi
  • Patent number: 10924879
    Abstract: A sound effect controlling method and a sound outputting device with dynamic gain adjustment are disclosed. The sound effect controlling method includes the following steps. An original left sound signal and an original right sound signal are transformed to a virtual center sound signal, a virtual left sound signal, a virtual left surrounding sound signal, a virtual right surrounding sound signal and a virtual right sound signal according to a center gain, a left gain, a left surrounding gain, a right surrounding gain and a right gain, which are calculated according to a rotation angle and a dual sound relationship. An updated left sound signal and an updated right sound signal are obtained according to the virtual center sound signal, the virtual left sound signal, the virtual left surrounding sound signal, the virtual right surrounding sound signal and the virtual right sound signal.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: February 16, 2021
    Assignee: ACER INCORPORATED
    Inventors: Po-Jen Tu, Jia-Ren Chang, Kai-Meng Tzeng
  • Patent number: 10871939
    Abstract: A virtual reality (VR) audio rendering system and method of using HRTF functions to quickly capture new positional cues to pre-computed audio frames responsive to changes in user position relative to sound systems. In a client-server VR system, when a user position change is detected, the client determines an appropriate HRTF based on the new position and convolves them with a set of audio frames that have been generated by the server based on a prior position, resulting in modified frames for rendering. Meanwhile, the client propagates the new position to the server to generate subsequent audio frames for the corrected position. As HRTF convolution is computationally inexpensive, the latency between user position change and the resultant sound change as perceived by the user can be significantly reduced. As a result, an immersive VR experience of the user can be preserved.
    Type: Grant
    Filed: November 7, 2018
    Date of Patent: December 22, 2020
    Assignee: NVIDIA Corporation
    Inventors: Ambrish Dantrey, Abhijit Patait, Utkarsh Patankar
  • Patent number: 10869155
    Abstract: Apparatus including a processor configured to: provide a position for at least one sound source relative to a reference position; analyse at least one input audio signal associated with the at least one sound source to determine at least one gain value based on the at least one input audio signal and the position for the at least one sound source relative to the reference position; and synthesize at least two output channels based on the at least one input audio signal, a directional transfer function pair, the at least one gain value and the position for the at least one sound source relative to the reference position.
    Type: Grant
    Filed: September 14, 2017
    Date of Patent: December 15, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Jorma Makinen, Mikko Tammi, Mikko-Ville Laitinen, Jussi Virolainen
  • Patent number: 10848873
    Abstract: Example embodiments disclosed herein relate to orientation-aware surround sound playback. A method for processing audio on an electronic device that includes a plurality of loudspeakers is disclosed, the loudspeakers arranged in more than one dimension of the electronic device. The method includes, responsive to receipt of a plurality of received audio streams, generating a rendering component associated with the plurality of received audio streams, determining an orientation dependent component of the rendering component, processing the rendering component by updating the orientation dependent component according to an orientation of the loudspeakers and dispatching the received audio streams to the plurality of loudspeakers for playback based on the processed rendering component. Corresponding system and computer program products are also disclosed.
    Type: Grant
    Filed: July 22, 2019
    Date of Patent: November 24, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Xuejing Sun, Guilin Ma, Xiguang Zheng
  • Patent number: 10820097
    Abstract: The present document describes a method (700) for determining the position of at least one audio source (200). The method (700) includes capturing (701) first and second microphone signals at two or more microphone arrays (210, 220, 230), wherein the two or more microphone arrays (210, 220, 230) are placed at different positions. The two or more microphone arrays (210, 220, 230) each comprise at least a first microphone capsule to capture a first microphone signal and a second microphone capsule to capture a second microphone signal, wherein the first and second microphone capsules have differently oriented spatial directivities. Furthermore, the method (700) comprises determining (702), for each microphone array (210, 220, 230) and based on the respective first and second microphone signals, an incident direction (211, 221, 231) of at least one audio source (200) at the respective microphone array (210, 220, 230).
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: October 27, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Nicolas R. Tsingos, Pradeep Kumar Govindaraju
  • Patent number: 10798516
    Abstract: The present disclosure relates to an information processing apparatus and method capable of performing compensation to achieve a standard sound regardless of a recording environment. The microphone picks up sound from a sound source and inputs the sound to a recording apparatus as an analog audio signal. The recording apparatus is an apparatus that performs binaural recording and generates an audio file of a sound obtained by binaural recording. The recording apparatus adds metadata related to a recording environment of binaural content to the audio file generated by binaural recording and transmits the file with the metadata to a reproducing apparatus. The present disclosure is applicable to a recording/reproducing system that performs binaural recording and reproduction of the sound, for example.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: October 6, 2020
    Assignee: SONY CORPORATION
    Inventors: Shigetoshi Hayashi, Kohei Asada, Yushi Yamabe
  • Patent number: 10764705
    Abstract: A method comprising: causing classification of sound objects, within a rendered virtual space, as a first class of sound object or a second class of sound object in dependence upon historic action of a user within the virtual space; rendering one or more sound objects of the first class according to at least first rules; and rendering one or more sound objects of the second class according to at least second rules, different to the first rules, and a current position of the user within the virtual space.
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: September 1, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Lasse Laaksonen, Miikka Vilermo, Mikko Tammi, Arto Lehtiniemi
  • Patent number: 10694310
    Abstract: An input unit receives input of an assumed listening position of sound of an object, which is a sound source, and outputs assumed listening position information indicating the assumed listening position. A position information correction unit corrects position information of each object on the basis of the assumed listening position information to obtain corrected position information. A gain/frequency characteristic correction unit performs gain correction and frequency characteristic correction on a waveform signal of an object on the basis of the position information and the corrected position information. A spatial acoustic characteristic addition unit further adds a spatial acoustic characteristic to the waveform signal resulting from the gain correction and the frequency characteristic correction on the basis of the position information of the object and the assumed listening position information. The present technology is applicable to an audio processing device.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: June 23, 2020
    Assignee: SONY CORPORATION
    Inventors: Minoru Tsuji, Toru Chinen
  • Patent number: 10674268
    Abstract: A method for operating a wearable loudspeaker device that is worn on the upper part of the body of a user distant to the user's ears and head comprises determining sensor data, based on the sensor data, and determining at least one parameter related to the current position of the user's head in relation to the wearable loudspeaker device. The method further includes adapting a filter transfer function of at least one filter unit for the current position of the user's head based on the at least one parameter, and an audio output signal that is output to at least one loudspeaker of the wearable loudspeaker device depends on the filter transfer function.
    Type: Grant
    Filed: August 3, 2017
    Date of Patent: June 2, 2020
    Assignee: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
    Inventor: Genaro Woelfl
  • Patent number: 10659896
    Abstract: A method provides binaural sound to a user. An intelligent personal assistant selects a location for the user where the user hears binaural sound that emanates from a sound localization point (SLP) in empty space away from a head of the user. A wearable electronic device (WED) receives a voice command from the user to move the SLP to another location.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: May 19, 2020
    Inventors: Glen A. Norris, Philip Scott Lyren
  • Patent number: 10645489
    Abstract: A sound system for a vehicle including an engine and an audio device for an internal space of a cabin as sound sources disposed at given positions of the vehicle is provided which includes an engine sound localizer configured to localize a first sound generated by the engine to cause a vehicle driver inside the cabin to hear the first sound from a first position, and change the first position, and a traveling state detector configured to detect a traveling state of the vehicle. The engine sound localizer normally sets the first position at a default position and, when a given traveling state is detected by the traveling state detector, changes the first position to a specific position at which the vehicle driver is able to recognize the engine sound more clearly than at the default position.
    Type: Grant
    Filed: May 7, 2018
    Date of Patent: May 5, 2020
    Assignee: Mazda Motor Corporation
    Inventors: Isao Toda, Kenji Asada, Katsumasa Sogame, Hironobu Hashiguchi
  • Patent number: 10645512
    Abstract: A wearable electronic device (WED) worn on a head of a user displays first and second virtual images. A digital signal processor (DSP) processes sound to a first sound localization point (SLP) at the first virtual image and to a second SLP at the second virtual image. A command controls the first and second SLPs when a head orientation of the user is directed to the SLP.
    Type: Grant
    Filed: June 18, 2019
    Date of Patent: May 5, 2020
    Inventors: Glen A. Norris, Philip Scott Lyren
  • Patent number: 10645511
    Abstract: A digital signal processor (DSP) in headphones processes sound with head-related transfer functions (HRTFs) to produce binaural sound that externally localizes away from a head of a user wearing the headphones. The headphones include a microphone that receives a voice command that causes the headphones to move a location of the binaural sound.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: May 5, 2020
    Inventors: Glen A. Norris, Philip Scott Lyren
  • Patent number: 10638242
    Abstract: A digital signal processor (DSP) in headphones processes sound with head-related transfer functions (HRTFs) to produce binaural sound that externally localizes away from a head of a user wearing the headphones. The headphones include a microphone that receives a voice command to an intelligent personal assistant that causes the headphones to change a location of the binaural sound.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: April 28, 2020
    Inventors: Glen A. Norris, Philip Scott Lyren
  • Patent number: 10631114
    Abstract: A digital signal processor (DSP) in a wearable electronic device (WED) worn on a head of a user processes sound with head-related transfer functions (HRTFs) to produce binaural sound that externally localizes away from the head of the user wearing the WED. The WED includes a microphone that receives a voice command to an intelligent personal assistant that causes the WED to move a location of the binaural sound.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: April 21, 2020
    Inventors: Glen A. Norris, Philip Scott Lyren
  • Patent number: 10602297
    Abstract: The disclosure relates to a processing multi-channel audio signals, an example embodiment including a method of processing a multi-channel audio signal, the method comprising: determining a location of sound sources (101, 102) within the signal; applying a rotation operation to the signal, a direction of the rotation operation dependent on the location of the sound sources in the signal; and generating a rotated audio signal.
    Type: Grant
    Filed: December 1, 2017
    Date of Patent: March 24, 2020
    Assignee: NXP B.V.
    Inventors: Xueru Zhang, Eric Chambatte, Denis Kutuzov, Nilesh Madhu, Abid Rashid
  • Patent number: 10595146
    Abstract: An exemplary ambient sound extraction system accesses a location-confined A-format signal that includes a first set of audio signals captured by different capsules of a multi-capsule microphone disposed at a first location with respect to a capture zone of a real-world scene. The ambient sound extraction system also accesses a second set of audio signals captured by a plurality of microphones disposed at a plurality of other locations with respect to the capture zone. The ambient sound extraction system generates a location-diffused A-format signal. The location-diffused A-format signal includes a third set of audio signals that is based on the first and second sets of audio signals. Based on the location-diffused A-format signal, the ambient sound extraction system generates a location-diffused B-format signal representative of ambient sound in the capture zone. Corresponding methods are also disclosed.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: March 17, 2020
    Assignee: Verizon Patent and Licensing Inc.
    Inventor: Zhiguang Eric Zhang
  • Patent number: 10595148
    Abstract: The present technique relates to sound processing apparatus and method, and a program that can more efficiently reproduce sound; A sound processing apparatus includes: a head direction acquisition unit that acquires a head direction of a user listening to sound; a rotation matrix generation unit that selects two first rotation matrices on the basis of the head direction from a plurality of first rotation matrices for rotation in a first direction held in advance, selects one second rotation matrix on the basis of the head direction from a plurality of second rotation matrices for rotation in a second direction held in advance, and generates a third rotation matrix on the basis of the selected two first rotation matrices and the selected one second rotation matrix; and a head-related transfer function composition unit that composes an input signal in a spherical harmonic domain, a head-related transfer function in the spherical harmonic domain, and the third rotation matrix to generate a headphone drive signal
    Type: Grant
    Filed: December 22, 2016
    Date of Patent: March 17, 2020
    Assignee: Sony Corporation
    Inventors: Tetsu Magariyachi, Yuhki Mitsufuji, Yu Maeno
  • Patent number: 10595143
    Abstract: A method provides a voice in binaural sound to a user. A wearable electronic device (WED) selects head-related transfer functions (HRTFs) based on a distance between eyes of the user. A digital signal processor (DSP) in the WED processes the voice with the HRTFs to generate the voice in the binaural sound that localizes at a sound localization point (SLP) at a location in empty space to the user.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: March 17, 2020
    Inventors: Glen A. Norris, Philip Scott Lyren
  • Patent number: 10587974
    Abstract: Headphones include a digital signal processor (DSP) that processes sound into binaural sound that externally localizes to a user wearing the headphones at a sound localization point (SLP) in empty space at least one meter away from a head of the user. A microphone receives a voice command that executes to change the sound from playing as the binaural sound that externally localizes to the user at the SLP in empty space at least one meter away from the head of the user to playing as stereo sound.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: March 10, 2020
    Inventors: Glen A. Norris, Philip Scott Lyren