Reverberators Patents (Class 381/63)
  • Patent number: 11843910
    Abstract: The transfer function estimation device includes: a correlation matrix computing unit 43 computing a correlation matrix of N frequency domain signals y(f,l); a signal space basis vector computing unit 44 obtaining M vectors v1(f), . . . , vM(f) from eigenvectors of the correlation matrix from highest in the order of corresponding eigenvalues; and a plural RTF estimation unit 45 determining ti(f), . . . , tM(f) that satisfy the relationship of Expression (1), determining a matrix D(f) that is not a zero matrix and that makes ui(f), . . . , uM(f) defined by Expression (2) sparse in a time direction, determining ci,1(f), . . . , cM,N(f) that satisfy the relationship of Expression (3), and outputting c1(f)/c1,j(f), . . . , cM(f)/cM,j(f) as a relative transfer function, where j is an integer of 1 or more and not more than N.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: December 12, 2023
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventor: Satoru Emura
  • Patent number: 11812254
    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment.
    Type: Grant
    Filed: November 1, 2021
    Date of Patent: November 7, 2023
    Assignee: Adobe Inc.
    Inventors: Zhenyu Tang, Timothy Langlois, Nicholas Bryan, Dingzeyu Li
  • Patent number: 11805385
    Abstract: An audio signal processing method includes generating an initial reflected sound control signal according to a geometrical shape of a virtual space, generating a reverberant sound control signal using a reflected sound parameter of the virtual space, calculating timing of connection, the timing of connection being a point in time at which a volume of an initial reflected sound reproducible by the initial reflected sound control signal is a same as a volume of a reverberant sound reproducible by the reverberant sound control signal, based on the geometrical shape of the virtual space, and increasing, in a period of time before the timing of connection, a level of the reverberant sound control signal so as to cause the volume of the reverberant sound to be closer to the volume of the reverberant sound at the timing of connection.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: October 31, 2023
    Assignee: YAMAHA CORPORATION
    Inventors: Takayuki Watanabe, Dai Hashimoto, Hiroomi Shidoji
  • Patent number: 11778487
    Abstract: A scene-based beam generation method for ground-to-air coverage based on convex polygon subdivision is provided and includes: obtaining a collection of base station positions by using a method of universal transverse mercator projection; constructing a three-dimensional (3D) low altitude signal coverage area; performing convex polygon subdivision on the area to be covered; and generating a beam configuration of each base station. The method realizes generation of beam configurations of base stations in the 3D low altitude signal coverage area, overcomes a problem that the existing 17 kind of scene-based beams cannot realize the coverage of 3D area, overcomes a problem of mismatch between network state information and beam configuration caused by dynamic adjustment of beam configurations. The beam configurations generated by the method does not need to obtain the number of users in real time to adjust the beam, and has a good coverage ability.
    Type: Grant
    Filed: May 25, 2022
    Date of Patent: October 3, 2023
    Assignee: XIDIAN UNIVERSITY
    Inventors: Junyu Liu, Min Sheng, Songtao Lei, Ziye Zhang, Yan Shi, Yu Su, Jiandong Li
  • Patent number: 11750997
    Abstract: A signal processing system and method for delivering spatialized sound, comprising: a spatial mapping sensor, configured to map an environment, to determine at least a position of at least one listener and at least one object; a signal processor configured to: transform a received audio program according to a spatialization model comprising parameters defining a head-related transfer function, and an acoustic interaction of the object, to form spatialized audio; generate an array of audio transducer signals for an audio transducer array representing the spatialized audio; and a network port configured to communicate physical state information for the at least one listener through digital packet communication network.
    Type: Grant
    Filed: July 7, 2021
    Date of Patent: September 5, 2023
    Assignee: Comhear Inc.
    Inventors: Michael Binn, Jeffrey M. Claar, Henry R. Goldansky, James Satloff
  • Patent number: 11743645
    Abstract: In one implementation, a method of transforming a sound into a virtual sound for a synthesized reality (SR) setting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a microphone, a speaker, and a display. The method includes displaying, on the display, an image representation of a synthesized reality (SR) setting including a plurality of surfaces associated with an acoustic reverberation property of the SR setting. The method includes recording, via the microphone, a real sound produced in a physical setting. The method further includes generating, using the one or more processors, a virtual sound by transforming the real sound based on the acoustic reverberation property of the SR setting. The method further includes playing, via the speaker, the virtual sound.
    Type: Grant
    Filed: June 15, 2022
    Date of Patent: August 29, 2023
    Assignee: APPLE INC.
    Inventor: Avi Bar-Zeev
  • Patent number: 11736889
    Abstract: Methods, systems, and program products for generating a virtual studio are disclosed. In one embodiment a method includes processing image information for at least one pinna of a user to generate a head-related transfer function (HRTF) profile of the user. A studio model that includes a studio-specific acoustic profile is accessed such as by a virtual studio client application executing on a laptop. An audio configuration of the studio model is selected based on the studio-specific acoustic profile. An audio media source is activated and the audio configuration is applied in combination with the HRTF profile of the user to audio generated by the audio media source.
    Type: Grant
    Filed: March 20, 2021
    Date of Patent: August 22, 2023
    Assignee: EMBODYVR, INC.
    Inventors: Kaushik Sunder, Kieran Coulter, Kapil Jain
  • Patent number: 11716065
    Abstract: Systems and methods for limiting volume in an audio playback device using a feedback controller are disclosed herein. In one example, a gain stage modulates gain of an audio signal based in part on feedback from a downstream limiter. The gain stage receives a first audio signal as well as a feedback signal from the feedback controller. Based at least in part on the feedback signal from the feedback controller, the gain stage modulates a gain of the first audio signal to provide a second audio signal. The second audio signal is delivered to the limiter, which limits the second audio signal to produce an output signal. The output signal is played back via a transducer. The feedback controller receives a gain reduction value from the limiter and determines a feedback signal to provide to the gain stage upstream of the limiter.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: August 1, 2023
    Assignee: Sonos, Inc.
    Inventor: Aurelio Ramos
  • Patent number: 11694663
    Abstract: An effect addition device includes at least one processor that executes a time domain convolution process of convolving a first time domain data part of impulse response of sound effects with a time domain data on an original sound, a frequency domain convolution process of convoluting a second time domain data part of the impulse response data with the time domain data on the original sound, a convolution extension process of extending a convolved state(s) of an output signal(s) resulting from the time domain convolution process and/or the frequency domain convolution process by arithmetic processing which corresponds to an all-pass filter and/or arithmetic processing which corresponds to a comb filter, and a synthesized sound effect addition process of adding a sound effect which is synthesized by execution of the time domain convolution process, the frequency domain convolution process and the convolution extension process to the original sound.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: July 4, 2023
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Masuo Yokota
  • Patent number: 11688385
    Abstract: A method and apparatus for simulating reverberation in rendering systems. A decoder/renderer may determine how to simulate reverberation with reference to audio scene description format file information or other bitstream information regarding the virtual scene geometry, and/or a lookup table. Late reverberation may be generated based on reverberator parameters derived from the virtual scene geometry, including the lengths of delay lines, attenuation filter coefficients, and diffuse-to-direct ratio characteristics, using a feedback delay network. Early reverberation may be generated based on determining what potential reflecting elements in a virtual scene geometry are reflecting planes; this may involve the simulation of ray reflection, potentially through beam tracing.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: June 27, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Sujeet Mate, Jussi Leppanen, Pasi Liimatainen
  • Patent number: 11689873
    Abstract: Methods, systems, and computer program products for rending an audio object having an apparent size are disclosed. An audio processing system receives audio panning data including a first grid mapping first virtual sound sources in a space and speaker positions to speaker gains. The first grid specifies first speaker gains of the first virtual sound sources in the space. The audio processing system determines a second grid of second virtual sound sources in the space, including mapping the first virtual sound sources into the second virtual sound sources of the second virtual sources. The audio processing system selects at least one of the first grid or second grid for rendering an audio object based on an apparent size of the audio object. The audio processing system renders the audio object based on the selected grid or grids.
    Type: Grant
    Filed: August 2, 2021
    Date of Patent: June 27, 2023
    Assignee: Dolby International AB
    Inventors: Daniel Arteaga, Giulio Cengarle, Antonio Mateos Sole
  • Patent number: 11689879
    Abstract: The present invention relates to a method for generating a filter for an audio signal and a parameterization device for the same, and more particularly, to a method for generating a filter for an audio signal, to implement filtering of an input audio signal with a low computational complexity, and a parameterization device therefor.
    Type: Grant
    Filed: August 5, 2021
    Date of Patent: June 27, 2023
    Assignees: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC., GCOA CO., LTD.
    Inventors: Taegyu Lee, Hyunoh Oh
  • Patent number: 11670319
    Abstract: Techniques for regenerating reverberation include generating a reverberation signal based on a source signal and a response of a listening space, generating a compressed reverberation signal by increasing output levels of a first portion of the reverberation signal having output levels below a threshold level more than output levels of a second portion of the reverberation signal having output levels above the threshold level, and combining the compressed reverberation signal with the source signal to form an output signal for the listening space.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: June 6, 2023
    Assignee: Harman Becker Automotive Systems GMBH
    Inventors: Friedrich Von Tuerckheim, Stefan Finauer, Adrian Von Dem Knesebeck, Tobias Muench
  • Patent number: 11631393
    Abstract: Ray tracing is performed with sound sources and a listener position in a listening environment, to generate impulse responses associated with each of the sound sources. The impulse responses are combined to form a combined impulse response. One or more filters are determined, each corresponding to the sound sources, based on the combined impulse response and the impulse responses. Each filter serves as a correction factor that holds unique acoustic information for the sound source that the filter is associated with. The combined impulse response and the filters can be applied to one or more audio signals that contain the sound sources, resulting in audio having reverberation that is tailored to the various sound sources. Other aspects are described and claimed.
    Type: Grant
    Filed: September 8, 2021
    Date of Patent: April 18, 2023
    Assignee: Apple Inc.
    Inventors: Soenke Pelzer, David E. Romblom, Dirk Schroeder, Jonathan D. Sheaffer
  • Patent number: 11632646
    Abstract: Disclosed herein are systems and methods for generating and presenting virtual audio for mixed reality systems. A method may include determining a collision between a first object and a second object, wherein the first object comprises a first virtual object. A memory storing one or more audio models can be accessed. It can be determined if the one or more audio models stored in the memory comprises an audio model corresponding to the first object. In accordance with a determination that the one or more audio models comprises an audio model corresponding to the first object, an audio signal can be synthesized, wherein the audio signal is based on the collision and the audio model corresponding to the first object, and the audio signal can be presented to a user via a speaker of a head-wearable device.
    Type: Grant
    Filed: April 12, 2022
    Date of Patent: April 18, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Colby Nelson Leider, Justin Dan Mathew, Michael Z. Land, Blaine Ivin Wood, Jung-Suk Lee, Anastasia Andreyevna Tajik, Jean-Marc Jot
  • Patent number: 11599936
    Abstract: A mixed reality system for displaying virtual holograms using a head mounted display and a tracking device. The HMD has one or more cameras mounted on its exterior connected to a portable computing device. The cameras record what a user's eyes would see in the environment and project the images onto the screen panel display. The cameras also transmit tracking device data to a software application installed on a portable computing device. Light emitting diodes serve as tracking points for the detection algorithm. The tracking device can be configured to transmit data to the portable computing device via optical modulation. Less private radio frequency technologies can be employed such as Bluetooth or WiFi to enable one-way or two-way communication. In some embodiments, multiplexing can be implemented to enable identifying and differentiating multiple tracking devices in a single frame.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: March 7, 2023
    Inventor: David Rashkin
  • Patent number: 11589184
    Abstract: Methods and systems for intuitive spatial audio rendering with improved intelligibility are disclosed. By establishing a virtual association between an audio source and a location in the listener's virtual audio space, a spatial audio rendering system can generate spatial audio signals that create a natural and immersive audio field for a listener. The system can receive the virtual location of the source as a parameter and map the source audio signal to a source-specific multi-channel audio signal. In addition, the spatial audio rendering system can be interactive and dynamically modify the rendering of the spatial audio in response to a user's active control or tracked movement.
    Type: Grant
    Filed: March 21, 2022
    Date of Patent: February 21, 2023
    Assignee: SoundHound, Inc
    Inventor: Bernard Mont-Reynaud
  • Patent number: 11568852
    Abstract: An example reverberation device configured for use with a musical instrument is disclosed. The example reverberation device comprises: (a) an input amplifier configured to receive an input signal from the musical instrument and output an amplified input signal based on the received input signal; (b) an input transducer connected to the input amplifier and configured to transmit the amplified input signal; (c) a reverberation plate comprising a bended surface, wherein the reverberation plate is connected to the input transducer, and wherein the reverberation plate is configured to output the input signal as an output signal at the bended surface; (d) an output transducer connected to the reverberation plate at the bended surface and configured to transmit the output signal; and (e) an output amplifier configured to receive the transmitted output signal from the output transducer and output an amplified output signal.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: January 31, 2023
    Inventor: James Lenger
  • Patent number: 11568884
    Abstract: An analysis filter bank corresponding to a plurality of sub-bands, comprising: multiple sub-filters with different center frequencies which perform multiple complex-type first-order infinite impulse response filtering operations on an audio input signal to generate multiple sub-filter signals; a first set of binomial combiners, each of which performs a weighted-sum operation on a first number of the sub-filter signals with a first set of binomial weights to generate one of multiple sub-band signals; a second set of binomial combiners, each of which performs a weighted-sum operation on a second number of the sub-filter signals with a second set of binomial weights to generate one of multiple lower sub-band-edge signals or one of multiple higher sub-band-edge signals; and multiple envelope detection with decimation devices, which perform multiple envelope detection with decimation operations on the sub-band signals, the lower sub-band-edge signals, and the higher sub-band-edge signals to generate multiple fine
    Type: Grant
    Filed: May 24, 2021
    Date of Patent: January 31, 2023
    Inventor: Ming-Luen Liou
  • Patent number: 11570570
    Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reverberation of the input audio signal in the virtual environment.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: January 31, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Remi Samuel Audfray, Jean-Marc Jot, Samuel Charles Dicker
  • Patent number: 11488574
    Abstract: The implementation of modal processors, which involve the parallel combination resonant filters, may be costly for applications such as artificial reverberation that can require thousands of modes. In one embodiment, the input signal is decomposed into a plurality of subbands, the outputs of which are downsampled. In each downsampled band, resonant filters are applied at the downsampled sampling rate, and their output is upsampled and filtered to form the band output. In these and other embodiments, a feature of responses of the mode filters have been optimized to minimize an aspect of a residual error after a point in time.
    Type: Grant
    Filed: November 2, 2020
    Date of Patent: November 1, 2022
    Inventor: Jonathan Stuart Abel
  • Patent number: 11432071
    Abstract: Disclosed are techniques and devices which include a memory configured to store audio data within a first audio zone, or a second audio zone in a layered soundfield. The memory is coupled to one or more processors and the memory is configured to store the audio data in the first audio zone and the second audio data in the layered soundfield. The one or more processors are configured to receive an interaction command to control the audio data in the first audio zone and the second audio zone in the layered soundfield, and generate one or more indicators that the interaction command was received to control the audio data, in the first audio zone or the second audio zone of the layered soundfield.
    Type: Grant
    Filed: August 8, 2018
    Date of Patent: August 30, 2022
    Assignee: Qualcomm Incorporated
    Inventor: Nils Gunther Peters
  • Patent number: 11395090
    Abstract: An illustrative method for estimating a direct-to-reverberant ratio of a sound signal is described, wherein the direct-to-reverberant ratio is indicative of a ratio between direct sound received from a sound source and reverberated sound received from reflections in an environment of the sound source. The method includes determining a first energy value of a sound signal for a first time frame; assigning to an onset value of the first time frame a positive value, if the difference of the first energy value of the first time frame and a second energy value of a preceding second time frame is greater than a threshold, and a zero value otherwise; and determining the direct-to-reverberant ratio by providing an onset signal comprising the onset value to a machine learning algorithm, which has been trained to determine the direct-to-reverberant ratio based on the onset signal.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: July 19, 2022
    Assignees: Universität Zürich, Sonova AG
    Inventor: Ruksana Giurda
  • Patent number: 11363378
    Abstract: In one implementation, a method of transforming a sound into a virtual sound for a synthesized reality (SR) setting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a microphone, a speaker, and a display. The method includes displaying, on the display, an image representation of a synthesized reality (SR) setting including a plurality of surfaces associated with an acoustic reverberation property of the SR setting. The method includes recording, via the microphone, a real sound produced in a physical setting. The method further includes generating, using the one or more processors, a virtual sound by transforming the real sound based on the acoustic reverberation property of the SR setting. The method further includes playing, via the speaker, the virtual sound.
    Type: Grant
    Filed: November 3, 2020
    Date of Patent: June 14, 2022
    Assignee: APPLE INC.
    Inventor: Avi Bar-Zeev
  • Patent number: 11304000
    Abstract: A signal processing device includes a power estimating unit that treats the feature quantity of a signal including reverberation as the input; inputs an observation feature quantity corresponding to an observation signal to a neural network which is learnt in such a way that the estimate value of the feature quantity corresponding to the power of the signal having reduced reverberation, from among the input signal, is output; and estimates the estimate value of the feature quantity corresponding to the power of the signal having reduced reverberation and corresponding to the observation signal. Moreover, the signal processing device includes a regression coefficient estimating unit that uses the estimate value of the feature quantity corresponding to the power as obtained as the estimation result by the power estimating unit, and estimates a regression coefficient of the autoregressive process for generating the observation signal.
    Type: Grant
    Filed: August 1, 2018
    Date of Patent: April 12, 2022
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Keisuke Kinoshita, Tomohiro Nakatani, Marc Delcroix
  • Patent number: 11304017
    Abstract: Examples of the disclosure describe systems and methods for estimating acoustic properties of an environment. In an example method, a first audio signal is received via a microphone of a wearable head device. An envelope of the first audio signal is determined, and a first reverberation time is estimated based on the envelope of the first audio signal. A difference between the first reverberation time and a second reverberation time is determined. A change in the environment is determined based on the difference between the first reverberation time and the second reverberation time. A second audio signal is presented via a speaker of a wearable head device, wherein the second audio signal is based on the second reverberation time.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: April 12, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Mathieu Parvaix, Jean-Marc Jot, Colby Nelson Leider
  • Patent number: 11246002
    Abstract: Determination of a composite acoustic parameter value for a headset is presented herein. A directionally enhanced audio signal is generated based on audio signals from an acoustic sensor array and a spatial signal enhancement filter that is directed for enhancement of a sound source. A SNR improvement value is determined based on a SNR value of the directionally enhanced audio signal and a SNR value of an audio signal from an acoustic sensor of the acoustic sensor array. The SNR improvement value is input into a model that maps SNR improvement values to spatial acoustic parameters to determine a spatial acoustic parameter. A temporal acoustic parameter is determined based on the audio signals. The composite acoustic parameter value is determined based on the spatial acoustic parameter and a temporal acoustic parameter value. Audio content presented to a user is adjusted based in part on the composite acoustic parameter value.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: February 8, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Jacob Ryan Donley, Paul Thomas Calamia
  • Patent number: 11153685
    Abstract: The present technology relates to an audio output controller, an audio output control method, and a program that can improve sound quality. An audio output controller includes multiple speaker units installed so as to face different directions, outputs measurement sound from at least one speaker unit of the multiple speaker units, and controls a gain of the speaker unit on the basis of a reverberation characteristic when the measurement sound is measured by a microphone in a predetermined position. Measurement sound output from a speaker unit installed in another audio output controller is measured by the microphone. Alternatively, measurement sound output from an installed speaker unit is measured by the microphone. The present technology can be applied to a wireless speakers, for example.
    Type: Grant
    Filed: May 2, 2018
    Date of Patent: October 19, 2021
    Assignee: Sony Corporation
    Inventor: Yasuhiro Toguri
  • Patent number: 11133017
    Abstract: A system for enhancing artificial reverberation in a noisy listening space includes a sensor configured to generate a signal indicating a current noise level in a listening space, a loudspeaker configured to output sound in the listening space based on an output signal, and at least one processor.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: September 28, 2021
    Assignee: HARMAN BECKER AUTOMOTIVE SYSTEMS GmbH
    Inventors: Friedrich Von Tuerckheim, Stefan Finauer, Adrian Von Dem Knesebeck, Tobias Muench
  • Patent number: 11102603
    Abstract: Determination of material acoustic parameters for a headset is presented herein. A value of a material acoustic parameter is initialized. A simulation is performed using the value of the material acoustic parameter and a model. The model includes a three-dimensional representation of a local area occupied by the headset. During the simulation, the value of the material acoustic parameter is dynamically modified until a reverberation time calculated based on the modified value of the material acoustic parameter falls within a threshold value of a target reverberation time. The model is updated with the modified value of the material acoustic parameter. The model is used to determine one or more acoustic parameters. Audio content is rendered based on the one or more acoustic parameters so that the audio content appears originating from an object in the local area.
    Type: Grant
    Filed: May 28, 2019
    Date of Patent: August 24, 2021
    Assignee: Facebook Technologies, LLC
    Inventor: Carl Schissler
  • Patent number: 11074925
    Abstract: The disclosure describes one or more embodiments of an impulse response system that generates accurate and realistic synthetic impulse responses. For example, given an acoustic impulse response, the impulse response system can generate one or more synthetic impulse responses that modify the direct-to-reverberant ratio (DRR) of the acoustic impulse response. As another example, the impulse response system can generate one or more synthetic impulse responses that modify the reverberation time (e.g., T60) of the acoustic impulse response. Further, utilizing the synthetic impulse responses, the impulse response system can perform a variety of functions to improve a digital audio recording or acoustic measurement or prediction model.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: July 27, 2021
    Assignee: ADOBE INC.
    Inventor: Nicholas Bryan
  • Patent number: 11043207
    Abstract: A method, computer program product, and computer system for measuring, by a computing device, a plurality of Room Impulse Responses (RIRs) associated with a set of two or more microphones. At least a portion of the RIRs may be augmented. At least the portion of the RIRs may be converted to their respective Relative Transfer Function (RTF) representations. The RTF representations may be applied to training data to generate an acoustic model for automatic speech recognition.
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: June 22, 2021
    Assignee: Nuance Communications, Inc.
    Inventors: Dushyant Sharma, Sharmistha Sarkar Gray, Uwe Helmut Jost, Patrick A. Naylor
  • Patent number: 11037544
    Abstract: According to the present disclosure, a sound output device includes a sound acquisition part that acquires a sound signal generated from an ambient sound, a reverb process part that performs a reverb process on the sound signal, and a sound output part that outputs a sound generated from the sound signal subjected to the reverb process, to a vicinity of an ear of a listener. This configuration allows a listener to hear sound acquired in real time to which desired reverberation is added.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: June 15, 2021
    Assignee: SONY CORPORATION
    Inventors: Kohei Asada, Go Igarashi, Koji Nageno
  • Patent number: 10993028
    Abstract: A sound processing device includes: a sound source that outputs a common sound signal to a first speaker for a vehicle exterior and a second speaker for a vehicle interior that are mounted on the vehicle; a notification sound controller that outputs a signal corresponding to a notification sound for notifying an approach of the vehicle to the first speaker based on the sound signal output from the sound source; and an acceleration sound controller that outputs a signal corresponding to an acceleration sound of the vehicle to the second speaker based on the sound signal output from the sound source.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: April 27, 2021
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Fumiyasu Konno, Ichiro Ohno, Shinnosuke Nagasawa
  • Patent number: 10825443
    Abstract: The implementation of modal processors, which involve the parallel combination resonant filters, may be costly for applications such as artificial reverberation that can require thousands of modes. In one embodiment, the input signal is decomposed into a plurality of subbands, the outputs of which are downsampled. In each downsampled band, resonant filters are applied at the downsampled sampling rate, and their output is upsampled and filtered to form the band output.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: November 3, 2020
    Inventor: Jonathan Stuart Abel
  • Patent number: 10810992
    Abstract: Systems and methods for providing accurate and independent control of reverberation properties are disclosed. In some embodiments, a system may include a reverberation processing system, a direct processing system, and a combiner. The reverberation processing system can include a reverb initial power (RIP) control system and a reverberator. The RIP control system can include a reverb initial gain (RIG) and a RIP corrector. The RIG can be configured to apply a RIG value to the input signal, and the RIP corrector can be configured to apply a RIP correction factor to the signal from the RIG. The reverberator can be configured to apply reverberation effects to the signal from the RIP control system. In some embodiments, one or more values and/or correction factors can be calculated and applied such that the signal output from a component in the reverberation processing system is normalized to a predetermined value (e.g., unity (1.0)).
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: October 20, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Remi Samuel Audfray, Jean-Marc Jot, Samuel Charles Dicker
  • Patent number: 10789917
    Abstract: A sound processing device includes: a combining processor that combines a performance sound and a source sound, based on operation information corresponding to a performance operation on an instrument. The performance sound is obtained by picking up a sound generated by the performance operation on the instrument. The source sound is obtained from a sound source.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: September 29, 2020
    Assignee: YAMAHA CORPORATION
    Inventors: Masakazu Kato, Takashi Sakamoto, Hideaki Takehisa
  • Patent number: 10762914
    Abstract: Utilizing an adaptive multichannel technique to mitigate reverberation present in received audio signals, prior to providing corresponding audio data to one or more additional component(s), such as automatic speech recognition (ASR) components. Implementations disclosed herein are “adaptive”, in that they utilize a filter, in the reverberation mitigation, that is online, causal and varies depending on characteristics of the input. Implementations disclosed herein are “multichannel”, in that a corresponding audio signal is received from each of multiple audio transducers (also referred to herein as “microphones”) of a client device, and the multiple audio signals (e.g., frequency domain representations thereof) are utilized in updating of the filter—and dereverberation occurs for audio data corresponding to each of the audio signals (e.g., frequency domain representations thereof) prior to the audio data being provided to ASR component(s) and/or other component(s).
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: September 1, 2020
    Assignee: GOOGLE LLC
    Inventors: Joseph Caroselli, Arun Narayanan, Izhak Shafran, Richard Rose
  • Patent number: 10726855
    Abstract: Certain example embodiments relate to speech privacy systems and/or associated methods. The techniques described herein disrupt the intelligibility of the perceived speech by, for example, superimposing onto an original speech signal a masking replica of the original speech signal in which portions of it are smeared by a time delay and/or amplitude adjustment, with the time delays and/or amplitude adjustments oscillating over time. In certain example embodiments, smearing of the original signal may be generated in frequency ranges corresponding to formants, consonant sounds, phonemes, and/or other related or non-related information-carrying building blocks of speech. Additionally, or in the alternative, annoying reverberations particular to a room or area in low frequency ranges may be “cut out” of the replica signal, without increasing or substantially increasing perceived loudness.
    Type: Grant
    Filed: March 15, 2017
    Date of Patent: July 28, 2020
    Assignee: GUARDIAN GLASS, LLC.
    Inventor: Alexey Krasnov
  • Patent number: 10720137
    Abstract: Methods and systems for modifying ambient sound waves passing through a wall are disclosed. The wall has a first side and a second side with a cavity therebetween. A sound producing device is situated between the first side and the second side and is configured to produce interfering sound waves in the cavity such that the sound waves passing through the wall are reduced, masked, or reduced and masked.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: July 21, 2020
    Assignee: Hall Labs LLC
    Inventors: David Hall, Benjamin Jensen, Andrew Priddis, Nathan Davis
  • Patent number: 10674304
    Abstract: Provided is a signal processing apparatus that can replicate, in a real space, an environment different from the real space by granting an acoustic characteristic different from that of the real space, to a sound released in the real space. There is provided a signal processing apparatus including a control unit configured to decide a predetermined acoustic characteristic for causing a user to hear a collected ambient sound of the user in a space having a different acoustic characteristic, in accordance with content being reproduced, or an action of a user, and to add the decided acoustic characteristic to the ambient sound.
    Type: Grant
    Filed: September 21, 2016
    Date of Patent: June 2, 2020
    Assignee: SONY CORPORATION
    Inventors: Heesoon Kim, Masaharu Yoshino, Masahiko Inami, Kouta Minamizawa, Yuta Sugiura, Shunichi Kasahara
  • Patent number: 10595152
    Abstract: Diffuse or spatially large audio objects may be identified for special processing. A decorrelation process may be performed on audio signals corresponding to the large audio objects to produce decorrelated large audio object audio signals. These decorrelated large audio object audio signals may be associated with object locations, which may be stationary or time-varying locations. For example, the decorrelated large audio object audio signals may be rendered to virtual or actual speaker locations. The output of such a rendering process may be input to a scene simplification process. The decorrelation, associating and/or scene simplification processes may be performed prior to a process of encoding the audio data.
    Type: Grant
    Filed: June 14, 2018
    Date of Patent: March 17, 2020
    Assignees: Dolby Laboratories Licensing Corporation, Dolby International AB
    Inventors: Dirk Jeroen Breebaart, Lie Lu, Nicolas R. Tsingos, Antonio Mateos Sole
  • Patent number: 10559295
    Abstract: In music recording and virtual reality applications, it is desired to control the perceived size of a synthesized acoustic space. In an embodiment, a room size parameter is used to modify characteristics of an artificial reverberator so as to affect a listener's sense of the size of the acoustic space. Properties of the reverberation related to perceived room size such as decay time and equalization are adjusted interactively.
    Type: Grant
    Filed: December 7, 2018
    Date of Patent: February 11, 2020
    Inventor: Jonathan S. Abel
  • Patent number: 10499167
    Abstract: The application relates to a method of reducing reverberation in an audio processing device and to an audio processing device. The object of the present application is to provide an alternative method of reducing noise, e.g. reverberation, in a sound signal. The method comprises the steps of a) providing a time variant electric input signal representative of a sound; b) providing a logarithmic representation of said electric input signal; c) providing a predefined statistical model of the likelihood that a specific slope of the logarithmic representation of the electric input signal is due to reverberation; d) identifying time instances of the electric input signal being reverberant according to the statistical model; and e) applying an attenuation to the time instances identified as reverberant. This has the advantage of providing an enhanced sound signal. The invention may e.g. be used for enhancing noisy, e.g. reverberant, signals.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: December 3, 2019
    Assignee: OTICON A/S
    Inventors: Martin Kuriger, Bernhard Kuenzle
  • Patent number: 10477337
    Abstract: The present technology relates to an audio processing device, a method therefor, and a program therefor capable of achieving more flexible audio reproduction. An input unit receives input of an assumed listening position of sound of an object, which is a sound source, and outputs assumed listening position information indicating the assumed listening position. A position information correction unit corrects position information of each object on the basis of the assumed listening position information to obtain corrected position information. A gain/frequency characteristic correction unit performs gain correction and frequency characteristic correction on a waveform signal of an object on the basis of the position information and the corrected position information.
    Type: Grant
    Filed: January 6, 2015
    Date of Patent: November 12, 2019
    Assignee: SONY CORPORATION
    Inventors: Minoru Tsuji, Toru Chinen
  • Patent number: 10412490
    Abstract: A method of processing a series of microphone inputs of an audio conference, the method including the steps of: (a) conducting a spatial analysis and feature extraction of the audio conference based on current audio activity; (b) aggregating historical information to obtain information about the approximate relative location of recent sound objects relative to the series of microphone inputs; (c) utilizing the relative location or distance of the sound objects from the series of microphone inputs to determine if beam forming should be utilized to enhance the audio reception from recent sound objects.
    Type: Grant
    Filed: February 23, 2017
    Date of Patent: September 10, 2019
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: David Gunawan, Glenn N. Dickins
  • Patent number: 10405120
    Abstract: An audio object including audio content and object metadata is received. The object metadata indicates an object spatial position of the audio object to be rendered by audio speakers in a playback environment. Based on the object spatial position and source spatial positions of the audio speakers, initial gain values for the audio speakers are determined. The initial gain values can be used to select a set of audio speakers from among the audio speakers. Based on the object spatial position and a set of source spatial positions at which the set of audio speakers are respectively located in the playback environment, a set of non-negative optimized gain values for the set of audio speakers is determined. The audio object at the object spatial position is rendered with the set of optimized gain values for the set of audio speakers.
    Type: Grant
    Filed: July 11, 2017
    Date of Patent: September 3, 2019
    Assignees: Dolby Laboratories Licensing Corporation, Dolby International AB
    Inventors: Jun Wang, Giulio Cengarle, Juan Felix Torres, Daniel Arteaga
  • Patent number: 10382875
    Abstract: The present disclosure relates to reverberation generation for headphone virtualization. A method of generating one or more components of a binaural room impulse response (BRIR) for headphone virtualization is described. In the method, directionally-controlled reflections are generated, wherein directionally-controlled reflections impart a desired perceptual cue to an audio input signal corresponding to a sound source location. Then at least the generated reflections are combined to obtain the one or more components of the BRIR. Corresponding system and computer program products are described as well.
    Type: Grant
    Filed: October 18, 2018
    Date of Patent: August 13, 2019
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Louis D. Fielder, Zhiwei Shuang, Grant A. Davidson, Xiguang Zheng, Mark S. Vinton
  • Patent number: 10339907
    Abstract: A signal processing apparatus has a first memory in which plural pieces of FIR coefficient data used for implementing an FIR filter algorithm are stored, a second memory which stores plural pieces of input data to be subjected to the FIR filter algorithm, and a processor implements the FIR filter algorithm using the plural pieces of FIR coefficient data stored in the first memory and the plural pieces of input data stored in the second memory as many times as the number corresponding to a designated filter order, in which filter algorithm each piece of coefficient data and each piece of input data are multiplied together and resultant products are summed up. The signal processing apparatus is provided, which can implement plural sorts of FIR filter algorithms of filter order which can be changed flexibly.
    Type: Grant
    Filed: January 22, 2018
    Date of Patent: July 2, 2019
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Masuo Yokota
  • Patent number: 10313809
    Abstract: A method for estimating the acoustic reverberations in an environment comprising the following steps: a measurement step in which one acoustic signal emitted in the environment is captured; a step for determination of acoustic energy decay rate distribution during which an acoustic energy decay rate distribution is determined from the acoustic signal captured in step (a); an estimation step during which a reverberation time and a reverberation level of sound in the environment are estimated by regression from the characteristic function of the acoustic energy decay rate distribution determined in step (b).
    Type: Grant
    Filed: November 21, 2016
    Date of Patent: June 4, 2019
    Assignee: INVOXIA
    Inventors: Arthur Belhomme, Yves Grenier, Roland Badeau, Eric Humbert