EAR-COUPLING DETECTION AND ADJUSTMENT OF ADAPTIVE RESPONSE IN NOISE-CANCELING IN PERSONAL AUDIO DEVICES
A personal audio device, such as a wireless telephone, includes an adaptive noise canceling (ANC) circuit that adaptively generates an anti-noise signal from a reference microphone signal and injects the anti-noise signal into the speaker or other transducer output to cause cancellation of ambient audio sounds. An error microphone is also provided proximate the speaker to estimate an electro-acoustical path from the noise canceling circuit through the transducer. A processing circuit determines a degree of coupling between the user's ear and the transducer and adjusts the adaptive cancellation of the ambient sounds to prevent erroneous and possibly disruptive generation of the anti-noise signal if the degree of coupling lies either below or above a range of normal operating ear contact pressure.
This U.S. Patent Application Claims priority under 35 U.S.C. 119(e) to U.S. Provisional Patent Application Ser. No. 61/419,532 filed on Dec. 3, 2010 and to U.S. Provisional Patent Application Ser. No. 61/493,162 filed on Jun. 3, 2011.
BACKGROUND OF THE INVENTION1. Field of the Invention
The present invention relates generally to personal audio devices such as wireless telephones that include adaptive noise cancellation (ANC), and more specifically, to management of ANC in a personal audio device that is responsive to the quality of the coupling of the output transducer of the personal audio device to the user's ear.
2. Background of the Invention
Wireless telephones, such as mobile/cellular telephones, cordless telephones, and other consumer audio devices, such as mp3 players, are in widespread use. Performance of such devices with respect to intelligibility can be improved by providing noise canceling using a microphone to measure ambient acoustic events and then using signal processing to insert an anti-noise signal into the output of the device to cancel the ambient acoustic events.
Since the acoustic environment around personal audio devices, such as wireless telephones, can change dramatically, depending on the sources of noise that are present and the position of the device itself, it is desirable to adapt the noise canceling to take into account such environmental changes. However, the performance of an adaptive noise canceling system varies with how closely the transducer used to generate the output audio including noise-canceling information is coupled to the user's ear.
Therefore, it would be desirable to provide a personal audio device, including a wireless telephone, that provides noise cancellation in a variable acoustic environment and that can compensate for the quality of the coupling between the output transducer and the user's ear.
SUMMARY OF THE INVENTIONThe above stated objective of providing a personal audio device providing noise cancellation in a variable acoustic environment and that compensates for the quality of coupling between the output transducer and the user's ear, is accomplished in a personal audio device, a method of operation, and an integrated circuit.
The personal audio device includes a housing, with a transducer mounted on the housing for reproducing an audio signal that includes both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer. A reference microphone is mounted on the housing to provide a reference microphone signal indicative of the ambient audio sounds. The personal audio device further includes an adaptive noise-canceling (ANC) processing circuit within the housing for adaptively generating an anti-noise signal from the reference microphone signal such that the anti-noise signal causes substantial cancellation of the ambient audio sounds. An error microphone is included for correcting for the electro-acoustic path from the output of the processing circuit through the transducer and to determine the degree of coupling between the user's ear and the transducer and a secondary path estimating adaptive filter is used to correct the error microphone signal for changes due to the acoustic path from the transducer to the error microphone. The ANC processing circuit monitors the response of the secondary path adaptive filter and optionally the error microphone signal to determine the pressure between the user's ear and the personal audio device. The ANC circuit then takes action to prevent the anti-noise signal from being undesirably/erroneously generated due to the phone being away from the user's ear (loosely coupled) or pressed too hard on the user's ear.
The foregoing and other objectives, features, and advantages of the invention will be apparent from the following, more particular, description of the preferred embodiment of the invention, as illustrated in the accompanying drawings.
The present invention encompasses noise canceling techniques and circuits that can be implemented in a personal audio device, such as a wireless telephone. The personal audio device includes an adaptive noise canceling (ANC) circuit that measures the ambient acoustic environment and generates a signal that is injected into the speaker (or other transducer) output to cancel ambient acoustic events. A reference microphone is provided to measure the ambient acoustic environment and an error microphone is included to measure the ambient audio and transducer output at the transducer, thus giving an indication of the effectiveness of the noise cancellation. However, depending on the contact pressure between the user's ear and the personal audio device, the ANC circuit may operate improperly and the anti-noise may be ineffective or even worsen the audibility of the audio information being presented to the user. The present invention provides mechanisms for determining the level of contact pressure between the device and the user's ear and taking action on the ANC circuits to avoid undesirable responses.
Referring now to
Wireless telephone 10 includes adaptive noise canceling (ANC) circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. A reference microphone R is provided for measuring the ambient acoustic environment, and is positioned away from the typical position of a user's mouth, so that the near-end speech is minimized in the signal produced by reference microphone R. A third microphone, error microphone E, is provided in order to further improve the ANC operation by providing a measure of the ambient audio combined with the audio reproduced by speaker SPKR close to ear 5, when wireless telephone 10 is in close proximity to ear 5. Exemplary circuit 14 within wireless telephone 10 includes an audio CODEC integrated circuit 20 that receives the signals from reference microphone R, near speech microphone NS and error microphone E and interfaces with other integrated circuits such as an RF integrated circuit 12 containing the wireless telephone transceiver. In other embodiments of the invention, the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that contains control circuits and other functionality for implementing the entirety of the personal audio device, such as an MP3 player-on-a-chip integrated circuit.
In general, the ANC techniques of the present invention measure ambient acoustic events (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, the ANC processing circuits of illustrated wireless telephone 10 adapt an anti-noise signal generated from the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events present at error microphone E. Since acoustic path P(z) extends from reference microphone R to error microphone E, the ANC circuits are essentially estimating acoustic path P(z) combined with removing effects of an electro-acoustic path S(z). Electro-acoustic path S(z) represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment. S(z) is affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, when wireless telephone is not firmly pressed to ear 5. While the illustrated wireless telephone 10 includes a two microphone ANC system with a third near speech microphone NS, some aspects of the present invention may be practiced in a system in accordance with other embodiments of the invention that do not include separate error and reference microphones, or yet other embodiments of the invention in which a wireless telephone uses near speech microphone NS to perform the function of the reference microphone R. Also, in personal audio devices designed only for audio playback, near speech microphone NS will generally not be included, and the near-speech signal paths in the circuits described in further detail below can be omitted, without changing the scope of the invention, other than to limit the options provided for input to the microphone covering detection schemes.
Referring now to
Referring now to
To implement the above, adaptive filter 34A has coefficients controlled by SE coefficient control block 33, which compares downlink audio signal ds and error microphone signal err after removal of the above-described filtered downlink audio signal ds, that has been filtered by adaptive filter 34A to represent the expected downlink audio delivered to error microphone E, and which is removed from the output of adaptive filter 34A by a combiner 36A. SE coefficient control block 33 correlates the actual downlink speech signal ds with the components of downlink audio signal ds that are present in error microphone signal err. Adaptive filter 34A is thereby adapted to generate a signal from downlink audio signal ds (and optionally, the anti-noise signal combined by combiner 36B during muting conditions as described above), that when subtracted from error microphone signal err, contains the content of error microphone signal err that is not due to downlink audio signal ds. As will be described in further detail below, the overall energy of the error signal normalized to the overall energy of the response SE(z) is related to the quality of the seal between the user's ear and wireless telephone 10. An ear pressure indicator computation block 37 determines the ratio between E|e(n)|, which is the energy of the error signal generated by combiner 36 and the overall magnitude of the response of SE(z): Σ|SEn(z)|. Ear pressure indication E|e(n)|/Σ|SEn(z)| is only one possible function of e(n) and SEn(z) that may be used to yield a measure of ear pressure. For example, Σ|SEn(z)| or E SEn(z)2 which are functions of only SE(z) can alternatively be used, since response SE(z) changes with ear pressure. A comparator K1 compares the output of computation block 37 with a low pressure threshold VthL. If E|e(n)|/Σ|SEn(z)| is above the threshold, indicating that ear pressure is below the normal operating range (e.g., wireless telephone 10 is off of the user's ear) then ear pressure response logic is signaled to take action to prevent generation of undesirable anti-noise at the user's ear 5. Similarly, a comparator K2 compares the output of computation block with a high pressure threshold VthH and if E|e(n)|/Σ|SEn(z)| is below the threshold, indicating that ear pressure is above the normal operating range (e.g., wireless telephone 10 is pressed hard onto the user's ear) then ear pressure response logic is also signaled to take action to prevent generation of undesirable anti-noise at the user's ear 5.
Referring now to
Referring now to
When comparator K1 in the circuit of
1) Stop adaptation of W coefficient control 31
2) Mute the anti-noise signal by disabling amplifier A1
When comparator K2 in the circuit of
1) Increase leakage of W coefficient control 31 or reset response WADAPT(z) and freeze adaptation of response WADAPT(z). As an alternative, the value produced by computation block 37 can be a multi-valued or continuous indication of different ear pressure levels, and the actions above can be replaced by applying an attenuation factor to the anti-noise signal in conformity with the level of ear pressure, so that when the ear pressure passes out of the normal operating range the anti-noise signal level is also attenuated by lowering the gain of amplifier A1. In one embodiment of the invention, response WFIXED(z) of fixed filter 32A is trained for maximum ear pressure, i.e., set to the appropriate response for to the maximum level of ear pressure (perfect seal). Then, the adaptive response of adaptive filter 32B, response WADAPT(z), is allowed to vary with ear pressure changes, up to the point that contact with the ear is minimal (no seal), at which point the adapting of response W(z) is halted and the anti-noise signal is muted, or the pressure on the ear is over the maximum pressure, at which point response WADAPT(z) is reset and adaptation of response WADAPT(z) is frozen, or the leakage is increased.
Referring now to
Referring now to
In the system depicted in
The above arrangement of baseband and oversampled signaling provides for simplified control and reduced power consumed in the adaptive control blocks, such as leaky LMS controllers MA and 54B, while providing the tap flexibility afforded by implementing adaptive filter stages 44A-44B, 55A-55B and filter 51 at the oversampled rates. The remainder of the system of
In accordance with an embodiment of the invention, the output of combiner 46D is also combined with the output of adaptive filter stages 44A-44B that have been processed by a control chain that includes a corresponding hard mute block 45A, 45B for each of the filter stages, a combiner 46A that combines the outputs of hard mute blocks 45A, 45B, a soft mute 47 and then a soft limiter 48 to produce the anti-noise signal that is subtracted by a combiner 46B with the source audio output of combiner 46D. The output of combiner 46B is interpolated up by a factor of two by an interpolator 49 and then reproduced by a sigma-delta DAC 50 operated at the 64× oversampling rate. The output of DAC 50 is provided to amplifier A1, which generates the signal delivered to speaker SPKR.
Each or some of the elements in the system of
While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that the foregoing and other changes in form, and details may be made therein without departing from the spirit and scope of the invention.
Claims
1. A personal audio device, comprising:
- a personal audio device housing;
- a transducer mounted on the housing for reproducing an audio signal including both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer;
- a reference microphone mounted on the housing for providing a reference microphone signal indicative of the ambient audio sounds;
- an error microphone mounted on the housing in proximity to the transducer for providing an error microphone signal indicative of the acoustic output of the transducer; and
- a processing circuit that implements an adaptive filter having a response that shapes the anti-noise signal to reduce the presence of the ambient audio sounds heard by the listener, wherein the processing circuit determines a degree of coupling between the transducer and an ear of the listener and alters the response of the adaptive filter in conformity with the degree of coupling between the transducer and the ear of the listener.
2. The personal audio device of claim 1, wherein the processing circuit alters the response of the adaptive filter by forcing the response of the adaptive filter to a predetermined response in response to determining that the degree of coupling is greater than an upper threshold value.
3. The personal audio device of claim 2, wherein the predetermined response is a response that is trained to cancel the presence of the ambient audio sounds heard by the listener when the degree of coupling is greater than the upper threshold value.
4. The personal audio device of claim 2, wherein an adaptive control of the response of the adaptive filter has a leakage characteristic that restores the response of the adaptive filter to the predetermined response at an adjustable rate of change, and wherein the processing circuit increases the adjustable rate of change in response to determining the degree of coupling is greater than the upper threshold value.
5. The personal audio device of claim 1, wherein the processing circuit mutes the anti-noise signal in response to determining that the degree of coupling is lower than a lower threshold value.
6. The personal audio device of claim 5, wherein the processing circuit stops adaptation of the response of the adaptive filter in response to determining that the degree of coupling is lower than the lower threshold value.
7. The personal audio device of claim 5, wherein the processing circuit alters the response of the adaptive filter by forcing the response of the adaptive filter to a predetermined response in response to determining that the ear of the listener and the transducer to determining that the degree of coupling is greater than an upper threshold value.
8. The personal audio device of claim 7, wherein an adaptive control of the response of the adaptive filter has a leakage characteristic that restores the response of the adaptive filter to the predetermined response at an adjustable rate of change, and wherein the processing circuit increases the adjustable rate of change in response to determining that the degree of coupling is greater than the upper threshold value.
9. The personal audio device of claim 1, wherein the processing circuit implements a secondary path adaptive filter having a secondary path estimated response that shapes the source audio and a combiner that removes the source audio from the error microphone signal to provide an error signal indicative of the combined anti-noise and ambient audio sounds delivered to the listener, wherein the processing circuit adapts the response of the adaptive filter to minimize the error signal, and wherein the processing determines changes in the degree of coupling from changes in the secondary path estimated response.
10. The personal audio device of claim 9, wherein the processing circuit determines the degree of coupling between the transducer and the ear of the listener from a magnitude of the error signal weighted by an inverse of a peak magnitude of the secondary path response of the secondary path adaptive filter, wherein an decrease in the magnitude of the error signal weighted by the inverse of the peak magnitude of the secondary path response of the secondary path adaptive filter indicates a greater degree of coupling between the transducer and the ear of the listener.
11. The personal audio device of claim 9, wherein the processing circuit determines the degree of coupling between the transducer and the ear of the listener by comparing an indication of a peak magnitude of the secondary path response of the secondary path adaptive filter to a threshold value, wherein an increase in the peak magnitude of the secondary path response of the secondary path adaptive filter indicates a greater degree of coupling between the transducer and the ear of the listener.
12. A method of canceling ambient audio sounds in the proximity of a transducer of a personal audio device, the method comprising:
- first measuring ambient audio sounds with a reference microphone;
- second measuring an output of the transducer with an error microphone;
- adaptively generating an anti-noise signal from a result of the first measuring for countering the effects of ambient audio sounds at an acoustic output of the transducer by adapting a response of an adaptive filter that filters an output of the reference microphone;
- combining the anti-noise signal with a source audio signal to generate an audio signal provided to the transducer;
- determining a degree of coupling between the transducer and an ear of the listener;
- altering the response of the adaptive filter in conformity with the degree of coupling between the transducer and the ear of the listener;
- combining the anti-noise signal with a source audio signal; and
- providing a result of the combining to the transducer to generate the acoustic output.
13. The method of claim 12, wherein the altering alters the response of the adaptive filter by forcing the response of the adaptive filter to a predetermined response in response to determining that the degree of coupling is greater than an upper threshold.
14. The method of claim 13, wherein the predetermined response is a response that is trained to cancel the presence of the ambient audio sounds heard by the listener in response to determining that the degree of coupling is greater than an upper threshold.
15. The method of claim 13, wherein an adaptive control of the response of the adaptive filter has a leakage characteristic that restores the response of the adaptive filter to a predetermined response at an adjustable rate of change, and wherein the altering increases the adjustable rate of change in response to determining that the degree of coupling is less than a lower threshold.
16. The method of claim 12, further comprising muting the anti-noise signal in response to determining that the degree of coupling is less than a lower threshold.
17. The method of claim 16, wherein the altering stops adaptation of the response of the adaptive filter in response to determining that the degree of coupling is less than the lower threshold.
18. The method of claim 16, wherein the altering alters the response of the adaptive filter by forcing the response of the adaptive filter to a predetermined response in response to determining that the degree of coupling is greater than an upper threshold.
19. The method of claim 18, wherein an adaptive control of the response of the adaptive filter has a leakage characteristic that restores the response of the adaptive filter to a predetermined response at an adjustable rate of change, and wherein the altering increases the adjustable rate of change in response to determining the degree of coupling is less than the lower threshold.
20. The method of claim 12, further comprising:
- shaping the source audio using a secondary path adaptive filter having a secondary path estimated response; and
- removing the source audio from the error microphone signal to provide an error signal indicative of the combined anti-noise and ambient audio sounds delivered to the listener, wherein the adaptively generating adapts the response of the adaptive filter to minimize the error signal, and wherein the determining determines changes in the degree of coupling from changes in the secondary path estimated response.
21. The method of claim 20, wherein the determining determines the degree of coupling between the transducer and the ear of the listener from a magnitude of the error signal weighted by an inverse of a peak magnitude of the secondary path response of the secondary path adaptive filter, wherein a decrease in the magnitude of the error signal weighted by the inverse of the peak magnitude of the secondary path response of the secondary path adaptive filter indicates a greater degree of coupling between the transducer and the ear of the listener.
22. The method of claim 20, wherein the determining determines the degree of coupling between the transducer and the ear of the listener from an indication of a peak magnitude of the secondary path response of the secondary path adaptive filter wherein an increase in the peak magnitude of the secondary path response of the secondary path adaptive filter indicates a greater degree of coupling between the transducer and the ear of the listener.
23. An integrated circuit for implementing at least a portion of a personal audio device, comprising:
- an output for providing a signal to a transducer including both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer;
- a reference microphone input for receiving a reference microphone signal indicative of the ambient audio sounds;
- an error microphone input for receiving an error microphone signal indicative of the output of the transducer; and
- a processing circuit that implements an adaptive filter having a response that shapes the anti-noise signal to reduce the presence of the ambient audio sounds heard by the listener, wherein the processing circuit determines a degree of coupling between the transducer and an ear of the listener and alters the response of the adaptive filter in conformity with the degree of coupling between the transducer and the ear of the listener.
24. The integrated circuit of claim 23, wherein the processing circuit alters the response of the adaptive filter by forcing the response of the adaptive filter to a predetermined response in response to determining that the degree of coupling is greater than an upper threshold.
25. The integrated circuit of claim 24, wherein the predetermined response is a response that is trained to cancel the presence of the ambient audio sounds heard by the listener in response to determining that the degree of coupling is greater than the upper threshold.
26. The integrated circuit of claim 24, wherein an adaptive control of the response of the adaptive filter has a leakage characteristic that restores the response of the adaptive filter to a predetermined response at an adjustable rate of change, and wherein the processing circuit increases the adjustable rate of change in response to determining that the degree of coupling is greater than the upper threshold.
27. The integrated circuit of claim 26, wherein the processing circuit mutes the anti-noise signal in response to determining that when the degree of coupling is less than a lower threshold.
28. The integrated circuit of claim 27, wherein the processing circuit stops adaptation of the response of the adaptive filter in response to determining that the degree of coupling is less than the lower threshold.
29. The integrated circuit of claim 27, wherein the processing circuit alters the response of the adaptive filter by forcing the response of the adaptive filter to a predetermined response in response to determining that the degree of coupling is greater than an upper threshold.
30. The integrated circuit of claim 29, wherein an adaptive control of the response of the adaptive filter has a leakage characteristic that restores the response of the adaptive filter to the predetermined response at an adjustable rate of change, and wherein the processing circuit increases the adjustable rate of change in response to determining that the degree of coupling is greater than the upper threshold.
31. The integrated circuit of claim 23, wherein the processing circuit implements a secondary path adaptive filter having a secondary path estimated response that shapes the source audio and a combiner that removes the source audio from the error microphone signal to provide an error signal indicative of the combined anti-noise and ambient audio sounds delivered to the listener, wherein the processing circuit adapts the response of the adaptive filter to minimize the error signal, and wherein the processing determines changes in the degree of coupling from changes in the secondary path estimated response.
32. The personal audio device of claim 31, wherein the processing circuit determines the degree of coupling between the transducer and the ear of the listener from a magnitude of the error signal weighted by an inverse of a peak magnitude of the secondary path response of the secondary path adaptive filter, wherein an decrease in the magnitude of the error signal weighted by the inverse of the peak magnitude of the secondary path response of the secondary path adaptive filter indicates a greater degree of coupling between the transducer and the ear of the listener.
33. The integrated circuit of claim 31, wherein the processing circuit determines the degree of coupling between the transducer and the ear of the listener by comparing an indication of a peak magnitude of the secondary path response of the secondary path adaptive filter to a threshold value, wherein an increase in the peak magnitude of the secondary path response of the secondary path adaptive filter indicates a greater degree of coupling between the transducer and the ear of the listener.
Type: Application
Filed: Dec 2, 2011
Publication Date: Aug 16, 2012
Patent Grant number: 8908877
Inventors: Ali Abdollahzadeh Milani (Austin, TX), Gautham Devendra Kamath (Austin, TX)
Application Number: 13/310,380