Hearing device
A hearing device comprising a first and a second input sound transducers, a processing unit, and an output sound transducer. The first transducer is configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals from the received acoustical sound signals. The second transducer is configured to be arranged behind a pinna or on, behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals from the received acoustical sound signals. The processing unit is configured to process the first and second electrical acoustic signals and apply a direction dependent gain. The output sound transducer is configured generate acoustical output sound signals in accordance with the applied direction dependent gain.
Latest OTICON A/S Patents:
This application is a Continuation-in-Part of copending application Ser. No. 15/266,094, filed on Sep. 15, 2016, which is a Continuation-in-Part of application Ser. No. 14/716,421, filed on May 19, 2015, which claims priority under 35 U.S.C. § 119(a) to Application No. EP 14169059.4, filed in the European Patent Office on May 20, 2014, all of which are hereby incorporated by reference in their entireties into the present invention.
FIELDThe invention relates to a hearing device comprising a first input sound transducer and an output sound transducer (receiver) configured to be arranged in an ear canal or in an ear of a user and a second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user.
The invention relates to a hearing device comprising a first input sound transducer and an output sound transducer (receiver) configured to be arranged in an ear canal or in an ear of a user and a second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user.
DESCRIPTIONHearing or auditory perception is the process of perceiving sounds by detecting acoustical vibrations with a sound vibration input. Mechanical vibrations, i.e., sound waves, are time dependent changes in pressure of a medium, e.g., air, surrounding the sound vibration input, e.g., an ear. The human ear has an external portion called auricle or pinna, which serves to direct and amplify sound waves to an ear canal, which ends at an eardrum, the so-called tympanic membrane.
The pinna serves to collect sound by acting as a funnel, which may amplify sound pressure level by about 10 to 15 dB in a frequency range of 1.5 kHz to 7 kHz. Further the cavities and elevations of the pinna serve for vertical sound localization by working as a direction dependent filter system, which performs a frequency dependent amplitude modulation. Some frequencies of the incoming sound waves are amplified by the pinna and others are attenuated, which allows distinguishing between the angle of incidence on the vertical plane.
The ear canal has a sigmoid tube like shape which is open on one side to the environment with a typical length of about 2.3 cm and a typical diameter of about 0.7 cm. Sound waves running through the ear canal are amplified in the frequency range of about 3 kHz to 4 kHz, corresponding to the fundamental frequency of a tube closed on one end. The ear canal has an outer flexible portion of a cartilaginous tissue covering about one third of the ear canal, which connects to the pinna. An inner bony portion covers the other two thirds of the ear canal, which ends at the ear drum. The ear drum receives the sound waves amplified by the pinna and the ear canal.
A speaker, also called receiver, of a hearing aid device can be arranged in the ear canal, near the eardrum, of a hearing impaired user in order to amplify sounds from the acoustic environment to allow the user to perceive the sound. Hearing aid devices can be worn on one ear, i.e. monaurally, or on both ears, i.e. binaurally. Binaural hearing aid devices comprise two hearing aids, one for a left ear and one for a right ear of the user. The binaural hearing aids can exchange information with each other wirelessly and allow spatial hearing.
Hearing aids typically comprise microphone(s), an output sound transducer, e.g., speaker or receiver, electric circuitry, and a power source, e.g., a battery. The microphone(s) receives an acoustical sound signal from the environment and generates an electrical acoustic signal representing the acoustical sound signal. The electrical acoustic signal is processed, e.g., frequency selectively amplified, noise reduced, adjusted to a listening environment, and/or frequency transposed or the like, by the electric circuitry and a processed acoustical output sound signal is generated by the output sound transducer to stimulate the hearing of the user. In order to improve the hearing experience of the user, a spectral filterbank can be included in the electric circuitry, which, e.g., analyses different frequency bands or processes electrical acoustic signals in different frequency bands individually and allows improving the signal-to-noise ratio.
Typically, the microphones of the hearing aid device receiving the incoming acoustical sound signal are omnidirectional, meaning that they do not differentiate between the directions of the incoming sound. In order to improve the hearing of the user, a beamformer can be included in the electric circuitry. The beamformer improves the spatial hearing by suppressing sound from other directions than a direction defined by beamformer parameters, i.e., a look vector. In this way, the signal-to-noise ratio can be increased, as mainly sound from a sound source, e.g., in front of the user is received. Typically, a beamformer divides the space in two subspaces, one from which sound is received and the rest, where sound is suppressed, which results in spatial hearing.
One way to characterize hearing aid devices is by the way they fit to an ear of the user. Conventional hearing aids include for example ITE (In-The-Ear), RITE (Receiver-In-The-Ear), ITC (In-The-Canal), CIC (Completely-In-the-Canal), and BTE (Behind-The-Ear) hearing aids. The components of the ITE hearing aids are mainly located in an ear, while ITC and CIC hearing aid components are located in an ear canal. BTE hearing aids typically comprise a Behind-The-Ear unit, which is generally mounted behind or on an ear of the user and which is connected to an air filled tube that has a distal end that can be fitted in an ear canal of the user. Sound generated by a speaker can be transmitted through the air filled tube to an ear drum of the user's ear canal. RITE hearing aids typically comprise a BTE unit arranged behind or on an ear of the user and an ITE unit with a receiver that is arranged to be positioned in the ear canal of the user. The BTE unit and ITE unit are typically connected via a lead. An electrical acoustic signal can be transmitted to the receiver arranged in the ear canal via the lead.
Hearing aid users with hearing aids that have at least one insertion part configured to be inserted into an ear canal of the user to guide the sound to the ear drum experience various acoustic effects, e.g., a comb filter effect, sound oscillations or occlusion. Simultaneous occurrence of natural sound and device-generated sound in an ear canal of the user creates the comb filter effect, as the natural sound and device-generated sounds reach the eardrum with a time delay. Sound oscillations generally occur for hearing aid devices including a microphone, with the sound oscillations being generated through sound reflections off the ear canal to the microphone of the hearing aid device. A common way to suppress the aforementioned acoustic effects is to close the ear canal, which effectively prevents natural sound to reach the ear drum and device generated sound to leave the ear canal. Closing the ear canal, however, leads to the occlusion effect, which corresponds to an amplification of a user's own voice when the ear canal is closed, as bone-conducted sound vibrations cannot escape through the ear canal and reverberate off the insertion part of the hearing aid device.
Using a microphone in the ear canal allows using the amplification from the pinna. However, this also increases acoustic and mechanical feedback from the speaker arranged in the ear canal, as sound generated in the ear canal is reverberated by the ear canal walls and received by the microphone in the ear canal. A microphone behind or on the ear receives less sound from the receiver in the ear canal. The microphone behind or on the ear, however, will amplify sounds impinging from behind more than sounds impinging from the front, and consequently the spatial cue preservation will be worse.
Therefore, there is a need to provide an improved hearing device.
SUMMARYAccording to an embodiment, a hearing device comprising a first input sound transducer, a second input sound transducer, a processing unit, and an output sound transducer is disclosed. The first input sound transducer is configured to be arranged in an ear canal or in the ear of the user, and to receive acoustical sound signals from the environment for generating a first electrical acoustic signal in accordance with the received acoustical sound signals. The second input sound transducer is configured to be arranged behind a pinna or on/behind or at the ear of the user, and to receive acoustical sound signals from the environment for generating a second electrical acoustic signals in accordance with the received acoustical sound signals. The processing unit is configured to process the first and second electrical acoustic signals. The processing unit is further configured to determine a first level of the first electrical acoustic signal, a second level of the second electrical acoustic signal, and a level difference between the first level and second level and to use the level difference to process the first electrical acoustic signal and/or second electrical acoustic signal for generating an electrical output sound signal. The output sound transducer, arranged in the ear canal of the user, is configured to generate an acoustical output sound signal in accordance with the electrical output sound signal. The output sound transducer may also be configured to generate acoustical output sound signals in accordance with electrical acoustic signals.
The first input sound transducer, e.g. a microphone, and the output sound transducer, e.g. a speaker or receiver, can be comprised in an insertion part, e.g. an In-The-Ear unit, configured to be arranged in the ear or in the ear canal of the user. The other components of the hearing device, including the second input transducer, can be comprised in a Behind-The-Ear unit configured to be arranged behind the pinna or on/behind or at the ear of the user. The value of the level difference may be limited to a threshold value of level difference to avoid feedback issues or generating level difference based electrical output acoustical signal in atypical scenarios such as scratching at or close to one of the microphones of the hearing device.
In one embodiment of the invention, the use of the level difference of the electrical acoustic signals generated by the two input sound transducers at different locations with respect to the output sound transducer allows for improving the sound quality provided to the user in the acoustical output sound signal, as generated by the output sound transducer. In another embodiment of the disclosure, the hearing device allows for improving the directional response in the acoustical output sound signal. This means that using the level difference to process the electrical acoustic signals improves spatial hearing of the user. In yet another embodiment of the disclosure, the consonant part of the speech may be enhanced, thus improving the reception of speech. Furthermore, the design-freedom for a housing enclosing at least part of the hearing device is increased, as only one microphone has to be placed in the Behind-The-Ear part of the hearing device. In another embodiment, the distance between the two input sound transducers is increased, thus allowing for achieving improved directivity for lower frequencies. The increase in the distance is in relation to a typical hearing instrument where the microphone distance is generally approximately 10 mm.
In yet another embodiment, the hearing device may comprise microelectromechanical system (MEMS) components, e.g. MEMS microphones and balanced speakers, thus allowing for manufacturing the hearing device with a very small insertion part with good mechanical decoupling. In an embodiment, a housing comprising the balanced speakers/speaker may be at least partially enclosed by an expandable balloon, which may be permanent or detachable and can be replaced. The balloon includes a sound exit hole, through which output sound signal is emitted for the user of the hearing device. Using the expandable balloon improves the fit of the earpiece in the ear canal. Such balloon arrangement is provided in US2014/0056454A1, which is incorporated herein by reference. In other scenarios,
instead of the expandable balloon, conventionally known domes or moulds may also be used.
In an embodiment of the disclosure, the processing unit is configured to compensate the first electrical acoustic signal and/or the second electrical acoustic signal by the determined level difference between the first electrical acoustic signal and second electrical acoustic signal. The compensation may, for example be performed by multiplication of a gain factor to the respective electrical acoustic signal. The processing unit may be configured to process the first electrical acoustic signal and second electrical acoustic signal for generating an electrical output acoustical signal by using the first electrical acoustic signal or the second electrical acoustic signal or a combination of the first and the second electrical acoustic signal to generate the electrical output sound signal.
A combination of the first electrical acoustic signal and the second electrical acoustic signal can for example be a weighted sum of the first electrical acoustic signal and the second electrical acoustic signals. The weight factor may depend on the feedback between one or more of the input sound transducers to the output sound transducer or feedback estimates determined by the hearing device, e.g. through or during fitting. It is to be noted that the weight is not necessarily scalar. It could as well be a filter such as an FIR filter or the weight could as well consist of complex numbers in a frequency domain.
In one embodiment, the first electrical acoustic signal and the second electrical acoustic signal can be combined, where one electrical acoustic signal is delayed compared to the another electrical acoustic signal for example, the second electrical acoustic signal is delayed compared to the first electrical acoustic signal. The delay could e.g. be in the range of 1-10 ms. A weight is applied to both the first and the second electrical signal. The ratio of the weights may depend on the estimated feedback paths. By delaying the second microphone signal compared to the first microphone signal, a higher gain may be obtained by applying most of the weight of the BTE microphone signal, while maintaining correct spatial perception by allowing the first wavefront of the mixed sound to origin from the ITE microphone. The delay between the first and the second microphones on the two hearing instruments being used for the left ear and the right ear set up in a binaural system could be different. Hereby the perceived coloration due to the comb-filter effect is reduced as the notches on the two instruments will occur at different frequencies.
In an embodiment, the use of the level difference allows to compensate for a location difference of the two input sound transducers in order to use an input sound transducer location which might be less optimal with respect to the spatial cue preservation but more optimal with respect to minimizing feedback.
In one embodiment, the processing unit is configured to use the level difference between the first electrical acoustic signal and second electrical acoustic signal to determine a direction of a sound source of the acoustical sound signal with respect to the input sound transducers for generating an input sound transducer directivity pattern. The processing unit can be further configured to amplify and/or attenuate the first electrical acoustic signal or the second electrical acoustic signal or a combination of the first electrical acoustic signal and second electrical acoustic signal for generating an electrical output acoustical signal in dependence of the input sound transducer directivity pattern. The direction of the sound source can for example be determined by comparing the levels at the first input sound transducer and second input sound transducer. In one embodiment, the processing unit determines the sound to be received from a front direction, if the level at the first input sound transducer is higher than the level at the second input sound transducer because for the second input sound transducer, the pinna shadows sounds approaching from the front but for the first input sound transducer, the pinna amplifies sounds approaching from the front. Additionally or alternatively, the processing unit determines the sound to be to be received from the rear direction, if the level at the first input sound transducer is lower than the level of the second at the second input sound transducer, because the pinna in this case shadows sounds approaching from the rear for the first input sound transducer. Comparison of the levels determined from the electrical acoustic signals received by both input sound transducers (microphones), a determination for a direction of the sound source can be made.
The hearing device may also include a filter-bank configured to filter each electrical acoustic signal into a number of frequency channels, each comprising an electrical sub-band acoustic signal. The processing unit can further be configured to determine a level of sound for each electrical sub-band acoustic signal. In one embodiment, the processing unit is configured to determine a level difference between the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal in at least a part of the frequency channels. The processing unit can further be configured to convert the level difference into a gain. The processing unit can also be configured to apply the gain to at least a part of the electrical sub-band acoustic signals.
The first input sound transducer and the second input sound transducer may have different frequency responses. Therefore, the offset between the sound levels resulting from the different frequency response can for example be removed by high-pass filtering the level difference before it is converted into a gain.
In one embodiment, the processing unit is configured to determine whether the level of the first electrical sub-band acoustic signal or the level of the second electrical sub-band acoustic signal is higher. Based on the result which level is higher, the processing unit can be configured to convert the level difference in a direction-dependent gain. The direction-dependent gain is adapted to amplify the electrical acoustic signal, if the level of the first electrical sub-band acoustic signal is higher than the level of the second electrical sub-band acoustic signal and to attenuate the electrical acoustic signal, if the level of the first electrical sub-band acoustic signal is lower than the level of the second electrical sub-band acoustic signal. The gain may have a functional dependence on the level difference, e.g., a linear dependence or any other functional dependence, i.e., the gain is higher/lower for higher/lower level difference.
The processing unit can also be configured to determine the gain and/or the direction-dependent gain in dependence of an overall level of sound of the first electrical acoustic signal and the second electrical acoustic signal.
In one embodiment, the processing unit is configured to determine feedback frequency channels that do not fulfil a feedback stability criterion. The processing unit can also be configured to determine non-feedback frequency channels that fulfil a feedback stability criterion. Alternatively or additionally, the processing unit can be configured to determine feedback frequency channels and non-feedback frequency channels corresponding to predetermined data comprising feedback and non-feedback frequency channel information. A feedback stability criterion can for example be a Lyapunov criterion, a circle criterion or any other criterion such as comparing magnitude of the frequency domain feedback path estimate to a given limit that allows determining if a frequency channel is prone to feedback. The feedback frequency channels can also be determined by comparison of a determined level of sound in the frequency channel and a predetermined level threshold value indicating feedback. Alternatively or additionally, the feedback frequency channels can also be determined by comparison of a determined level difference of sound in the frequency channel and a predetermined level difference threshold value indicating feedback. The feedback channels can be determined in a fitting procedure step, e.g., by sending a test sound signal generated by a sound generation unit and analysing the test sound signal in the frequency channels. The test sound may also include a sound played during a start up of the hearing aid and/or by a user request such as using a smartphone app communicating with the hearing aid. The test sound may consists of sine tones, it be a sine sweep or may also be a Gaussian noise limited to certain frequency bands. If the test sound should also be used for estimating the delay between the microphones, lower frequencies, where feedback is less likely, may also be included. The determination of feedback frequency channels can also be performed during the operation of the hearing device, e.g., by sending a non-audible test sound signal, i.e. a sound signal non-audible to humans with a frequency of for example 20 kHz or higher, to determine a feedback path between the two microphones and the speaker of the hearing device. The feedback path estimate for the non-audible test sound signal can then be used to determine an estimated feedback for other frequency channels.
In one embodiment, the processing unit is configured to use second electrical sub-band acoustic signals from feedback frequency channels and first electrical sub-band acoustic signals from non-feedback frequency channels in order to generate the electrical output sound signal. That is, the processing unit is configured to apply the direction-dependent gain to second electrical sub-band acoustic signals from feedback frequency channels and to first electrical sub-band acoustic signals from non-feedback frequency channels in order to generate the electrical output sound signal. In another embodiment, the processing unit can further be configured to compensate each respective first or second electrical sub-band acoustic signal or a combination of the respective first and second electrical sub-band acoustic signal from each respective feedback frequency channel in dependence of the level difference between the first and second electrical sub-band acoustic signal.
The hearing device can comprise one or more low-pass filters that are adapted to filter a magnitude of each electrical acoustic signal and/or electrical sub-band acoustic signal in order to determine a level of sound. The electrical acoustic signals can for example be Fourier transformed by an FFT, DFT or other frequency transformation schemes performed on the processing unit in order to transform the electrical acoustic signals in the frequency domain and to derive the magnitude of an electrical sub-band acoustic signal of a certain frequency channel.
In one embodiment, the hearing device comprises a calculation unit. The calculation unit can also be included in the processing unit. The calculation unit can be configured to calculate a magnitude or a magnitude squared of each of the electrical acoustic signals and/or electrical sub-band acoustic signals in order to determine a level of sound for each electrical acoustic signal and/or electrical sub-band acoustic signal.
In one embodiment, the processing unit is configured to estimate a feedback path between the first input sound transducer and the output sound transducer. The processing unit can further be configured to estimate a feedback path between the second input sound transducer and the output sound transducer. The feedback path can be estimated online, e.g., based on the acoustical sound signal or a non-audible test sound signal. The feedback path can also be estimated offline during a fitting of the hearing device. Alternatively or additionally, the feedback path can also be estimated each time after the hearing device is mounted and/or turned on. The feedback path can for example be estimated by using audible or non-audible test sound signals generated by a sound generation unit of the hearing device or stored in a memory of the hearing device. The feedback path may also be estimated online, and the microphone weights may be adjusted adaptively according to the changing feedback estimate. The test sound signals preferably comprise a non-zero level of sound for frequencies that are prone to feedback. The feedback frequency channels and non-feedback frequency channels can then be determined based on the determination of the feedback paths. If feedback is detected in one of the frequency channels, the processing unit can be configured to use the second electrical acoustic signal for said feedback frequency channel only for a predetermined time interval. After the predetermined time interval is over, the processing unit can be configured to use the first electrical acoustic signal for said feedback frequency channel again in order to test whether the feedback is still present in said feedback frequency channel. If feedback is likely to occur in said feedback frequency channel, i.e., a predetermined number of feedback howls occurs over a predetermined amount of time, the processing unit can be configured to use the second electrical acoustic signal in said feedback frequency channel permanently for generating the electrical output acoustical signal for said frequency channel. It is also possible to use a weighted sum of first and second electrical acoustic signals of a specific frequency channel to generate the electrical output acoustical signal for said specific frequency channel. The weighted sum may be in the form of wITE(f)XITE(f)+wBTE(f)XBTE(f), where wITE(f) and wBTE(f) are the (complex) weights at the frequency band f applied to the two signals XITE(f) and XBTE(f), respectively. Depending on the weights, one can have a tradeoff between good localization (wITE dominant) and less feedback (wBTE dominant), ITE referring to in-the-ear and BTE referring to behind-the-ear.
In one embodiment, the two input sound transducers and the output sound transducer are arranged in the same or substantially same horizontal plane. In an embodiment, the first input sound transducer and second input sound transducer are arranged in different horizontal planes. The output transducer may be arranged in same horizontal plane with one of the input sound transducers, preferably in same horizontal plane as the first input sound transducer. The processing unit may be configured to use information about length of the output transducer and/or about tilting of the hearing device during use, i.e. tilt of behind-the-ear (BTE) part of the hearing device during use. The tilt may relate to the design of the hearing instrument, i.e. relative arrangement of the BTE part with respect to the second input sound transducer and/or positioning of the BTE part behind the ear with respect to the first input sound transducer when the hearing device is in use. The tilt of the BTE part may be measured off-line and may be measured using an accelerometer. The tilt may be defined by an imaginary line tangent to a surface, proximal to and/or at location of the second input transducer, of the BTE part. The tilt angle θ is an angle between the first input sound transducer and second input sound transducer. The tilt angle may be defined as an angle that a horizontal plane containing the first input sound transducer makes with a line joining the first input sound transducer and the second input sound transducer. The tilt angle is a function of the length of output transducer and tilt, i.e. tilt angle θ=f(length, tilt). In an embodiment, the processing unit is configured to convert the distance or delay d from the feedback paths, i.e. first feedback path and second feedback path, into a horizontal distance d′ defined by d′=d*cos θ or d*sin(90−θ). The horizontal distance d′ may thus
define corresponding delay and/or phase difference between the sound received at the two input transducers. In another embodiment, the processing unit is configured to convert the length of output transducer, tilt and distance or delay d into a horizontal distance d′ using a non-linear function g, such that d′=g(d, length, tilt). In another embodiment, the processing unit is configured to access the horizontal distance d′ stored in a memory that is locally available within the hearing device or remote from the hearing device. The horizontal distance d′ may be stored in the memory as a look up table that provides conversion of the distance or delay d from the feedback paths into a horizontal distance d′. Additionally or alternatively, the processing unit is configured to access the horizontal distance d′ from a neural network providing the most likely angle for a given length of the output transducer and/or tilt.
The processing unit can be configured to determine a cross correlation between the feedback path between the first input sound transducer and the output sound transducer and the feedback path between the second input sound transducer and the output sound transducer. It is to be noted that the cross correlation at lower frequencies will be useful for estimating the delay between the microphone signals as the delay will be less influenced from the acoustic properties related to the pinna and the head shadow. The processing unit can further be configured to use the cross correlation to determine a distance between the first input sound transducer and the second input sound transducer or time delay or phase difference between the microphone signals. The processing unit can also be configured to select a directional filter optimized for the directionality in lower frequencies based on the distance between the first input sound transducer and the second input sound transducer or time delay or phase difference between the microphone signals. Additionally or alternatively, the first input sound transducer and second input sound transducer can be arranged in the horizontal plane in a manner to maximise the distance between the two input sound transducers. Preferably, the first input sound transducer is as close to the eardrum as possible, while being as far away from the output sound transducer as possible to reduce feedback. For example, the first input sound transducer can be arranged at the entrance of the ear canal and the second input sound transducer can be arranged behind the pinna in a horizontal plane with the first input sound transducer. Additionally and alternatively, the microphone array including the first input sound transducer and the second input sound transducer are not only in the same horizontal plane but the microphone array is parallel to the front-back axis of the head. This would be the case when the ITE microphone is positioned at the entrance of the ear canal. The positioning of the first input sound transducer relative to the second input sound transducer result in increased distance along the horizontal plane, for example increasing the distance to around 30 mm. Lower frequencies require longer distances between the microphones due to the longer wavelength of the lower-frequency sound signals. Therefore, the increased distance, relative to a typical hearing aid microphone distance, between the two input sound transducers allow for achieving improved directivity for lower frequencies. It may also be possible to include a sensor or the like configured to determine the relative positioning of the input sound transducers and have accurate information on the distance, which may be important to the directivity processing. The differential beamformer will be less efficient at low frequencies because the microphone signals are subtracted from each other. As the frequency becomes lower, subtraction takes place between two DC signals. This means that the resulting beamformer will be highpass-filtered with a frequency response proportional to sin(2*pi*f*d/c), where f is the frequency, d is the microphone distance, and c is the sound velocity. At some point, the microphone noise becomes dominant, and the beamformer becomes less efficient. For example, doubling the microphone distance d, the low frequency roll-off will be shifted down in frequency by one octave.
In an embodiment, at least one of the input sound transducers such as the first input sound transducer can be a microelectromechanical system (MEMS) microphone. In one embodiment, all input sound transducers are MEMS microphones. In one embodiment, the hearing device comprises mainly MEMS components in order to produce a small and lightweight hearing device.
The hearing device can further comprise a beamformer configured to enhance the directivity pattern for low frequencies. Preferably, the beamformer is used when the input sound transducers are arranged in a horizontal plane and the distance between the input sound transducers is known, such that the input sound transducers form an input sound transducer array, e.g. a microphone array. The beamformer can for example be a delay and subtract beamformer. The beamformer is preferably used for electrical acoustic signals with low frequencies and can be combined with electrical acoustic signals with high frequencies, which have been processed by the processing unit therefore allowing to synthesize an electrical output acoustical signal with low frequency parts processed by the beamformer and high frequency parts processed by the processing unit.
In an embodiment, the disclosure relates to a method for processing acoustical sound signals from the environment comprising feedback. The method comprises a step of receiving an acoustical sound signal in an ear or in an ear canal of a user and generating a first electrical acoustic signal and receiving the acoustical sound signal behind a pinna or on/behind or at the ear of the user and generating a second electrical acoustic signal. The method further comprises a step of estimating the level of sound of the first and the second electrical acoustic signal. Furthermore, the method comprises a step of determining the level difference between the first electrical acoustic signal and the second electrical acoustic signal. Another step of the method is converting the value of the level difference into a gain value. Finally, the method comprises the step of applying the gain to the first acoustic signal or second electrical acoustic signal or a combination of the first and second electrical acoustic signal to generate an output sound signal.
In yet another embodiment, the disclosure further relates to a method for processing acoustical sound signals from the environment with the following steps. The method comprises the step of receiving an acoustical sound signal in an ear or in an ear canal of a user and generating a first electrical acoustic signal and receiving the acoustical sound signal behind a pinna or on/behind or at the ear of the user and generating a second electrical acoustic signal. The method further comprises the step of filtering the electrical acoustic signals into frequency channels generating first electrical sub-band acoustic signals and second electrical sub-band acoustic signals. Furthermore, the method comprises the step of estimating the level of sound of each first electrical sub-band acoustic signal and second electrical sub-band acoustic signal in each frequency channel. The method further comprises the step of determining the level difference between each first and second electrical sub-band acoustic signal in the respective frequency channel. The method also comprises the step of converting the value of the level difference into a gain value for each frequency channel. Furthermore, the method comprises the step of applying the gain to electrical sub-band acoustic signals. The method also comprises the step of synthesizing an output sound signal from the electrical sub-band acoustic signals.
In an embodiment, instead of estimating a level of sound between the first electrical sub-band acoustic signal and second electrical sub-band acoustic signal in each frequency channel for level difference determination, one can envisage estimating the level between the first electrical sub-band acoustic signal and a weighted sum of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal. In another embodiment, the level between the second electrical sub-band acoustic signal and a weighted sum of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal may also be used.
In one embodiment of the method, the gain is applied to the second electrical sub-band acoustic signals in feedback frequency channels, which do not fulfil a feedback stability criterion in order to generate compensated second electrical sub-band acoustic signals in the feedback frequency channels. The gain can also be applied to the first electrical sub-band acoustic signals in non-feedback frequency channels, which fulfil a feedback stability criterion in order to generate compensated first electrical sub-band acoustic signals in the non-feedback frequency channels. Additionally an output sound signal can be synthesized from the compensated second electrical sub-band acoustic signals and the compensated first electrical sub-band acoustic signals.
In one embodiment of the method, the step of converting the value of the level difference into a gain value for each frequency channel, results in the value of the level difference that represents direction-dependent gain value. The direction-dependent gain value is adapted to amplify the electrical acoustic signal, if the level of the first electrical sub-band acoustic signal is higher than the level of the second electrical sub-band acoustic signal and to attenuate the electrical acoustic signal, if the level of the first electrical sub-band acoustic signal is lower than the level of the second electrical sub-band acoustic signal. The direction dependent gain can be applied to electrical sub-band acoustic signals. Additionally an output sound signal can be synthesized from the electrical sub-band acoustic signals.
The gain value used in the method can be limited to a predetermined threshold gain value.
The disclosure further relates to the use of the hearing device of an embodiment of the disclosure, in order to perform at least some of the steps of one of the methods for processing acoustical sound signals from the environment.
According to an embodiment, a hearing device configured to be worn in, on, behind, and/or at an ear of a user is disclosed. The hearing aid includes a first input sound transducer, a second input sound transducer, a filter bank, a processing unit, and an output sound transducer. The first input sound transducer configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals.
The second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals. The filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal. The processing unit configured to determine a level of sound for each electrical sub-band acoustic signal, determine a level difference between a first electrical sub-band acoustic signal and a second electrical sub-band acoustic signal in at least a part of the frequency channels, determine whether the level of the first electrical sub-band acoustic signal or the level of the second electrical sub-band acoustic signal is higher, convert the level difference in a direction-dependent gain that is configured to amplify the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is higher than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal for generating an electrical output acoustic signal and the second electrical sub-band acoustic signal, and/or to attenuate the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is lower than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal for generating an electrical output acoustic signal. The output sound transducer is configured to be arranged in the ear canal of the user, wherein the output sound transducer is configured to generate an acoustical output sound signal based on the electrical output acoustical signal.
In an embodiment, the processing unit is configured to limit the value of the level difference to a threshold value of level difference. This may be useful in order to avoid feedback issues or generating level difference based electrical output acoustical signal in atypical scenarios such as scratching at or close to one of the microphones of the hearing device.
In an embodiment, the first and second input sound transducers are arranged in different horizontal planes or at least substantially same horizontal plane; and the processing unit is configured to use a first feedback path between the output transducer and first input transducer, and a second feedback path between the output transducer and the second input transducer to determine a distance or delay or phase difference between the first input transducer and the second input sound transducer. The output sound transducer may be arranged in same horizontal plane as one of the input sound transducer.
In an embodiment, the processing unit is configured to select a directional filter optimized for the directionality in lower frequencies based on the distance between the first input sound transducer and second input sound transducer or time delay or phase difference between the microphone signals. Additionally or alternatively, the first input sound transducer and second input sound transducer can be arranged in the different or at least substantially same horizontal plane in a manner to maximise the distance between the two input sound transducers. Preferably, the first input sound transducer is as close to the eardrum as possible, while being as far away from the output sound transducer as possible to reduce feedback. For example, the first input sound transducer can be arranged at the entrance of the ear canal and the second input sound transducer can be arranged behind the pinna in a horizontal plane with the first input sound transducer. Additionally and alternatively, the microphone array including the first input sound transducer and the second input sound transducer are not only in the same horizontal plane but the microphone array is parallel to the front-back axis of the head. This would be the case when the ITE microphone is positioned at the entrance of the ear canal. The positioning of the first input sound transducer relative to the second input sound transducer result in increased distance along the horizontal plane, for example increasing the distance to around 30 mm.
According to an embodiment, the processing unit is configured to determine feedback frequency channels that do not fulfil a feedback stability criterion and to determine non-feedback frequency channels that do fulfil a feedback stability criterion or to determine feedback frequency prone channels and non-feedback frequency channels not prone to feedback corresponding to predetermined data comprising feedback and non-feedback frequency channel information.
According to an embodiment, the processing unit is configured to apply the direction-dependent gain to second electrical sub-band acoustic signals or to a weighted sum of the first electrical subband acoustic signal and the second electrical sub-band acoustic signal from feedback frequency channels and first electrical sub-band acoustic signals from non-feedback frequency channels in order to generate the electrical output sound signal.
According to an embodiment, the processing unit is configured to apply the direction-dependent gain if the level difference is higher than a minimum threshold value. This allows for ensuring that the processing unit is configured to prevent application of direction dependent if the level difference is below the minimum threshold value. This may be useful because applying minor level differences as direction dependent gains may not provide required contrast in perception between the sound arriving from different direction, for example from front or behind the user but additional processing of applying direction dependent gain continues to drain power source (battery).
In an embodiment, t processing unit is configured to apply the direction dependent gain to amplify if the level difference is higher than a first minimum threshold value. The first minimum threshold value may be same for different frequency channels or different for at least two frequency channels.
In an embodiment, the processing unit is configured to apply the direction dependent gain to attenuate if the level difference is higher than a second minimum threshold value. The second minimum threshold value may be same for different frequency channels or different for at least two frequency channels.
In different embodiments, the first minimum threshold value and second minimum threshold value is selected from same value or different values.
In an embodiment, the first minimum threshold value corresponding to a frequency channel is a function of frequency specific amplification that is based on a hearing loss profile of the user. Additionally or alternatively, the second minimum threshold value corresponding to a frequency channel is a function of frequency specific amplification that is based on a hearing loss profile of the user. The frequency channel usually includes the frequency for which the amplification based on the hearing loss profile is applied. The hearing loss profile is generally expressed in an audiogram.
In an embodiment, the processing unit is configured to apply the direction dependent gain in combination with the frequency specific amplification that is based on a hearing loss profile of the user. Typically, a hearing device such as hearing aid is configured to provide a frequency specific amplification, which depends upon frequency specific hearing loss of the user. In one embodiment, the combination may be described as the processing unit configured to apply a correction filter to an electrical acoustic signal that is modulated (amplified) in accordance with the hearing loss profile. The correction filter is configured to further apply the direction dependent gain on the modulated electrical acoustic signal such that the modulated electrical signal is either amplified or attenuated to produce the electrical output acoustical signal. The applied direction dependent gain may correspond to the frequency channel that includes the frequency for which amplification based on hearing loss profile is applied. In another embodiment, the combination may be described as the processing unit configured to modify frequency specific amplification based on the hearing loss profile by the direction dependent gain and to apply the modified frequency specific amplification to the electrical acoustic signal to produce the electrical output acoustical signal. The applied direction dependent gain may correspond to the frequency channel that includes the frequency for which amplification based on hearing loss profile is applied.
In another embodiment, a hearing device configured to be worn in, on, behind, and/or at an ear of a user is disclosed. The hearing device includes a first input sound transducer, a second input transducer, a filter bank, a processing unit and an output transducer. The first input transducer is configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals. The second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals. The filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal. The processing unit configured to determine feedback frequency channels that do not fulfil a feedback stability criterion and to determine non-feedback frequency channels that do fulfil a feedback stability criterion or to
determine feedback frequency prone channels and non-feedback frequency channels not prone to feedback corresponding to predetermined data comprising feedback and non-feedback frequency channel information. The output sound transducer configured to be arranged in the ear canal of the user.
In another embodiment, a hearing device configured to be worn in, on, behind, and/or at an ear of a user is disclosed. The hearing device includes a first input sound transducer, a second input sound transducer, a filter bank, a processing unit and an output transducer. The first input sound transducer configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals. The second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals. The filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal. The output sound transducer configured to be arranged in the ear canal of the user; wherein the first and second input sound transducers are arranged in different horizontal planes or at least substantially same horizontal plane. The output sound transducer may be arranged in same horizontal plane as one of the input sound transducer. The processing unit is further configured to use a first feedback path between the output transducer and first input transducer, and a second feedback path between the output transducer and the second input transducer to determine a distance or delay or phase difference between the first input transducer and the second input sound transducer.
According to an embodiment, a hearing device configured to be worn in, on, behind, and/or at an ear of a user is disclosed. The hearing device includes a first input sound transducer configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals; a second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals; a filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal; a processing unit and an output transducer. The processing unit is configured to determine a level of sound for each electrical sub-band acoustic signal, determine a level difference between a first electrical sub-band acoustic signal and a second electrical sub-band acoustic signal in at least a part of the frequency channels, determine whether the level of the first electrical sub-band acoustic signal or the level of the second electrical sub-band acoustic signal is higher, convert the level difference in a direction-dependent gain that is configured to amplify the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is higher than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal for generating an electrical output acoustic signal and the second electrical sub-band acoustic signal, and/or to attenuate the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is lower than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal for generating an electrical output acoustic signal. The output sound transducer configured to be arranged in the ear canal of the user, wherein the output sound transducer is configured to generate an acoustical output sound signal based on the electrical output acoustical signal.
According to an embodiment, the first and second input sound transducers are arranged such that the sound, defining the feedback paths, from the output transducer preferably passes the first input sound transducer on its path to the second input sound transducer. Thus, the time difference between the first feedback path and the second feedback path may be directly related to the microphone distance because the microphone distance approximately equals (feedback path time difference)×(speed of sound).
According to an embodiment, the first and second input sound transducers are arranged in different horizontal planes or at least substantially same horizontal plane; and the processing unit is configured to use a first feedback path between the output transducer and first input transducer, and a second feedback path between the output transducer and the second input transducer to determine a distance or delay or phase difference between the first input transducer and the second input sound transducer. At least one of the input transducer, preferably the first input transducer, and the output transducer may be arranged in same or substantially same horizontal plane selected from one of the different horizontal planes or the at least substantially same horizontal plane.
In an embodiment, a hearing device configured to be worn in, on, behind, and/or at an ear of a user is disclosed. The hearing device includes a first input sound transducer configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals; a second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals; a filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal; an output sound transducer configured to be arranged in the ear canal of the user;
wherein the first and second input sound transducers are arranged in different horizontal planes or at least substantially same horizontal plane; and a processing unit configured to use a first feedback path between the output transducer and first input transducer, and a second feedback path between the output transducer and the second input transducer to determine a distance or delay or phase difference between the first input transducer and the second input sound transducer.
In an embodiment, when the first and second input sound transducers are arranged in different horizontal planes, the processing unit is configured to convert the distance or delay between the first and second feedback paths into a horizontal distance between the first and second input sound transducers, the horizontal distance being defined by d′=d*cos θ or d*sin(90−θ), where where d′ corresponds to delay and/or phase difference between a sound received at the first and second input sound transducers, d is distance or delay between the first and second feedback paths and θ is tilt angle between the first input sound transducer and second input sound transducer.
In an embodiment, the processing unit is configured to select a directional filter optimized for the directionality in lower frequencies based on the distance between the first input sound transducer and second input sound transducer or time delay or phase difference between the microphone signals.
In an embodiment, the hearing device is a hearing aid.
The present disclosure will be more fully understood from the following detailed description of embodiments thereof, taken together with the drawings in which:
In the present context, a “hearing device” refers to a device, such as e.g. a hearing aid or an active ear-protection device, which is adapted to improve, augment and/or protect the hearing capability of an individual by receiving acoustic sound signals from an individual's surroundings, generating corresponding electrical acoustic signals, modifying the electrical acoustic signals and providing the modified electrical acoustic signals as output sound signals to at least one of the individual's ears. Such output sound signals may be provided into the individual's outer ears, output sound signals being transferred through the middle ear to the inner ear of the user of the hearing device.
As used herein, the singular forms “a”, “an”, and “the” are intended to include the plural forms as well (i.e. to have the meaning “at least one”), unless expressly stated otherwise. It will be further understood that the terms “has”, “includes”, “comprises”, “having”, “including” and/or “comprising”, when used in this specification, specify the presence of stated features, integers, steps, operations, elements and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and/or groups thereof. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
The electric circuitry 16 comprises a control unit 32, a processing unit 34, a sound generation unit 36, a memory 38, a receiver unit 40, and a transmitter unit 42. In the present embodiment, the processing unit 34, the sound generation unit 36 and the memory 38 are part of the control unit 32. The hearing aid 10 is configured to be worn at one ear 26 of the user 28. One hearing aid 10 can for example be arranged at a left ear 40 and one hearing aid can be arranged at a right ear 42 of the user 28 (see
An insertion part 44, comprising the first microphone 12 and the speaker 18, of the hearing aid 10 is arranged in the ear canal 24 of the user 28 (see
The hearing aid 10 can be operated in various modes of operation, which are executed by the control unit 32 and use various components of the hearing aid 10. The control unit 32 is therefore configured to execute algorithms, to apply outputs on electrical signals processed by the control unit 32, and to perform calculations, e.g., for filtering, for amplification, for signal processing, or for other functions performed by the control unit 32 or its components. The calculations performed by the control unit 32 are performed on the processing unit 34. Executing the modes of operation includes the interaction of various components of the hearing aid 10, which are controlled by algorithms executed on the control unit 32. The algorithms can also be executed on the processing unit 34.
In a hearing aid mode, the hearing aid 10 is used as a hearing aid for hearing improvement by sound amplification and filtering of sound received by the first microphone 12 or the second microphone 14. In a pinna enhancement mode the hearing aid 10 is used to improve the hearing by using sound received by the first microphone 12 and the second microphone 14 (see
The mode of operation of the hearing aid 10 can be manually selected by the user via the user interface 20 or automatically selected by the control unit 32, e.g., by receiving transmissions from an external device, receiving environment sound, or other indications that allow to determine that the user 28 is in need of a specific mode of operation. The modes of operation can also be performed in parallel, e.g., the sound received by the first microphone 12 and second microphone 14 can also be used simultaneously for the pinna enhancement mode and the directivity enhancement mode. The hearing aid 10 can also be configured to continuously perform certain modes of operation, e.g., the pinna enhancement mode and the directivity enhancement mode.
The hearing aid 10 operating in the hearing aid mode receives acoustical sound signals 50 at the first microphone 12 and/or the second microphone 14. The first microphone 12 generates first electrical acoustic signals 52 and/or the second microphone 14 generates second electrical acoustic signals 58, which are provided to the control unit 32. The processing unit 34 of the control unit 32 processes the first electrical acoustic signals 52 and/or second electrical acoustic signals 58, e.g. by spectral filtering, frequency dependent amplifying, filtering, or other typical processing of electrical acoustic signals in a hearing aid generating an electrical output acoustical signal 54. The processing of the first electrical acoustic signals 52 and/or second electrical acoustic signals 58 by the processing unit 34 may depend on various parameters, e.g., sound environment, sound source location, signal-to-noise ratio of incoming sound, mode of operation, battery level, and/or other user specific parameters and/or environment specific parameters. The electrical output acoustical signal 54 is provided to the speaker 18, which generates an acoustical output sound signal 56 corresponding to the electrical output acoustical signal 54 which stimulates the hearing of the user.
Now referring to
The processing unit 34 comprises a filter-bank 60, 60′ of band-pass filters that filters each of the electrical acoustic signals 52 and 58 respectively into a number of frequency sub-bands, i.e., converting each of the two electrical acoustic signals 52 and 58 provided by the first microphone 12 and second microphone 14 into the frequency domain. A band sum unit 85, 85′ sums the electrical acoustic signals 52 and 58 over a predetermined number of frequency channels, e.g. a frequency band of a range of 0.5 kHz, such as a frequency band from 0.5 to 1 kHz, in order to allow deriving an average level of sound.
The magnitude or magnitude squared of the respective electrical sub-band acoustic signal 62, 64 is then determined in the respective absolute value determination unit 66, 66′. The magnitudes are low-pass filtered by filters 68, 68′ in order to determine In-The-Ear (ITE) levels of sound for the first electrical sub-band acoustic signals 62 and Behind-The-Ear (BTE) levels of sound for the second electrical sub-band acoustic signals 64 in the frequency band. The filters 68, 68′ determine a level based on a short term basis, such as a level based on a short time interval, such as for example the last 5 ms to 40 ms or such as the last 10 ms.
The level is then converted to a domain such as a logarithmic domain or any other domain by unit 70, 70′. Then, a level difference is determined by summation unit 72. The level difference is used to determine for each unit in time and the selected frequency band if the In-The-Ear (ITE) level of the first electrical sub-band acoustic signal 62 or the Behind-The-Ear (BTE) level of the second electrical acoustic signal 64 is dominant, i.e., greater, by a level comparison unit 86. The level difference is reconverted from the logarithmic domain or any other domain to the normal domain by unit 76. Alternatively, level difference is found by division of the two level estimates.
Then the distribution unit 88 converts the level difference into a direction-dependent gain that amplifies the first electrical sub-band acoustic signal 62 when the ITE level is greater than the BTE level and attenuates the first electrical acoustic signal 62 if the BTE level is greater than the ITE level. The amount of amplification or attenuation in this embodiment depends on the determined level difference. A small level difference results in little gain while a greater level difference is converted into more gain. The gain is multiplied to the first electrical acoustic signal 52 in this embodiment by multiplication unit 90, hereby amplifying the natural directivity further. The direction-dependent gain can also be applied to the second electrical acoustic signal 58. The electrical sub-band acoustic signals are finally synthesized in the synthesize unit 84 to generate an electrical output acoustical signal 54. The electrical output acoustical signal 54 can be presented to the user 28 using speaker 18.
The gain is preferably applied to the second electrical acoustic signal 58, if too much feedback between speaker 18 and the first microphone 12 prevents the first electrical acoustic signal 52 from being used. In order to determine whether there is too much feedback the processing unit 34 can determine an average level difference over the frequency channels and select frequency channels with too large variation in level difference or too large levels for the first electrical acoustic signal 52 as feedback channels that have too much feedback.
The determination of a direction-dependent gain can also be performed only for selected frequency channels or selected frequency bands.
The units 60, 60′, 66, 66′, 68, 68′, 70, 70′, 72, 76, 84, 86, 88, and 90 can be physical units or also be algorithms performed on the processing unit 34 of the hearing aid 10.
A high pass filter 705 may be used to compensate for any constant bias present on one of the microphone signals. A HP filter having a time constant significantly greater than the LP filter (e.g. in the order of 1000 ms), would only allow fast level changes to be converted into a fluctuating gain. If the first microphone signal e.g. always is significantly greater than the second microphone signal, we would without the HP filter just obtain a constant amplification.
Now referring to
The processing unit 34 comprises a filter-bank 60, 60′ which filters each of the electrical acoustic signals 52 and 58 into a number of frequency sub-bands. The filter-bank 60 processes the first electrical acoustic signals 52 into first electrical sub-band acoustic signals 62 and the filer-bank 60′ processes the second electrical acoustic signals 58 into second electrical sub-band acoustic signals 64. A band summation unit, similar to the one illustrated in
An absolute value determination unit 66, 66′ is used to determine the magnitude of the first electrical sub-band acoustic signal 52 and second electrical sub-band acoustic signal 58 respectively. In this embodiment, the processing unit 34 comprises a first order IIR filter 68, 68′ which uses low-pass filtering of the magnitude of the electrical sub-band acoustic signals 62, 64 in each frequency channel to determine a level of each of the electrical sub-band acoustic signals 62 and 64 in each frequency channel. In this embodiment, the first order IIR filter has time constants in the range of 5-40 ms, preferably 10 ms. The filter could also be IIR filters possibly with different attack and release times such as an attack time between 1 and 1000 ms and a release time between 1 and 40 ms. The level can also be
determined based on the magnitude squared (not shown). The level depends on the impinging acoustical sound signal 50 at the first microphone 12 and the second microphone 14, and the IIR filter 68, 68′ provides a fast estimate.
In an embodiment, instead of estimating a level between the first electrical sub-band acoustic signal and second electrical sub-band acoustic signal in each frequency channel; one can envisage estimating the level between the first electrical sub-band acoustic signal and a weighted sum of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal as indicated by an additional combine unit 505 and weighted signal 505′. In another embodiment, the level between the second electrical sub-band acoustic signal and a weighted sum of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal may also be used. In absence of the combine unit 505; the electrical sub-band acoustic signals 62, 64 in each frequency channel are compared instead of one of the compared signal being the weighted sum of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal.
In each frequency channel, the level of the respective first electrical sub-band acoustic signal 62 and the respective second electrical sub-band acoustic signal 64 is converted into the a domain such as a logarithmic domain or any other domain by unit 70, 70′. A summation unit 72 determines a level difference between the level of sound of the first electrical acoustic signal 52 and the level of sound of the second electrical acoustic signal 58 in each frequency channel.
In order to avoid that the level estimate of the in-ear signal being influenced by feedback events from near-field sounds which may cause that (|Ain-ear|/|ABTE|)>(|Hin-ear|/|HBTE|), in this embodiment the level difference is limited by a level saturation unit 74 in order to ensure that (|Ain-ear|/|ABTE|)<(|Hin-ear|/|HBTE|.) The level saturation unit 74 therefore replaces the value of the level difference by a predetermined level difference threshold value, if the determined value of the level difference exceeds the predetermined level difference threshold value. The predetermined level difference threshold value can be different for different frequency channels. When the level difference is limited, the level difference between the two electrical sub-band acoustic signals 62 and 64 is only partly compensated. An external sound may cause (|Ain-ear|/|ABTE|)>(|Hin-ear|/|HBTE|) when for example there is scratching near the first microphone 12 arranged in the ear 26 or if the second microphone 14 is blocked.
The level difference is then reconverted from the domain such as a logarithmic domain or any other domain into the normal domain by unit 76. The gain unit 80 then converts the level difference into a gain. The gain is applied to second electrical sub-band acoustic signals 64 via the gain unit 80 for feedback frequency channels selected by channel selection unit 78′. The application of the gain compensates the lack of spatial cue of the second electrical acoustic signals 58. The channel selection unit 78′ is configured to select feedback frequency channels based on a feedback stability criterion or based on feedback information stored in memory 38 from, e.g., a fitting procedure. If feedback paths between the speaker 18 and each of the microphones 12 and 14 have been estimated, the selection of the feedback frequency channels can also depend on a prescribed gain, corresponding to the gain which would be applied when no feedback was present in the corresponding frequency channel, and the estimated feedback path.
Channel selection unit 78 selects non-feedback channels based on a feedback stability criterion or based on feedback information stored in memory 38 or based on the result of the channel selection unit 78′. The first electrical sub-band acoustic signals 62 are added by a summation unit 82 to the second electrical sub-band acoustic signals 64 compensated by the gain, which are then synthesized into an electrical output acoustical signal 54 by a synthesize unit 84 which can be converted to an acoustical output sound signal 56 (see
Whenever the feedback path 92 at the first microphone 12 allows to apply the prescribed gain to the first electrical sub-band acoustic signal 62 in a specific frequency channel, the first electrical sub-band acoustic signal 62 is used. However, whenever the feedback path 92 at the first microphone 12 does not allow the first electrical sub-band acoustic signal 62 to be used, the second electrical sub-band acoustic signal 64 compensated for the level difference is used in said specific frequency channel. The second electrical sub-band acoustic signal 64 can also be only used for a specific frequency channel, when low input levels are estimated in that specific frequency channel.
The units 60, 66, 66′, 68, 68′, 70, 70′, 72, 74, 76, 80, 82, and 84 can be physical units or also be algorithms performed on the processing unit 34 of the hearing aid 10.
The gain function determined by the pinna enhancement mode and the directivity enhancement mode can also depend on the overall level of the electrical acoustic signals 52 and 58, for example, the enhancement may only be required in loud sound environments.
The memory 38 is used to store data, e.g., predetermined output test sounds, predetermined electrical acoustic signals, predetermined time delays, algorithms, operation mode instructions, or other data, e.g., used for the processing of electrical acoustic signals.
The receiver unit 40 and the transmitter unit 42 allow the hearing aid 10 to connect to one or more external devices, e.g., a second hearing aid, a mobile phone, an alarm, a personal computer or other devices (not shown). The receiver unit 40 and transmitter unit 42 receive and/or transmit, i.e., exchange, data with the external devices. The hearing aid 10 can for example exchange predetermined output test sounds, predetermined electrical acoustic signals, predetermined time delays, algorithms, operation mode instructions, software updates, or other data used, e.g., for operating the hearing aid 10. The receiver unit 40 and transmitter unit 42 can also be combined in a transceiver unit, e.g., a Bluetooth-transceiver, a wireless transceiver, or the like. The receiver unit 40 and the transmitter unit 42 can also be connected with a connector for a wire, a connector for a cable or a connector for a similar line to connect an external device to the hearing aid 10.
Referring to
In an embodiment, instead of estimating a level between the first electrical sub-band acoustic signal and second electrical sub-band acoustic signal in each frequency channel; one can envisage estimating the level between the first electrical sub-band acoustic signal and a weighted sum of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal. In another embodiment, the level between the second electrical sub-band acoustic signal and a weighted sum of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal may also be used.
In an embodiment, a selection criterion for binaural fitting may also be provided, where the same microphone is chosen on both ears. For example, the BTE (or a weighted sum of the microphones) microphone is selected in a specific frequency band on the left hearing instrument due to feedback problems, the same configuration may be selected on the right hearing instrument, even though there might not be any feedback issues in this particular frequency band on the right hearing instrument. Because of similar configurations on both left and right hearing instruments, localization cues are better maintained.
In some frequency bands, the level difference between the first microphone 12 arranged in the ear 26 and the second microphone 14 arranged behind the ear 26 is greater than the level difference in other frequency bands, as can be seen by comparison of
Furthermore, the frequency response of the first microphone 12 and the second microphone 14 may be different to each other. An offset between the levels of the electrical acoustic signals 52 and 58 generated by the microphones 12 and 14 can be removed by high-pass filtering the level difference before it is converted into a gain (not shown).
Now referring to
The directivity enhancement method mainly enhances the directivity patterns at higher frequencies, i.e. in the following called high frequency (HF) directivity enhancement mode, which means that especially the consonant part of speech will be enhanced. With microphones 12 and 14 placed on each side of the pinna 30 a microphone array which is close to a horizontal array in a horizontal plane 102 can be build (see
Additionally and alternatively, the microphone array including the first input sound transducer and the second input sound transducer are not only in the same horizontal plane but the microphone array is parallel to the front-back axis 104 (see
Referring now to
In an embodiment, the processing unit is configured to convert the distance or delay d from the feedback paths, i.e. first feedback path and second feedback path, into a horizontal distance d′ by d′=d*cos θ or or d*sin(90−θ). The horizontal distance d′ may thus define corresponding delay and/or phase difference between the sound received at the two input transducers. In another embodiment, the processing unit is configured to convert the length of output transducer, tilt and distance or delay d into a horizontal distance d′ using a non-linear function g, such that d′=g(d, length, tilt). In another embodiment, the processing unit is configured to access the horizontal distance d′ stored in a memory that is locally available within the hearing device or remote from the hearing device. The horizontal distance d′ may be stored in the memory as a look up table that provides conversion of the distance or delay d from the feedback paths into a horizontal distance d′. Additionally or alternatively, the processing unit is configured to access the horizontal distance d′ from a neural network providing the most likely angle for a given length of the output transducer and/or tilt of the BTE part of the hearing device.
According to an embodiment of the disclosure, the positioning of the first input sound transducer 12 relative to the second input sound transducer 14 increases distance between the two input transducers (microphones), for example increasing the distance to around 30 mm. Lower frequencies require longer distances between the microphones due to the longer wavelength of the lower-frequency sound signals. Therefore, the increased distance between the two microphones allow for achieving improved directivity for lower frequencies. The longer separation distance between the first microphone 12 and the second microphone 14 would provide a clearer difference between the electrical signals obtained from the two microphones. The directionality (low frequency directionality for instance) is based on this difference and the greater it is, the better directionality and lesser the noise.
Using a balanced speaker 18 along with the MEMS microphone allows for manufacturing the hearing aid 10 having a very small insertion part 44 with good mechanical vibrational decoupling. The housing comprising the balanced speakers may be enclosed by an expandable balloon (not shown), which may be permanent or detachable and can be replaced. The balloon includes a sound exit hole, through which output sound signal is emitted for the user of the hearing device. Using the expandable balloon improves the fit of the earpiece in the ear canal. Such balloon arrangement is provided in US2014/0056454A1, which is incorporated herein by reference.
It should be appreciated that reference throughout this specification to “one embodiment” or “an embodiment” or features included as “can” or “may” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Therefore, it is emphasized and should be appreciated that two or more references to “an embodiment” or “one embodiment” or “an alternative embodiment” or features included as “can” or “may” in various portions of this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure.
Throughout the foregoing description, for the purposes of explanation, numerous specific details were set forth in order to provide a thorough understanding of the disclosure. It will be apparent, however, to one skilled in the art that the disclosure may be practised without some of these specific details.
Accordingly, the scope of the disclosure should be judged in terms of the claims which follow.
Claims
1. A hearing device configured to be worn in, on, behind, and/or at an ear of a user comprising
- a first input sound transducer configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals;
- a second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals;
- a filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal;
- a processing unit configured to
- determine a level of sound for each electrical sub-band acoustic signal,
- determine a level difference between a first electrical sub-band acoustic signal and a second electrical sub-band acoustic signal in at least a part of the frequency channels,
- determine whether the level of the first electrical sub-band acoustic signal or the level of the second electrical sub-band acoustic signal is higher,
- convert the level difference in a direction-dependent gain that is configured
- to amplify the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is higher than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal for generating an electrical output acoustic signal and the second electrical sub-band acoustic signal, and/or
- to attenuate the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is lower than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal for generating an electrical output acoustic signal; and
- an output sound transducer configured to be arranged in the ear canal of the user, wherein the output sound transducer is configured to generate an acoustical output sound signal based on the electrical output acoustical signal,
- wherein the first and second input sound transducers are arranged such that the sound, defining feedback paths, from the output transducer passes the first input sound transducer on its path to the second input sound transducer.
2. A hearing device configured to be worn in, on, behind, and/or at an ear of a user comprising
- a first input sound transducer configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals;
- a second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals;
- a filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal;
- a processing unit configured to
- determine a level of sound for each electrical sub-band acoustic signal,
- determine a level difference between a first electrical sub-band acoustic signal and a second electrical sub-band acoustic signal in at least a part of the frequency channels,
- determine whether the level of the first electrical sub-band acoustic signal or the level of the second electrical sub-band acoustic signal is higher,
- convert the level difference in a direction-dependent gain that is configured
- to amplify the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is higher than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal for generating an electrical output acoustic signal and the second electrical sub-band acoustic signal, and/or
- to attenuate the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is lower than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal for generating an electrical output acoustic signal; and
- an output sound transducer configured to be arranged in the ear canal of the user, wherein the output sound transducer is configured to generate an acoustical output sound signal based on the electrical output acoustical signal,
- wherein the first and second input sound transducers are arranged in different horizontal planes or at least substantially same horizontal plane;
- the processing unit is configured to use a first feedback path between the output transducer and first input transducer, and a second feedback path between the output transducer and the second input transducer to determine a distance or delay or phase difference between the first input transducer and the second input sound transducer, and
- wherein the output transducer and at least one of the first input sound transducer or second input sound transducer are arranged in same or substantially same horizontal plane selected from one of the different horizontal planes or the at least substantially same horizontal plane.
3. A hearing device configured to be worn in, on, behind, and/or at an ear of a user comprising
- a first input sound transducer configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals;
- a second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals;
- a filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal;
- a processing unit configured to
- determine a level of sound for each electrical sub-band acoustic signal,
- determine a level difference between a first electrical sub-band acoustic signal and a second electrical sub-band acoustic signal in at least a part of the frequency channels,
- determine whether the level of the first electrical sub-band acoustic signal or the level of the second electrical sub-band acoustic signal is higher,
- convert the level difference in a direction-dependent gain that is configured
- to amplify the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is higher than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal for generating an electrical output acoustic signal and the second electrical sub-band acoustic signal, and/or
- to attenuate the electrical acoustic signal for generating an electrical output acoustical signal, if the level of the first electrical sub-band acoustic signal is lower than the level of the second electrical sub-band acoustic signal or a combination of the first electrical sub-band acoustic signal and the second electrical sub-band acoustic signal for generating an electrical output acoustic signal; and
- an output sound transducer configured to be arranged in the ear canal of the user, wherein the output sound transducer is configured to generate an acoustical output sound signal based on the electrical output acoustical signal,
- wherein the first and second input sound transducers are arranged in different horizontal planes or at least substantially same horizontal plane;
- the processing unit is configured to use a first feedback path between the output transducer and first input transducer, and a second feedback path between the output transducer and the second input transducer to determine a distance or delay or phase difference between the first input transducer and the second input sound transducer, and,
- wherein when the first and second input sound transducers are arranged in different horizontal planes, the processing unit is configured to convert the distance or delay between the first and second feedback paths into a horizontal distance between the first and second input sound transducers, the horizontal distance being defined by d′=d*cos θor d*sin(90-θ), where d′ corresponds to delay and/or phase difference between a sound received at the first and second input sound transducers, d is distance or delay between the first and second feedback paths and θ is tilt angle between the first input sound transducer and second input sound transducer.
4. The hearing device according to claim 2, wherein the processing unit is configured to select a directional filter optimized for the directionality in lower frequencies based on the distance between the first input sound transducer and second input sound transducer or time delay or phase difference between the microphone signals.
5. The hearing device according to claim 1, wherein the hearing device is a hearing aid.
6. A hearing device configured to be worn in, on, behind, and/or at an ear of a user comprising
- a first input sound transducer configured to be arranged in an ear canal or in the ear of the user, to receive acoustical sound signals from the environment and to generate first electrical acoustic signals based on the received acoustical sound signals;
- a second input sound transducer configured to be arranged behind a pinna or on/behind or at the ear of the user, to receive acoustical sound signals from the environment and to generate second electrical acoustic signals based on the received acoustical sound signals;
- a filter-bank configured to filter each electrical acoustic signal into a number of frequency channels each comprising an electrical sub-band acoustic signal;
- an output sound transducer configured to be arranged in the ear canal of the user; wherein the first and second input sound transducers are arranged in different horizontal planes or at least substantially same horizontal plane; and
- a processing unit configured to use a first feedback path between the output transducer and first input transducer, and a second feedback path between the output transducer and the second input transducer to determine a distance or delay or phase difference between the first input transducer and the second input sound transducer.
7. The hearing device according to claim 6, wherein the first and second input sound transducers are arranged such that the sound, defining the feedback paths, from the output transducer passes the first input sound transducer on its path to the second input sound transducer.
8. The hearing device according to claim 6, wherein the output transducer and at least one of the first input sound transducer or second input sound transducer are arranged in same or substantially same horizontal plane selected from one of the different horizontal planes or the at least substantially same horizontal plane.
9. The hearing device according to claim 6, wherein when the first and second input sound transducers are arranged in different horizontal planes, the processing unit is configured to convert the distance or delay between the first and second feedback paths into a horizontal distance between the first and second input sound transducers, the horizontal distance being defined by d′=d*cos θ or d*sin(90-θ), where d′ corresponds to delay and/or phase difference between a sound received at the first and second input sound transducers, d is distance or delay between the first and second feedback paths and θ is tilt angle between the first input sound transducer and second input sound transducer.
10. The hearing device according to claim 6, wherein the processing unit is configured to select a directional filter optimized for the directionality in lower frequencies based on the distance between the first input sound transducer and second input sound transducer or time delay or phase difference between the microphone signals.
11. The hearing device according to claim 6, wherein the hearing device is a hearing aid.
12. The hearing device according to claim 2, wherein the hearing device is a hearing aid.
13. The hearing device according to claim 3, wherein the hearing device is a hearing aid.
| 6424721 | July 23, 2002 | Hohn |
| 7274794 | September 25, 2007 | Rasmussen |
| 20020041695 | April 11, 2002 | Luo |
| 20080031477 | February 7, 2008 | Von Buol |
| 20080206175 | August 28, 2008 | Chung |
| 20100092016 | April 15, 2010 | Iwano et al. |
| 20130170680 | July 4, 2013 | Gran et al. |
| 20130188816 | July 25, 2013 | Bouse |
Type: Grant
Filed: Nov 9, 2017
Date of Patent: May 21, 2019
Patent Publication Number: 20180070185
Assignee: OTICON A/S (Smørum)
Inventors: Michael Syskind Pedersen (Smorum), Thomas Kaulberg (Smorum), Anders Thule (Smorum), Steen Michael Munk (Smorum), Karsten Bo Rasmussen (Smorum)
Primary Examiner: Matthew A Eason
Application Number: 15/808,604
