Abstract: Embodiments relate to an audio system that performs equalization of audio signals based on one or more diffuse field head-related transfer functions (HRTFs) and device-specific data. User-specific data and device-specific data (i.e., transducer-specific data) are applied to an acoustic model to predict an acoustic response for a user. An equalization filter is then determined using the acoustic response and the one or more diffuse field HRTFs. The equalization filter is applied to a processed version of an audio signal to create a modified version of the audio signal. The modified version of the audio signal is presented to the user via a transducer array of the audio system. The audio system can further include a microphone assembly that reduces the Helmholtz resonance effect.

Abstract: An audio system for spatializing virtual sound sources is described. A microphone array of the audio system is configured to monitor sound in a local area. A controller of the audio system identifies sound sources within the local area using the monitored sound from the microphone array and determines their locations. The controller of the audio system generates a target position for a virtual sound source based on one or more constraints. The one or more constraints include that the target position be at least a threshold distance away from each of the determined locations of the identified sound sources. The controller generates one or more sound filters based in part on the target position to spatialize the virtual sound source. A transducer array of the audio system presents spatialized audio including the virtual sound source content based in part on the one or more sound filters.

Abstract: An audio system for spatializing virtual sound sources is described. A microphone array of the audio system is configured to monitor sound in a local area. A controller of the audio system identifies sound sources within the local area using the monitored sound from the microphone array and determines their locations. The controller of the audio system generates a target position for a virtual sound source based on one or more constraints. The one or more constraints include that the target position be at least a threshold distance away from each of the determined locations of the identified sound sources. The controller generates one or more sound filters based in part on the target position to spatialize the virtual sound source. A transducer array of the audio system presents spatialized audio including the virtual sound source content based in part on the one or more sound filters.

Abstract: A headset includes multiple pairs of acoustic sensors for capturing audio of a local area surrounding the headset. Each pair of acoustic sensors includes an acoustic sensor on a side of the headset and an additional acoustic sensor on an opposite side of the headset. One pair of acoustic sensors is positioned closer to the ears of a user than other pairs of acoustic sensors. The headset determines a filter for each pair of acoustic sensors that modifies audio captured by the acoustic sensors of a pair. Application of the filter causes audio captured by the pair of acoustic sensors to have sound similar to audio captured at the user's ears. In some embodiments, audio from multiple pairs of acoustic sensors is filtered by corresponding filters then combined.

Abstract: Embodiments relate to an audio system that performs equalization of audio signals based on one or more diffuse field head-related transfer functions (HRTFs) and device-specific data. User-specific data and device-specific data (i.e., transducer-specific data) are applied to an acoustic model to predict an acoustic response for a user. An equalization filter is then determined using the acoustic response and the one or more diffuse field HRTFs. The equalization filter is applied to a processed version of an audio signal to create a modified version of the audio signal. The modified version of the audio signal is presented to the user via a transducer array of the audio system. The audio system can further include a microphone assembly that reduces the Helmholtz resonance effect.

Abstract: Embodiments relate to an audio system that performs equalization of audio signals based on one or more diffuse field head-related transfer functions (HRTFs) and device-specific data. User-specific data and device-specific data (i.e., transducer-specific data) are applied to an acoustic model to predict an acoustic response for a user. An equalization filter is then determined using the acoustic response and the one or more diffuse field HRTFs. The equalization filter is applied to a processed version of an audio signal to create a modified version of the audio signal. The modified version of the audio signal is presented to the user via a transducer array of the audio system. The audio system can further include a microphone assembly that reduces the Helmholtz resonance effect.

Abstract: An in-ear device occludes an ear canal of an ear of a user. The in-ear device is configured to be calibrated such that the user perceives audio content as though the in-ear device is not occluding the ear canal. A transducer of the in-ear device presents audio content, and an inner microphone of the in-ear device detects sound pressure data within the ear canal. A controller of the in-ear device determines a blocked sound pressure at the entrance to the ear canal based on sound pressure data from an outer microphone. The controller generates sound filters custom to the user based in part on the detected sound pressure within the ear canal and the blocked sound pressure at the entrance to the ear canal. The controller adjusts audio content using the sound filter, and the transducer presents the adjusted audio content to the user.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that present spatial audio using the speakers of a wearable audio device and speakers external to the wearable audio device. In particular, in one or more embodiments, the disclosed systems generate spatial audio having a high-frequency component and a low-frequency component. The disclosed systems further generate cross-talk cancellation filters for the low-frequency component of the spatial audio. The disclosed systems can provide the high-frequency component for presentation via speakers of the wearable audio device and the low-frequency component for presentation via the external speakers using the cross-talk cancellation filters. In some cases, the disclosed systems generate the spatial audio or the cross-talk cancellation filters using a personalized interaural display model and/or head-related transfer functions.

Abstract: An audio signal is enhanced using interaural coherence to control noise reduction and binaural cue preservation. Sounds from a local area are detected via an acoustic array. An interaural coherence is determined using the detected sounds. Sound filters for an audio signal are generated based on the interaural coherence. The sound filters implement a tradeoff between increasing signal-to-noise ratio (SNR) between a target source and an interfering source and preserving of binaural information of the interfering source. The tradeoff is controlled based on the interaural coherence. The sound filters are applied to the audio signal to generate audio content. The audio content is presented via a speaker array.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that present spatial audio using the speakers of a wearable audio device and speakers external to the wearable audio device. In particular, in one or more embodiments, the disclosed systems generate spatial audio having a high-frequency component and a low-frequency component. The disclosed systems further generate cross-talk cancellation filters for the low-frequency component of the spatial audio. The disclosed systems can provide the high-frequency component for presentation via speakers of the wearable audio device and the low-frequency component for presentation via the external speakers using the cross-talk cancellation filters. In some cases, the disclosed systems generate the spatial audio or the cross-talk cancellation filters using a personalized interaural display model and/or head-related transfer functions.

Abstract: An audio system for spatializing virtual sound sources is described. A microphone array of the audio system is configured to monitor sound in a local area. A controller of the audio system identifies sound sources within the local area using the monitored sound from the microphone array and determines their locations. The controller of the audio system generates a target position for a virtual sound source based on one or more constraints. The one or more constraints include that the target position be at least a threshold distance away from each of the determined locations of the identified sound sources. The controller generates one or more sound filters based in part on the target position to spatialize the virtual sound source. A transducer array of the audio system presents spatialized audio including the virtual sound source content based in part on the one or more sound filters.

Abstract: A system reduces sound coloration caused by rendering of a 3D audio signal. The system renders the 3D audio signal including a plurality of channels using the input audio signal. Input spectra data defining spectral information of the input audio signal is computed. 3D spectra data defining spectral information of a single channel representation of the 3D audio signal is computed. The system generates a tonal balance filter based on the input spectral data and the 3D spectral data. The tonal balance filter, when applied to the 3D audio signal, reduces sound coloration caused by the rendering of the 3D audio signal. The tonal balance filter is applied to the 3D audio signal to generate an output audio signal and the output audio signal is presented via a speaker array.

Abstract: An in-ear device occludes an ear canal of an ear of a user. The in-ear device is configured to be calibrated such that the user perceives audio content as though the in-ear device is not occluding the ear canal. A transducer of the in-ear device presents audio content, and an inner microphone of the in-ear device detects sound pressure data within the ear canal. A controller of the in-ear device determines a blocked sound pressure at the entrance to the ear canal based on sound pressure data from an outer microphone. The controller generates sound filters custom to the user based in part on the detected sound pressure within the ear canal and the blocked sound pressure at the entrance to the ear canal. The controller adjusts audio content using the sound filter, and the transducer presents the adjusted audio content to the user.

Abstract: An in-ear device occludes an ear canal of an ear of a user. The in-ear device is configured to be calibrated such that the user perceives audio content as though the in-ear device is not occluding the ear canal. A transducer of the in-ear device presents audio content, and an inner microphone of the in-ear device detects sound pressure data within the ear canal. A controller of the in-ear device determines a blocked sound pressure at the entrance to the ear canal based on sound pressure data from an outer microphone. The controller generates sound filters custom to the user based in part on the detected sound pressure within the ear canal and the blocked sound pressure at the entrance to the ear canal. The controller adjusts audio content using the sound filter, and the transducer presents the adjusted audio content to the user.

Abstract: An audio system includes a plurality of transducers, one or more acoustic sensors, and a controller. The plurality of transducers transmits an ultrasonic beam towards an ear of a user. The one or more acoustic sensors detect a reflected signal generated by an interaction of the ultrasonic beam with the ear. The controller updates a three-dimensional geometry of the ear based on the reflected signal. The controller determines a head-related transfer function (HRTF) for the user based in part on the three-dimensional geometry of the ear.

Abstract: A method for adjusting sound (e.g., aural) output of a worn audio device includes obtaining orientation or position data that indicates an orientation or a position of the worn audio device. The method also includes determining at least one change in the orientation or position data indicating a change in orientation or position of the worn audio device. The method also includes adjusting or selecting a filter for adjusting aural output produced by the worn audio device using the orientation or position data, and operating the worn audio device to provide the sound output using the filter in response to the at least one change in the orientation or position data.

Abstract: Embodiments relate to an audio system for various artificial reality applications. The audio system performs large scale filter optimization for audio rendering, preserving spatial and intra-population characteristics using neural networks. Further, the audio system performs adaptive hearing enhancement-aware binaural rendering. The audio includes an in-ear device with an inertial measurement unit (IMU) and a camera. The camera captures image data of a local area, and the image data is used to correct for IMU drift. In some embodiments, the audio system calculates a transducer to ear response for an individual ear using an equalization prediction or acoustic simulation framework. Individual ear pressure fields as a function of frequency are generated. Frequency-dependent directivity patterns of the transducers are characterized in the free field. In some embodiments, the audio system includes a headset and one or more removable audio apparatuses for enhancing acoustic features of the headset.

Abstract: An in-ear device occludes an ear canal of an ear of a user. The in-ear device is configured to be calibrated such that the user perceives audio content as though the in-ear device is not occluding the ear canal. A transducer of the in-ear device presents audio content, and an inner microphone of the in-ear device detects sound pressure data within the ear canal. A controller of the in-ear device determines a blocked sound pressure at the entrance to the ear canal based on sound pressure data from an outer microphone. The controller generates sound filters custom to the user based in part on the detected sound pressure within the ear canal and the blocked sound pressure at the entrance to the ear canal. The controller adjusts audio content using the sound filter, and the transducer presents the adjusted audio content to the user.

Abstract: Embodiments relate to an audio system that performs equalization of audio signals based on one or more diffuse field head-related transfer functions (HRTFs) and device-specific data. User-specific data and device-specific data (i.e., transducer-specific data) are applied to an acoustic model to predict an acoustic response for a user. An equalization filter is then determined using the acoustic response and the one or more diffuse field HRTFs. The equalization filter is applied to a processed version of an audio signal to create a modified version of the audio signal. The modified version of the audio signal is presented to the user via a transducer array of the audio system. The audio system can further include a microphone assembly that reduces the Helmholtz resonance effect.

Abstract: An audio system calibrates a virtual microphone using displacement of an outer ear of a user. A transducer presents audio content to the user. One or more sensors monitor displacement of a portion of a pinna of the user. The displacement may be caused in part by the presented audio content. The audio system estimates a sound pressure at an entrance to an ear canal of the user based on the monitored displacement of the portion of the pinna, generates a sound filter accordingly, and adjusts audio content using the sound filter. The transducer presents the adjusted audio content to the user, thereby improving the user's auditory experience.