Abstract: A system receives audio data in a frequency range of 20 Hz-20 kHz. The received audio data is encoded by the system into ultrasonic data in frequencies that are greater than 20 kHz, and transmitted into a local area that is proximal to the transmitting device, i.e., within the transmission range of the transmitting device. An ultrasonic communication device that is located in the transmission range of the transmitting device may receive the ultrasonic data. The received ultrasonic data is decoded by the ultrasonic communication system in the receiving device into audio data in a frequency range of 20 Hz-20 kHz, and subsequently presented to a user of the receiving ultrasonic communication device.

Abstract: An audio system for spatializing virtual sound sources is described. A microphone array of the audio system is configured to monitor sound in a local area. A controller of the audio system identifies sound sources within the local area using the monitored sound from the microphone array and determines their locations. The controller of the audio system generates a target position for a virtual sound source based on one or more constraints. The one or more constraints include that the target position be at least a threshold distance away from each of the determined locations of the identified sound sources. The controller generates one or more sound filters based in part on the target position to spatialize the virtual sound source. A transducer array of the audio system presents spatialized audio including the virtual sound source content based in part on the one or more sound filters.

Abstract: A system is disclosed for using an audio time and level difference renderer (TLDR) to generate spatialized audio content for multiple channels from an audio signal received at a single channel. The system selects an audio TLDR from a set of audio TLDRs based on received input parameters. The system configures the selected audio TLDR based on received input parameters using a filter parameter model to generate a configured audio TLDR that comprises a set of configured binaural dynamic filters, and a configured delay between the multiple channel. The system applies the configured audio TLDR to an audio signal received at the single channel to generate spatialized multiple channel audio content for each channel of the multiple audio channel and presents the generated spatialized audio content at multiple channels to a user via a headset.

Abstract: A system receives audio data in a frequency range of 20 Hz-20 kHz. The received audio data is encoded by the system into ultrasonic data in frequencies that are greater than 20 kHz, and transmitted into a local area that is proximal to the transmitting device, i.e., within the transmission range of the transmitting device. An ultrasonic communication device that is located in the transmission range of the transmitting device may receive the ultrasonic data. The received ultrasonic data is decoded by the ultrasonic communication system in the receiving device into audio data in a frequency range of 20 Hz-20 kHz, and subsequently presented to a user of the receiving ultrasonic communication device.

Abstract: Embodiments relate to an audio system for various artificial reality applications. The audio system performs large scale filter optimization for audio rendering, preserving spatial and intra-population characteristics using neural networks. Further, the audio system performs adaptive hearing enhancement-aware binaural rendering. The audio includes an in-ear device with an inertial measurement unit (IMU) and a camera. The camera captures image data of a local area, and the image data is used to correct for IMU drift. In some embodiments, the audio system calculates a transducer to ear response for an individual ear using an equalization prediction or acoustic simulation framework. Individual ear pressure fields as a function of frequency are generated. Frequency-dependent directivity patterns of the transducers are characterized in the free field. In some embodiments, the audio system includes a headset and one or more removable audio apparatuses for enhancing acoustic features of the headset.

Abstract: A system generates an output audio signal for an object or virtual object using image data of a room to select a room impulse response from a database. A headset may include a depth camera assembly (DCA) and processing circuitry. The DCA generates depth image data of a room. The processing circuitry determines room parameters such as the dimensions of the room based on the depth image data. A room impulse response for the room is determined based on referencing a database of room impulse responses using the room parameters. An output audio signal is generated by convolving a source audio signal of an object with the room impulse response.

Abstract: An audio system is configured to present a modified audio experience that reduces the degradation of a target audio experience presented to a user by the audio system. The audio system includes an acoustic sensor array, a controller, and a playback device array. To generate the modified audio experience, the acoustic sensor array receives the sound waves from one or more non-target audio source(s) causing the degradation, identifies the audio source(s), determines the spatial location of the audio source(s), determines the type of the audio source(s) and generates audio instructions that, when executed by the playback device array, present the modified audio experience to the user. The modified audio experience may perform active noise cancelling, ambient sound masking, and/or neutral sound masking to compensate for the sound waves received from non-target audio sources. The audio system may be part of a headset that can produce an artificial reality environment.