Abstract: Embodiments relate to a headset that filters sounds according to a direction of a gaze of a user wearing the headset. The user wears the headset including an eye tracking unit and one or more microphones. The eye tracking unit tracks an orientation of an eye of the user to determine the direction of the gaze of the user. The direction of the gaze may be different from a facing direction of the headset. According to the determined direction of the gaze of the user, input sound signals generated by the microphones can be beamformed to amplify or emphasize sound originating from the direction of the gaze.

Abstract: An eyewear device includes an audio system. In one embodiment, the audio system includes a microphone array that includes a plurality of acoustic sensors. Each acoustic sensor is configured to detect sounds within a local area surrounding the microphone array. For a plurality of the detected sounds, the audio system performs a direction of arrival (DoA) estimation. Based on parameters of the detected sound and/or the DoA estimation, the audio system may then generate or update one or more acoustic transfer functions unique to a user. The audio system may use the one or more acoustic transfer functions to generate audio content for the user.

Abstract: An image of at least a portion of a head of a user is received. A geometry is generated of the head wearing an eyewear device based in part on the received image of the head and a geometry of the eyewear device. The geometry of the eyewear device includes a microphone array composed of a plurality of acoustic sensors that are configured to detect sounds within a local area surrounding the microphone array. A simulation is performed of sound propagation between an audio source and the plurality of acoustic sensors based on the generated geometry. An acoustic transfer function (ATF) is determined associated with the microphone array based on the simulation. The determined ATF is customized to the user, and is provided to the eyewear device of the user.

Abstract: A listening device includes a reference microphone positioned outside a blocked ear canal of a user to receive environmental sounds and generate first signals based on the environmental sounds. A loudspeaker is coupled to the reference microphone and positioned inside the ear canal to generate internal sounds based on the first signals. An internal microphone is positioned inside the ear canal to receive the internal sounds from the loudspeaker and generate second signals based on the internal sounds. A controller is coupled to the internal microphone and the reference microphone to compute a transfer function based on the first signals and the second signals. The transfer function describes a variation between the environmental sounds and the internal sounds caused by the listening device blocking the ear canal. The controller adjusts, based on the transfer function, the internal sounds to mitigate the variation.

Abstract: A method for manufacturing a cartilage conduction audio device is disclosed. A manufacturing system receives data describing a three-dimensional shape of an ear (e.g., the outer ear, behind the ear, the concha bowel, etc.) of a user. The system identifies one or more locations for one or more transducers along a back of an auricle of the ear for the user that vibrate the auricle over a frequency range causing the auricle to create an acoustic pressure wave at an entrance of the ear canal. The system then generates a design for a cartilage conduction audio device for the user based on the one or more identified locations of the transducers at which acoustic pressure waves generated by the one or more transducers satisfy a threshold performance metric for the user. The design may then be used to fabricate the cartilage conduction audio device.

Abstract: Embodiments relate to obtaining head-related transfer function (HRTF) through performing simulation using images of a user's head. The geometry of the user's head is determined based in part on one or more images of the user's head. The simulation of sound propagation from an audio source to the user's head is performed based on the generated geometry. The geometry may be represented in a three-dimensional meshes or principal component analysis (PCA)-based where the user's head is represented as a combination of representative three-dimensional shapes of test subjects' heads.

Abstract: An audio system for providing content to a user. The system includes a first and a second transducer assembly of a plurality of transducer assemblies, an acoustic sensor, and a controller. The first transducer assembly couples to a portion of an auricle of the user's ear and vibrates over a first range of frequencies based on a first set of audio instructions. The vibration causes the portion of the ear to create a first range of acoustic pressure waves. The second transducer assembly is configured to vibrate over a second range of frequencies to produce a second range of acoustic pressure waves based on a second set of audio instructions. The acoustic sensor detects acoustic pressure waves at an entrance of the ear. The controller generates the audio instructions based on audio content to be provided to the user and the detected acoustic pressure waves from the acoustic sensor.

Abstract: Embodiments relate to providing audio by focusing vibrations from an array of a plurality of bone conduction transducers to a cochlea of a user's ear. When bone conduction signals are received, bone conduction transducers of the array transmit vibrations to the cochlea of the user. A bone conduction signal generator generates the bone conduction signals, which may vary in amplitude and phase for different bone conduction transducers to amplify a level of vibrations at the cochlea of one ear while attenuating vibrations at another cochlea of another ear.

Abstract: A system including base stations determines head-related transfer functions (HRTFs) for a user. Each base station is located at a distinct location within a local area and includes a speaker configured to emit a test sound in accordance with calibration instructions. A depth camera assembly determines depth information describing a position of a head-mounted display (HMD) in the local area relative to the locations of the base stations. A microphone is placed in an ear canal of a user wearing the HMD, and generates a respective audio sample from the test sound emitted by the speaker of each base station. A controller determines the relative position of the HMD using the depth information, generates the calibration instructions based on the relative position of the HMD, and determines the HRTFs based on the audio samples.

Abstract: A listening device includes a reference microphone positioned outside a blocked ear canal of a user to receive environmental sounds and generate first signals based on the environmental sounds. A loudspeaker is coupled to the reference microphone and positioned inside the ear canal to generate internal sounds based on the first signals. An internal microphone is positioned inside the ear canal to receive the internal sounds from the loudspeaker and generate second signals based on the internal sounds. A controller is coupled to the internal microphone and the reference microphone to compute a transfer function based on the first signals and the second signals. The transfer function describes a variation between the environmental sounds and the internal sounds caused by the listening device blocking the ear canal. The controller adjusts, based on the transfer function, the internal sounds to mitigate the variation.

Abstract: A technique for auditory masking for a coherence-controlled calibration system includes generating a first auditory masking pattern based on a frequency spectrum of at least a first frame of a first audio signal. The technique continues by generating a first calibration signal based on the first auditory masking pattern. The technique then includes producing a combined input signal based on the first audio signal and the first calibration signal. The technique also includes performing one or more calibration operations based on the combined input signal.

Abstract: A virtual reality (VR) system simulates sounds that a user of the VR system perceives to have originated from sources at desired virtual locations of the VR system. The simulated sounds are generated based on personalized head-related transfer functions (HRTF) of the user that are constructed by applying machine-learned models to a set of anatomical features identified for the user. The set of anatomical features may be identified from images of the user captured by a camera. In one instance, the HRTF is represented as a reduced set of parameters that allow the machine-learned models to capture the variability in HRTF across individual users while being trained in a computationally-efficient manner.

Abstract: A haptic device provides haptic sensation to a user. The haptic device comprises a haptic plate and a plurality of actuators. The haptic plate includes a center portion and an outer portion that circumscribes the center portion. The plurality of actuators is coupled to the outer portion of the haptic plate. Of the plurality of actuators, one or more actuators are configured to generate, in accordance with haptic instructions, a haptic wave that converges to a specific waveform at a specific region of the center portion of the haptic plate. The shape of the specific waveform and the location of the specific region on the center portion of the haptic plate are based in part on the haptic instructions.

Abstract: An audio system includes a transducer assembly, an audio sensor, and a controller. The transducer assembly is coupled to a back of an auricle of an ear of the user. The transducer assembly vibrates the auricle over a frequency range to cause the auricle to create an acoustic pressure wave in accordance with vibration instructions. The acoustic sensor detects the acoustic pressure wave at an entrance of the ear of the user. The controller dynamically adjusts a frequency response model based in part on the detected acoustic pressure wave, updates the vibration instructions using the adjusted frequency response model, and provides the updated vibration instructions to the transducer assembly.

Abstract: A haptic device provides haptic sensation to a user. The haptic device comprises a haptic plate and a plurality of actuators. The haptic plate includes a center portion and an outer portion that circumscribes the center portion. The plurality of actuators is coupled to the outer portion of the haptic plate. Of the plurality of actuators, one or more actuators are configured to generate, in accordance with haptic instructions, a haptic wave that converges to a specific waveform at a specific region of the center portion of the haptic plate. The shape of the specific waveform and the location of the specific region on the center portion of the haptic plate are based in part on the haptic instructions.

Abstract: An audio system includes a transducer assembly, an audio sensor, and a controller. The transducer assembly is coupled to a back of an auricle of an ear of the user. The transducer assembly vibrates the auricle over a frequency range to cause the auricle to create an acoustic pressure wave in accordance with vibration instructions. The acoustic sensor detects the acoustic pressure wave at an entrance of the ear of the user. The controller dynamically adjusts a frequency response model based in part on the detected acoustic pressure wave, updates the vibration instructions using the adjusted frequency response model, and provides the updated vibration instructions to the transducer assembly.

Abstract: Embodiments relate to cancelling crosstalk vibrations due to the use of multiple bone conduction transducers by modifying bone conduction signals sent to the bone conduction transducers. The bone conduction signals are modified using an adaptive filter with its coefficients adjusted based on the vibrations generated at a bone conduction transducer and crosstalk vibrations sensed at a vibration sensor assembly. The bone conduction transducer for generating the calibration vibrations and the vibration sensor assembly for detecting the crosstalk vibrations may be placed at opposite sides of the user's head.

Abstract: An audio system includes a transducer assembly, an audio sensor, and a controller. The transducer assembly is coupled to a back of an auricle of an ear of the user. The transducer assembly vibrates the auricle over a frequency range to cause the auricle to create an acoustic pressure wave in accordance with vibration instructions. The acoustic sensor detects the acoustic pressure wave at an entrance of the ear of the user. The controller dynamically adjusts a frequency response model based in part on the detected acoustic pressure wave, updates the vibration instructions using the adjusted frequency response model, and provides the updated vibration instructions to the transducer assembly.

Abstract: A virtual reality (VR) system simulates sounds that a user of the VR system perceives to have originated from sources at desired virtual locations of the VR system. The simulated sounds are generated based on personalized head-related transfer functions (HRTF) of the user that are constructed by applying machine-learned models to a set of anatomical features identified for the user. The set of anatomical features may be identified from images of the user captured by a camera. In one instance, the HRTF is represented as a reduced set of parameters that allow the machine-learned models to capture the variability in HRTF across individual users while being trained in a computationally-efficient manner.

Abstract: A haptic device configured to provide haptic feedback to a user. In one aspect, a user or part of a user is located on the haptic device including actuators and damping elements. A haptic feedback wave is generated by an actuator and propagated to the user or part of the user on the haptic device. Damping elements receive the haptic feedback wave and suppress the haptic feedback wave to reduce a reflection thereof.