Abstract: An open-ear device performs active noise cancellation (ANC) for a user. A sensor located outside an ear of a user which does not occlude an ear canal of the ear and measures vibrational data indicative of a sound pressure level at a location outside the ear, or a level of pinna vibration of the user. A prediction pipeline generates a prediction of sound pressure within the ear canal using an individualized model, taking into account the measured vibrational data and the unique geometric shape of the user's head and pinna. This sound pressure prediction is used to generate audio instructions for rendering playback at an noise cancellation source, such as a bone conduction transducer and/or cartilage transducer, to perform ANC for the user by cancelling at least portion of the sound received at the ear canal.

Abstract: A communication system provides audio content to one or more client devices capable of playing spatialized audio content. For example, the communication system receives audio content from a client device and transmits the audio content to other client devices to be played for users. The communication system dynamically modifies audio content transmitted to different client devices based on a payload including audio parameters (e.g., local area acoustic properties, an audiogram for a user, a head related transfer function for a user, etc.) received from a client device.

Abstract: An audio system includes a speaker having a transducer, where the speaker is positioned within an enclosure that forms a front volume and a rear volume on opposite sides of the transducer. The rear part of the enclosure defining the rear volume is formed of an acoustic metamaterial that defines a plurality of channels within the rear volume, where the number and dimensions of the channels is configured to virtual increase the rear volume to amplify a bass portion of sound produced by the speaker. In addition, the channels may be configured to match an impedance of the front volume to serve as an absorber for high frequency audio.

Abstract: A communication system provides audio content to one or more client devices capable of playing spatialized audio content. For example, the communication system receives audio content from a client device and transmits the audio content to other client devices to be played for users. The communication system dynamically modifies audio content transmitted to different client devices based on a payload including audio parameters (e.g., local area acoustic properties, an audiogram for a user, a head related transfer function for a user, etc.) received from a client device.

Abstract: A system for presenting audio content to a user. The system comprises one or more microphones coupled to a frame of a headset. The one or more microphones capture sound from a local area. The system further comprises an audio controller integrated into the headset and communicatively coupled to an in-ear device worn by a user. The audio controller identifies one or more sound sources in the local area based on the captured sound. The audio controller further determines a target sound source of the one or more sound sources and determines one or more filters to apply to a sound signal associated with the target sound source in the captured sound. The audio controller further generates an augmented sound signal by applying the one or more filters to the sound signal and provides the augmented sound signal to the in-ear device for presentation to a user.

Abstract: A system for presenting audio content to a user. The system comprises one or more microphones coupled to a frame of a headset. The one or more microphones capture sound from a local area. The system further comprises an audio controller integrated into the headset and communicatively coupled to an in-ear device worn by a user. The audio controller identifies one or more sound sources in the local area based on the captured sound. The audio controller further determines a target sound source of the one or more sound sources and determines one or more filters to apply to a sound signal associated with the target sound source in the captured sound. The audio controller further generates an augmented sound signal by applying the one or more filters to the sound signal and provides the augmented sound signal to the in-ear device for presentation to a user.

Abstract: An audio system is described for calibrating one or more transducers for a user using the auditory steady state response (ASSR) of the user. The audio system presents an audio calibration signal to the user via a transducer array in the headset. The system measures electrical signals that are generated in the auditory cortex of the brain of the user in response to the presented audio calibration signal. The audio system determines an ASSR of the user based on the measured electrical signals. The audio system determines a value for one or more sound filter parameter based on the determined ASSR and a model. The audio system calibrates the transducer array using the determined sound filter parameters. The calibrated transducer array is used to present audio content to the user.

Abstract: A device for in-ear use is provided. The device includes an in-ear fixture configured to seal an ear canal of a user, an internal microphone coupled to receive an internal acoustic signal, propagating through the ear canal of the user, an external microphone coupled to receive an external acoustic signal, propagating through an environment of the user, and a processor that is coupled to an augmented reality headset, the processor configured to identify a vital sign of the user based on at least one of the internal acoustic signal and the external acoustic signal. A memory storing instructions which, when executed by a processor, cause a method for use of the above device to identify a vital sign of a user, the memory, the processor, and the method are also provided.

Abstract: An audio system for artificial reality systems is configured to reduce feedback and mitigate entrainment in audio content presented to the user. The audio system utilizes adaptive feedback cancellation processes to reduce feedback. The audio system processes reference signals in a hybrid of the time domain and the frequency domain to achieve rapid convergence with decreased entrainment. The audio system may pre-whiten reference signals and speaker signals and separate the pre-whitened signals into frequency bands using a filter bank. The audio system uses a state space algorithm to generate adaptive filters in each frequency band. The adaptive filters may be applied to the speaker signal to generate a feedback cancelation signal which may be subtracted from the reference signal to decrease feedback.

Abstract: An in-ear device for immersive reality applications is provided. The device includes an in-ear fixture configured to fit in an ear canal of a user, a motion sensor mounted on the in-ear fixture and configured to provide a motion signal indicative of an inner body motion or a bulk body motion of the user, a speaker coupled to provide an audio signal to the user, and a processor that is coupled to an augmented reality headset, the processor configured to identify a health condition of the user based on the motion signal. A method for using the above device, a memory and a processor for storing and executing instructions to perform the method are also provided.

Abstract: An in-ear device for immersive reality applications is provided. The device includes a fixture configured to fit in an ear canal of a user, an emitter mounted on the in-ear fixture and configured to emit a first electromagnetic radiation onto the ear canal of the user, a detector configured to provide a signal indicative of a second electromagnetic radiation from the ear canal of the user, and a processor that is coupled to an augmented reality headset, the processor configured to identify a health condition of the user based on the signal, wherein the second electromagnetic radiation includes at least a portion of the first electromagnetic radiation reflected from a tissue in the ear canal of the user. A memory storing instructions to cause processors in a system to perform a method for use of the above in-ear device, the memory, the processor, the system and the method are also provided.

Abstract: A computer method for managing, processing and handling sensor signals from an in-ear monitor for immersive reality applications is provided. The method includes receiving, from a first electrode, a first electronic signal from a skin in a first ear canal of a user of an in-ear device, receiving, from a first microphone, a first acoustic signal from the first ear canal of the user of the in-ear monitor, and a second acoustic signal from a second ear canal of the user (binaural data capture), forming an acoustic waveform with the first acoustic signal, forming an electronic waveform with the first electronic signal, and identifying a health condition of the user based on the acoustic waveform and the electronic waveform. A device including a memory storing instructions and processors to execute the instructions to perform the above method are also provided.

Abstract: An in-ear device for immersive reality applications is provided. The device includes an in-ear fixture configured to seal an ear canal of a user, a temperature sensor mounted on the in-ear fixture and configured to receive a temperature signal from the ear canal of the user, and a processor that is coupled to an augmented reality headset, the processor configured to identify a health condition of the user based on the temperature signal. A method for using the above device, a memory storing instructions and a processor that executes the instructions to perform the method are also provided.

Abstract: A device for performing electrical measurements for in-ear monitoring is provided. The device includes an in-ear fixture configured to fit in an ear canal of a user, a first electrode mounted on the in-ear fixture and configured to receive an electronic signal from the skin, and an internal microphone to receive an acoustic signal, propagating through the ear of the user. The device also includes an external microphone coupled to receive an external acoustic signal, propagating through an environment, and a processor that is coupled to an augmented reality headset, the processor identifies a cardiovascular condition, or a neurologic condition of the user based on at least one of the electronic signals, the internal acoustic signal, and the external acoustic signal. A memory storing instructions which, when executed by a processor cause a method of use of the above device. The memory, the processor and the method are also provided.

Abstract: A communication system provides audio content to one or more client devices capable of playing spatialized audio content. For example, the communication system receives audio content from a client device and transmits the audio content to other client devices to be played for users. The communication system dynamically modifies audio content transmitted to different client devices based on a payload including audio parameters (e.g., local area acoustic properties, an audiogram for a user, a head related transfer function for a user, etc.) received from a client device.

Abstract: A system provides ECG monitoring for a user. The system includes an in-ear device and processor. The in-ear device includes in-ear electrodes that capture electrical signals of the pulses of the heartbeat of the user from within the user's ear canal, and an out-of-ear electrode that does not contact any surface of the user's ear or ear canal, and captures electrical signals of pulses of the heartbeat of the user from a fingertip of the user when the user contacts the out-of-ear electrode with their fingertip. The processor generates ECG data using captured electrical signals responsive to a determination that the user has positioned a finger to touch the out-of-ear electrode on the in-ear device. This configuration allows the out-of-ear electrode to, when touched by the user's fingertip, effectively function as an arm electrode, allowing for ECG data to be measured from two different angles, through a path that passes through the user's heart.

Abstract: An audio system for artificial reality systems is configured to reduce feedback and mitigate entrainment in audio content presented to the user. The audio system utilizes adaptive feedback cancellation processes to reduce feedback. The audio system processes reference signals in a hybrid of the time domain and the frequency domain to achieve rapid convergence with decreased entrainment. The audio system may pre-whiten reference signals and speaker signals and separate the pre-whitened signals into frequency bands using a filter bank. The audio system uses a state space algorithm to generate adaptive filters in each frequency band. The adaptive filters may be applied to the speaker signal to generate a feedback cancelation signal which may be subtracted from the reference signal to decrease feedback.

Abstract: A wearable device assembly is described for determining eye-tracking information of a user using generated biopotential signals on the head of the user. The eye tracking system monitors biopotential signals generated on a head of a user using electrodes that are mounted on a device that is coupled to the head of the user. The system determines eye-tracking information for the user based on the monitored biopotential signals using a machine learning model. The system performs at least one action based in part on the determined eye-tracking information.

Abstract: An audio system is described for calibrating one or more transducers for a user using the auditory steady state response (ASSR) of the user. The audio system presents an audio calibration signal to the user via a transducer array in the headset. The system measures electrical signals that are generated in the auditory cortex of the brain of the user in response to the presented audio calibration signal. The audio system determines an ASSR of the user based on the measured electrical signals. The audio system determines a value for one or more sound filter parameter based on the determined ASSR and a model. The audio system calibrates the transducer array using the determined sound filter parameters. The calibrated transducer array is used to present audio content to the user.

Abstract: A system provides blood pressure monitoring for a user. The system includes an in-ear device, a sensor, and a processor. The in-ear device includes in-ear electrodes that capture electrical signals of pulses of a user's heartbeat from within an ear canal of the user. The sensor captures sensor data indicating tissue movements caused by the user's heartbeat. The processor determines a time interval between a peak in an R wave in electrocardiogram (EKG) data generated using the electrical signals and a peak in a waveform representing the tissue movement generated using the sensor data. The processor determines a blood pressure level of the user using the time interval. The sensor may be located on the in-ear device, and may be a motion sensor, an acoustic sensor, or a photoplethysmogram (PPG) sensor.