Abstract: An electronic system is described that is responsive to non-verbal commands. The system may include a display component for presenting visual content to a user and an audio system, such as an in-ear or over-the-ear speaker system. The speaker system may be equipped with a bone conduction sensor or in-ear microphone that generates data associated with vibrations of a facial region of the user. The system may use the data to detect non-verbal command in the form of grunts, hums, coughs, tongue clicks, and the like. The system may perform various predetermined operations based on the detected vibrations.

Abstract: An open-ear device performs active noise cancellation (ANC) for a user. A sensor located outside an ear of a user which does not occlude an ear canal of the ear and measures vibrational data indicative of a sound pressure level at a location outside the ear, or a level of pinna vibration of the user. A prediction pipeline generates a prediction of sound pressure within the ear canal using an individualized model, taking into account the measured vibrational data and the unique geometric shape of the user's head and pinna. This sound pressure prediction is used to generate audio instructions for rendering playback at an noise cancellation source, such as a bone conduction transducer and/or cartilage transducer, to perform ANC for the user by cancelling at least portion of the sound received at the ear canal.

Abstract: An electronic system is described that is responsive to non-verbal commands. The system may include a display component for presenting visual content to a user and an audio system, such as an in-ear or over-the-ear speaker system. The speaker system may be equipped with a bone conduction sensor or in-ear microphone that generates data associated with vibrations of a facial region of the user. The system may use the data to detect non-verbal command in the form of grunts, hums, coughs, tongue clicks, and the like. The system may perform various predetermined operations based on the detected vibrations.

Abstract: An audio system includes a speaker having a transducer, where the speaker is positioned within an enclosure that forms a front volume and a rear volume on opposite sides of the transducer. The rear part of the enclosure defining the rear volume is formed of an acoustic metamaterial that defines a plurality of channels within the rear volume, where the number and dimensions of the channels is configured to virtual increase the rear volume to amplify a bass portion of sound produced by the speaker. In addition, the channels may be configured to match an impedance of the front volume to serve as an absorber for high frequency audio.

Abstract: One embodiment of the present invention sets forth a technique for developing a curated transcription of an acoustic experience containing spoken words. The technique includes computing a first metric for a word based on biomarkers associated with the user, where the metric indicates an attentional state of a user perceiving the word during an auditory experience. The technique further includes computing a second metric corresponding to an intelligibility of the word during the auditory experience. The technique also includes computing a third metric corresponding to an importance of the word in a context of other proximate words during the auditory experience. Based on a weighting assigned to each of the first, second and third metric, the technique includes determining whether to transcribe the word on a display.

Abstract: An audio system configured to authenticate a user. The system detects, via a microphone array, airborne acoustic waves corresponding to a vocalization of a user. The system also detects, via a vibration measurement assembly, vibration of tissue of the user caused by the vocalization. The system generates an authentication dataset using the detected airborne acoustic waves and the detected vibration of tissue. The system may authenticate the user based in part on the authentication dataset.

Abstract: An electronic device may include one or more terminals configured to provide a voltage signal to an actuator. The electronic device may detect a current associated with the voltage signal provided by the terminal to the actuator. The electronic device may determine an impedance across associated with the actuator based on the voltage signal and the electrical current. The electronic device may compare the impedance to a threshold impedance to determine whether there is sufficient skin contact with the actuator. The electronic device may provide audio via cartilage conduction if there is sufficient contact based on comparing the impedance to the threshold impedance, or may output a notification to the user to adjust placement of the electronic device to improve contact.

Abstract: An artificial-reality device for audio playback is provided. The artificial-reality device includes: (i) a head-mounted display including at least one lens, and (ii) one or more transducers, coupled to the head-mounted display. The transducers are configured to generate signals that vibrate the at least one lens of the head-mounted display. The at least one lens generates acoustic waves that correspond to media presented by the head-mounted display when vibrated by the one or more transducers. Characteristics of the signals generated by the one or more transducers cause the acoustic waves generated by the at least one lens to be directed towards at least one ear of a user of the artificial reality device. Values of the characteristics for the signals are determined based on: (i) the media presented by the head-mounted display and (ii) characteristics of the at least one lens.

Abstract: An audio system is described for calibrating one or more transducers for a user using the auditory steady state response (ASSR) of the user. The audio system presents an audio calibration signal to the user via a transducer array in the headset. The system measures electrical signals that are generated in the auditory cortex of the brain of the user in response to the presented audio calibration signal. The audio system determines an ASSR of the user based on the measured electrical signals. The audio system determines a value for one or more sound filter parameter based on the determined ASSR and a model. The audio system calibrates the transducer array using the determined sound filter parameters. The calibrated transducer array is used to present audio content to the user.

Abstract: A cognitive load estimation system. The system includes an-in ear device (IED) configured to be placed within an ear canal of a user. The IED includes a first set of functional near-infrared spectroscopy (fNIRS) optodes that are configured to capture first fNIRS signal data representing hemodynamic changes in a brain of the user. The system further includes at least one electroencephalography (EEG) electrode configured to capture electrical signals corresponding to brain activity of the user. The system further includes a controller configured to filter the first fNIRS signal data based in part on the electrical signals to generate filtered fNIRS signal data. The controller is further configured to estimate a cognitive load of the user based on the filtered fNIRS signal data.

Abstract: An audio system comprises an array of transparent piezoelectric transducers on a transparent surface. Each transparent piezoelectric transducer includes one or more piezoelectric layers and one or more conductive layers that are substantially transparent to visible light. A transparent piezoelectric transducer may include, e.g., a first conductive layer, a first piezoelectric layer on the first conductive layer, and a second conductive layer on the first piezoelectric layer. Or in another example, the transparent piezoelectric transducer includes many (e.g., 20-30) piezoelectric layers and many (e.g., 20-30) conductive layers.

Abstract: An in-ear device occludes an ear canal of an ear of a user. The in-ear device is configured to be calibrated such that the user perceives audio content as though the in-ear device is not occluding the ear canal. A transducer of the in-ear device presents audio content, and an inner microphone of the in-ear device detects sound pressure data within the ear canal. A controller of the in-ear device determines a blocked sound pressure at the entrance to the ear canal based on sound pressure data from an outer microphone. The controller generates sound filters custom to the user based in part on the detected sound pressure within the ear canal and the blocked sound pressure at the entrance to the ear canal. The controller adjusts audio content using the sound filter, and the transducer presents the adjusted audio content to the user.

Abstract: A real-time in-ear EEG signal verification system. The system includes an in-ear device (IED) configured to be placed within an ear canal of a user and a controller. The IED includes a speaker configured to present a calibration audio signal to the user, the calibration audio signal being embedded with a predetermined audible feature, and an in-ear electrode configured to be in contact with an inner surface of the ear canal. The controller is configured to instruct the speaker to present the calibration audio signal to the user, and generate neural signal data based on electrical signals from the in-ear electrode. The electrical signals correspond to brain activity of the user in response to the predetermined audible feature. The controller is configured to determine a quality of the generated neural signal data, and perform an action based on the quality of the neural signal data.

Abstract: A design system generates a design for an in-ear device customized for a user. The in-ear device produces audio content for the user. The design system captures anthropometric data of the user. Using machine learning techniques, the design system determines features of an ear of the user from the anthropometric and generates a three dimensional (3D) geometry of the user's ear. A design for the in-ear device is generated based on the 3D geometry of the user's ear and includes a shell configured to fit in at least a portion of an ear canal of the user.

Abstract: A device for in-ear use is provided. The device includes an in-ear fixture configured to seal an ear canal of a user, an internal microphone coupled to receive an internal acoustic signal, propagating through the ear canal of the user, an external microphone coupled to receive an external acoustic signal, propagating through an environment of the user, and a processor that is coupled to an augmented reality headset, the processor configured to identify a vital sign of the user based on at least one of the internal acoustic signal and the external acoustic signal. A memory storing instructions which, when executed by a processor, cause a method for use of the above device to identify a vital sign of a user, the memory, the processor, and the method are also provided.

Abstract: An audio system for providing content to a user. The system includes a first and a second transducer assembly of a plurality of transducer assemblies, an acoustic sensor, and a controller. The first transducer assembly couples to a portion of an auricle of the user's ear and vibrates over a first range of frequencies based on a first set of audio instructions. The vibration causes the portion of the ear to create a first range of acoustic pressure waves. The second transducer assembly is configured to vibrate over a second range of frequencies to produce a second range of acoustic pressure waves based on a second set of audio instructions. The acoustic sensor detects acoustic pressure waves at an entrance of the ear. The controller generates the audio instructions based on audio content to be provided to the user and the detected acoustic pressure waves from the acoustic sensor.

Abstract: A sensor system includes an actuator, an accelerometer coupled with the actuator, a rigid member, a transducer, and one or more processors. The actuator generates motion. The accelerometer outputs an acceleration signal responsive to at least the motion of the actuator. The rigid member extends from a first end coupled with the accelerometer to a second end. The transducer is coupled with the second end of the rigid member. The transducer can be configured to couple with a load, and can output a force signal responsive to at least a portion of the motion of the actuator transmitted to the transducer via the rigid member. The one or more processors determine a mechanical impedance of the load based at least on the acceleration signal and the force signal.

Abstract: A device for performing electrical measurements for in-ear monitoring is provided. The device includes an in-ear fixture configured to fit in an ear canal of a user, a first electrode mounted on the in-ear fixture and configured to receive an electronic signal from the skin, and an internal microphone to receive an acoustic signal, propagating through the ear of the user. The device also includes an external microphone coupled to receive an external acoustic signal, propagating through an environment, and a processor that is coupled to an augmented reality headset, the processor identifies a cardiovascular condition, or a neurologic condition of the user based on at least one of the electronic signals, the internal acoustic signal, and the external acoustic signal. A memory storing instructions which, when executed by a processor cause a method of use of the above device. The memory, the processor and the method are also provided.

Abstract: A computer method for managing, processing and handling sensor signals from an in-ear monitor for immersive reality applications is provided. The method includes receiving, from a first electrode, a first electronic signal from a skin in a first ear canal of a user of an in-ear device, receiving, from a first microphone, a first acoustic signal from the first ear canal of the user of the in-ear monitor, and a second acoustic signal from a second ear canal of the user (binaural data capture), forming an acoustic waveform with the first acoustic signal, forming an electronic waveform with the first electronic signal, and identifying a health condition of the user based on the acoustic waveform and the electronic waveform. A device including a memory storing instructions and processors to execute the instructions to perform the above method are also provided.

Abstract: An in-ear device for immersive reality applications is provided. The device includes an in-ear fixture configured to seal an ear canal of a user, a temperature sensor mounted on the in-ear fixture and configured to receive a temperature signal from the ear canal of the user, and a processor that is coupled to an augmented reality headset, the processor configured to identify a health condition of the user based on the temperature signal. A method for using the above device, a memory storing instructions and a processor that executes the instructions to perform the method are also provided.