Abstract: Disclosed are systems and methods for automatically transitioning between communication modes of wearable audio output devices based solely on acoustic analysis. The audio output devices may operate in one of three electroacoustic modes. In the transparency mode, an audio output device may pass through the speech signal of a nearby user. In the peer-to-peer mode, the audio output device may establish a direct low-latency radio frequency (RF) link to another audio output device. In the telephony mode, the audio output device may communicate with another audio output device using networked telephony. The disclosed methods and systems perform acoustic analysis of the near-field speech signal of a local wearer of the audio output device and the far-field speech signal of a remote talker to determine the best mode for the audio output device to use and to seamlessly transition between the modes as the acoustic environment between the wearers changes.

Abstract: Processing of ambience and speech can include extracting from audio signals, ambience and speech signals. One or more spatial parameters can be generated that define spatial characteristics of ambience sound in the one or more ambience audio signals. The primary speech signal, the one or more ambience audio signals, and the spatial parameters can be encoded into one or more encoded data streams. Other aspects are described and claimed.

Abstract: A method for providing navigation assistance using a head-worn device that has a camera, several microphones, and several speakers. The method captures sound in an environment as a plurality of microphone audio signals, captures, using the camera, a scene of the environment as a digital image, and processes the digital image to detect an object therein. The method selects, in response to the detection of the object, one of several navigation audio rendering modes. The several navigation audio rendering modes include a first mode that activates an acoustic transparency function to cause the speakers to reproduce the sound of the environment, a second mode that sonifies the object and activates the acoustic transparency function, and a third mode that sonifies the object, partially activates the acoustic transparency function, and an activates active noise cancellation function.

Abstract: A plurality of microphone signals of a microphone array may be obtained. An environment change may be detected based on the microphone signals. In response, a reverberation time environment may be determined. The reverberation may be used to modify a playback audio signal.

Abstract: A method for routing audio content through an electronic device that is to be worn by a user. The method obtains a communication and determines whether the communication is private. In response to determining that the communication is private, the method drives a bone conduction transducer of the electronic device with an audio signal associated with the communication. In response to determining that the communication is not private, however, the method drives a speaker of the electronic device with the audio signal.

Abstract: A method performed by a processor of a computer system including a headset that is to be worn on a head of a user. The method drives a speaker of the headset with an input audio signal to output sound into an environment. The method determines that the speaker is at least partially covered with a cupped hand. In response to determining that the speaker is at least partially covered with the cupped hand, applying a gain to the input audio signal to reduce an output sound level of the speaker.

Abstract: Disclosed are systems and methods for automatically transitioning between communication modes of wearable audio output devices based solely on acoustic analysis. The audio output devices may operate in one of three electroacoustic modes. In the transparency mode, an audio output device may pass through the speech signal of a nearby user. In the peer-to-peer mode, the audio output device may establish a direct low-latency radio frequency (RF) link to another audio output device. In the telephony mode, the audio output device may communicate with another audio output device using networked telephony. The disclosed methods and systems perform acoustic analysis of the near-field speech signal of a local wearer of the audio output device and the far-field speech signal of a remote talker to determine the best mode for the audio output device to use and to seamlessly transition between the modes as the acoustic environment between the wearers changes.

Abstract: A conversation detector processes microphone signals and other sensor signals of a headphone to declare a conversation and configures a filter block to activate a transparency audio signal. It then declares an end to the conversation based on processing one or more of the microphone signals and the other sensor signals, and in response deactivates the transparency audio signal. The conversation detector monitors an idle duration in which an OVAD and a TVAD are both or simultaneously indicating no activity and declares the end to the conversation in response to the idle duration being longer than an idle threshold. Other aspects are also described and claimed.

Abstract: A conversation detector processes microphone signals and other sensor signals of a headphone to declare a conversation and configures a filter block to activate a transparency audio signal. It then declares an end to the conversation based on processing one or more of the microphone signals and the other sensor signals, and in response deactivates the transparency audio signal. The conversation detector monitors an idle duration in which an OVAD and a TVAD are both or simultaneously indicating no activity and declares the end to the conversation in response to the idle duration being longer than an idle threshold. Other aspects are also described and claimed.

Abstract: Acoustic pickup beams (sound beams) can be formed in a physical environment from a plurality of microphone signals. Each of the sound beams can measure acoustic energy in a direction of the respective sound beam. Directional decay of the acoustic energy measured through each of the sound beams is determined. Room surface acoustic properties of the physical environment are determined based on mapping the directional decay of the acoustic energy to the physical environment. Other aspects are described and claimed.

Abstract: A method for routing audio content through an electronic device that is to be worn by a user. The method obtains a communication and determines whether the communication is private. In response to determining that the communication is private, the method drives a bone conduction transducer of the electronic device with an audio signal associated with the communication. In response to determining that the communication is not private, however, the method drives a speaker of the electronic device with the audio signal.

Abstract: Aspects of the subject technology provide for joint processing of signals from acoustic microphones and signals from vibration sensors that directly or remotely sense vibrations of the source of the sound itself. The vibration sensors may include remote vibration sensors such as a light-based microphone, which may be implemented as an optical microphone. Joint processing of the signals may include detecting a sound from the source in the signals from the acoustic microphone by selecting a portion of the signals from the acoustic microphone based on the signals from the vibration sensor.

Abstract: Disclosed are techniques for a multimedia device with audio and video capturing capability to identify an audio device based on acoustic playback signal if the audio device cannot be identified from captured video. The multimedia device may assemble a list of candidate audio devices that are a possible match for the observed audio device from a database of previously recognized audio devices and may transmit commands to the candidate audio devices to play acoustic identification signals. The acoustic identification signals may be audible sound or ultrasonic tone sequences with embedded identification information unique to each audio device. The multimedia device may record and analyze the acoustic identification signals received from any of the candidate audio devices to construct metrics to select the most likely candidate for the observed audio device. The metrics may include time of flight, direction of arrival, received amplitude, direct-to-reverberant ratio (DRR) of the acoustic identification signals.

Abstract: Aspects of the subject technology relate to providing device-independent audio for electronic devices. In one or more implementations, microphone data captured by multiple microphones at an electronic device may be provided to a device-specific audio generalizer at the electronic device. The device-specific audio generalizer may utilize device specific information to generalize the microphone data to form device-independent audio data. The device-independent audio data may then be provided to a device-independent machine learning model at the electronic device or another electronic device for further processing.

Abstract: An audio system and a method of using the audio system to determine one or more of a head-related transfer function (HRTF) or a headphone equalization (HpEQ) filter for a user, are described. The audio system can determine an acoustic transfer function that relates an output signal detected by a microphone of a headphone worn by the user to an in input signal played by a speaker of the headphone. The acoustic transfer function corresponds to sound reflecting from a pinna of the user between the speaker and the microphone, and accordingly, the acoustic transfer function is user-specific. The user-specific acoustic transfer function can be used to determine the HRTF or the HpEQ filter for the user. Other aspects are also described and claimed.

Abstract: A method performed by a programmed processor, the method including receiving an input noise signal, generating, using a machine learning model that has an input based on the input noise signal, a mono audio signal that includes a sound and a spatial parameter for the mono audio signal, and generating spatial audio data by spatially encoding the mono audio signal according to the spatial parameter.

Abstract: Sound sources can be spatially rendered in a setting and shown through a display. In response to satisfaction of a threshold criterion that is satisfied based on relative distance between the sound sources and a position of a listener, the rendering of the sound sources can be adjusted to maintain spatial integrity of the sound sources. The adjustment can be performed to prevent one of the sound sources from arriving at the listener earlier than another of the sound sources.

Abstract: A method for self-calibrating a sound pickup process that uses a microphone array in a wearable device that also includes a loudspeaker, where the microphone array being in a physical arrangement with respect to the loudspeaker. The method obtains, for each of several microphones of the microphone array, one or more transfer functions that each represent a response of the microphone to sound from a position in an acoustic space. The method determines whether a physical arrangement of the microphone array with respect to the loudspeaker has changed and adjusts the transfer function, for at least one of the microphones of the several microphones, in response to determining that the current physical arrangement of the microphone array with respect to the loudspeaker has changed.

Abstract: In one implementation, a method of visualizing a combined audio pick-up pattern is performed at a first device in a physical environment, the first device including a display, one or more processors, and non-transitory memory. The method includes determining a first audio pick-up pattern of the first device. The method includes determining one or more second audio pick-up patterns of a respective one or more second devices. The method includes determining a combined audio pick-up pattern of the first device and the one or more second devices based on the first audio pick-up pattern and the one or more second audio pick-up patterns. The method includes displaying, on the display, a representation of the combined audio pick-up pattern. In one implementation, a method of determining an audio emission pattern is performed at a first device at a first location, the first device having a microphone, one or more processors, and non-transitory memory.

Abstract: Microphone signals of a primary headphone are processed and either a first transparency mode of operation is activated or a second transparency mode of operation. In another aspect, a processor enters different configurations in response to estimated ambient acoustic noise being lower or higher than a threshold, wherein in a first configuration a transparency audio signal is adapted via target voice and wearer voice processing (TVWVP) of a microphone signal to boost detected speech frequencies in the transparency audio signal, and in a second configuration the TVWVP is controlled to, as the estimated ambient acoustic noise increases, reduce boosting of, or not boost at all, the detected speech frequencies in the transparency audio signal. Other aspects are also described and claimed.