Abstract: In one implementation, a method of performing an action is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes receiving, from the image sensor, one or more images of a physical environment. The method includes detecting, in the one or more images of the physical environment, a selection hand gesture selecting a particular actionable item depicted in the one or more images, the particular actionable item being associated with an action. The method includes in response to detecting the selection hand gesture selecting the particular actionable item, performing the action associated with the particular actionable item without displaying a user interface element comprising a selectable control element for invoking the action.

Abstract: In one implementation, a method of detecting an occlusion of an image sensor is performed at a device including one or more image sensors, one or more speakers, one or more processors, and non-transitory memory. The method includes receiving, from the one or more image sensors, an image of a physical environment. The method includes detecting, based on the image of the physical environment, an occlusion at least partially occluding the one or more image sensors. The method includes classifying the occlusion as one of a plurality of occlusion types. The method includes playing, via the one or more speakers, an occlusion notification based on the classification.

Abstract: An output device that includes a housing, a first speaker driver that is integrated within the housing at a first location and is arranged to project sound into an ambient environment in a first direction, and a second speaker driver that is integrated within the housing at a second location that is different than the first location and is arranged to project sound into the ambient environment, where the first and second speaker drivers are integrated within the housing and share a common back volume within the housing.

Abstract: A system can receive, at an extended reality (XR) system worn by a user, a reverberation control signal that is external to media content. The system can generate a reverberation setting comprising a plurality of reverberation parameters utilized to control a simulated reverberation of audio content. The reverberation control signal can tune the reverberation setting for a given application running on the XR system on a per application basis. In some cases, the reverberation setting may be generated based on a video classification, a reverberant characteristic, and/or the reverberation control signal. Other aspects are also described and claimed.

Abstract: In one implementation, a method of performing an action is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes receiving, from the image sensor, one or more images of a physical environment. The method includes detecting, in the one or more images of the physical environment, one or more actionable items respectively associated with one or more actions. The method includes detecting, in the one or more images of the physical environment, a hand gesture indicating a particular actionable item. The method includes in response to detecting the hand gesture, performing an action associated with the particular actionable item.

Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.

Abstract: An audio system and a method of determining an audio filter based on a position of an audio device of the audio system, are described. The audio system receives an image of the audio device being worn by a user and determines, based on the image and a known geometric relationship between a datum on the audio device and an electroacoustic transducer of the audio device, a relative position between the electroacoustic transducer and an anatomical feature of the user. The audio filter is determined based on the relative position. The audio filter can be applied to an audio input signal to render spatialized sound to the user through the electroacoustic transducer, or the audio filter can be applied to a microphone input signal to capture speech of the user by the electroacoustic transducer. Other aspects are also described and claimed.

Abstract: A method performed by a programmed processor of an audio system, the method includes retrieving a head-related transfer function (HRTF) dataset from memory, processing the HRTF dataset to remote comb filtering effects during audio playback; applying, to each HRTF in the processed HRTF dataset, a gain to increase a magnitude of the HRTF at a frequency range; and storing the processed HRTF dataset in memory.

Abstract: An output device that includes a housing, a first speaker driver that is integrated within the housing at a first location and is arranged to project sound into an ambient environment in a first direction, and a second speaker driver that is integrated within the housing at a second location that is different than the first location and is arranged to project sound into the ambient environment, where the first and second speaker drivers are integrated within the housing and share a common back volume within the housing.

Abstract: In one implementation, a method of playing audio data is performed at a device including a frame configured for insertion into an outer ear, a speaker coupled to the frame, an image sensor coupled to the frame, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, one or more images of a physical environment. The method includes generating audio data based on the one or more images of the physical environment. The method includes playing, via the speaker, the audio data.

Abstract: A multimedia device having a housing that includes a display screen, two tweeters, two mid-range drivers, and two woofers, which are integrated into the housing. Both woofers are disposed at a first distance from a center vertical axis of the housing in opposite horizontal directions, both tweeters are disposed at a second distance from the center vertical axis in the opposite horizontal directions, and both mid-range drivers are disposed at a third distance from the center vertical axis in opposite horizontal directions. In addition, both the first and second distances are greater than the third distance.

Abstract: A method for self-calibrating a sound pickup process that uses a microphone array in a wearable device that also includes a loudspeaker, where the microphone array being in a physical arrangement with respect to the loudspeaker. The method obtains, for each of several microphones of the microphone array, one or more transfer functions that each represent a response of the microphone to sound from a position in an acoustic space. The method determines whether a physical arrangement of the microphone array with respect to the loudspeaker has changed and adjusts the transfer function, for at least one of the microphones of the several microphones, in response to determining that the current physical arrangement of the microphone array with respect to the loudspeaker has changed.

Abstract: A computer system outputs audio content via one or more audio output devices. If the audio content includes information that enables spatialization of the audio content, the system outputs the audio content in a simulated three-dimensional environment, including, if the audio content corresponds to a first category of content, causing the one or more audio output devices to simulate production of the audio content in a first virtual space, and if the audio content corresponds to a second category of content, causing the one or more audio output devices to simulate production of the audio content in a second virtual space that has different simulated acoustic properties than simulated acoustic properties of the first virtual space.

Abstract: Disclosed are systems and methods for automatically transitioning between communication modes of wearable audio output devices based solely on acoustic analysis. The audio output devices may operate in one of three electroacoustic modes. In the transparency mode, an audio output device may pass through the speech signal of a nearby user. In the peer-to-peer mode, the audio output device may establish a direct low-latency radio frequency (RF) link to another audio output device. In the telephony mode, the audio output device may communicate with another audio output device using networked telephony. The disclosed methods and systems perform acoustic analysis of the near-field speech signal of a local wearer of the audio output device and the far-field speech signal of a remote talker to determine the best mode for the audio output device to use and to seamlessly transition between the modes as the acoustic environment between the wearers changes.

Abstract: A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatially rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatially rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.

Abstract: A system for enhancing audio including a plurality of sensors, an output device, and a processor in communication with the plurality of sensors and the output device. The processor is configured to process data captured by the plurality of sensors, and based on that, modify an output of the output device. The processor also is configured to determine whether there are a plurality of users associated with a video conferencing session, determine which user of the plurality of users is speaking, and enhance the audio or video output of the speaking user on the output device.

Abstract: Loudspeakers are described that may reduce comb filtering effects perceived by a listener by either 1) moving transducers closer to a sound reflective surface (e.g., a baseplate, a tabletop or a floor) through vertical (height) or rotational adjustments of the transducers or 2) guiding sound produced by the transducers to be released into the listening area proximate to the reflective surface through the use of horns and openings that are at a prescribed distance from the reflective surface. The reduction of this distance between the reflective surface and the point at which sound emitted by the transducers is released into the listening area may lead to shorter reflected path that reduces comb filtering effects caused by reflected sounds that are delayed relative to the direct sound. Accordingly, the loudspeakers shown and described may be placed on reflective surfaces without severe audio coloration caused by reflected sounds.

Abstract: A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatially rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatially rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.

Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.

Abstract: Disclosed are systems and methods for automatically transitioning between communication modes of wearable audio output devices based solely on acoustic analysis. The audio output devices may operate in one of three electroacoustic modes. In the transparency mode, an audio output device may pass through the speech signal of a nearby user. In the peer-to-peer mode, the audio output device may establish a direct low-latency radio frequency (RF) link to another audio output device. In the telephony mode, the audio output device may communicate with another audio output device using networked telephony. The disclosed methods and systems perform acoustic analysis of the near-field speech signal of a local wearer of the audio output device and the far-field speech signal of a remote talker to determine the best mode for the audio output device to use and to seamlessly transition between the modes as the acoustic environment between the wearers changes.