Abstract: Aspects of the subject technology provide individual volume controls for concurrently operating audio sources at an electronic device. The audio sources may be spatialized audio sources that are associated with display objects that are displayed to appear at various three-dimensional locations around a user of the electronic device, such as in an extended reality environment. In this way, an electronic device may provide the user with the ability to individually control the volumes of the various audio streams originating from the various three-dimensional locations around the user. The individual volume controls may be applied according to individual volume control curves, and/or based on a user intent determined by the electronic device.

Abstract: A method performed by a first device that has an internal clock. The method transmits a signal to a second device to share a clock of the first device. The method presents an extended reality (XR) environment and plays back audio content on the first electronic device, wherein the XR environment is also presented and the audio content is played back on the second electronic device The method generates timebase information that includes a first timebase that that defines a relationship between the shared clock and internal clock and a second timebase that defines a relationship between the first timebase and a playback state of the audio content. The method transmits the timebase information to the second device that synchronizes the playback state of the audio content in the second device, with the playback state of the audio content in the first device.

Abstract: A method performed by a first electronic device. The method generates, at the first electronic device that is sharing a global clock with a second electronic device, a first timebase information that includes a first timebase that defines a relationship between the shared clock and an internal clock of the first electronic device, the first timebase information for synchronizing playback of a first piece of media content associated with a first application between the first and second electronic devices. The method receives, from a second application, a second timebase information that includes a second timebase that defines a relationship between the first timebase and a second piece of media content, generates a third timebase information that includes the first timebase and the second timebase, and transmits the third timebase information to the second electronic device.

Abstract: A device can receive an audio signal and determine a measure of correlation between the audio signal and a microphone signal. The audio signal can be attenuated based on the measure of correlation. The audio signal can be used to drive one or more speakers of the device. Other aspects are described and claimed.

Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.

Abstract: Remote user interface (UI) rendering effects provide increased privacy and efficiency in computer user input systems. In an aspect, an application specifies remote UI effects to be managed and rendered on UI elements separately from the application, such as by an effects component running outside of the application's operating system process. When user input indicates a preliminary interaction with a UI element, the remote UI effect can be rendered without the application's knowledge of the preliminary interaction, hence preserving a user's privacy from the application of preliminary UI interactions.

Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.

Abstract: In one implementation, a method of playing audio is performed by a device located in a physical environment, coupled to two or more speakers, and including one or more processors and non-transitory memory. The method includes executing an operating system and an application. The method includes receiving, by the operating system from the application via an application programming interface, audio session parameters including a spatial experience value providing instructions for the spatial playback of audio associated with the application. The method includes receiving, by the operating system from the application, instructions to play audio data. The method includes adjusting, by the operating system, the audio data based on the spatial experience value. The method includes sending, by the operating system to the two or more speakers, the adjusted audio data.

Abstract: An audio asset library containing audio assets formatted in accordance with a file format for spatial audio includes asset metadata that enables simulated reality (SR) application developers to compose sounds for use in SR applications. The audio assets are formatted to include audio data encoding a sound capable of being composed into a SR application along with asset metadata describing not only how the sound was encoded, but also how a listener in SR environment experiences the sound. A SR developer platform is configured so that developers can compose sound for SR objects using audio assets stored in the audio library, including editing the asset metadata to include transformation parameters that support dynamic transformation of the asset metadata in the SR environment to alter how the SR listener experiences the composed sound. Other embodiments are also described and claimed.

Abstract: A method performed by a first electronic device. The method generates, at the first electronic device that is sharing a global clock with a second electronic device, a first timebase information that includes a first timebase that defines a relationship between the shared clock and an internal clock of the first electronic device, the first timebase information for synchronizing playback of a first piece of media content associated with a first application between the first and second electronic devices. The method receives, from a second application, a second timebase information that includes a second timebase that defines a relationship between the first timebase and a second piece of media content, generates a third timebase information that includes the first timebase and the second timebase, and transmits the third timebase information to the second electronic device.

Abstract: Channels of audio data in a spatial audio object are associated with any one or more of a direction and a location of one or more recorded sounds, which channels are to be reproduced as spatial sound. A visualized spatial sound object represents a snapshot/thumbnail of the spatial sound. To preview the spatial sound (by experiencing its snapshot or thumbnail), a user manipulates the orientation of the visualized spatial sound object, and a weighted downmix of the channels is rendered for output as a spatial preview sound, e.g., a single output audio signal is provided to a spatial audio renderer; one or more of the channels that are oriented toward the user are emphasized in the preview sound, more than channels that are oriented away from the user. Other aspects are also described and claimed.

Abstract: A device can receive an audio signal and determine a measure of correlation between the audio signal and a microphone signal. The audio signal can be attenuated based on the measure of correlation. The audio signal can be used to drive one or more speakers of the device. Other aspects are described and claimed.

Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user’s current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.

Abstract: An object can represent computer applications that play audio. Audio parameters associated with the audio can be determined based on size of the object so that when the object is large, the audio sounds like it originates from a large sound source or sources. When the object is small, the audio parameters are determined so that the audio sounds like it originates from a small sound source. Other aspects are described.

Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.

Abstract: Channels of audio data in a spatial audio object are associated with any one or more of a direction and a location of one or more recorded sounds, which channels are to be reproduced as spatial sound. A visualized spatial sound object represents a snapshot/thumbnail of the spatial sound. To preview the spatial sound (by experiencing its snapshot or thumbnail), a user manipulates the orientation of the visualized spatial sound object, and a weighted downmix of the channels is rendered for output as a spatial preview sound, e.g., a single output audio signal is provided to a spatial audio renderer; one or more of the channels that are oriented toward the user are emphasized in the preview sound, more than channels that are oriented away from the user. Other aspects are also described and claimed.

Abstract: Channels of audio data in a spatial audio object are associated with any one or more of a direction and a location of one or more recorded sounds, which channels are to be reproduced as spatial sound. A visualized spatial sound object represents a snapshot/thumbnail of the spatial sound. To preview the spatial sound (by experiencing its snapshot or thumbnail), a user manipulates the orientation of the visualized spatial sound object, and a weighted downmix of the channels is rendered for output as a spatial preview sound, e.g., a single output audio signal is provided to a spatial audio renderer; one or more of the channels that are oriented toward the user are emphasized in the preview sound, more than channels that are oriented away from the user. Other aspects are also described and claimed.

Abstract: An audio asset library containing audio assets formatted in accordance with a file format for spatial audio includes asset metadata that enables simulated reality (SR) application developers to compose sounds for use in SR applications. The audio assets are formatted to include audio data encoding a sound capable of being composed into a SR application along with asset metadata describing not only how the sound was encoded, but also how a listener in SR environment experiences the sound. A SR developer platform is configured so that developers can compose sound for SR objects using audio assets stored in the audio library, including editing the asset metadata to include transformation parameters that support dynamic transformation of the asset metadata in the SR environment to alter how the SR listener experiences the composed sound. Other embodiments are also described and claimed.

Abstract: An audio asset library containing audio assets formatted in accordance with a file format for spatial audio includes asset metadata that enables simulated reality (SR) application developers to compose sounds for use in SR applications. The audio assets are formatted to include audio data encoding a sound capable of being composed into a SR application along with asset metadata describing not only how the sound was encoded, but also how a listener in SR environment experiences the sound. A SR developer platform is configured so that developers can compose sound for SR objects using audio assets stored in the audio library, including editing the asset metadata to include transformation parameters that support dynamic transformation of the asset metadata in the SR environment to alter how the SR listener experiences the composed sound. Other embodiments are also described and claimed.

Abstract: Channels of audio data in a spatial audio object are associated with any one or more of a direction and a location of one or more recorded sounds, which channels are to be reproduced as spatial sound. A visualized spatial sound object represents a snapshot/thumbnail of the spatial sound. To preview the spatial sound (by experiencing its snapshot or thumbnail), a user manipulates the orientation of the visualized spatial sound object, and a weighted downmix of the channels is rendered for output as a spatial preview sound, e.g., a single output audio signal is provided to a spatial audio renderer; one or more of the channels that are oriented toward the user are emphasized in the preview sound, more than channels that are oriented away from the user. Other aspects are also described and claimed.