Abstract: The techniques disclosed herein provide apparatuses and related methods for the communication of spatial audio and related metadata. In some implementations, a source provides prerecorded spatial audio that has embedded metadata. A computing device processes the prerecorded spatial audio to generate an audio codec that is segmented to include a first section of audio data and a second section that includes metadata extracted from the prerecorded spatial audio. The generated audio codec may be received by a device that includes an encoder. The encoder may process the generated audio codec to generate audio data that includes the metadata.

Abstract: A system for enabling a shared three-dimensional (“3D”) audio bed available to multiple software applications is provided. The system manages bed metadata defining a number of speaker objects of a 3D audio bed. The bed metadata also associates each speaker object with a location, which in some configurations, is defined by a three-dimensional coordinate system. The bed metadata is communicated to a plurality of applications. The applications can then generate custom 3D audio data that associates individual audio streams with individual speaker objects of the 3D audio bed. The applications can then communicate the custom 3D audio data to a 3D audio bed engine, which causes the processing and rendering of the custom 3D audio data to an output device utilizing a selected spatialization technology. Aspects of the 3D bed can be altered when the spatialization technology or the output device changes.

Abstract: The techniques disclosed herein can enable a system to coordinate the processing of object-based audio and channel-based audio generated by multiple applications. The system determines a spatialization technology to utilize based on contextual data. In some configurations, the contextual data can indicate the capabilities of one or more computing resources. In some configurations, the contextual data can also indicate preferences. The preferences, for example, can indicate user preferences for a type of spatialization technology, e.g., Dolby Atmos, over another type of spatialization technology, e.g., DTSX. Based on the contextual data, the system can select a spatialization technology and a corresponding encoder to process the input signals to generate a spatially encoded stream that appropriately renders the audio of multiple applications to an available output device. The techniques disclosed herein also allow a system to dynamically change the spatialization technologies during use.

Abstract: The techniques disclosed herein provide application programming interfaces (APIs) for enabling a system to select a spatialization technology. The APIs also enable a system to balance resources by allocating audio objects to a number of applications executing on a computer system. The system coordinates the audio objects between applications and each application can control the number of objects they individually generate. In some configurations, the system can also fold audio objects across different applications. Different spatialization technologies can be selected based on an analysis of contextual data and policy data. For instance, when a new headphone system is plugged in, the system may switch from Dolby Atmos to the Microsoft HoloLens HRTF spatialization technology. The system can dynamically control a number of generated audio objects and dynamically change a utilized spatialization technology based on changes to a computing environment.

Abstract: Systems and methods disclosed herein may include receiving from an audio application running on the computing device, a selection of a multimedia endpoint device. The multimedia endpoint device may be connected with the audio application in response to a request from the audio application. An audio stream of the audio application may be separated from a system audio stream. The system audio stream may include a plurality of audio signals generated by system components of the computing device or applications running on the computing device. The plurality of audio signals may be played on a default audio endpoint of the computing device. The separated audio stream of the audio application may be communicated to the selected multimedia endpoint device for playback. Separating the audio stream of the audio application from the system audio stream may be based on an API request from the application.

Abstract: A remote media server provides a resource identifier to a digital media controller. A digital media controller passes this resource identifier to a digital media renderer. The digital media renderer launches an application that processes the resource identifier to access the remote media server and play back the media. Playback is responsive to controls from the digital media controller. The digital media renderer can play back media identified by the digital media controller, but that is encoded and protected in a manner specific to the digital media renderer. The digital media controller can shut down or become dormant to save battery power without affecting playback by the digital media renderer. By providing the information about available applications from the digital media renderer to the digital media controller, the digital media controller can reliably send resource identifiers for which applications are available the digital media renderer.

Abstract: Example apparatus and methods concern a first device (e.g., smart phone, tablet, laptop) that may discover and control remote media sessions (e.g., movie, game, book, podcast) running on remote devices (e.g., smart television, game console). The first device may run a local shell process that interacts with a shell process or other process on a remote device. The local shell process may acquire information about exposed remote media sessions. The local shell process may present a user interface on the first device. The user interface may provide user interface elements (e.g., buttons) for controlling a remote media session. The user interface and user interface elements are native to the first device. The user interface may allow navigating (e.g., flipping) between multiple remote media sessions that are discovered. The local shell process may also discover media sessions local to the first device and include those sessions in the user interface.

Abstract: A remote media server provides a resource identifier to a digital media controller. A digital media controller passes this resource identifier to a digital media renderer. The digital media renderer launches an application that processes the resource identifier to access the remote media server and play back the media. Playback is responsive to controls from the digital media controller. The digital media renderer can play back media identified by the digital media controller, but that is encoded and protected in a manner specific to the digital media renderer. The digital media controller can shut down or become dormant to save battery power without affecting playback by the digital media renderer. By providing the information about available applications from the digital media renderer to the digital media controller, the digital media controller can reliably send resource identifiers for which applications are available the digital media renderer.