Abstract: Disclosed herein is a system for leveraging telemetry data representing usage of a component installed on a group of sampled computing devices to confidently infer the quality of a user experience and/or the behavior of the component (e.g., an operating system) on a larger group of unsampled computing devices. The system is configured to use a propensity score matching approach to identify a sampled computing device that best represents an unsampled computing device using configuration data that is collected from both the sampled and unsampled computing devices. The quality of the user experience and/or the behavior of the component may be captured by a metric of interest (e.g., a QoS value). Accordingly, the system is configured to use the known metric of interest, determined from the telemetry data collected for the sampled computing device, to determine or predict the metric of interest for the unsampled computing device.

Abstract: A system for enabling spatializing audio data is provided. The system analyzes audio data to identify when to generate spatialized audio data. The system can receive incoming audio data including a plurality of channel-based audio signals as well as object-based audio. The system performs an analysis of the audio data and/or metadata associated with the audio data to determine when to generate the spatialized audio data. The system can identify one or more categories associated with the audio data (e.g., stereo, mono, game effect, . . . ) and use the category to determine whether to spatialize the audio data or not spatialize the audio data.

Abstract: The present disclosure provides a number of techniques for personalization of spatial audio across a plurality of systems. A participant media system participating in a session may generate two outputs: personalized audio data and depersonalized audio data. When a spectator attempts to spectate the session, a media sharing platform may distribute shared depersonalized audio data to the spectator system. Based on this shared depersonalized audio data, the spectator media system can personalized the audio data to cause an endpoint device to render spectator personalized audio based on HRTF data for the spectator. Accordingly, the spectator personalized audio is personalized and allows a rich, immersive spectating experience that overcome drawbacks associated with receiving personalized audio from participant systems.

Abstract: The techniques disclosed herein provide a high fidelity, rich, and engaging experience for spectators of streaming video services. The techniques disclosed herein enable a system to receive, process and, store session data defining activity of a virtual reality environment. The system can generate recorded video data of the session activity along with rendered spatial audio data, e.g., render the spatial audio in the cloud, for streaming of the video data and rendered spatial audio data to one or more computers. The video data and rendered spatial audio data can provide high fidelity video clips of salient activity of a virtual reality environment. In one illustrative example, the system can automatically create a video from one or more camera positions and audio data that corresponds to the camera positions.

Abstract: The present disclosure provides a number of techniques for personalization of audio for communication to an endpoint device. According to one technique, a cloud-based computing device may receive media data from a media platform, and generate depersonalized audio data based on the media data, the depersonalized audio data including at least one audio component associated with the media platform. The technique may further generate user personalized audio data based on the depersonalized audio data. The user personalized audio data may include at least one audio component personalized based on a unique head-related transfer function (HRTF) data associated with a user or default HRTF data. The user personalized audio may be communicated to the endpoint device for consumption by the user. Such techniques reduce the need for advanced audio processing technologies on client systems and makes personalized audio more available to users.

Abstract: The present disclosure provides a number of techniques for personalization of audio for communication to an endpoint device. According to one technique, a cloud-based computing device may receive media data from a media platform, and generate depersonalized audio data based on the media data, the depersonalized audio data including at least one audio component associated with the media platform. The technique may further generate user personalized audio data based on the depersonalized audio data. The user personalized audio data may include at least one audio component personalized based on a unique head-related transfer function (HRTF) data associated with a user or default HRTF data. The user personalized audio may be communicated to the endpoint device for consumption by the user. Such techniques reduce the need for advanced audio processing technologies on client systems and makes personalized audio more available to users.

Abstract: The techniques disclosed herein provide a high fidelity, rich, and engaging experience for spectators of streaming video services. The techniques disclosed herein enable a system to receive, process and, store session data defining activity of a virtual reality environment. The system can generate recorded video data of the session activity along with rendered spatial audio data, e.g., render the spatial audio in the cloud, for streaming of the video data and rendered spatial audio data to one or more computers. The video data and rendered spatial audio data can provide high fidelity video clips of salient activity of a virtual reality environment. In one illustrative example, the system can automatically create a video from one or more camera positions and audio data that corresponds to the camera positions.

Abstract: A system for enabling spatializing audio data is provided. The system analyzes audio data to identify when to generate spatialized audio data. The system can receive incoming audio data including a plurality of channel-based audio signals as well as object-based audio. The system performs an analysis of the audio data and/or metadata associated with the audio data to determine when to generate the spatialized audio data. The system can identify one or more categories associated with the audio data (e.g., stereo, mono, game effect, . . . ) and use the category to determine whether to spatialize the audio data or not spatialize the audio data.

Abstract: The present disclosure provides a number of techniques for personalization of spatial audio across a plurality of systems. A participant media system participating in a session may generate two outputs: personalized audio data and depersonalized audio data. When a spectator attempts to spectate the session, a media sharing platform may distribute shared depersonalized audio data to the spectator system. Based on this shared depersonalized audio data, the spectator media system can personalized the audio data to cause an endpoint device to render spectator personalized audio based on HRTF data for the spectator. Accordingly, the spectator personalized audio is personalized and allows a rich, immersive spectating experience that overcome drawbacks associated with receiving personalized audio from participant systems.

Abstract: The present disclosure enables applications of a computing system to coordinate object-based audio resources by the use of a minimum resource working set. The minimum resource working set encourages an application to be fair in its requirements since specifying a large number will most likely result in the application receiving zero resources, or losing all of its resources to another application. A working set, which can include a minimum and a maximum working set, also provides a useful metric for the spatial audio resource manager to use when balancing demand. In addition, a minimum working set provides a performance metric for resource balancing since it exposes what the minimum functional requirement is from the maxim requested resource claim.

Abstract: The present disclosure enables applications of a computing system to coordinate object-based audio resources by the use of a minimum resource working set. The minimum resource working set encourages an application to be fair in its requirements since specifying a large number will most likely result in the application receiving zero resources, or losing all of its resources to another application. A working set, which can include a minimum and a maximum working set, also provides a useful metric for the spatial audio resource manager to use when balancing demand. In addition, a minimum working set provides a performance metric for resource balancing since it exposes what the minimum functional requirement is from the maxim requested resource claim.

Abstract: The rendering of media generated by media production systems on a display of a different computer system that operates an operating system. A display of a computer system that operates an operating system is sometimes referred to as a smart display. When the computer system receives the media from the media production system(s), the computer system formulates an operating system control that, when triggered, performs one or more operating system operations. The computer system then displays a visualization of the operating system control along with at least part of the received media on the display of the computer system. The operating system control is structured so as to be triggered when a user interacts in at least a particular way with the visualization of the operating system control. Thus, rather than simply render the media as provided, additional operating system level control is provided by the smart display.

Abstract: Embodiments are directed to displaying content projected from a source computing device on a display of a locked target computing device. Embodiments are also directed to projecting control information onto a locked target computing device's display and allowing control of a second computing device using the control information displayed on the target computing device. In one scenario, a target computing device receives a request to display content projected from another computing system. The target computing device determines whether receiving projected content from the other computing system is permissible on the target computing device when the target computing device is in a locked state. Then, upon verifying permissibility, the target computing device provisions computing resources to display the received content while in the locked state. The target computing device may also control functions on the other computing system using control information.