Abstract: This disclosure describes, in part, techniques and systems for generating and outputting immersive, multi-device content items in user environment, such as connected homes, offices, and the like. For example, the techniques and systems may output different portions of content on different devices within a user environment based on information such as respective capabilities of the devices, a current location of the user within the environment, a time of day, which user(s) are present in the environment, and/or the like.

Abstract: Functionality is disclosed herein for using a framework for a VR/AR application to utilize different services. In some configurations, a VR/AR application can utilize different services, such as an animation service, a multi-modal disambiguation service, a virtual platform service, a recognition service, an automatic speech recognition (ASR) service, a text-to-speech (TTS) service, a search service, as well as one or more other services. Instead of a developer of the VR/AR application having to develop programming code to implement features provided by one or more of services, the developer may utilize functionality of existing services that are available from a service provider network.

Abstract: A technology is described for streaming object data for a virtual object to a simulation client and dynamically incorporating the virtual object into a simulation environment in response to detecting an interactive event in the simulation environment. An example method may include receiving an indication of an interactive event associated with a simulation environment, where the indication of the interactive event may be sent over a network by a simulation client configured to execute the simulation environment. In response to receiving the indication of the interactive event, object data for a virtual object linked to the interactive event may be identified. An audio stream for the virtual object may be obtained, and the object data and the audio stream may be streamed to the simulation client and the virtual object may be incorporated in the simulation environment.

Abstract: Functionality is disclosed herein for using a framework for a VR/AR application to utilize different services. In some configurations, a VR/AR application can utilize different services, such as an animation service, a multi-modal disambiguation service, a virtual platform service, a recognition service, an automatic speech recognition (ASR) service, a text-to-speech (TTS) service, a search service, as well as one or more other services. Instead of a developer of the VR/AR application having to develop programming code to implement features provided by one or more of services, the developer may utilize functionality of existing services that are available from a service provider network.

Abstract: One or more services may generate audio data and animations of an avatar based on input text. A speech input ingestion (SII) service may identify tags of objects in a virtual environment and associate tags of those objects with words in the input text, which may be stored as metadata in speech markup data. This association may enable an animation service to generate gestures toward objects while animating an avatar, or may be used to create animations or effects of the object. The SII service may analyze input text to identify dialog including multiple speakers associated with the text. The SII service may create metadata to associate certain words with respective speakers (avatars) of those words, which may be processed by the animation service to animate multiple avatars speaking the dialog.

Abstract: Functionality is disclosed herein for using a framework for a VR/AR application to utilize different services. In some configurations, a VR/AR application can utilize different services, such as an animation service, a multi-modal disambiguation service, a virtual platform service, a recognition service, an automatic speech recognition (ASR) service, a text-to-speech (TTS) service, a search service, as well as one or more other services. Instead of a developer of the VR/AR application having to develop programming code to implement features provided by one or more of services, the developer may utilize functionality of existing services that are available from a service provider network.

Abstract: A technology is described for simulating communication expressions detected in speech data using virtual objects. An example method may include receiving speech data for a virtual object configured to simulate communication expressions provided by the speech data. The speech data may be analyzed for an indicator of a communication expression and communication mark data that includes an expression tag representing the communication expression may be generated. The speech data and the communication mark data may be transmitted to a simulation client to enable synchronization of an animated expression for the virtual object with the speech data using the expression tag in the communication mark data.