Abstract: A spectating system that leverages game metadata and/or broadcast metadata to provide rewards to or otherwise acknowledge participants in broadcasts. The system may analyze the metadata to detect events or other information about broadcasts, and may recognize and/or reward participants based at least in part on the analysis. Spectators may be rewarded for participating in broadcasts, or in particular events in broadcasts. Broadcasters may be rewarded for in-game achievements or for achieving levels of audience participation or support. Participants may select or vote on other participants to receive rewards. Rewards may, for example, include acknowledgement of participants via the user interface, virtual items such as in-game virtual gear, physical items such as game-related merchandise, and granting of benefits or privileges by the spectating system and/or game system such as special content for a broadcaster's channel.

Abstract: A spectating system that exposes an application programming interface (API) to game systems. The spectating system obtains game metadata from the game systems for games being broadcast by the spectating system according to the API, and generates content for the broadcasts based at least in part on the game metadata. The broadcast content is provided to spectator devices with the broadcasts. The spectating system receives indications of spectators' interactions with the broadcast content from the spectator devices, and provides indications of the interactions to the game systems according to the API.

Abstract: A game spectating system that leverages game metadata to allow spectators to join or “step into” games being broadcast. Broadcast content may include user interface elements via which spectators can order, purchase, or otherwise obtain demo or full versions of games. Game client software and game data may be obtained and downloaded to the spectator's devices via the spectating system interfaces and broadcast streams. Spectators can order, purchase, or otherwise obtain characters, avatars, and gear for participation in particular games. Using the spectating UI to obtain the game client software, game data, characters, and gear via the broadcast streams, the spectators may join live game sessions of online games, start new game sessions, and/or replay previously recorded game sessions.

Abstract: A game spectating system that provides interfaces and methods for providing game content to viewers. The spectating system obtains game metadata from game systems for games being broadcast by the spectating system according to the API, and generates broadcast content based at least in part on the game metadata. The broadcast content includes user interface (UI) elements for obtaining virtual or physical objects corresponding to the game content. The broadcast content is provided to spectator devices with the broadcasts. The spectating system receives indications of spectators' interactions with the broadcast content from the spectator devices including interactions requesting the virtual or physical objects, and facilitates provisioning or delivery of the objects to respective spectator devices or spectators.

Abstract: A spectating system that generates game inputs based on spectator inputs and interactions, and provides the game inputs to game systems according to an application programming interface (API). The spectating system may allow spectators to interact with and affect a game being broadcast via inputs to and interactions with user interface (UI) elements presented on the spectating UI. Spectators may affect or influence the game, objects within the game universe, events within the game, or the players in the game via the UI elements on the spectating UI. The spectators may become involved in the games being broadcast by influencing game play via the spectating inputs. Game play for the players may be enhanced by providing interesting variations in game play based on the spectating inputs.

Abstract: An interaction analysis module may collect data about user interactions with video content in a real-time video exploration (RVE) system, analyze the collected data to determine correlations between users or groups of users and particular video content, and provide the analysis data to one or more systems, for example to the RVE system or to an online merchant. The RVE system may dynamically render and stream new video content targeted at particular users or groups based at least in part on the analysis data. Network-based computation resources and services may be leveraged by the RVE system to enable interactive exploration of video content by the users, as well as the real-time rendering and streaming of the new video content. Entities such as online merchants may target information such as advertising or recommendations to particular users or groups based at least in part on the analysis information.

Abstract: A virtual world generation engine and methods for generating virtual worlds from images collected from various sources, including crowdsourced images. A virtual world generation engine may obtain images (e.g., digital photographs, digital video frames, etc.) related to a particular real-world scene, combine the images using image processing techniques such as image stitching techniques to generate composite images representing a view of the scene, and generate models from the composite images. The models may be used in rendering video content representing virtual worlds generated from the collected images of real-world scenes; the video content may be streamed to client device(s). Obtaining the images, generating models, rendering video content from the models, and streaming the video content may be performed in response to user interactions with video content on the client device(s) to allow interactive exploration of the virtual worlds in real-time or near-real time.

Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to discover, select, explore, and manipulate objects within the modeled worlds used to generate video content. The RVE system may implement methods that allow users to view and explore in more detail the features, components, and/or accessories of selected objects that are being manipulated and explored. The RVE system may also implement methods that allow users to interact with interfaces of selected objects or interfaces of components of selected objects.

Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to select and manipulate objects within a scene, and to modify an object by adding or removing accessories from the object or otherwise customizing the object according to the user's preferences or desires. The RVE system may also provide an interface or interfaces via which the user can obtain additional information for the object, customize the object, be given a price or price(s) for the object as customized, and purchase the object as specified if desired.

Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, and explore 2D or 3D modeled worlds of scenes in a video. The system may leverage network-based computation resources to render and stream new video content from the models to clients with low latency. A user may pause a video, step into a scene, and interactively change viewing positions and angles in the model to move through or explore the scene. The user may resume playback of the recorded video when done exploring the scene. Thus, rather than just viewing a pre-rendered scene in a movie from a pre-determined perspective, a user may step into and explore the scene from different angles, and may wander around the scene at will within the scope of the model to discover parts of the scene that are not visible in the original video.

Abstract: A real-time video targeting (RVT) system may leverage network-based computation resources and services, available 2D or 3D model data, and available viewer information to dynamically personalize content of, or add personalized content to, video for particular viewers or viewer groups. When playing back pre-recorded video to viewers, at least some objects or other content in at least some of the scenes of the video may be replaced with objects or content targeted at particular viewers or groups according to profiles or preferences of the viewers or groups. Since the video is being rendered and streamed to different viewers or groups in real-time by the network-based computation resources and services, any given scene of a video may be modified and viewed in many different ways by different viewers or groups based on the particular viewers' or groups' profiles.

Abstract: A real-time video exploration (RVE) system that allows users to pause a pre-recorded video (e.g., a movie) and change viewing positions and angles of one or more scenes. The RVE system may also allow users to select, manipulate, and modify objects within one or more scenes. The RVE system may render new video of the scenes and stream the new video to the user's client device. Using the RVE system, a user may create modified versions of one or more scenes to replace original scenes in a video to thus create a modified version of the video. The RVE system may allow the user to record the modified version of the video, and may allow the user to share the modified version of the video with other viewers.