Abstract: A virtual world generation engine and methods for generating virtual worlds from images collected from various sources, including crowdsourced images. A virtual world generation engine may obtain images (e.g., digital photographs, digital video frames, etc.) related to a particular real-world scene, combine the images using image processing techniques such as image stitching techniques to generate composite images representing a view of the scene, and generate models from the composite images. The models may be used in rendering video content representing virtual worlds generated from the collected images of real-world scenes; the video content may be streamed to client device(s). Obtaining the images, generating models, rendering video content from the models, and streaming the video content may be performed in response to user interactions with video content on the client device(s) to allow interactive exploration of the virtual worlds in real-time or near-real time.

Abstract: Disclosed are various embodiments that facilitate remote emulation of computing devices. A request is received from a client device to evaluate an application without installing the application upon the client device. The application is then executed in a hosted environment, and a video signal from the application is captured. User interface data for a browser executed in the client device is generated. The browser renders the video signal and captures user input relative to the video signal. The user interface data and data encoding the video signal are sent to the client device.

Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to discover, select, explore, and manipulate objects within the modeled worlds used to generate video content. The RVE system may implement methods that allow users to view and explore in more detail the features, components, and/or accessories of selected objects that are being manipulated and explored. The RVE system may also implement methods that allow users to interact with interfaces of selected objects or interfaces of components of selected objects.

Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, and explore 2D or 3D modeled worlds of scenes in a video. The system may leverage network-based computation resources to render and stream new video content from the models to clients with low latency. A user may pause a video, step into a scene, and interactively change viewing positions and angles in the model to move through or explore the scene. The user may resume playback of the recorded video when done exploring the scene. Thus, rather than just viewing a pre-rendered scene in a movie from a pre-determined perspective, a user may step into and explore the scene from different angles, and may wander around the scene at will within the scope of the model to discover parts of the scene that are not visible in the original video.

Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to select and manipulate objects within a scene, and to modify an object by adding or removing accessories from the object or otherwise customizing the object according to the user's preferences or desires. The RVE system may also provide an interface or interfaces via which the user can obtain additional information for the object, customize the object, be given a price or price(s) for the object as customized, and purchase the object as specified if desired.

Abstract: A game spectating system that leverages game metadata to allow spectators to join or “step into” games being broadcast. Broadcast content may include user interface elements via which spectators can order, purchase, or otherwise obtain demo or full versions of games. Game client software and game data may be obtained and downloaded to the spectator's devices via the spectating system interfaces and broadcast streams. Spectators can order, purchase, or otherwise obtain characters, avatars, and gear for participation in particular games. Using the spectating UI to obtain the game client software, game data, characters, and gear via the broadcast streams, the spectators may join live game sessions of online games, start new game sessions, and/or replay previously recorded game sessions.

Abstract: A system that collects, analyzes, and applies physical metrics from participants in game environments. Participants (players and/or spectators) in a game may wear or hold devices that collect physical data from the participants via sensors, generate metrics data from the sensor data, and provide the metrics data to a participant metrics module. The module may receive the metrics data from the devices, analyze the metrics data to generate game inputs based on the participants' physical metrics, and provide the game inputs to the game system to affect game play. The module may also receive alerts or other information from the game system or from players, determine feedback for participants according to the received information, and signal the devices to provide feedback or alerts to the participants in the game. The devices may include indicators that are activated by the signals to provide visual, audio, and/or haptic indications to respective participants.

Abstract: An audio analysis system that may analyze participant audio input in a game spectating environment. The audio analysis system may receive audio input for participants (broadcasters and/or spectators) in a game spectating system. The audio analysis system may analyze the audio input to generate audio analysis information for broadcasts, and provide the information to the game spectating system. The audio analysis information may be applied in the game spectating system in various ways. For example, the information may be used to determine active or popular broadcasts, broadcasters, games, and/or recordings of broadcasts, and the active or popular content may be indicated to spectators via a game spectating user interface. The audio analysis system may provide an application programming interface (API) to receive the audio input and to provide audio analysis information.

Abstract: A real-time video exploration (RVE) system that allows users to pause a pre-recorded video (e.g., a movie) and change viewing positions and angles of one or more scenes. The RVE system may also allow users to select, manipulate, and modify objects within one or more scenes. The RVE system may render new video of the scenes and stream the new video to the user's client device. Using the RVE system, a user may create modified versions of one or more scenes to replace original scenes in a video to thus create a modified version of the video. The RVE system may allow the user to record the modified version of the video, and may allow the user to share the modified version of the video with other viewers.

Abstract: Methods and apparatus for collecting information for physical products by providing virtual products to customers. Virtual products (digital representations of physical products) may be provided to customers that provide item information including but not limited to evidence of ownership of corresponding physical products, for example photographs or sales receipts. The customers may use the virtual products in various applications in which the customers may establish a virtual presence. The information provided by the customers may be collected, analyzed, and applied in one or more areas of real-world production and marketing, for example in obtaining competitive pricing information. Digital lockers may be provided for the customers to which the virtual products are stored; the applications may access the virtual products for a customer from a respective digital locker.

Abstract: Methods and apparatus for presenting highlights from broadcasts in spectating environments. A highlight service determines highlight events in the broadcasts, and extracts highlight segments from the broadcasts according to the determined events. Highlight reels may be created from the highlight segments according to highlight selection criteria (genre, game title, broadcaster, time period, etc.) and/or spectator preferences. The highlight service may provide a highlight user interface (UI) via which spectators may selectively view the highlights and highlight reels. The highlight service may generate highlight reels targeted to particular spectators or groups of spectators according to spectators' specified or otherwise determined preferences, demographics, viewing history, and so on.

Abstract: Methods and apparatus for collecting information for physical products by providing virtual products to customers. Virtual products (digital representations of physical products) may be provided to customers that provide item information including but not limited to evidence of ownership of corresponding physical products, for example photographs or sales receipts. The customers may use the virtual products in various applications in which the customers may establish a virtual presence. The information provided by the customers may be collected, analyzed, and applied in one or more areas of real-world production and marketing, for example in obtaining competitive pricing information. Digital lockers may be provided for the customers to which the virtual products are stored; the applications may access the virtual products for a customer from a respective digital locker.

Abstract: Disclosed are various embodiments that facilitate execution of applications through remotely emulated computing devices. An application is executed in a hosted environment. A video signal of the application is encoded into a media stream, which is sent to a client computing device. In various embodiments, access to data that is locally available to the client computing device is facilitated. In various embodiments, data related to the operation of the application is recorded.

Abstract: A game spectating system that provides interfaces and methods for providing game content to viewers. The spectating system obtains game metadata from game systems for games being broadcast by the spectating system according to the API, and generates broadcast content based at least in part on the game metadata. The broadcast content includes user interface (UI) elements for obtaining virtual or physical objects corresponding to the game content. The broadcast content is provided to spectator devices with the broadcasts. The spectating system receives indications of spectators' interactions with the broadcast content from the spectator devices including interactions requesting the virtual or physical objects, and facilitates provisioning or delivery of the objects to respective spectator devices or spectators.

Abstract: A virtual world generation engine and methods for generating virtual worlds from images collected from various sources, including crowdsourced images. A virtual world generation engine may obtain images (e.g., digital photographs, digital video frames, etc.) related to a particular real-world scene, combine the images using image processing techniques such as image stitching techniques to generate composite images representing a view of the scene, and generate models from the composite images. The models may be used in rendering video content representing virtual worlds generated from the collected images of real-world scenes; the video content may be streamed to client device(s). Obtaining the images, generating models, rendering video content from the models, and streaming the video content may be performed in response to user interactions with video content on the client device(s) to allow interactive exploration of the virtual worlds in real-time or near-real time.

Abstract: A media universe system may provide digital media content to clients via methods and apparatus that provide interactive and immersive viewing experiences to the clients. A repository service may store digital assets for the media universe and maintain an asset tracking database that may track how the digital assets of the media universe relate to one another over time within a world encompassed by the media universe. The repository service may also maintain mappings between the digital assets and other content of the media universe. The repository service may serve as a centralized continuity database for the world and the media universe. Providing an accessible, scalable, network-based location for the continuity database may enable developers to build interactive experiences for users to explore the world of the media universe, both spatially and temporally.

Abstract: An audio analysis system that may analyze participant audio input in a game spectating environment. The audio analysis system may receive audio input for participants (broadcasters and/or spectators) in a game spectating system. The audio analysis system may analyze the audio input to generate audio analysis information for broadcasts, and provide the information to the game spectating system. The audio analysis information may be applied in the game spectating system in various ways. For example, the information may be used to determine active or popular broadcasts, broadcasters, games, and/or recordings of broadcasts, and the active or popular content may be indicated to spectators via a game spectating user interface. The audio analysis system may provide an application programming interface (API) to receive the audio input and to provide audio analysis information.

Abstract: A spectating system that leverages game metadata and/or broadcast metadata to provide rewards to or otherwise acknowledge participants in broadcasts. The system may analyze the metadata to detect events or other information about broadcasts, and may recognize and/or reward participants based at least in part on the analysis. Spectators may be rewarded for participating in broadcasts, or in particular events in broadcasts. Broadcasters may be rewarded for in-game achievements or for achieving levels of audience participation or support. Participants may select or vote on other participants to receive rewards. Rewards may, for example, include acknowledgement of participants via the user interface, virtual items such as in-game virtual gear, physical items such as game-related merchandise, and granting of benefits or privileges by the spectating system and/or game system such as special content for a broadcaster's channel.

Abstract: A real-time video targeting (RVT) system may leverage network-based computation resources and services, available 2D or 3D model data, and available viewer information to dynamically personalize content of, or add personalized content to, video for particular viewers or viewer groups. When playing back pre-recorded video to viewers, at least some objects or other content in at least some of the scenes of the video may be replaced with objects or content targeted at particular viewers or groups according to profiles or preferences of the viewers or groups. Since the video is being rendered and streamed to different viewers or groups in real-time by the network-based computation resources and services, any given scene of a video may be modified and viewed in many different ways by different viewers or groups based on the particular viewers' or groups' profiles.

Abstract: Methods and apparatus for determining highlights from broadcasts in spectating environments. A highlight service obtains highlight data for broadcasts including game- and participant-specified events, audio input, and text chat, analyzes the highlight data to determine notable events (highlights) in the broadcasts, and extracts highlight segments from the broadcasts according to the determined events. Highlight reels may be created from the highlight segments according to one or more highlight selection criteria and/or spectator preferences. The highlight service may provide access to the highlights and highlight reels via a highlight user interface (UI). The spectators may selectively view the highlights or highlight reels via the highlight UI.