Abstract: Systems and methods for providing an interactive augmented experience using prerecorded video include: creating a scene model based on an image of a physical environment; generating a fantasy object; integrating a position of the fantasy object onto the scene model; determining a state of the fantasy object; selecting, using a type of meta data, one or more frames of a pre-recorded video of the physical environment associated with a desired physical camera, such that each of the frames is associated with a frame number and acquired with a physical camera; synchronizing a virtual camera with the desired physical camera; and projecting, using a first video player or a second video player, the one or more frames onto the scene model to position the scene model relative to the fantasy object, such that the projecting alternates between the first video player and the second video player.

Abstract: Described herein are systems and methods for providing an interactive augmented experience using prerecorded video including creating a scene model based; generating a fantasy object; integrating a position of the fantasy object onto the scene model; determining a state of the fantasy object; selecting, using a type of meta data, one or more frames of a pre-recorded video of the physical environment associated with a desired physical camera, wherein each of the one or more frames is associated with a frame number, wherein each of the one or more frames is acquired with a physical camera; synchronizing a virtual camera with the desired physical camera; and projecting, using the first video player or the second video player, the one or more frames onto the scene model to position the scene model relative to the fantasy object, wherein the projecting alternates between the first video player and the second video player.