Abstract: A real-time image-manipulation based synchronization system and method for live or pre-recorded media content, such as an MP4, WebM, Flash, Real, or Windows Media stream, are provided in which the media content is synchronized with a series of interactive elements that are part of a rich media presentation. The media content may be any combination of audio and video data, including webcam output and screen capture output, and the synchronization commands are embedded by modifying the video image (frame) or audio data itself, without the need for a separate (often proprietary) metadata channel, allowing a broad distribution in any video format, including H.264/HTML5.