Abstract: A method and apparatus for user interaction with a video stream includes providing a video stream capturing a live gaming field, analyzing the video stream so as to detect at least one gaming object of the live gaining field in the video stream, mapping position data related to the respective detected gaming object in the video stream into real world locations so as to prove real world location information related to the respective detected gaming object, the mapping being performed based on a known transformation relation between the positions in the video stream and real world locations, identifying a potential future game event or a combination of future game events, and at least occasionally amending the video stream with at least one interactive visual marker related to the identified potential future game event or combination of game events.