Abstract: Embodiments of the present invention described herein generally relate to systems, methods and computer program products for tracking and reacting to touch events that a user generates when viewing a video. In particular, the embodiments of the invention relate to systems, methods and computer program products for defining objects that enter and leave a video scene, as well as move within the video scene as a function of time. Embodiments of the invention further relate to systems, methods and computer program products for tracking and reacting to users who generate events through the selection of objects while viewing the video scene, which can be in the form of a video stream or file, as well as reacting to or further processing such events.