Abstract: Systems and methods for analyzing scenes from cameras imaging an event, such as a sporting event broadcast, are provided. Systems and methods include detecting and tracking patterns and trails. This may be performed with intra-frame processing and without knowledge of camera parameters. A system for analyzing a scene may include an object characterizer, a foreground detector, an object tracker, a trail updater, and a video annotator. Systems and methods may provide information regarding centers and spans of activity based on object locations and trails, which may be used to control camera field of views such as a camera pose and zoom level. A magnification may be determined for images in a video sequence based on the size of an object in the images. Measurements may be determined from object trails in a video sequence based on an effective magnification of images in the video sequence.

Abstract: A device, system, and method generates augmentations for an enhanced display. The method performed at an enhancement server includes receiving device data from a plurality of client devices associated with respective users attending an event at a venue, the client devices configured to capture data associated with the event in the venue. The method includes determining a first client device of the client devices in which an augmentation is to be shown based on the device data. The method includes determining a second client device of the client devices that captured second data corresponding to the augmentation. The method includes facilitating an exchange of the second data with the first client device, the second data being used to augment the first data by generating an enhanced data based on the first and second data for presentation to a first user associated with the first client device.

Abstract: Systems and methods for analyzing scenes from cameras imaging an event, such as a sporting event broadcast, are provided. Systems and methods include detecting and tracking patterns and trails. This may be performed with intra-frame processing and without knowledge of camera parameters. A system for analyzing a scene may include an object characterizer, a foreground detector, an object tracker, a trail updater, and a video annotator. Systems and methods may provide information regarding centers and spans of activity based on object locations and trails, which may be used to control camera field of views such as a camera pose and zoom level. A magnification may be determined for images in a video sequence based on the size of an object in the images. Measurements may be determined from object trails in a video sequence based on an effective magnification of images in the video sequence.

Abstract: A device, system, and method generates augmentations for an enhanced display. The method performed at an enhancement server includes receiving device data from a plurality of client devices associated with respective users attending an event at a venue, the client devices configured to capture data associated with the event in the venue. The method includes determining a first client device of the client devices in which an augmentation is to be shown based on the device data. The method includes determining a second client device of the client devices that captured second data corresponding to the augmentation. The method includes facilitating an exchange of the second data with the first client device, the second data being used to augment the first data by generating an enhanced data based on the first and second data for presentation to a first user associated with the first client device.

Abstract: Systems and methods for analyzing scenes from cameras imaging an event, such as a sporting event broadcast, are provided. Systems and methods include detecting and tracking patterns and trails. This may be performed with intra-frame processing and without knowledge of camera parameters. A system for analyzing a scene may include an object characterizer, a foreground detector, an object tracker, a trail updater, and a video annotator. Systems and methods may provide information regarding centers and spans of activity based on object locations and trails, which may be used to control camera field of views such as a camera pose and zoom level. A magnification may be determined for images in a video sequence based on the size of an object in the images. Measurements may be determined from object trails in a video sequence based on an effective magnification of images in the video sequence.

Abstract: A device, system, and method generates augmentations for an enhanced display. The method performed at an enhancement server includes receiving device data from a plurality of client devices associated with respective users attending an event at a venue, the client devices configured to capture data associated with the event in the venue. The method includes determining a first client device of the client devices in which an augmentation is to be shown based on the device data. The method includes determining a second client device of the client devices that captured second data corresponding to the augmentation. The method includes facilitating an exchange of the second data with the first client device, the second data being used to augment the first data by generating an enhanced data based on the first and second data for presentation to a first user associated with the first client device.

Abstract: An accurate camera pose is determined by pairing a first camera with a second camera in proximity to one another, and by developing a known spatial relationship between them. An image from the first camera and an image from the second camera are analyzed to determine corresponding features in both images, and a relative homography is calculated from these corresponding features. A relative parameter, such as a focal length or an extrinsic parameter is used to calculate a first camera's parameter based on a second camera's parameter and the relative homography.

Abstract: A device, system, and method generates augmentations for an enhanced display. The method performed at an enhancement server includes receiving device data from a plurality of client devices associated with respective users attending an event at a venue, the client devices configured to capture data associated with the event in the venue. The method includes determining a first client device of the client devices in which an augmentation is to be shown based on the device data. The method includes determining a second client device of the client devices that captured second data corresponding to the augmentation. The method includes facilitating an exchange of the second data with the first client device, the second data being used to augment the first data by generating an enhanced data based on the first and second data for presentation to a first user associated with the first client device.

Abstract: A device, system, and method performs a camera driven background subtraction. The method being performed at an electronic device includes receiving information corresponding to an image-capturing device that is capturing an image. The method includes automatically selecting one of a plurality of image analysis mechanisms based upon the information. The method includes receiving the captured image captured by the image-capturing device. The method includes performing an image analysis using the selected image analysis mechanism on the captured image to determine a foreground and a background in the captured image.

Abstract: A device, system, and method performs a camera driven background subtraction. The method being performed at an electronic device includes receiving information corresponding to an image-capturing device that is capturing an image. The method includes automatically selecting one of a plurality of image analysis mechanisms based upon the information. The method includes receiving the captured image captured by the image-capturing device. The method includes performing an image analysis using the selected image analysis mechanism on the captured image to determine a foreground and a background in the captured image.

Abstract: A system and method for automatically repositioning virtual and physical elements in a scene. The system and method being configured to receive a video frame, receive data, including position data, describing a first element to be imaged in the video frame, receive data, including position data, describing a second element to be imaged in the video frame, assign a dynamic status to the first element and automatically reposition at least the first element to create a modified video frame.

Abstract: A method for automatically tracking multiple objects from a sequence of video images that may extract raw data about participating elements in a sporting, or other event, in a way that does not interfere with the actual participating elements in the event. The raw data may include the position and velocity of the players, the referees, and the puck, as well as the team affiliation of the players. These data may be collected in real time and may include accounting for players moving fast and unpredictably, colliding with and occluding each other, and getting in and out of the playing field. The video sequence, captured by a suitable sensor, may be processed by a suitably programmed general purpose computing device.

Abstract: Systems and methods for synchronizing a broadcast video with contextual data are disclosed, wherein the broadcast video is enhanced by graphical overlays. Synchronization is achieved by means of digital watermarking of the broadcast video in conjunction with the graphical-overlays. Exemplary embodiments embed a watermark bitstream into the broadcast video based on an overlay-template, characteristic of a corresponding overlay-graphic. The watermarked video is then transmitted over a communication link to a receiving-end including a detector. According to some embodiment, the embedder inserts the watermark bitstream into the overlay-graphics' regions of the video and the detector extracts the watermark bitstream based on information in the overlay-template and based on a restored version of the original overlay-graphics.

Abstract: A method for automatically tracking multiple objects from a sequence of video images that may extract raw data about participating elements in a sporting, or other event, in a way that does not interfere with the actual participating elements in the event. The raw data may include the position and velocity of the players, the referees, and the puck, as well as the team affiliation of the players. These data may be collected in real time and may include accounting for players moving fast and unpredictably, colliding with and occluding each other, and getting in and out of the playing field. The video sequence, captured by a suitable sensor, may be processed by a suitably programmed general purpose computing device.

Abstract: A method for automatically tracking multiple objects from a sequence of video images that may extract raw data about participating elements in a sporting, or other event, in a way that does not interfere with the actual participating elements in the event. The raw data may include the position and velocity of the players, the referees, and the puck, as well as the team affiliation of the players. These data may be collected in real time and may include accounting for players moving fast and unpredictably, colliding with and occluding each other, and getting in and out of the playing field. The video sequence, captured by a suitable sensor, may be processed by a suitably programmed general purpose computing device.

Abstract: Systems and methods for low-scale and low-cost production of events. The system having a plurality of video cameras, each of the video cameras capturing a video stream, a video processing server receiving the video streams from the video cameras and generating a panoramic video stream from the video streams and a video production server selecting a region of interest based on a selection received from a user and generating a video broadcast including the region of interest, the region of interest being a portion of the panoramic video stream.

Abstract: A method for tracking objects in a scene may include receiving visual-based information of the scene with a vision-based tracking system and telemetry-based information of the scene with a RTLS-based tracking system. The method may also include determining a location and identity of a first object in the scene using a combination of the visual-based information and the telemetry-based information. Another method for tracking objects in a scene may include detecting a location and identity of a first object and determining a telemetry-based measurement between the first object and a second object using a real time locating system (RTLS)-based tracking system. The method may further include determining a location and identity of the second object based on the detected location of the first object and the determined measurement. A system for tracking objects in a scene may include visual-based and telemetry-based information receivers and an object tracker.

Abstract: Embodiments of this invention relate to controlling insertion of visual elements integrated into video. In an embodiment, a method enables control of insertions in a video. In the embodiment, control data is received from a user input device. Movement of at least one point of interest in a video is analyzed to determine video metadata. Finally, a visual element is inserted into a video according to the control data, and the visual element changes or moves with the video as specified by the video metadata to appear integrated with the video.

Abstract: An accurate camera pose is determined by pairing a first camera with a second camera in proximity to one another, and by developing a known spatial relationship between them. An image from the first camera and an image from the second camera are analyzed to determine corresponding features in both images, and a relative homography is calculated from these corresponding features. A relative parameter, such as a focal length or an extrinsic parameter is used to calculate a first camera's parameter based on a second camera's parameter and the relative homography.

Abstract: A viewer may directly interact with a 3D object that is virtually placed in a physical location in a video scene. Initially, the object appears as an integral part of the original video scene and does not interfere with the general viewer's experience of the program. A viewer may initiate interaction with the object using an input device. An interested viewer may navigate through the object's architecture based on the viewer's interest. For example, the viewer may drag the object to a new physical insertion point in the scene. The user may rotate the 3D object into different orientations and zoom in. Each orientation of the object, if selected by the viewer, may invoke a new linked object in the predefined architecture. For example, the viewer may walk through the linked objects in the predefined architecture or observe an object at an increasing level of detail.