Abstract: An object is detected in images of a live event by storing and indexing templates based on representations of the object from previous images. For example, the object may be a vehicle which repeatedly traverses a course. A first set of images of the live event is captured when the object is at different locations in the live event. A representation of the object in each image is obtained, such as by image recognition techniques, and a corresponding template is stored. When the object again traverses the course, for each location, the stored template which is indexed to the location can be retrieved for use in detecting the object in a current image. The object's current location may be obtained from GPS data from the object, for instance, or from camera sensor data, e.g., pan, tilt and zoom, which indicates a direction in which the camera is pointed.

Abstract: An automated system for measuring information about a target image in a video is described. One embodiment includes receiving a set of one or more video images for the video, automatically finding the target image in at least a subset of the video images, determining one or more statistics regarding the target image being in the video, and reporting the one or more statistics.

Abstract: The path and/or position of an object is tracked using two or more cameras which run asynchronously so there is need to provide a common timing signal to each camera. Captured images are analyzed to detect a position of the object in the image. Equations of motion for the object are then solved based on the detected positions and a transformation which relates the detected positions to a desired coordinate system in which the path is to be described. The position of an object can also be determined from a position which meets a distance metric relative to lines of position from three or more images. The images can be enhanced to depict the path and/or position of the object as a graphical element. Further, statistics such as maximum object speed and distance traveled can be obtained. Applications include tracking the position of a game object at a sports event.

Abstract: A method is disclosed for three-dimensional rendering of a live event such as an automobile race over a client device such as a personal computer. Moving and stationary objects at the event may be rendered using computer-generated graphics of the moving and stationary objects and real time positional data giving the position of the moving objects over time. The positional data may be streamed to the client device and displayed in real time or substantially real time.

Abstract: A video effect is created that provides an experience to a viewer of freezing time during an event that is the subject of a video presentation, investigating the event during that frozen moment in time, and (optionally) resuming the action of the event. During that frozen moment in time, the video can move around the scene of the event and/or zoom in (or out) to better highlight an aspect of the event. In one embodiment, there will be a transition from video captured by a broadcast camera (or another camera) to a high resolution still image, movement around the high resolution still image, and a transition from the high resolution still image back to video from the broadcast camera (or another camera).

Abstract: A telestrator system is disclosed that allows a broadcaster to annotate video during or after an event. For example, while televising a sporting event, an announcer (or other user) can use the present invention to draw over the video of the event to highlight one or more actions, features, etc. In one embodiment, when the announcer draws over the video, it appears that the announcer is drawing on the field or location of the event. Such an appearance can be performed by mapping the pixels location from the user's drawing to three dimensional locations at the event. Other embodiments include drawing on the video without obscuring persons and/or other specified objects, and/or smoothing the drawings in real time.

Abstract: A system is disclosed for using camera attitude sensors with a camera. A camera assembly includes a tripod base, a tripod head interface mounted on the tripod base, a tripod head mounted on the tripod head interface and a camera mounted on the tripod head. The tripod head enables the camera to pan and tilt. The system also includes a first optical encoder for detecting the amount that the camera has been panned and a second optical encoder for detecting the amount that the camera has been tilted. Two inclinometers are mounted on the tripod head interface to measure attitude of the tripod head. Two gyroscopes (“gyros”) are mounted on the camera assembly. Data from the encoders, gyros and inclinometers are packaged and sent to graphics production equipment to be used for enhancing video captured by the camera.

Abstract: A system is disclosed for blending two image that makes use of a color map which indicates colors in a foreground can be mixed with the background and how much of each source to mix. One embodiment of the invention restricts the use of the color map to only pixels in the foreground that correspond to a graphic (or effect) in the background. Another embodiment makes use of a gray scale matte which stores blending values for each pixel in the foreground.

Abstract: A system is disclosed that uses GPS and additional data to determine the location of an object. Typically, GPS receivers need valid data from four satellites to accurately determine a three dimensional location. If a GPS receiver is receiving valid data from fewer than four satellites, then additional data is used to compensate for the shortage of satellites in view of the GPS receiver. Examples of additional data includes a representation of the surface that the object is traveling on, an accurate clock, an odometer, dead reckoning information, pseudolite information, and error correction information from a differential reference receiver. An exemplar use of the disclosed system is to concurrently track a set of one or more automobiles during a race. The determined locations of the automobile can be used to provide route information, to generate statistics and/or to edit video of one or more of the automobiles.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: A system is disclosed that can be used to enhance a video of an event. Sensors are used at the event to acquire information. For example, the system can include pan, tilt and zoom sensors to acquire camera view information. This information can be added to the video signal from a camera (e.g. in the vertical blanking interval) or otherwise transmitted to a central studio. At the studio, the sensor information is used to enhance the video for broadcast. Example enhancements include drawing lines or other shapes in the video, adding advertisements to the video or adding other graphics to the video.

Abstract: A system is disclosed that can determine the speed of a golf club or golf ball, and report that speed in a format suitable for use on a television broadcast, a radio broadcast, the Internet or another medium. In one embodiment, the system includes a set of radars pointed toward the golf ball. Data from the radars is collected and sent to a computer which can determine the speed of the club during a swing, the speed of the ball after being hit, the angle of the path of the ball and/or other related statistics.

Abstract: A system is disclosed that uses GPS and additional data to determine the location of an object. Typically, GPS receivers need valid data from four satellites to accurately determine a three dimensional location. If a GPS receiver is receiving valid data from fewer than four satellites, then additional data is used to compensate for the shortage of satellites in view of the GPS receiver. Examples of additional data includes a representation of the surface that the object is traveling on, an accurate clock, an odometer, dead reckoning information, pseudolite information, and error correction information from a differential reference receiver. An exemplar use of the disclosed system is to concurrently track a set of one or more automobiles during a race. The determined locations of the automobile can be used to provide route information, to generate statistics and/or to edit video of one or more of the automobiles.

Abstract: A system is disclosed that can determine the distance a baseball would have traveled after being hit if its path was not interrupted. Thus, when a player hits a home run and the ball collides with an obstruction such as the seating area of a stadium or a wall, the present invention can determine how far the ball would have traveled had the ball not hit the stadium or the wall. The present invention can also be used to determine information about the path of objects other than a baseball.

Abstract: A system is disclosed that can determine the speed of an object and report that speed in a format suitable for use on a television broadcast, a radio broadcast, the Internet or another medium. One example of a suitable use for the present invention includes determining the speed that a baseball player swings a bat. Another use of the present invention is to measure the speed of a moving ball. In one embodiment, the system includes a set of radars positioned behind and pointed toward the batter. Data from all of the radars is collected and sent to a computer which can determine the start of a pitch, when a ball was hit, the speed of the ball and the speed of the bat.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: A graphic and video are blended by controlling the relative transparency of corresponding pixels in the graphic and the video through the use of blending coefficients. One example of a blending coefficient is an alpha signal used in conjunction with a keyer. The value of a blending coefficient for a pixel in the graphic is based on the luminance and chrominance characteristics of a neighborhood of pixels in the video. Inclusions and exclusions are set up which define how the neighborhood of pixels is used to create or change a particular blending characteristic.

Abstract: A system is disclosed that can measure the vertical height and/or the hang time of a jump. The system includes an acceleration detector, a controller, a display, a power source and a case that houses the components in a manner that allows the device to be worn or held by a person or object. The acceleration detector is used to determine the start of a jump and the end of a jump. Based on the time elapsed between the start of the jump and the end of the jump, the controller can determine the vertical height of the jump and/or the hang time.

Abstract: A system determines the vertical position of an object and report that vertical position in a format suitable for use on a television broadcast, a radio broadcast, the Internet or another medium. One example of a suitable use for the system includes determining the height that a basketball player jumped and adding a graphic to a television broadcast that displays the determined height. The system includes two or more cameras that capture a video image of the object being measured. The object's position in the video images is determined and is used to find the three dimensional location of the object. The three dimensional location includes a height coordinate. In some cases, the height coordinate is the desired vertical position. In other cases, the height or size of the object may be subtracted from the height coordinate to determined the vertical position.