Abstract: A system is disclosed that uses GPS and additional data to determine the location of an object. Typically, GPS receivers need valid data from four satellites to accurately determine a three dimensional location. If a GPS receiver is receiving valid data from fewer than four satellites, then additional data is used to compensate for the shortage of satellites in view of the GPS receiver. Examples of additional data includes a representation of the surface that the object is traveling on, an accurate clock, an odometer, dead reckoning information, pseudolite information, and error correction information from a differential reference receiver. An exemplar use of the disclosed system is to concurrently track a set of one or more automobiles during a race. The determined locations of the automobile can be used to provide route information, to generate statistics and/or to edit video of one or more of the automobiles.

Abstract: A system adds a graphical image of the strike zone to a video or other image of a baseball game. The system determines location of the strike zone and the ball in real space. The locations of the strike zone and the ball are depicted in the video. Based on knowing the locations of the strike zone and the ball, the system can determines whether the pitch was a strike or a ball.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: A system is disclosed that can be used to enhance a video of an event. Sensors are used at the event to acquire information. For example, the system can include pan, tilt and zoom sensors to acquire camera view information. This information can be added to the video signal from a camera (e.g. in the vertical blanking interval) or otherwise transmitted to a central studio. At the studio, the sensor information is used to enhance the video for broadcast. Example enhancements include drawing lines or other shapes in the video, adding advertisements to the video or adding other graphics to the video.

Abstract: A system is disclosed that can determine the speed of a golf club or golf ball, and report that speed in a format suitable for use on a television broadcast, a radio broadcast, the Internet or another medium. In one embodiment, the system includes a set of radars pointed toward the golf ball. Data from the radars is collected and sent to a computer which can determine the speed of the club during a swing, the speed of the ball after being hit, the angle of the path of the ball and/or other related statistics.

Abstract: A system is disclosed that uses GPS and additional data to determine the location of an object. Typically, GPS receivers need valid data from four satellites to accurately determine a three dimensional location. If a GPS receiver is receiving valid data from fewer than four satellites, then additional data is used to compensate for the shortage of satellites in view of the GPS receiver. Examples of additional data includes a representation of the surface that the object is traveling on, an accurate clock, an odometer, dead reckoning information, pseudolite information, and error correction information from a differential reference receiver. An exemplar use of the disclosed system is to concurrently track a set of one or more automobiles during a race. The determined locations of the automobile can be used to provide route information, to generate statistics and/or to edit video of one or more of the automobiles.

Abstract: A system is disclosed that can determine the distance a baseball would have traveled after being hit if its path was not interrupted. Thus, when a player hits a home run and the ball collides with an obstruction such as the seating area of a stadium or a wall, the present invention can determine how far the ball would have traveled had the ball not hit the stadium or the wall. The present invention can also be used to determine information about the path of objects other than a baseball.

Abstract: Pan, tilt and zoom sensors are coupled to a broadcast camera in order to determine the field of view of the broadcast camera and to make a rough estimate of a target's location in the broadcast camera's field of view. Pattern recognition techniques can be used to determine the exact location of the target in the broadcast camera's field of view. If a preselected target is at least partially within the field of view of the broadcast camera, all or part of the target's image is enhanced. The enhancements include replacing the target image with a second image, overlaying the target image or highlighting the target image. Examples of a target include a billboard, a portion of a playing field or another location at a live event. The enhancements made to the target's image can be seen by the television viewer but are not visible to persons at the live event.

Abstract: A system is disclosed that can determine the speed of an object and report that speed in a format suitable for use on a television broadcast, a radio broadcast, the Internet or another medium. One example of a suitable use for the present invention includes determining the speed that a baseball player swings a bat. Another use of the present invention is to measure the speed of a moving ball. In one embodiment, the system includes a set of radars positioned behind and pointed toward the batter. Data from all of the radars is collected and sent to a computer which can determine the start of a pitch, when a ball was hit, the speed of the ball and the speed of the bat.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: A system for enhancing the television presentation of an object that can highlight the object without obscuring the image of the object. The system receives a first video image, matches a second video image to a portion of the first video image corresponding to the image of the object. Specific pixels within the portion of the first video image which are not part of the image of the object are modified using a pixel from the second video image.

Abstract: A graphic and video are blended by controlling the relative transparency of corresponding pixels in the graphic and the video through the use of blending coefficients. One example of a blending coefficient is an alpha signal used in conjunction with a keyer. The value of a blending coefficient for a pixel in the graphic is based on the luminance and chrominance characteristics of a neighborhood of pixels in the video. Inclusions and exclusions are set up which define how the neighborhood of pixels is used to create or change a particular blending characteristic.

Abstract: A system is disclosed that can measure the vertical height and/or the hang time of a jump. The system includes an acceleration detector, a controller, a display, a power source and a case that houses the components in a manner that allows the device to be worn or held by a person or object. The acceleration detector is used to determine the start of a jump and the end of a jump. Based on the time elapsed between the start of the jump and the end of the jump, the controller can determine the vertical height of the jump and/or the hang time.

Abstract: A system for enhancing the television presentation of an object at a sporting event includes one or more sensors which are used to determine the location of the object. Based on the location of the object and the field of view of a broadcast camera, a processor determines the position of the object in a video frame of the broadcast camera. Once knowing where the object is positioned within the video frame, the television signal can be edited or augmented to enhance the presentation of the object.

Abstract: Pan, tilt and zoom sensors are coupled to a broadcast camera in order to determine the field of view of the broadcast camera and to make a rough estimate of a target's location in the broadcast camera's field of view. Pattern recognition techniques can be used to determine the exact location of the target in the broadcast camera's field of view. If a preselected target is at least partially within the field of view of the broadcast camera, all or part of the target's image is enhanced. The enhancements include replacing the target image with a second image, overlaying the target image or highlighting the target image. Examples of a target include a billboard, a portion of a playing field or another location at a live event. The enhancements made to the target's image can be seen by the television viewer but are not visible to persons at the live event.

Abstract: A system determines the vertical position of an object and report that vertical position in a format suitable for use on a television broadcast, a radio broadcast, the Internet or another medium. One example of a suitable use for the system includes determining the height that a basketball player jumped and adding a graphic to a television broadcast that displays the determined height. The system includes two or more cameras that capture a video image of the object being measured. The object's position in the video images is determined and is used to find the three dimensional location of the object. The three dimensional location includes a height coordinate. In some cases, the height coordinate is the desired vertical position. In other cases, the height or size of the object may be subtracted from the height coordinate to determined the vertical position.

Abstract: A system for enhancing the television presentation of an object that can display the object even if the object is not visible to a camera. The system determines whether the object is visible to the camera broadcasting the event. If the object is not visible to the camera, the video image captured by the camera is edited to show the object, not show the object or enhance the video in a different manner. The object is placed in the captured video image at the position the object would be in the camera's field of view if there was no barrier between the object and the camera.

Abstract: Pan, tilt and zoom sensors are coupled to a broadcast camera in order to determine the field of view of the broadcast camera and to make a rough estimate of a target's location in the broadcast camera's field of view. Pattern recognition techniques can be used to determine the exact location of the target in the broadcast camera's field of view. If a preselected target is at least partially within the field of view of the broadcast camera, all or part of the target's image is enhanced. The enhancements include replacing the target image with a second image, overlaying the target image or highlighting the target image. Examples of a target include a billboard, a portion of a playing field or another location at a live event. The enhancements made to the target's image can be seen by the television viewer but are not visible to persons at the live event.

Abstract: A system for enhancing the television presentation of an object at a sporting event includes one or more sensors which are used to determine the location of the object. Based on the location of the object and the field of view of a broadcast camera, a processor determines the position of the object in a video frame of the broadcast camera. Once knowing where the object is positioned within the video frame, the television signal can be edited or augmented to enhance the presentation of the object.