Abstract: A system simultaneously tracks multiple objects. All or a subset of the objects includes a wireless receiver and a transmitter for providing an output. The system includes one or more wireless transmitters that send commands to the wireless receivers of the multiple objects instructing different subsets of the multiple objects to output (via their respective transmitter) at different times. The system also includes object sensors that receive output from the transmitters of the multiple objects and a computer system in communication with the object sensors. The computer system calculates locations of the multiple objects based on the sensed output from the multiple objects.

Abstract: A plurality of high speed tracking cameras are pointed towards a routine hovering area of an in-the-field sports participant who routinely hovers about that area. Spots within the hovering area are registered relative to a predetermined multi-dimensional coordinates reference frame (e.g., Xw, Yw, Zw, Tw) such that two-dimensional coordinates of 2D images captured by the high speed tracking cameras can be converted to multi-dimensional coordinates of the reference frame. A body part recognizing unit recognizes 2D locations of a specific body part in the 2D captured images and a mapping unit maps them into the multi-dimensional coordinates of the reference frame. A multi-dimensional curve generator then generates a multi-dimensional motion curve describing motion of the body part based on the mapped coordinates (e.g., Xw, Yw, Zw, Tw).

Abstract: Video frames of a baseball game are analyzed to determine a track for the participants in the game, e.g., players, coaches and umpires, and to update a digital record of the game. The start and/or end of a half-inning can be indicated by factors such as: the participants leaving the dugout region and entering the playing field, including the outfield, a participant leaving the dugout region and entering the region of a base coach's box, a pitcher throwing pitches when no batter is present, and players on the playing field throwing the ball back and forth to one another. In one approach, the combination of detecting an event which is known to occur most often or always between half-innings followed by detecting another event which is known to occur most often or always during a half-inning, can be used to signal that a half-inning has started.

Abstract: A need for plural manned and manually pannable video cameras in a large event space is obviated by instead providing a method of substituting for one or more of the manned and pannable video cameras with the use of an unmanned, continuously filming, and substantially fixedly aimed first video camera having an image capture resolution of n*J-by-m*K pixels, where J-by-K pixels is the highest resolution of any of the substituted-for video cameras, where J and K are integers greater than one, and where n and m are multiplying values each equal to or greater than one. The method includes automatically determining what portions of the n*J-by-m*K pixels imagery are worthy to be kept or reviewed as providing respective views of objects of potential interest and what portions of the n*J-by-m*K pixels imagery may be discarded or not reviewed.

Abstract: Image data of an event is provided by updating a textured 3d model of the event. For example, in a sporting event, a model of a stadium can be periodically updated to reflect changes over time in lighting, advertisements, number of spectators in the stands and so forth. Different virtual viewpoints of the event can be depicted in an animation using the textured 3d model and image data from objects at the event such as participants in the sporting event. The same image from which object data is obtained can also be used to update the textured 3d model so that the model is current in the animation, resulting in greater realism. The updating can be based on an operator command or automatic detection of a specified event, such as change in lighting or passage of time. The animation can be provided in a broadcast television signal.

Abstract: A system simultaneously tracks multiple objects. All or a subset of the objects includes a wireless receiver and a transmitter for providing an output. The system includes one or more wireless transmitters that send commands to the wireless receivers of the multiple objects instructing different subsets of the multiple objects to output (via their respective transmitter) at different times. The system also includes object sensors that receive output from the transmitters of the multiple objects and a computer system in communication with the object sensors. The computer system calculates locations of the multiple objects based on the sensed output from the multiple objects.

Abstract: A system simultaneously tracks multiple objects. All or a subset of the objects includes a wireless receiver and a transmitter for providing an output. The system includes one or more wireless transmitters that send commands to the wireless receivers of the multiple objects instructing different subsets of the multiple objects to output (via their respective transmitter) at different times. The system also includes object sensors that receive output from the transmitters of the multiple objects and a computer system in communication with the object sensors. The computer system calculates locations of the multiple objects based on the sensed output from the multiple objects. In some embodiments, the system can also track an item based on proximity of that item to one or more of the objects. In such embodiments, the multiple objects each includes one or more local sensors.

Abstract: A system simultaneously tracks multiple objects. All or a subset of the objects includes a wireless receiver and a transmitter for providing an output. The system includes one or more wireless transmitters that send commands to the wireless receivers of the multiple objects instructing different subsets of the multiple objects to output (via their respective transmitter) at different times. The system also includes object sensors that receive output from the transmitters of the multiple objects and a computer system in communication with the object sensors. The computer system calculates locations of the multiple objects based on the sensed output from the multiple objects. In some embodiments, the system can also track an item based on proximity of that item to one or more of the objects. In such embodiments, the multiple objects each includes one or more local sensors.

Abstract: The path and/or position of an object is tracked using two or more cameras which run asynchronously so there is need to provide a common timing signal to each camera. Captured images are analyzed to detect a position of the object in the image. Equations of motion for the object are then solved based on the detected positions and a transformation which relates the detected positions to a desired coordinate system in which the path is to be described. The position of an object can also be determined from a position which meets a distance metric relative to lines of position from three or more images. The images can be enhanced to depict the path and/or position of the object as a graphical element. Further, statistics such as maximum object speed and distance traveled can be obtained. Applications include tracking the position of a game object at a sports event.

Abstract: Video frames of a baseball game are analyzed to determine a track for the participants in the game, e.g., players, coaches and umpires, and to update a digital record of the game. The start and/or end of a half-inning can be indicated by factors such as: the participants leaving the dugout region and entering the playing field, including the outfield, a participant leaving the dugout region and entering the region of a base coach's box, a pitcher throwing pitches when no batter is present, and players on the playing field throwing the ball back and forth to one another. In one approach, the combination of detecting an event which is known to occur most often or always between half-innings followed by detecting another event which is known to occur most often or always during a half-inning, can be used to signal that a half-inning has started.

Abstract: A video broadcast of a live event is enhanced by providing graphics in the video in real time to depict the fluid flow around a moving object in the event and to provide other informative graphics regarding aerodynamic forces on the object. A detailed flow field around the object is calculated before the event, on an offline basis, for different speeds of the object and different locations of other nearby objects. The fluid flow data is represented by baseline data and modification factors or adjustments which are based on the speed of the object and the locations of the other objects. During the event, the modification factors are applied to the baseline data to determine fluid flow in real time, as the event is captured on video. In an example implementation, the objects are race cars which transmit their location and/or speed to a processing facility which provides the video.

Abstract: A user such as a television viewer is provided with the capability to view an event from different virtual viewpoints which differ from the viewpoint of a camera. In one aspect, the user is informed of particular camera images from which a virtual viewpoint can be viewed. For example, a menu interface may provide thumbnail preview images of the one or more particular camera images. In another aspect, the use enters commands to manipulate a virtual viewpoint, such as by rotating around a point, moving a lookout point and zooming in or out. In response, a display is provided which includes a textured 3d model of the event combined with at least one textured object in the event. For instance, the event may be a sporting event and the at least one textured object may be a participant in the sporting event.

Abstract: An object is detected in images of a live event by storing and indexing templates based on representations of the object from previous images. For example, the object may be a vehicle which repeatedly traverses a course. A first set of images of the live event is captured when the object is at different locations in the live event. A representation of the object in each image is obtained, such as by image recognition techniques, and a corresponding template is stored. When the object again traverses the course, for each location, the stored template which is indexed to the location can be retrieved for use in detecting the object in a current image. The object's current location may be obtained from GPS data from the object, for instance, or from camera sensor data, e.g., pan, tilt and zoom, which indicates a direction in which the camera is pointed.

Abstract: A video effect is created that provides an experience to a viewer of freezing time during an event that is the subject of a video presentation, investigating the event during that frozen moment in time, and (optionally) resuming the action of the event. During that frozen moment in time, the video can move around the scene of the event and/or zoom in (or out) to better highlight an aspect of the event. In one embodiment, there will be a transition from video captured by a broadcast camera (or another camera) to a high resolution still image, movement around the high resolution still image, and a transition from the high resolution still image back to video from the broadcast camera (or another camera).

Abstract: A representation of an object in an image of a live event is obtained by determining a color profile of the object. The color profile may be determined from the image in real time and compared to stored color profiles to determine a best match. For example, the color profile of the representation of the object can be obtained by classifying color data of the representation of the object into different bins of a color space, in a histogram of color data. The stored color profiles may be indexed to object identifiers, object viewpoints, or object orientations. Color data which is common to different objects or to a background color may be excluded. Further, a template can be used as an additional aid in identifying the representation of the object. The template can include, e.g., a model of the object or pixel data of the object from a prior image.

Abstract: In one aspect, images of an event are obtained from a first video camera and a second camera, where the second camera captures images at a higher resolution than the first video camera. A particular image of interest is identified from the images obtained by the first video camera, e.g., based on an operator's command. A corresponding image which has been obtained by the second camera is then identified. The second image is used to depict virtual viewpoints which differ from the real viewpoints of the first and second camera, such as by combining data from a textured 3d model of the event with data from the second image. In another aspect, a presentation includes images from a first camera, followed by an animation of different virtual viewpoints, followed by images from a second camera which has a different real viewpoint of the event than the first camera.

Abstract: A system and method for repairing an object in image data of an event. An image of the event is obtained from a camera, and an object is detected in the image. For example, the event may be a sporting event in which the object is a participant. Moreover, a portion of the object is occluded in a viewpoint of the camera. For instance, a limb of the participant may be occluded by another participant. The object is repaired by providing a substitute for the occluded portion. A user may perform the repair via a user interface by selecting part of an image from an image library and positioning the selected portion relative to the object. A textured 3d model of the event is combined with data from the repaired object, to depict a realistic virtual viewpoint of the event which differs from a viewpoint of the camera.

Abstract: A representation of an object in a live event is detected in an image of the event. A location of the object in the live event is translated to an estimated location in the image based on camera sensor and/or registration data. A search area is determined around the estimated location in the image. A direction of motion of the object in the image is also determined. A representation of the object is identified in the search area by detecting edges of the object, e.g., perpendicular to the direction of motion and parallel to the direction of motion, performing morphological processing, and matching against a model or other template of the object. Based on the position of the representation of the object, the camera sensor and/or registration data can be updated, and a graphic can be located in the image substantially in real time.

Abstract: The path and/or position of an object is tracked using two or more cameras which run asynchronously so there is need to provide a common timing signal to each camera. Captured images are analyzed to detect a position of the object in the image. Equations of motion for the object are then solved based on the detected positions and a transformation which relates the detected positions to a desired coordinate system in which the path is to be described. The position of an object can also be determined from a position which meets a distance metric relative to lines of position from three or more images. The images can be enhanced to depict the path and/or position of the object as a graphical element. Further, statistics such as maximum object speed and distance traveled can be obtained. Applications include tracking the position of a game object at a sports event.

Abstract: A representation of an object in an image of a live event is detected by matching potential representation of the object against multiple types of templates. For example, the templates can include monochrome data, chrominance and/or luminance data, pixel data of the object from an earlier image, e.g., as a video template, an edge and morphology based template, a model of the object, or a predetermined static texture which is based on an appearance of the object. A weighting function may also be used. In one possible approach, a first type of template is used in an initial search area, and a second type of template is used in a smaller region of the initial search area. Based on a position of the optimum representation of the object in the image, a graphic can be provided in the image, or sensor and/or registration data of a camera can be updated.