Abstract: Linked zones define the temporal and spatial relationships among multiple zones of a surveillance area, and are used to model an object's disappearance from one zone, for potential reappearance at another zone. One or more zones are defined within each camera's field of view. Two zones are linked if an object that disappears from one zone is capable of appearing in the other zone. Each link has an associated delay parameter or function that characterizes the time delay, if any, between a disappearance and subsequent appearance. For each zone, a set of other zones that are linked to this zone is maintained. When an object disappears from a zone, the set of other zones that are linked to this zone is used to reduce the search space for object appearances corresponding to this disappearance. When the corresponding object appearance is found, the tracking function is handed-off to the tracking module associated with the zone in which the object appeared.

Abstract: To calibrate images from an overhead camera, two equal-length reference lines at different heights relative to the floor plane are imaged. By comparing the resultant image-width of each of these lines in the view provided by the camera, the effective focal point of the camera is determined. In a preferred embodiment, a doorframe is used to provide equal-length lines at different heights parallel to the floor. The threshold of the doorway at the floor plane is used as a reference plane, and a parallel calibration line at a known/measured height in the doorway is defined. The image produced by a vertically oriented camera of these two equal length lines will show a longer line at the elevated position, the different widths of the images of these lines being dependent upon the camera's effective focal point. From these two projections of the equal-length lines at different heights, the camera's focal point distance from the reference floor plane is determined.

Abstract: A video processing and analysis system is coupled to a building management and control system. The video processing system provides traffic, occupancy, and other information derived from video images of sections of the building and its environs to the building management and control systems.

Abstract: A video interface kernel with a defined application program interface includes each of a plurality of core functions for interfacing with video equipment and video processing subsystems. The core functions include such functions as video capture and video output, video recording and playback, and event notification. Optional embodiments include video analysis functions and/or interfaces to analysis subsystems, as well as interfaces to point-of-sale terminals, access control systems, and location tracking systems. An intelligent video management module facilitates managing the interactions among the other modules of the kernel, further simplifying the application level interface.

Abstract: A method and apparatus are disclosed for automatically learning and identifying events in image data using hierarchical HMMs to define and detect one or more events. The hierarchical HMMs include multiple paths that encompass variations of the same event. Hierarchical HMMs provide a framework for defining events that may be exhibited in various ways. Each event is modeled in the hierarchical HMM with a set of sequential states that describe the paths in a high-dimensional feature space. These models can then be used to analyze video sequences to segment and recognize each individual event to be recognized. The hierarchical HMM is generated during a training phase, by processing a number of images of the event of interest in various ways, typically observed from multiple viewpoints.

Abstract: The present invention is a method and apparatus for enhancing a perceived video quality (e.g. higher resolution) on a display in a region surrounding an intersection point of a user's gaze onto a screen of the display.

Abstract: A method and system for avatar mobile video communications are disclosed. Since the creation and realistic driving of avatars may not be done fully automatically with in a mobile communication device (e.g., a cellular phone), an avatar database is provided along with realistic driving mechanisms. Mobile callers may select appropriate downloadable avatars for using during a mobile video communication. The avatar database is provided as a global resource for the mobile video commutation system.

Abstract: A video surveillance system is integrated with an RFID tracking system. The calibration of the RFID tracking system is enhanced by using information provided by the video surveillance system. Optionally, the calibration of the video surveillance system may be enhanced by using information provided by the RFID tracking system. Calibration of the RFID tracking system is facilitated by placing RFID tags at visually apparent locations in a surveillance area and using the location information determined from the video surveillance system to determine appropriate correction factors for use in subsequent RFID location determinations. Dynamic performance is also calibrated by placing RFID tags on visually apparent moving targets and using the location information determined from the video surveillance system to determine the parameters used to qualify subsequent RFID location estimates of moving targets.

Abstract: An image processing system (250) and method (300) are disclosed for correcting a head pose in a video phone image, so that a frontal view is presented on a display. A disclosed head pose corrector (250) estimates the orientation of a head pose and adjusts the orientation of the head pose, if necessary, to present a frontal view. The orientation of the head pose is adjusted by generating a three dimensional model of the face surface and adjusting the orientation of the three dimensional face model to provide the desired frontal view. The head pose corrector (250) may be included in a video phone (100) to correct the head pose of transmitted or received images (or both) or may be included in a server on a network to automatically adjust the head shots of one or more participants to a video phone communication.

Abstract: A system for white balancing images using facial color as a reference signal is provided. The system includes a face detector that is operable to receive a digital image and to detect a human face within the digital image. A skin tone extractor is operable to extract a skin tone from the digital image. The extracted skin tone is associated with a human face detected by the face detector. A skin tone comparator is operable to access reference skin tones and to compare the extracted skin tone to the reference skin tones in order to identify a reference skin tone corresponding to the extracted skin tone. A balance parameter generator is operable to generate a balance parameter based on the extracted skin tone and the corresponding reference skin tone. The balance parameter is operable to be applied to the digital image to white balance the digital image.

Abstract: A system and method provides for the automatic generation of a list of channels, stations, selections, etc., that are selected most often on a media presentation device by a user during a particular period of time.

Abstract: Blocking zones of a surveillance system are configured to prevent false alarms caused by motion within the zones, while allowing tracking of objects through the zones. An object that first appears within a blocking zone is not considered to be a reportable object until the object leaves the zone. All reportable objects are tracked, without regard to the blocking zones. Objects that remain within their initial blocking zone are not deemed to be reportable objects, and therefore do not generate alarms. If an object initially appears within overlapping zones, the object is not deemed to be reportable until it leaves each of the zones at least once. The blocking zones do not mask the video images, and thus a complete record of activity is available for forensic purposes.

Abstract: A sound imaging system and method for generating multi-channel audio data from an audio/video signal having an audio component and a video component. The system comprises: a system for associating sound sources within the audio component to video objects within the video component of the audio/video signal; a system for determining position information of each sound source based on a position of the associated video object in the video component; and a system for assigning sound sources to audio channels based on the position information of each sound source.

Abstract: A video surveillance system is integrated with an RFID tracking system. The calibration of the RFID tracking system is enhanced by using information provided by the video surveillance system. Optionally, the calibration of the video surveillance system may be enhanced by using information provided by the RFID tracking system. Calibration of the RFID tracking system is facilitated by placing RFID tags at visually apparent locations in a surveillance area and using the location information determined from the video surveillance system to determine appropriate correction factors for use in subsequent RFID location determinations. Dynamic performance is also calibrated by placing RFID tags on visually apparent moving targets and using the location information determined from the video surveillance system to determine the parameters used to qualify subsequent RFID location estimates of moving targets.

Abstract: A method and system is configured to characterize regions of an environment by the likelihoods of transition of a target from each region to another. The likelihoods of transition between regions is preferably used in combination with conventional object-tracking algorithms to determine the likelihood that a newly-appearing object in a scene corresponds to a recently-disappeared target. The likelihoods of transition may be predefined based on the particular environment, or may be determined based on prior appearances and disappearances in the environment, or a combination of both. The likelihoods of transition may also vary as a function of the time of day, day of the week, and other factors that may affect the likelihoods of transitions between regions in the particular surveillance environment.

Abstract: A system for white balancing images using facial color as a reference signal is provided. The system includes a face detector that is operable to receive a digital image and to detect a human face within the digital image. A skin tone extractor is operable to extract a skin tone from the digital image. The extracted skin tone is associated with a human face detected by the face detector. A skin tone comparator is operable to access reference skin tones and to compare the extracted skin tone to the reference skin tones in order to identify a reference skin tone corresponding to the extracted skin tone. A balance parameter generator is operable to generate a balance parameter based on the extracted skin tone and the corresponding reference skin tone. The balance parameter is operable to be applied to the digital image to white balance the digital image.

Abstract: A motion transform is implemented for calculating the motion field between two images. An optical flow calculator is configured for generating an image motion vector field by iteratively comparing a predicted image with a second image frame, the predicted image being produced based upon a first memory frame and image gradients generated according to a motion estimate that is produced according to a transform function using transform coefficients. The transform coefficients are estimated based upon a previously determined image gradient.

Abstract: An apparatus for generating an image motion vector field which describes a motion of individual image components of a first image frame and corresponding image components of a second image frame in a sequence of image frames. The apparatus comprises a first frame memory for receiving said first image frame, a second frame memory for receiving a second image frame, and an optical flow calculator. The optical flow calculator is configured for generating an image motion vector field by iteratively comparing a predicted image with the second image frame. The predicted image is generated according to a current motion estimate in proximity to an observation point, wherein the observation point migrates according to a previous motion estimate and is implemented by the calculator to generate a current motion estimate.

Abstract: A system and method for encoding a video image using object-based encoding. The system comprises a foreground encoding system for coding a foreground shape in a foreground object plane; and a background encoding system for coding a background object plane, wherein the background encoding system pads a masked area in the background object plane, and wherein the masked area is determined from data associated with the foreground shape.

Abstract: A system and apparatus are disclosed for modeling patterns of behavior of humans or other animate objects and detecting a violation of a repetitive pattern of behavior. The behavior of one or more persons is observed over time and features of the behavior are recorded in a multi-dimensional space. Over time, the multi-dimensional data provides an indication of patterns of human behavior. Activities that are repetitive in terms of time, location and activity, such as sleeping and eating, would appear as a Gaussian distribution or cluster in the multi-dimensional data. Probability distribution functions can be analyzed using known Gaussian or clustering techniques to identify repetitive patterns of behavior and characteristics thereof, such as a mean and variance. Deviations from repetitive patterns of behavior can be detected and an alarm can be triggered, if appropriate.