Abstract: A method for processing a time-ordered sequence of video frames. The method is implemented by execution of program code on a processor of a computer system. Each frame includes a two-dimensional array of pixels and a frame-dependent color intensity at each pixel. A current frame and at least one frame occurring prior to the current frame in the sequence are analyzed via a background subtraction on the at least one frame to determine a background image and a static region mask associated with a static region. The background subtraction determines an existence of a static object relating to the static region. A status of the static object is determined, the status being either that the static object is an abandoned object or that the static object is a removed object. The determined status is stored in a data storage medium of the computer system.

Abstract: A system and method that processes video to extract a keyframe-based adequate visual representation. The method utilizes a hierarchical processing technique. The first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds are user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.

Abstract: The present invention provides a solution for controlling checkout throughput. Specifically, under the present invention a set of attributes of an item will be obtained. An analysis of the set of attributes will then be performed to determine whether an inconsistency exists based on a tolerance threshold. Such analysis can include, for example, comparing the weight of the item to its expected weight. This can help determine if a mistake has been made or fraud has been committed. Whether an inconsistency is observed is based on a tolerance threshold. For example, a certain deviation (i.e., the tolerance threshold) from an expected value could be allowed to could be allowed to reduce errors during the checkout process and thereby increase checkout throughput. As such, the present invention allows the tolerance threshold to be tuned based on a desired checkout throughput.

Abstract: Systems and methods are disclosed for implementing and managing distributed video surveillance systems. Systems and methods in accordance with the present invention provide a well-organized structure for describing and implementing distributed video surveillance systems and service protocols for managing the surveillance activities of clusters of video surveillance cameras. In particular, the service protocols provide a high degree of control over the surveillance activities of video surveillance cameras. In addition, the service protocols also provide a great deal of flexibility in selecting and managing a wide range of analytical and managerial tools for available for analyzing and organizing video track information.

Abstract: A novel system and method of treating the output of moving cameras, in particular ones that enable the application of conventional “static camera” algorithms, e.g., to enable the continuous vigilance of computer surveillance technology to be applied to moving cameras that cover a wide area. According to the invention, a single camera is deployed to cover an area that might require many static cameras and a corresponding number of processing units. A novel system for processing the main video sufficiently enables long-term change detection, particularly the observation that a static object has been moved or has appeared, for instance detecting the parking and departure of vehicles in a parking lot, the arrival of trains in stations, delivery of goods, arrival and dispersal of people, or any other application.

Abstract: Systems and methods are disclosed for analyzing, managing and cataloguing video tracks generated by a video surveillance system. Systems and methods operating in accordance with the present invention receive video tracks from a video surveillance system; analyze them for particular categories of, for example, objects or events, assign unique identifying tags to the video tracks; and save them in highly-cross-referenced databases so that video tracks containing, for example, particular objects or events can be easily searched for and recalled. In addition, the present invention provides browsing facilities for viewing events that have just elapsed, events that are occurring in near real-time.

Abstract: A system, method and program product for providing automated learning for a people counting system. A system is disclosed that includes a grid system for dividing a field of view (FOV) of a captured image data into a set of blocks; an object detection and tracking system for tracking a blob passing through the FOV; and a learning system that maintains person size parameters for each block and updates person size parameters for a selected block when a blob appears in the selected block.

Abstract: The present invention provides portable-device based store checkout. Specifically, a portable device is configured for store checkout. When the shopper obtains an item, he/she scans its barcode and captures its image using the portable device. The identity of the item as determined based on the barcode is compared with its appearance as determined based on the image. If the two are consistent with one another, the item is added to an inventory of items. The shopper can checkout by linking (e.g., porting) the portable device to a checkout station. The linking will cause the inventory of items to be made known to the checkout station, which will arrange payment using the portable device. Optionally, as an additional validation, the shopping receptacle can be weighed at the checkout station to make sure it reasonably meets an expected weight determined based on the inventory.

Abstract: The invention provides a method, system, and program product for presenting electronic surveillance data. One method according to the invention includes identifying a point to be surveyed; establishing a schedule at which the point will be surveyed; capturing a first image of the point; storing the first image; capturing a second image of the point; storing the second image; highlighting a difference between the first and second images; and presenting the first and second images to a user.

Abstract: Techniques for using transactional and visual event information to facilitate loss prevention are provided. The techniques include obtaining video of one or more visual events at a point of sale environment and one or more transaction log entries that correspond to the video, wherein the one or more transaction log entries comprise one or more transactional events, categorizing each event as one of one or more model events, using each categorized event to create a revised transaction log, wherein the revised transaction log comprises a sequence of categorized events, wherein each categorized event is a combination of the one or more transactional events and the one or more visual events, examining the revised transaction log to correct one or more mis-categorizations, if any, and revise one or more model event categories with the one or more corrected mis-categorizations, if any, and using the revised transaction log to facilitate loss prevention.

Abstract: Under the present invention, a single, overall alarm for an entire set of shopping items will be used for any and all discrepancies. The metric used for creating an alarm for the overall set of shopping items can be based on any one of the following candidate policies: if at least one item generated an alarm; if some fixed number of items generated an alarm; if some threshold discrepancy metric got exceed; if basket size is larger than certain threshold cash value and the alarm exceeded certain threshold alarm rate; a randomly generated alarm (e.g., random audit); the customer's identity and track record (e.g., loyalty card); and/or any combination of the above. Regardless, if an overall alarm is generated one or more of the following actions can be taken: no action send the customer to customer service; appropriately record customer track record (e.g., loyalty card) when customer identity is available; audit the customer at the “shop exit; and/or any combination of thereof.

Abstract: A novel system and method of treating the output of moving cameras, in particular ones that enable the application of conventional “static camera” algorithms, e.g., to enable the continuous vigilance of computer surveillance technology to be applied to moving cameras that cover a wide area. According to the invention, a single camera is deployed to cover an area that might require many static cameras and a corresponding number of processing units. A novel system for processing the main video sufficiently enables long-term change detection, particularly the observation that a static object has been moved or has appeared, for instance detecting the parking and departure of vehicles in a parking lot, the arrival of trains in stations, delivery of goods, arrival and dispersal of people, or any other application.

Abstract: There is provided an apparatus for the certification of privacy compliance. The apparatus includes a registry of at least one of enrolled video surveillance operators, approved surveillance hardware devices, approved surveillance software programs, approved surveillance system installers, and approved entities that manage surveillance systems. The apparatus further includes a registry searcher, in signal communication with the registry, for receiving queries to the registry, and for determining whether at least one of a particular surveillance operator, a particular surveillance hardware device, a particular surveillance software program, a particular surveillance system installer, and a particular entity that manages a particular surveillance system is on the registry based on a given query.

Abstract: Under the present invention, item verification is automated and expedited. Specifically, items to be purchased can be scanned by the shopper using a barcode reader (e.g., a scanner), attached to or positioned near the checkout station. As items are scanned, they are identified based on their barcode, and added to an item list. Item verification can then be performed at checkout using imaging technology. Specifically, as items are scanned, an item verification unit will capture an appearance thereof (via a camera). Item verification software within the item verification unit will access a database that associates items with their images/appearances. The appearance will be compared for consistency to the identity as determined based on the scan. In general, the item verification unit is a separate unit from the cash register, but adapted to work in conjunction therewith (e.g., as a pluggable system, via wireless communication, etc.).

Abstract: A method, information processing system, and computer program storage product annotate video images associated with an environmental situation based on detected actions of a human interacting with the environmental situation. A set of real-time video images are received that are captured by at least one video camera associated with an environment presenting one or more environmental situations to a human. One or more user actions made by the human that is associated with the set of real-time video images with respect to the environmental situation are monitored. A determination is made, based on the monitoring, that the human driver has one of performed and failed to perform at least one action associated with one or more images of the set of real-time video images. The one or more images of the set of real-time video images are annotated with a set of annotations.

Abstract: A system and method of treating the output of moving cameras, in particular ones that enable the application of conventional “static camera” algorithms, e.g., to enable the continuous vigilance of computer surveillance technology to be applied to moving cameras that cover a wide area. A single camera is deployed to cover an area that might require many static cameras and a corresponding number of processing units. A novel system for processing the main video sufficiently enables long-term change detection, particularly the observation that a static object has been moved or has appeared, for instance detecting the parking and departure of vehicles in a parking lot, the arrival of trains in stations, delivery of goods, arrival and dispersal of people, or any other application.

Abstract: An invention for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, and generate a set of compressed spatial representation of the trajectory data of the event within the video image data. A database component is configured to input the set of compressed spatial representations into a relational database, and a search component is configured to search the relational database to identify a spatial location of the event within the video image data.

Abstract: An invention for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, generate a lossless compressed contour-coded blob to encode the trajectory data of the event within video image data, and generate a lossy searchable code to enable searching of a relational database based on the trajectory data of the event within the video image data.

Abstract: A system for automatically acquiring high-resolution images by steering a pan-tilt-zoom camera at targets detected in a fixed camera view is provided. The system uses automatic or manual calibration between multiple cameras. Using automatic calibration, the homography between the cameras in a home position is estimated together with the effects of pan and tilt controls and the expected height of a person in the image. These calibrations are chained together to steer a slave camera. The manual calibration scheme steers a camera to the desired region of interest and calculates the pan, tile and zoom parameters accordingly.

Abstract: The present invention includes a method, system, and program product for detecting an event that includes receiving at least one data input stream from one or more sensors, selecting a data input stream from one of the one or more sensors, recording the data input stream on a recordable medium, specifying a rule comprising an event in the data input stream, and detecting at least one event in the data input stream based upon the rule.