Abstract: In a digital video surveillance system, a number of processing stages are employed to identify foreground regions representing moving objects in a video sequence. An object tracking stage (5) is also provided in order to identify a correspondence between candidate objects in a current frame and those that have already been identified in one or more previous frames. In this way, it is possible to calculate the path taken by the or each foreground object and to record this path information in a trajectory database. In order to improve tracking performance, the object tracking stage (5) employs a state transitional object management scheme which determines whether or not a particular object is tracked. The path information generated by the object tracking stage (5) can be displayed on a video monitor (15) of the surveillance system and/or made available to high level applications (7).

Abstract: A sequence of intensity measures is determined corresponding to each of a sequence of video frames. Such can be used for selection of videos according to user preferences and for providing highlights from a video sequence. Low level video characteristics are used which may be related to arousal and valence affects conveyed to a viewer while watching the video recording.

Abstract: A method for processing video data defining a series of images, comprising the steps of: defining a first series of nodes in a first multidimensional space, each of the first series of nodes corresponding to an image of the series of images and its location in the first space being defined in dependence on features of the respective image; defining a transformation function that maps each of the nodes in the first multidimensional space on to a respective node in a second multidimensional space having a lower dimensionality than the first multidimensional space, in such a way that neighbourhood relationships between nodes in the first multidimensional space are preserved between the respective nodes in the second multidimensional space; defining a second series of nodes in the second multidimensional space, each of the second series of nodes corresponding to one of the first set of nodes and its location in being the second multidimensional space being defined in accordance with the transformation function; a

Abstract: In an intelligent video surveillance system, video processing software performs a number of operations on video data received from a camera, including foreground extraction, shadow removal and object tracking. The foreground extraction stage classifies each pixel of a received frame as representing either foreground or background. Since shadow regions can be wrongly classified as foreground, a two-branch shadow removal operation is employed, comprising weak shadow removal (32) and strong shadow removal (33). The purpose of weak shadow removal (32) is to remove only the most severe shadows in each frame. Conversely, the purpose of strong shadow removal (33) is to remove substantially every shadow present in each frame. By comparing the overlap of foreground regions in the two resulting images, it is possible to identify foreground regions that have fragmented due to strong shadow removal, and thereafter classify them as representing a common foreground object.

Abstract: The luminance and chrominance values of pixels encoded according to MPEG or JPEG encoding are extracted using a forward discrete cosine transform (DCT). The forward DCT used in MPEG encoding is analyzed to derive a set of equations which directly relate a pixel value in an encoded image to one or more of the DCT coefficients obtained via the forward DCT transform in the usual image encoding process. These predetermined equations are used to allow for extremely fast and computationally efficient extraction of pixel values directly from the DCT coefficients of an encoded pixel block, without having to undergo an inverse DCT transform. Original images from MPEG and JPEG encoded versions may be extracted in a fast and efficient manner.

Abstract: A video surveillance system (10) comprises a camera (25), a personal computer (PC) (27) and a video monitor (29). Video processing software is provided on the hard disk drive of the PC (27). The software is arranged to perform a number of processing operations on video data received from the camera, the video data representing individual frames of captured video. In particular, the software is arranged to identify one or more foreground blobs in a current frame, to match the or each blob with an object identified in one or more previous frames, and to track the motion of the or each object as more frames are received. In order to maintain the identity of objects during an occlusion event, an appearance model is generated for blobs that are close to one another in terms of image position. Once occlusion takes place, the respective appearance models are used to segment the resulting group blob into regions which are classified as representing one or other of the merged objects.

Abstract: In a digital video surveillance system, a number of processing stages are employed to identify foreground regions representing moving objects in a video sequence. An object tracking stage 5 is also provided in order to identify a correspondence between candidate objects in a current frame and those that have already been identified in one or more previous frames. In this way, it is possible to calculate the path taken by the or each foreground object and to record this path information in a trajectory database. In order to improve tracking performance, the object tracking stage 5 employs a state transitional object management scheme which determines whether or not a particular object is to be tracked. As part of the object management scheme, spurious objects, which are identified on the basis of their motion characteristics, are deleted from the system. This ensures that valuable processing resources are not wasted tracking unwanted artefacts which may represent, for example, noise or random motion.

Abstract: A video surveillance system (10) comprises a camera (25), a personal computer (PC) (27) and a video monitor (29). Video processing software is provided on the hard disk drive of the PC (27). The software is arranged to perform a number of processing operations on video data received from the camera, the video data representing individual frames of captured video. In particular, the software is arranged to identify one or more foreground blobs in a current frame, to match the or each blob with an object identified in one or more previous frames, and to track the motion of the or each object as more frames are received. In order to maintain the identity of objects during an occlusion event, an appearance model is generated for blobs that are close to one another in terms of image position.

Abstract: A shot-based video content analysis method and system is described for providing automatic recognition of logical story units (LSUs). The method employs vector quantization (VQ) to represent the visual content of a shot, following which a shot clustering algorithm is employed together with automatic determination of merging and splitting events. The method provides an automated way of performing the time-consuming and laborious process of organising and indexing increasingly large video databases such that they can be easily browsed and searched using natural query structures.

Abstract: This invention provides an object tracking method and system for tracking objects in video frames which takes into account the scaling and variance of each matching feature. This provides for some latitude in the choice of matching feature, whilst ensuring that as many matching features as possible can be used to determine matches between objects, thus giving increased accuracy in the matching thus determined. A parallel matching approach is used, and heuristic rules employed to account for occlusions between objects.

Abstract: The invention applies a segmentation operation to an input image to identify foreground objects of interest, and then applies a shadow removal operation to remove any detected shadows from the foreground segmentation. The shadow removal algorithms can leave holes and bisections in the segmentation map, however, which will then subsequently impact on an object detection step performed using connected component analysis. To get around this problem, the invention applies a conditional morphological dilation operation to the segmentation map to ‘grow’ the segmented blobs to fill in any holes and bisections, without re-growing shadow pixels in the segmentation. The result is an object detection method and system which is robust to illumination changes causing shadows and/or highlights.

Abstract: A method and system for processing an image recorded by an imaging device may include: a) providing an image having an array of adjacent elements each corresponding to a respective part of the image and having a respective intensity value associated therewith; b) processing the intensity values to determine an intensity contrast value for each respective element according to differences in intensity values between respective adjacent elements; c) determining a depth value for each element corresponding to the distance between the imaging device and at least part of an image forming object represented in the image by the respective element; d) processing the depth values to determine a depth contrast value for each respective element according to differences in depth values between respective adjacent elements; and, processing the intensity contrast values and depth contrast values to identify at least one area of the image corresponding to one or more respective objects in the image being processed.

Abstract: The invention relates to estimating the global motion between frames of a motion-compensated inter-frame encoded video sequence, directly from the motion vectors encoded within the frames. For any particular frame, the motion vectors are first decoded, and a finite number of sets of vectors are selected. An affine or other geometrical transform is then used to generate a motion estimation for each set, and then the least median squared error present in each motion estimation is calculated for each estimation. The motion estimation with the smallest least median squared error is then selected as being representative of the global motion in the image of the frame.

Abstract: The invention relates to generating panoramic images of foreground and background panorama. Within mosaiced panoramic images there will often be more than one pixel value available for each pixel position. In the invention pixel values for a foreground panoramic image are selected by taking the most extraordinary pixel as foreground, and pixel values for a background image are selected by taking a median pixel value. We have found that such pixel selection gives improved results with respect to the prior art.

Abstract: The invention relates to estimating the global motion between frames of a motion-compensated inter-frame encoded video sequence, directly from the motion vectors encoded within the frames. For any particular frame, a motion estimation is determined from motion vectors direct from the frame's anchor frame to the frame in question. This motion estimation is then checked against pre-determined criteria, and where the criteria are not met, re-estimation along a different route is performed, using the bi-directional motion vectors contained within B-frames. A panoramic image generating method and system which makes uses of the global motion estimations thus obtained is also described.

Abstract: Audio/Visual data is classified into semantic classes such as News, Sports, Music video or the like by providing class models for each class and comparing input audio visual data to the models. The class models are generated by extracting feature vectors from training samples, and then subjecting the feature vectors to kernel discriminant analysis or principal component analysis to give discriminatory basis vectors. These vectors are then used to obtain further feature vector of much lower dimension than the original feature vectors, which may then be used directly as a class model, or used to train a Gaussian Mixture Model or the like. During classification of unknown input data, the same feature extraction and analysis steps are performed to obtain the low-dimensional feature vectors, which are then fed into the previously created class models to identify the data genre.

Abstract: The invention provides a method and apparatus for extracting the luminance and chrominance values of pixels encoded according to MPEG or JPEG encoding using a forward discrete cosine transform (DCT). The invention applies theoretical work to mathematically analyse the forward DCT used in MPEG encoding to derive a set of equations which directly relate a pixel value in an encoded image to one or more of the DCT coefficients obtained via the forward DCT transform in the usual image encoding process. These predetermined equations are used in the invention to allow for extremely fast and computationally efficient extraction of pixel values directly from the DCT coefficients of an encoded pixel block, without having to undergo an inverse DCT transform. The invention is expected to be of use in any application where it is desirable to extract original images from MPEG and JPEG encoded versions in a fast and efficient manner.

Abstract: The invention provides a method and apparatus for performing correspondence estimation between pixels of a stereo image pair to obtain matching information for corresponding pixels in each image. To perform a match for a particular pixel in a first image firstly an adaptive curve is constructed about the pixel, being a sequence of connected pixels with similar intensity values to the pixel being matched. The adaptive curve thus constructed is then used as a matching element within the second image to find a matching pixel representative of the same 3D scene point in the second image to the particular pixel. By performing matching in this manner for every pixel in an image, accurate disparity maps can be obtained which are then used in a known image synthesis algorithm to produce novel images of a scene of improved quality.

Abstract: The present invention relates to a method of determining a sequence of intensity measures corresponding to each of a sequence of video frames, the method being used particularly but not exclusively for selection of videos according to user preferences and for providing highlights from a video sequence.

Abstract: One aspect of the invention concerns a method and system for processing an image recorded by an imaging device.