Abstract: A dynamic method and system for processing video source frames (e.g., a television movie) with a video processing system (VPS) that includes a processor, a memory structure, input devices, and an output display. The video source frames, which are received by the VPS from a video source, are executed by the processor. While the video source frames are being executed, a subset of the frames, called key frames, are extracted from the video source frames and stored in the memory structure. The extracting of the key frames is implemented in accordance with a frame extraction algorithm. The extracting is terminated prior to completion of execution of the video source frames. Following termination of extracting, the key frames are reviewed by a user with the output display to determine whether to watch the remainder of the video source frames. The key frames are erased after being reviewed.

Abstract: An automatic speech recognizer only responsive to acoustic speech utterances is activated only in response to acoustic energy having a spectrum associated with the speech utterances and at least one facial characteristic associated with the speech utterances. In one embodiment, a speaker must be looking directly into a video camera and the voices and facial characteristics of plural speakers must be matched to enable activation of the automatic speech recognizer.

Abstract: An apparatus for detecting an emergency/law enforcement vehicle from a secondary vehicle. The apparatus includes: at least one camera mounted on the secondary vehicle; a display surface mounted inside an interior of the secondary vehicle for displaying video image data from the at least one camera; at least one of a pan, tilt, and zoom motor operatively connected to the at least one camera for providing an enhanced view of an emergency/law enforcement vehicle displayed on the display surface; and a controller for controlling the at least one pan, tilt, and zoom motors to provide the enhanced view. The apparatus alternatively also has the capability to detect, track and/or classify an emergency/law enforcement vehicle in the video image data.

Abstract: An acoustic based pointing device and a system and method for using the pointing device to move a cursor on a display screen of a display device. The pointing device comprises an acoustic source that generates and propagates an acoustic signal that is detected by four microphones M1, M2, M3, and M4 and is then converted into corresponding periodic electrical signals S1, S2, S3, and S4. The position vector P0 of the acoustic source is calculated by solving triangulation equations that depend on phase-shift time delays between S1 and Sj for j=1, 2, and 3. A position vector PC is calculated from P0 using a scale vector that relates a change in position of the cursor to a change in position of the acoustic source. Then the cursor is moved to a position PC associated with the position vector PC.

Abstract: Using known methods of face recognition, appliances can be automatically initiated and/or adjusted as a user enters an environment, such as a home or a room. The environment is networked such that there is a communication link between a camera monitoring the entrance to the environment, a face recognition system, and the appliances. The method of automatically controlling a networked environment includes capturing a face image of an individual, storing the face image (i.e., in a memory), and associating at least one appliance setup to the face image. The method also includes comparing the face image to stored face images, retrieving the at least one appliance setup for a matched face image, and initiating the at least one appliance setup. An appliance setup controls turning on or off an appliance, such as an illumination source, a television, or a stereo.

Abstract: An image processing system processes a sequence of images to generate a statistical model for each of a number of different persons to be tagged so as to be identifiable in subsequent images. The statistical model for a given tagged person incorporates at least one appearance feature, such as color, texture, etc., and at least one geometric feature, such as shape or position of a designated region of similar appearance within one or more images. The models are applied to subsequent images in order to perform a person detection, person location and/or person tracking operation. An action of the image processing system is controlled based on a result of the operation.

Abstract: An automatically switched camera system includes sensors for providing data of an image scene having subjects who are behaving in a manner which make them potential targets of the camera system, a pre-take indicator for providing an advanced notification to the subjects of the image scene that one of them is about to become a target of the camera system, a multimodal image analysis module communicating with the sensors and the pre-take indicator, for analyzing the data of the image scene provided by the sensors to select one of the subjects as a target of the camera system and outputting an indicator function command that causes the pre-take indicator to provide the advanced notification to the selected subject.

Abstract: A camera system comprising a camera, a monitor, an image detector, a touch screen, and a remote control. The monitor displays a field of view of a lens of the camera. The image detector provides a viewer image to the remote control whereby the remote control can determine a desired image within the field of view that the viewer is gazing upon. The touch screen enables a viewer of the monitor to point to the desired image of the field of view and provides signal(s) indicative of the pointing. The remote control is operable to activate various drives to pan and/or tilt the camera, or to zoom and/or focus the lens to the desired image and to follow any movement of the image within the field of view.

Abstract: A method and system for providing a mood based virtual photo album which provides photos based upon a sensed mood the viewer. The method may include the steps of capturing a first image of a facial expression of a viewer by a camera, providing the image to a pattern recognition module of a processor, determine a mood of the viewer by comparing the facial expression with a plurality of previously stored images of facial expressions having an associated emotional identifier that indicates a mood of each of the plurality of previously stored images, retrieving a set of photos from storage for transmission to the viewer based on the emotional identifier associated with the determined mood, and transmitting the set of photos in the form of an electronic photo album.

Abstract: Methods and apparatus are disclosed for predicting events using acoustic and visual cues. The present invention processes audio and video information to identify one or more (i) acoustic cues, such as intonation patterns, pitch and loudness, (ii) visual cues, such as gaze, facial pose, body postures, hand gestures and facial expressions, or (iii) a combination of the foregoing, that are typically associated with an event, such as behavior exhibited by a video conference participant before he or she speaks. In this manner, the present invention allows the video processing system to predict events, such as the identity of the next speaker. The predictive speaker identifier operates in a learning mode to learn the characteristic profile of each participant in terms of the concept that the participant “will speak” or “will not speak” under the presence or absence of one or more predefined visual or acoustic cues.

Abstract: A method and system for the automatic detection of a sleeping person and for adjusting electrical power supplied to a number of electronic devices; it includes a unit for observing the behavior of a person in a predetermined area under surveillance and a unit for analyzing output data from the observing unit to determine whether the observed behavior is associated with predefined sleeping behaviors. Upon recognition that the observed behavior indicates the sleeping state of a person, the electrical power supplied to the plurality of electronic devices is selectively adjusted according to predetermined criteria.

Abstract: A collaborative speed measurement device detection system provides early warning and increased reliability by sharing the responses of multiple detectors through a broadcast radio network. A vehicle with one detector (e.g., radar, laser detector) broadcasts a detection event to any other detectors in its vicinity. The receiving detectors generate a warning signal in response to the broadcast. The receivers can combine the results of multiple detections to generate a reliability estimate. The location of the detection events may be broadcast and used in generating alarms in the receiver as well.

Abstract: A security monitoring system including; an exit and entrance camera located at the exit and entrance of a structure; a detector for detecting the exit or entry of an individual; an image recording system for stroring images from the exit and entrance cameras; and a computer vision system for analyzing the stored images using a predetermined criteria to determine if the exiting and entering individuals are the same. In a preferred implementation, the system also includes a database for storing face image data for each authorized individual of the structure; and a face recognition system for comparing the stored images from the entry and entrance camera with the stored image data in the database and for determining if the exiting and entering individual is one of the authorized individuals.

Abstract: A tailgating safety system for a vehicle includes a distance determiner for determining a distance of the vehicle from objects which are leading or following the vehicle. The system also includes a speedometer for determining a speed of the vehicle and an alarm. If the speed of the vehicle is greater than a predetermined speed, and the distance of the vehicle from another object is less than a predetermined distance, then the alarm is activated to advise the driver that at the speed the vehicle is traveling, the distance between the vehicle and the object is not a safe traveling distance.

Abstract: A system and method for alerting a driver of an automobile to a traffic condition. The system comprises at least one camera having a field of view and facing in the forward direction of the automobile. The camera captures images of the field of view in front of the automobile. A control unit receives images of the field of view from the camera and identifies objects therein of a predetermined type. The control unit analyzes the object images of at least one predetermined type to determine whether one or more of the identified objects present a condition that requires the driver's response. A display receives control signals from the control unit regarding the one or more of the objects that present a condition that requires the driver's response. The display displays an image of the object to the driver that is positioned and scaled so that it overlays the actual object as seen by the driver, the displayed image of the object enhancing a feature of the actual object to alert the driver.

Abstract: A security monitoring system including: an alarm system having detectors for detection of an alarm in a structure; at least one camera for capturing image data inside and/or outside the structure; a processor for selecting a subset of the image data upon the occurrence of the alarm based on a predetermined criteria; and a modem for transmitting the subset of image data to a remote location. The processor ranks each video frame from the image data according to how well each video frame meets the predetermined criteria and the modem transmits a predetermined number of video frames having the best rank to the remote location.

Abstract: A system and method for automatic setting of a variable speed limits permits changing road conditions provides for variable speed limits at respective portions of a road based on weather conditions reported by sensor. A plurality of variable speed limit indicators are arranged at predetermined intervals along a road. Sensing report local road conditions regarding humidity, precipitation, temperature, fog, ice, snow, hail, sleet, wind, etc. A regulating unit correlates the sensed weather conditions with a predetermined speed limit for each given condition at each respective portion of the road. A matrix of a database may contain historical accident information regarding the specific location or zone of any accidents, time of day, date, temperature, precipitation, estimated speed and severity of injuries for each accident.

Abstract: A method for automatically displaying an indication of a recommended program to a viewer. The method including: receiving program content; calculating a recommendation score for the received program content, the recommendation score indicating a likelihood that the viewer will approve of the received program content; and automatically displaying an indication of the received program content to the viewer if the recommendation score is above a predetermined threshold. Preferably, the indication is the display of the received program content, which is more preferably displayed on a picture-in-picture display and which can be switched to a main display, if desired, by the viewer.

Abstract: A method for measuring customer satisfaction with at least one of a service, product, and content is provided. The method including: acquiring at least one of image and speech data for the customer; analyzing the acquired at least one of image and speech data for at least one of the following: (a) detection of a gaze of the customer; (b) detection of a facial expression of the customer; (c) detection of an emotion of the customer; (d) detection of a speech of the customer; and (e) detection of an interaction of the customer with at least one of the service, product, and content; and determining customer satisfaction based on at least one of (a)-(e).

Abstract: A fee-based commercial television broadcast system is provided, wherein non-theatrical data is removed from transmission signals containing theatrical data and non-theatrical data. An input video signal is received by a video processing system. The input video signal includes information relating to non-theatrical images', such as commercials, beginning and end points, as well as the total length of such non-theatrical images in a particular program. A broadcast television service provider offers this information for a fee. This information is then used by the video processing system to enable real-time recording and delayed playback such that a user may view the program in one continuous block without non-theatrical data interruption.