Abstract: A security monitoring system including: an alarm system having detectors for detection of an alarm in a structure; at least one camera for capturing image data inside and/or outside the structure; a processor for selecting a subset of the image data upon the occurrence of the alarm based on a predetermined criteria; and a modem for transmitting the subset of image data to a remote location. The processor ranks each video frame from the image data according to how well each video frame meets the predetermined criteria and the modem transmits a predetermined number of video frames having the best rank to the remote location.

Abstract: A security monitoring system including: an alarm system having detectors for detecting an unauthorized individual in a structure; at least one camera for capturing first image data of the unauthorized individual; a memory for storing second image data of at least one individual authorized to be in the structure; and a data link for transmitting third image data to a remote location upon the detection of the unauthorized individual. The third image data including at least portions of the first and second image data for comparison at the remote location. In a preferred implementation, the first image data includes image data of more than the face of the unauthorized individual and the system further includes a computer vision system for detecting the face of the unauthorized individual from the first image data.

Abstract: A camera-based system includes a number of sites, each having a camera associated therewith. A processing system processes a video signal received from a camera at a given one of the sites, and provides a controlled switching between a representative presence mode and at least one other mode for presentation, at one or more of the sites remote from the given site, of corresponding output video associated with the given site. The processing system utilizes information derived from the video signal generated by the camera to control the switching between the representative presence mode and the other mode, which may be, e.g., a live video mode. For example, the processing system may process the video to identify a user of the system, retrieve a corresponding user profile, and control the switching between the modes in accordance with information in the retrieved user profile.

Abstract: A security monitoring system including: an alarm system having detectors for detection of an alarm in a structure; at least one camera for capturing image data inside and/or outside the structure; a processor for selecting a subset of the image data upon the occurrence of the alarm based on a predetermined criteria; and a modem for transmitting the subset of image data to a remote location. The processor ranks each video frame from the image data according to how well each video frame meets the predetermined criteria and the modem transmits a predetermined number of video frames having the best rank to the remote location.

Abstract: Method and system of detecting and analyzing the presence of a logo in one or more datastreams. In the method, at least one video datastream of an event is first received. Next, one or more regions of interest (ROIs) for the logo in one or more images comprising the at least one datastream are identified. The one or more ROIs are analyzed to detect if the logo is present in the ROI. If so, the detection of the presence of the logo is used in making either a broadcasting decision or an advertising decision.

Abstract: A ball-throwing machine includes a camera connected to a computer vision unit and a microphone connected to a speech-processing unit. The computer vision unit processes images from the camera to determine a user's position, and to detect user gestures from a predetermined repertoire of gestures. The speech-processing unit recognizes user vocal commands from a predetermined repertoire of commands. A computer receives information from a control panel, from the computer vision unit, from the speech-processing unit, and from a file describing the ballistic properties of the ball to be thrown. The computer accordingly determines a ball trajectory according to the user's position and parameters indicated by a combination of control-panel settings, user gestures, and user vocal commands. The computer then adjusts the direction, elevation, ball speed, and ball spin to conform to the determined trajectory, and initiates throwing of a ball accordingly.

Abstract: A method for monitoring a person of interest in a scene, the method comprising: capturing image data of the scene; detecting and tracking the person of interest in the image data; analyzing features of the person of interest; and detecting at least one of an event and behavior associated with the detected person of interest based on the features; and informing a third party of the at least one detected events and behavior.

Abstract: A method for transmitting a stream of multi-media content from provider server to a user device includes transmitting multi-media content from the provider server to the user device via a communication network and outputting the multi-media content from the user device to a user via an output on the user device such that the multi-media content is delivered from the provider server to the user in real-time. A degree of attention that the user directs to the output of the user device is continuously determined during the transmission and a parameter adjusting module at the provider server adjusts a parameter of the multi-media content in response to the degree of attention.

Abstract: A video content analysis system extends content analysis capability of one system to multiple channels by providing for the spatial multiplexing of the multiple channels and appropriately analyzing the spatially multiplexed video signal. The resulting system may be lower in cost that present systems and permit the system to work with ancillary equipment such as video recorders. The system also preserves the real-time information inherent in the multiple source signals.

Abstract: A video display device having a picture-in-picture (PIP) display, an audio input device, an image input device, and a processor. The device utilizes a combination of an audio indication and a related gesture from a user to control PIP display characteristics such as a position of the PIP within a display and the size of the PIP. A microphone captures the audio indication and the processor performs a recognition act to determine that a PIP control command is intended from the user. Thereafter, the camera captures an image or a series of images of the user including at least some portion of the user containing a gesture. The processor then identifies the gesture and affects a PIP display characteristic in response to the combined audio indication and gesture.

Abstract: A monitoring system for an infant, child, invalid, or other person requiring care uses computer vision and hearing, and inputs of other modalities, to analyze the status of a caretaker and/or cared-for person and its environment. The conditions are classified as normal or alarm conditions and an informative alarm signal is generated which may include records of the vision audio and other inputs. The system also has the ability to solicit responses from the occupants to stimulate a classifiable input to reduce ambiguity in its state signal.

Abstract: A stereo camera system including: a stereo imaging system such as two or more cameras or a camera and a set of angled mirrors, for outputting at least one stereo image; a recognition system for locating an object of interest in the field of view of the stereo imaging system and at least one of a distance of the object of interest from the stereo imaging system and the size of the object of interest; and an adjustor for automatically changing at least one system parameter which affects the spatial resolution of the object of interest based on at least one of the located distance of the object of interest from the stereo imaging system and the size of the object of interest.

Abstract: A ball-throwing machine includes a camera connected to a computer vision unit and a microphone connected to a speech-processing unit. The computer vision unit processes images from the camera to determine a user's position, and to detect user gestures from a predetermined repertoire of gestures. The speech-processing unit recognizes user vocal commands from a predetermined repertoire of commands. A computer receives information from a control panel, from the computer vision unit, from the speech-processing unit, and from a file describing the ballistic properties of the ball to be thrown. The computer accordingly determines a ball trajectory according to the user's position and parameters indicated by a combination of control-panel settings, user gestures, and user vocal commands. The computer then adjusts the direction, elevation, ball speed, and ball spin to conform to the determined trajectory, and initiates throwing of a ball accordingly.

Abstract: A method for reacquiring a target in an automated video tracking system is provided. The method includes the steps of: selecting a desired target to be tracked; switching the automated video tracking system to an automatic mode to initiate a tracking sequence to automatically track the selected desired target; switching the automated video tracking system from an automatic mode to a manual mode if the automated video tracking system encounters a period of difficulty in tracking the desired target; reacquiring the desired target in manual mode; and switching the automated video tracking system to the automatic mode for automatic tracking of the reacquired desired target without initiating a new tracking sequence. An apparatus and automated video tracking system for carrying out the methods of the present invention are also provided.

Abstract: A selective noise canceling device is disclosed that evaluates an external audio signal and determines whether a given external audio signal should be suppressed or reproduced. A selective noise suppression circuit processes the external audio signal to classify the external audio signal as noise to be suppressed or as a desired audio signal to be reproduced. An external audio signal, or a desired portion thereof, is reproduced if a portion of the external audio signal is likely to be of interest to the user. The desired external signal may optionally be amplified over the primary selected audio signal for emphasis and the selected audio signal may optionally be suppressed entirely when the desired external signal is reproduced.

Abstract: A method for selecting a target in an automated video tracking system. The method including the steps of: displaying video image data of a scene having a target to be tracked; freezing the video image data to display a frame thereof; and selecting a desired target in the frame of the video image data. Also provided is an apparatus for selecting a target in an automated video tracking system and an automated video tracking system employing such methods and apparatus.

Abstract: A system and method that detects and identifies an event from a sequence of images received. The system comprises a control unit that receives and processes the sequence of images from the camera. The control unit identifies at least one stationary image prior to the event and one stationary image subsequent to the event. The control unit compares one or more representations corresponding to one or more edges in the first stationary image with one or more representations corresponding to one or more edges in the second stationary image to determine whether an object has been deposited or removed during the event.

Abstract: A system comprising at least one light source in a movable hand-held device, at least one light detector that detects light from said light source, and a control unit that receives data from the at least one light detector. The control unit determines the position of the hand-held device in at least two-dimensions from the data from the at least one light detector and translates the position to control a feature on a display.

Abstract: A security monitoring system including: an alarm system having detectors for detection of an alarm in a structure; at least one camera for capturing image data inside and/or outside the structure; a processor for selecting a subset of the image data upon the occurrence of the alarm based on a predetermined criteria; and a modem for transmitting the subset of image data to a remote location. Preferably, the processor ranks each video frame from the image data according to how well each video frame meets the predetermined criteria and the modem transmits a predetermined number of video frames having the best rank to the remote location.

Abstract: A video display device, such as a television, having a picture-in-picture (PIP) display and a processor. The processor detects cues, such as color/texture/events/behaviors, etc., present in a primary display image, that is overlaid by the PIP. These cues are utilized by the processor to determine important and relatively unimportant portions of the primary display image. The processor then determines whether a change in a display characteristic of the PIP leads to the PIP obscuring less of an important portion of the primary display image, and if so, the processor changes the display characteristic of the PIP. Display characteristics of the PIP that may be changed by the processor include the PIP position, size, and transparency. The processor may also utilize a combination of the detected cues to determine important and relatively unimportant portions of the primary display image. The processor may also change combinations of display characteristics of the PIP.