Abstract: System and method for automatically programming a universal remote. In the system, the remote acquires identification data from a particular device at which it is pointed. The data is processed to determine command protocols associated with the particular device. Control commands for the particular device input to the remote by a user are formatted according to the command protocols associated with the particular device.

Abstract: A method and apparatus are disclosed for generating and maintaining enhanced background models for use in background-foreground segmentation. Background models are modified to contain an indication of objects that are typically stationary. Thereafter, if an object moves and has been previously identified as an object that is typically stationary, the object will not unnecessarily be identified as part of the foreground during background-foreground segmentation. In an exemplary implementation, moving objects are classified into two sets. A first set includes objects that typically move independently and a second set includes objects that are typically stationary. Generally, once an object is assigned to the second (stationary object) set, the object will remain in the background, even if the object is moved (normally, movement of the object would cause the object to become part of the foreground).

Abstract: An image processing system processes a sequence of images to generate a statistical model for each of a number of different persons to be tagged so as to be identifiable in subsequent images. The statistical model for a given tagged person incorporates at least one appearance feature, such as color, texture, etc., and at least one geometric feature, such as shape or position of a designated region of similar appearance within one or more images. The models are applied to subsequent images in order to perform a person detection, person location and/or person tracking operation. An action of the image processing system is controlled based on a result of the operation.

Abstract: Using known methods of face recognition, appliances can be automatically initiated and/or adjusted as a user enters an environment, such as a home or a room. The environment is networked such that there is a communication link between a camera monitoring the entrance to the environment, a face recognition system, and the appliances. The method of automatically controlling a networked environment includes capturing a face image of an individual, storing the face image (i.e., in a memory), and associating at least one appliance setup to the face image. The method also includes comparing the face image to stored face images, retrieving the at least one appliance setup for a matched face image, and initiating the at least one appliance setup. An appliance setup controls turning on or off an appliance, such as an illumination source, a television, or a stereo.

Abstract: An image processing system includes a combined display-camera having an array of interspersed display elements and camera elements, arranged substantially in a common plane of a flat panel or other display. Each of at least a subset of the camera elements has one or more imaging angles associated therewith, with the one or more imaging angles being selected to provide a desired imaging operation for the combined display-camera. The imaging angles of the camera elements can be selected to provide an imaging operation which approximates that of a lens-based single-camera system, a pin-hole camera system or other type of system. Each of the camera elements may include multiple image sensors, such that different imaging angles can be set for the different image sensors of a given camera element, and different perspectives of a scene can be generated in the image processing system.

Abstract: Aspects of the present invention can be configured to demultiplex an asynchronously multiplexed video signal, which comprises images from a number of different cameras. Image matching techniques are used to assign input images with states. After a period, the number of states will generally equal the number of input cameras. The states may be modeled through any number of techniques, such as histogram analysis, clustering, and hidden Markov model analysis. Input images are assigned to states, and the input images are output as being associated with the states. Zone surveillance may be performed on a series of images from one or more of the states. Any events that occur can be distinguished and reported.

Abstract: An image processing system processes a sequence of images to generate a statistical model for each of a number of different persons to be tagged so as to be identifiable in subsequent images. The statistical model for a given tagged person incorporates at least one appearance feature, such as color, texture, etc., and at least one geometric feature, such as shape or position of a designated region of similar appearance within one or more images. The models are applied to subsequent images in order to perform a person detection, person location and/or person tracking operation. An action of the image processing system is controlled based on a result of the operation.

Abstract: An image processing system is disclosed that provides automatic face or skin blurring for images. All faces or skin can be blurred, or specific faces can be blurred. In one aspect of the invention, a particular face is blurred on an image or on a series of images in a video. Faces are determined in an image, and face matching is performed to match a particular face to faces in the image. If a match is found, the face or a portion of the face is blurred in the image. The blurring is performed on a portion of the image containing the particular face. Blurring may be performed through a variety of techniques. In another aspect of the invention, voice processing is used as an adjunct to or in place of face analysis to determine if a face in an image or series of images should be blurred. In another aspect of the invention, all faces or human skin in an image or series of images is blurred.

Abstract: A lighting controller is disclosed that automatically adjusts a lighting device based on user activity. The disclosed lighting controller processes at least one of audio and video information to identify predefined user events that suggest that a lighting device should be activated or adjusted. In one implementation, a number of behavior rules define various user activities or events that suggest that the user would like to activate or adjust a lighting device. Each rule contains one or more conditions, and, optionally, a corresponding action-item that should be performed when the rule is satisfied to activate or adjust the lighting device. Upon detection of a predefined event, the corresponding action, if any, is performed by the lighting controller.

Abstract: A system having a video display screen that provides video to a user. The position of the display screen is adjustable based upon the location of the user with respect to the display screen. The system includes at least one image capturing device trainable on a viewing region of the display screen and coupled to a control unit having image recognition software. The image recognition software identifies the user in an image generated by the image capturing device. The software of the control unit also generates at least one measurement of the position of the user based upon the detection of the user in the image.

Abstract: This invention provides an alarm system and method for adjusting the wake-up signals. The system includes a means for tracking the behavior of a person in a predetermined area under surveillance after the activation of an alarm clock, and a means for determining whether the person is motionless for a predetermined time period. Upon recognition that the observed behavior indicates the person is still sleeping, the wake-up signals are gradually increased. At the same time, the electrical power supplied to a plurality of electronic devices may be increased to assist the person to wake up.

Abstract: A lighting controller is disclosed that automatically adjusts a lighting device based on user activity. The disclosed lighting controller processes at least one of audio and video information to identify predefined user events that suggest that a lighting device should be activated or adjusted. In one implementation, a number of behavior rules define various user activities or events that suggest that the user would like to activate or adjust a lighting device. Each rule contains one or more conditions, and, optionally, a corresponding action-item that should be performed when the rule is satisfied to activate or adjust the lighting device. Upon detection of a predefined event, the corresponding action, if any, is performed by the lighting controller.

Abstract: System and method for automatically programming a universal remote. In the system, the remote acquires identification data from a particular device at which it is pointed. The data is processed to determine command protocols associated with the particular device. Control commands for the particular device input to the remote by a user are formatted according to the command protocols associated with the particular device.

Abstract: A signal processing system processes a signal using a hidden Markov model (HMM) having a number of states determined at least in part based on application of an iterative algorithm to the model. The iterative algorithm adjusts the number of states of the model, based at least in part on closeness measures computed between the states, until the model satisfies a specified performance criterion. The model having the adjusted number of states is then utilized to determine a characteristic of the signal, and an action of the signal processing system is controlled based on the determined characteristic.

Abstract: A lighting controller is disclosed that automatically adjusts a lighting device based on user activity. The disclosed lighting controller processes at least one of audio and video information to identify predefined user events that suggest that a lighting device should be activated or adjusted. In one implementation, a number of behavior rules define various user activities or events that suggest that the user would like to activate or adjust a lighting device. Each rule contains one or more conditions, and, optionally, a corresponding action-item that should be performed when the rule is satisfied to activate or adjust the lighting device. Upon detection of a predefined event, the corresponding action, if any, is performed by the lighting controller.

Abstract: A device for identifying vehicles traveling in excess of a predetermined speed. The device including: speed measurement detector for measuring the speed of a target vehicle and outputting a signal indicative of the measured speed; a camera operatively connected to the speed measurement detector for capturing image data of a license plate affixed to the target vehicle when the target vehicle exceeds the predetermined speed; and a device for tagging the captured image data with the signal indicative of the measured speed of the target vehicle. The device can further have a recognition system for recognizing the license plate of the target vehicle which controls the camera to provide an enhanced view of the license plate. The device can also have classification and color identification systems for identifying a type and color of the target vehicle. The type and color information can also be tagged to the image data.

Abstract: A computer-based assisted parking system and method for parking a vehicle into a parking space includes at least one sensor arranged to sense a position of the vehicle to be parked in a predetermined area adjacent the vehicle; a sensing system for at least two-dimensional reconstruction of feedback received from the one sensor; a path planning system for determining whether positions of other vehicles adjacent the parking space provide sufficient clearance for the vehicle to be parked and providing a planned path indicating how the vehicle to be parked will be maneuvered; a control system for controlling maneuvering of the vehicle to be parked based on the planned path determined by the path planning system, and the control system controls vehicle steering, direction, speed, and application of brakes, so that the vehicle to be parked is maneuvered into the parking space. Alternatively, directions may be given as the vehicle is parked under the control of the driver.

Abstract: A method and apparatus are disclosed for generating and maintaining enhanced background models for use in background-foreground segmentation. Background models are modified to contain an indication of objects that are typically stationary. Thereafter, if an object moves and has been previously identified as an object that is typically stationary, the object will not unnecessarily be identified as part of the foreground during background-foreground segmentation. In an exemplary implementation, moving objects are classified into two sets. A first set includes objects that typically move independently and a second set includes objects that are typically stationary. Generally, once an object is assigned to the second (stationary object) set, the object will remain in the background, even if the object is moved (normally, movement of the object would cause the object to become part of the foreground).

Abstract: Background-foreground segmentation is performed as a maximum likelihood classification. During a training procedure, a system estimates the parameters of likelihood probability models, which are the probability of observing images assuming that the images come from the background scene. During normal operation, the likelihood probability of captured images is estimated using the background models. The background-foreground segmentation is carried out by comparing the likelihood probabilities of the test images with fixed thresholds. The probability of observing foreground objects is assumed constant, as foreground images are generally not modeled. This value, the probability threshold, preferably represents a tunable parameter of the system. Pixels with low likelihood probability of belonging to the background scene are classified as foreground, while the rest are labeled as background.

Abstract: A media player controller is disclosed that monitors non-user event and automatically controls a media player in response to predefined events. The media player controller includes an information capture device that obtains input information from the non-user. The input information is processed by the media player controller to identify one or more predefined non-user events. A number of rules can be utilized to define various non-user events, such as when the non-user is in the vicinity of the media player. Each rule contains a condition and a corresponding action-item that should be performed when the condition is satisfied.