Abstract: A system and method are disclosed for generating an animatable object. A skeleton of the desired character is constructed by the user utilizing various predetermined components. These predetermined components include a various selection of rods and joints. The rods are static components which remain rigid during motion, while the various joints are moveable components. A static digitized image, for example, an image of the user, is utilized and a constructed skeleton is superimposed onto it. The desired object, such as the image of the user, can then be extracted from the background of the digital image and the resulting personal character can then be animated, for instance by selecting and dragging one of the hands with a mouse.

Abstract: Disclosed is an inventive method for providing visual chat. A character image is read into memory representing a character a user wishes to be for the duration of the visual chat. Continuous frames of video images are then received, typically using video camera, which include image data of a person. The head image of the person is then tracked by the system, and portions of the head image are extracted from the video images. These extracted portions are preferably features of the person in the video image. Finally, the extracted portions of the head image are blended into corresponding areas of the character image, such that the features of the blended character image match the features of the person, and change as the features of the person change.

Abstract: A background subtraction apparatus of the present invention includes a key point locator for locating key points on a known object type, a boundary point locator for locating boundary points of the known object that make up the edges of the known object, and an edge processor for processing the edges to provide a clean-edged extraction of the known object from a background image. Preferably, the key point locator includes an alignment detector for detecting alignment of an image of the known object type with a skeleton image. Still more preferably, the skeleton image is an exoskeleton image and the known object type is a human being.

Abstract: A method is provided for conducting commerce over a network via vision-enabled content. First, content is encoded to convert it into vision-enabled content. Payment is received for vision-enabling the content. Also, a program to decode the vision-enabled content is provided. Finally, the vision-enabled content is sent to a user over a network. The program decodes the vision-enabled content and receives an image of the user. The vision-enabled content may include advertising content, entertainment content, and educational or instructional content. In one embodiment, the program combines the image of the user with the vision-enabled content. In another embodiment, the program utilizes the image of the user to control the vision-enabled content.

Abstract: A system and method are disclosed for digitally compositing an object from an input image onto a destination image. The object is composited from an image having an arbitrary or non-uniform colored background containing some non-static elements onto a destination image with reduced effects from shadows cast by the object and with reduced gaps or holes within the object. Various improvements in the compositing procedure such as shadow reduction and hole filling, and less restrictive requirements regarding the object's surroundings are disclosed. A background model is created and a frame of an input image containing the object is obtained. An alpha image is created in which each pixel is either a zero, indicating it is not part of the object, or a one, indicating that it is part of the object.

Abstract: An interactive karaoke system includes a microphone developing an audio input from at least one karaoke performer; a camera producing a series of video frames including the at least one karaoke performer; and a karaoke processor system including a video environment and a related audio environment for the karaoke performer. The karaoke processor system is coupled to the camera to create extracted images of the at least one karaoke performer from the series of video frames and to composite the extracted images with a background derived from the video environment. The video environment is affected by at least one of a position and a movement of the at least one karaoke performer. A karaoke network includes a local area network, a local karaoke server coupled to the local area network and storing local karaoke content; and a number of karaoke systems coupled to the local area network, each of which can request karaoke content from the local karaoke server.

Abstract: A system, method and article of manufacture are provided for tracking a head portion of a person image in video images. Upon receiving video images, a first head tracking operation is executed for generating a first confidence value. Such first confidence value is representative of a confidence that a head portion of a person image in the video images is correctly located. Also executed is a second head tracking operation for generating a second confidence value representative of a confidence that the head portion of the person image in the video images is correctly located. The first confidence value and the second confidence value are then outputted. Subsequently, the depiction of the head portion of the person image in the video images is based on the first confidence value and the second confidence value.

Abstract: A system, method and article of manufacture are provided for tracking a head portion of a person image in video images. Upon receiving video images, a first head tracking operation is executed for generating a first confidence value. Such first confidence value is representative of a confidence that a head portion of a person image in the video images is correctly located. Also executed is a second head tracking operation for generating a second confidence value representative of a confidence that the head portion of the person image in the video images is correctly located. The first confidence value and the second confidence value are then outputted. Subsequently, the depiction of the head portion of the person image in the video images is based on the first confidence value and the second confidence value.

Abstract: An object is composited digitally from an input image onto a destination image. A background model is created and a frame of an input image containing the object is obtained. An alpha image is created in which each pixel is either a zero, indicating it is not part of the object, or a one, indicating that it is part of the object. The effect of shadows emanating from the object is reduced. A set of templates is then derived to allow holes or gaps in the object created during the compositing process to be filled to a large extent. The object is blended onto a destination image using the alpha image as a blending coefficient.

Abstract: An interactive karaoke system includes a microphone developing an audio input from at least one karaoke performer; a camera producing a series of video frames including the at least one performer; and a karaoke processor system including a video environment and a related audio environment for the karaoke performer. The karaoke processor system is coupled to the camera to create extracted images of the at least one karaoke performer from the series of video frames and to composite the extracted images with a background derived from the video environment. The video environment is affected by at least one of a position and a movement of the at least one karaoke performer. A karaoke network includes a local area network, a local karaoke server coupled to the local area network and storing local karaoke content; and a number of karaoke systems coupled to the local area network, each of which can request karaoke content from the local karaoke server.

Abstract: A system, method and article of manufacture are provided for executing a setup protocol. A camera and a visual display device are coupled to a computer. Images are generated by the camera upon activation of the camera. A series of setup tests are then conducted on the images generated by the camera to determine whether the camera and surrounding environmental elements satisfy predetermined criteria of an intended computer vision application for optimal running of the intended computer vision application on the computer. The series of setup tests comprises at least one setup test selected from a library of setup tests.

Abstract: A background subtraction apparatus of the present invention includes a key point locator for locating key points on a known object type, a boundary point locator for locating boundary points of the known object that make up the edges of the known object, and an edge processor for processing the edges to provide a clean-edged extraction of the known object from a background image. Preferably, the key point locator includes an alignment detector for detecting alignment of an image of the known object type with a skeleton image. Still more preferably, the skeleton image is an exoskeleton image and the known object type is a human being.

Abstract: A background subtraction apparatus of the present invention includes a key point locator for locating key points on a known object type, a boundary point locator for locating boundary points of the known object that make up the edges of the known object, and an edge processor for processing the edges to provide a clean-edged extraction of the known object from a background image. Preferably, the key point locator includes an alignment detector for detecting alignment of an image of the known object type with a skeleton image. Still more preferably, the skeleton image is an exoskeleton image and the known object type is a human being.

Abstract: A system and method are disclosed for generating an animatable object. A skeleton of the desired character is constructed by the user utilizing various predetermined components. These predetermined components include a various selection of rods and joints. The rods are static components which remain rigid during motion, while the various joints are moveable components. A static digitized image, for example, an image of the user, is utilized and a constructed skeleton is superimposed onto it. The desired object, such as the image of the user, can then be extracted from the background of the digital image and the resulting personal character can then be animated, for instance by selecting and dragging one of the hands with a mouse.

Abstract: A system and method for permitting a subject to interact with an electronic image. In one embodiment, the present invention obtains a first electronic image of a scene including the subject. An alpha image of the subject is generated. From the alpha image a characteristic of the subject is determined. The first characteristic is compared against a control box. The correlation between the first characteristic and the control box controls the interaction between the subject and the first electronic image. In another embodiment, the subject interacts with a second electronic image that is different from the first electronic image. In another embodiment, the interaction between the subject and the electronic image is the control of a cartoon character added to the electronic image. In a further embodiment, the cartoon character changes its appearance based upon the characteristic of the subject.

Abstract: The present invention provides a system and method for providing an animatable character displayed via a computer system. The character can be made animatable by utilizing ajoint which connects two portions of the character. When one portion of the character is rotated, or moved, with respect to the other portion of the character, then the dimensions of the portion which is being moved remain the same as prior to motion. Accordingly, the present invention can provide an animatable character by utilizing a single image of the character and moving various portions of the character while maintaining the integrity of the character's dimensions.

Abstract: A system and method are disclosed for providing an unencumbered capture by a computer system of an object in real-time. An object is placed in a displayer having an appropriate blue-screen surface which is positioned in the view of a camera connected to a computer. The camera captures a frame of an input image which included the object within the displayer being held by a user and possibly other background items. The system identifies a reduced-noise image of the input image and begins isolating the object. Any background items are filled out thereby recognizing the existence of the displayer. The displayer is then filled out leaving the object to be captured and entered into the computer for further manipulation and augmentation. The process is done with minimal human intervention and relies entirely on real-time visual input.

Abstract: A system and method are disclosed for providing a gesture recognition system for recognizing gestures made by a moving subject within an image and performing an operation based on the semantic meaning of the gesture. A subject, such as a human being, enters the viewing field of a camera connected to a computer and performs a gesture, such as flapping of the arms. The gesture is then examined by the system one image frame at a time. Positional data is derived from the input frames and compared to data representing gestures already known to the system. The comparisons are done in real-time and the system can be trained to better recognize known gestures or to recognize new gestures. A frame of the input image containing the subject is obtained after a background image model has been created. An input frame is used to derive a frame data set that contains particular coordinates of the subject at a given moment in time.

Abstract: Methods and apparatuses are disclosed for determining one or more characteristics of a sub-image within an electronic image.In one embodiment, the present invention includes an alpha image generator and a characterizer. The alpha image generator provides an alpha image of the subject being characterized, separated from a background of the input image. In another embodiment, the alpha image generator also may provide a summed area table. The characterizer determines a characteristic of the subject from the alpha image.In another embodiment, a first characteristic of the subject is derived from the alpha image. The characterizer determines a second characteristic based upon the first characteristic. In yet another embodiment, the determination of the second characteristic is simplified by eliminating all the unlikely estimates of the second characteristic in the overall potential estimates of the second characteristic.