Abstract: A system digitizes a three-dimensional object as a three-dimension model by placing the object on a turntable while taking two sets of corresponding images. The first set of images and the second set of images are obtained while rotating the turntable to a various positions and illuminated the object with the overhead lights and backlights. There is a one to one correspondence for images in each set for each position of the turntable. Object shape data and texture data are respectively extracted from the first and second set of images. The object shape data is correlated with the object texture data to construct the three-dimensional digital model stored in a memory of a computer system.

Abstract: A 3D model of a scene is constructed by acquiring first images of a scene having unknown characteristics with a first camera. Corresponding second images of a another scene having known characteristics are acquired by a second camera. The first and second cameras have a fixed physical relationship to each other. Only the second images are analyzed to determine corresponding positions of the second camera while acquiring the first images. Then, the first images are assembled into the 3D model using the corresponding positions and the fixed physical relationship of the first and second camera.

Abstract: A position and orientation of a projector are determined from projected images. First, a homography between a camera and a planar surface, where the relationship between the camera and planar surface is fixed, is determined. Next, a known pattern is projected on the planar surface with a projector having known intrinsic parameters and an unknown position and orientation. An image of the known pattern is acquired with the camera, and a position and orientation of the projector is determined from the image using the homography and the intrinsic parameters.

Abstract: An interactive display system includes a sensor for sensing a relationship between a mobile coordinate frame fixed to a moving projector, and a stable coordinate frame fixed to a stationary display surface in the real world. An output image to be projected on the display surface is partitioned into a black image portion having a fixed relationship to the mobile coordinate frame, a stable image portion within the block image portion having a fixed relationship to the stable coordinate frame, and a mobile image portion within the stable image portion having a fixed relationship to the mobile coordinate frame. The mobile portion can be used as a pointer within the stable portion in a mouse-cursor like manner.

Abstract: A method forms a cluster from a set of projectors. Each projector in the set includes a projector sub-system in a fixed physical relationship to a camera sub-system, and a communication sub-system for sending and receiving messages. A calibrate message is received in the projectors via the communications sub-system. A ready message is broadcast by the projectors using the communications sub-system. A structured pattern is projected sequentially by each of the projectors on a display surface using the projector sub-system. An input image of the structured pattern is acquired sequentially by each of the projectors using the camera sub-system. The projectors are globally aligned with each other and the display surface according to the input images.

Abstract: A method determines a shape of an object in from an image. A visual hull larger than the object is constructed such that the object can be entirely contained within the visual hull. An image is acquired of the object by a camera. The visual hull is projected onto the image according to a position and pose of the camera.

Abstract: A method links edges in stereo images into chains which correspond to physical contours in a scene. First, edges are detected in the stereo images. Edges between the stereo images are matched, such that each edge has associated stereo matches. The edges are linked into chains, such that each chained edge has a single associated stereo match, and neighboring edges in a chain have matches with a substantial similar stereo disparity.

Abstract: A method classifies an object in a scene as either an ambulatory person or a wheelchair user. Images of the scene are acquired with a set of stereo cameras. Moving objects in the scene are segmented from the background using detected edges. A 3D reconstruction of the object is generated from the edges, and tests are performed on height and 3D shape of the 3D reconstruction to classify the object as the ambulatory person or the wheelchair user.

Abstract: A method detects edges of an object in a scene by first acquiring a static image of the scene when the scene is static, and a live image of the scene including the object. A reference image is constructed from the static image. Then, image gradients of the reference image are compared with image gradients of the live image to identify edges of the object in the live image.

Abstract: A method models a three-dimensional object by first acquiring alpha mattes of the object for multiple viewpoints. The alpha mattes are then projected onto a surface hull completely enclosing the object to construct an opacity hull storing opacity values of the surface of the object. The object is illuminated for various lighting conditions while images are acquired. The images are projected onto the opacity hull to render the object under arbitrary lighting conditions for arbitrary viewpoints.

Abstract: A method dynamically identifies a badge in a sequence of images of a scene acquired by a camera. Each image in the sequence includes a plurality of pixels, and each pixel has a color and an intensity. Each image is scanned to detect a border pixel. Adjacent pixels to the border pixel are connected to determine a connected region of pixels. An inner boundary of the connected region is determined, and an ellipse is fitted to the inner boundary. The internal pixels inside the ellipse are distorted to a circular form, and a plurality of spokes are fitted to the distorted internal pixels to identify colored segments. Then, an unique identity is associated with each badge according to the colored segments.

Abstract: In a method and system for calibrating a multiple cameras, a calibration object is placed on a turntable while a set of images is acquired with each camera while rotating the turntable. Vertices of a calibration pattern are located in each set of images, and intrinsic parameters for each camera are determined from the vertices. An orientation of a rotation axis of the turntable relative to a position of each camera is estimated from the intrinsic parameters of each camera. A dependency of each orientation on a global geometry of the calibration pattern is minimized. Then, one camera is selected as a fixed camera, all other cameras are designated as floating cameras. A translation vector between the fixed camera and each floating camera is determined, and the translation vectors are used to place the cameras in a common coordinate frame according to the translating vectors.

Abstract: A system enables multiple users to interact with a picture presentation. The system includes a display surface having a horizontal orientation, preferably circular. A processor is configured to composite an image. The composite image includes a picture display area, an orientation area, and a plurality of control panels. There is one control panel for each of the users. A database, coupled to the processor, stores annotated pictures. Selected annotated pictures are to be composited into the picture display area of the displayed image. The pictures are selected using the control panel. A display device, coupled to the processor, displays the composite image on the display surface, and an input device is used to interact with the control panels, the orientation area, and the annotated pictures to enable the users to concurrently control the compositing of the sequence of images.

Abstract: A method calibrates a projector with a camera being a fixed physical relationship relative to each other. An output image is projected onto a display surface for a first and second pose of the projector and the camera relative to a display surface. For each pose, an input image is acquired. For each pose, a projector perspective projection matrix and a camera perspective projection matrix is determined from each input image. For each pose, a transformation from the projector perspective projection matrix and the camera perspective projection matrix to Euclidean form is determined, and the projector intrinsic parameters from the transformations.

Abstract: A 3D model of a scene is constructed by acquiring first images of a scene having unknown characteristics with a first camera. Corresponding second images of a another scene having known characteristics are acquired by a second camera. The first and second cameras have a fixed physical relationship to each other. Only the second images are analyzed to determine corresponding positions of the second camera while acquiring the first images. Then, the first images are assembled into the 3D model using the corresponding positions and the fixed physical relationship of the first and second camera.

Abstract: A system digitizes a three-dimensional object as a three-dimension model by placing the object on a turntable while taking two sets of corresponding images. The first set of images and the second set of images are obtained while rotating the turntable to a various positions and illuminated the object with the overhead lights and backlights. There is a one to one correspondence for images in each set for each position of the turntable. Object shape data and texture data are respectively extracted from the first and second set of images. The object shape data is correlated with the object texture data to construct the three-dimensional digital model stored in a memory of a computer system.

Abstract: An interactive vending machine includes a camera, an output device, and a vision system connected to the camera and the output device. The vision system includes a processor for detecting a logo batch, and interacting with a consumer via the output device in response to detecting the logo batch.

Abstract: A method recognizes three-dimensional physical objects using three-dimensional deformable templates. A particular object is scanned with a camera to generate volumetric data representing the object. The volumetric data is compared to each of a plurality of three-dimensional deformable templates stored in a database to obtain a score for each comparison. The deforming of the template is done by optimizing an objective function.

Abstract: A system for creating lighting for a photograph generates a large number of mages based upon structures determined from the photograph and randomly selected light positions, types and directions. One or more photographs are analyzed to determine the three-dimensional structures in the photographs. These structures are represented as gray surfaces, to which lighting is applied. The images are culled to provide a set of images which best spans the lighting space represented by the large number of images. The culling process is iterative; at each iteration, the image which is most dissimilar from a nearest neighbor in the selected set is added to the selected set. The images are organized in a hierarchical structure. A user interface allows the user to review and select images in the hierarchical structure. The images selected by the user are combined to create a final image with composite lighting. The lighting specifications can be saved for future reference by the lighting system or other applications.