Abstract: A system projects multiple output images on a display surface. The system includes multiple projectors. Each projector includes a processing unit. The processing unit includes a microprocessor, a memory and an I/O interface connected by busses. A projector sub-system coupled to the processing unit is for displaying output images on the display surface. A camera sub-system coupled to the processing unit is for acquiring input images reflecting a geometry of the display surface. The camera sub-system is in a fixed physical relationship to the projector sub-system. A network sub-system coupled to the processing unit is for communicating messages between the projectors. Internal sensors coupled to the processing unit are for determining an orientation of the projector sub-system and the camera sub-system with respect to the display surface.

Abstract: An apparatus for projecting an output image on a display surface includes a processing unit. The processing unit includes a microprocessor, a memory and an I/O interface connected by buses. A projector sub-system coupled to the processing unit is for display output images on the display surface. A camera sub-system couple to the processing unit is for acquiring input images reflecting a geometry of the display surface. The camera sub-system is in a fixed physical relationship to the projector sub-system. Internal sensors coupled to the processing unit are for determining an orientation of the projector sub-system and the camera sub-system with respect to the display surface.

Abstract: A method generates a stylized image of a scene including an object. A set of n input images are acquired of the scene with a camera. Each one of the n input images is illuminated by one of a set of n light sources mounted on a body of the camera at different positions from a center of projection of a lens of the camera. Ambient lighting can be used to illuminate one image. Features in the set of n input images are detected. The features include depth edges, intensity edges, and texture edges to determine qualitative depth relationships between the depth edges, the intensity edges and the texture edges. The set of n input images are then combined in an output image to enhance the detected features according to the qualitative relationships.

Abstract: A method displays an output image on an object. A set of unique markers are fixed to the object at predetermined locations. An input image of the object and the markers is acquired with a camera in a fixed physical relationship to a projector. A pose of the projector with respect to the markers is determined from the image. Then, one or more output images related to the object can be projected onto the object, at predetermine locations, according to the pose of the projector and the unique markers.

Abstract: A camera has a single lens and multiple flash units distributed around the lens. A set of images is acquired of a scene with different controlled lighting applied by the flash units, one at the time. The images are stored in a memory, and then combined to produce a single stylized image of the scene from the acquired images.

Abstract: A method detects silhouette edges in images. An ambient image is acquired of a scene with ambient light. A set of illuminated images is also acquired of the scene. Each illuminated image is acquired with a different light source illuminating the scene. The ambient image is combined with the set of illuminated to detect cast shadows, and silhouette edge pixels are located from the cast shadows.

Abstract: A system projects multiple output images on a display surface. The system includes multiple projectors. Each projector includes a processing unit. The processing unit includes a microprocessor, a memory and an I/O interface connected by busses. A projector sub-system coupled to the processing unit is for displaying output images on the display surface. A camera sub-system coupled to the processing unit is for acquiring input images reflecting a geometry of the display surface. The camera sub-system is in a fixed physical relationship to the projector sub-system. A network sub-system coupled to the processing unit is for communicating messages between the projectors. Internal sensors coupled to the processing unit are for determining an orientation of the projector sub-system and the camera sub-system with respect to the display surface.

Abstract: A method enhances images of a naturally illuminated scene. First, a set of images Ii(x, y) is acquired of a scene. Each image is acquired under a different uncontrolled illumination. For each image Ii(x, y), intensity gradients ∇Ii(x, y) are determined, and each image is weighted with weights according to the intensity gradients. The weighted images are then combined to construct an enhanced image I′.

Abstract: An apparatus for projecting an output image on a display surface includes a processing unit. The processing unit includes a microprocessor, a memory and an I/O interface connected by buses. A projector sub-system coupled to the processing unit is for displaying output images on the display surface. A camera sub-system coupled to the processing unit is for acquiring input images reflecting a geometry of the display surface. The camera sub-system is in a fixed physical relationship to the projector sub-system. Internal sensors coupled to the processing unit are for determining an orientation of the projector sub-system and the camera sub-system with respect to the display surface.

Abstract: A method generates a stylized image. First, a set of images is acquired of a scene. Each image is acquired under a different lighting condition. Silhouette edges are detected in the set of images. Texture regions are identified in the set of images according to the silhouette edges, and an output image is generated from a combination of the set of images wherein the silhouette edges and the texture regions are altered so as to enhance or de-emphasize selected details.

Abstract: A method projects one or more image onto a curved display surface. First, a predetermined structured light pattern is projected onto the display surface. A stereo pair of images is acquired of the projected images on the display surface. Then, a quadric transfer function between the predetermined images and the stereo pair of images, via the display surface, is determined. Thus, an arbitrary output image can be warped according to the quadric transfer function so that when it is projected onto the display surface it appears correct.

Abstract: A method generates an image with de-emphasized textures. Each pixel in the image is classified as either a silhouette edge pixel, a texture edge pixels, or a featureless pixel. A mask image M(x, y) is generated, wherein an intensity of a given pixel (x, y) in the mask image M(x, y) is zero if the pixel (x, y) is classified as the texture edge pixel, is d(x, y) if the pixel (x, y) is classified as the featureless pixel, and is one if the pixel (x, y) is classified as the silhouette edge pixel. An intensity gradient ∇I(x, y) is determined in the masked image, and the intensity gradients in the masked image are integrated according to G(x, y)=∇I(x, y). M(x, y). Then, an output image I′ is generated by minimizing |∇I′−G|, and normalizing the intensities in the output image I′.

Abstract: An input device is used to generate input strokes on a display device. The input strokes are acquired and resampled to be evenly spaced. Then, depth values are assigned to the resampled 2D points to form 3D contours. Variational implicit surfaces are fitted to the 3D contours to generate 3D blobs forming the 3D model to be rendered on an output device. The blobs can be merged by guidance strokes, and modified by target strokes.

Abstract: A method projects one or more image onto a curved display surface. First, a predetermined structured light pattern is projected onto the display surface. A stereo pair of images is acquired of the projected images on the display surface. Then, a quadric transfer function between the predetermined images and the stereo pair of images, via the display surface, is determined. Thus, an arbitrary output image can be warped according to the quadric transfer function so that when it is projected onto the display surface it appears correct.

Abstract: A method blends multiple input images into an output image for any arbitrary view. In the output images, pixels that are produced from only a single input pixel are identified. The weight of the single pixels is set to one. For each remaining pixel in the input images with unassigned weights distances to an image and a depth boundary are measured, and proportional weight, in a range from zero to one, for these remaining pixels are set proportional to the minimum of the two distances. Then, each input image is rendered to the output image according to the blending fields.

Abstract: A position and orientation of a projector are determined from projected images. First, a homography between a camera and a planar surface, where the relationship between the camera and planar surface is fixed, is determined. Next, a known pattern is projected on the planar surface with a projector having known intrinsic parameters and an unknown position and orientation. An image of the known pattern is acquired with the camera, and a position and orientation of the projector is determined from the image using the homography and the intrinsic parameters.

Abstract: An interactive display system includes a sensor for sensing a relationship between a mobile coordinate frame fixed to a moving projector, and a stable coordinate frame fixed to a stationary display surface in the real world. An output image to be projected on the display surface is partitioned into a black image portion having a fixed relationship to the mobile coordinate frame, a stable image portion within the block image portion having a fixed relationship to the stable coordinate frame, and a mobile image portion within the stable image portion having a fixed relationship to the mobile coordinate frame. The mobile portion can be used as a pointer within the stable portion in a mouse-cursor like manner.

Abstract: A method forms a cluster from a set of projectors. Each projector in the set includes a projector sub-system in a fixed physical relationship to a camera sub-system, and a communication sub-system for sending and receiving messages. A calibrate message is received in the projectors via the communications sub-system. A ready message is broadcast by the projectors using the communications sub-system. A structured pattern is projected sequentially by each of the projectors on a display surface using the projector sub-system. An input image of the structured pattern is acquired sequentially by each of the projectors using the camera sub-system. The projectors are globally aligned with each other and the display surface according to the input images.

Abstract: A method renders a mesh constructed of polygons representing a graphics model one at the time to accentuate geometric features of the mesh. At least one additional polygon is generated at each edge of each polygon of the mesh. Each additional polygon has a predetermined orientation, size, and color. The predetermined orientation of the generated polygons is 180° with respect to the polygon if the polygon is a back-facing polygon to accentuate silhouettes. The predetermined orientation of the generated polygon is a first threshold angle with respect to the polygon if the polygon is a front-facing polygon to accentuate ridges, and the predetermined orientation of the generated polygon is a second threshold angle with respect to the polygon if the polygon is a front-facing polygon to accentuate valleys.

Abstract: A method forms a mosaic image on a display surface with a multiple projectors. For each projector in turn, a registration image is projected onto the display surface so that a union of the projected registration images forms a polygon. With a camera, for each registration image in turn, a corresponding input image is acquired. A display area on the display surface enclosed by the polygon is then identified, and a single projective matrix between the display area and each input image is determined for each projector. A source image for each projector is warped according to the corresponding homography of the projector. The pixels of the warped source image are weighted according to the single projective matrix, and then the warped and weighted source images are concurrently projected directly onto the display surface to form the mosaic image.