Abstract: A method determines a largest rectangle on a display surface. A polygon L is drawn on a first depth plane having a depth z=1 in a depth buffer. A rectangle R is drawn with a predetermined aspect ratio on a second depth plane having a depth z=0. A center of projection is determined with a minimum depth z in a range [0,1] that maps the rectangle R into a largest rectangle S in the first depth plane so that the rectangle S remains completely inside the polygon L.

Abstract: A method displays an image on a display surface. First, structured patterns are projected on the display surface by multiple projectors Pi. Input images of the structured pattern are acquired. Each input image is acquired by a camera Ci in a fixed physical relationship to a corresponding one of the projectors. The correspondences are triangulated to determine a quadric transfer TPiCk. Quadric transfer parameters are determined of the quadric transfer T. Output images from the projectors are warped according to the quadric transfer and the quadric transfer parameters.

Abstract: A method adapts an output image to a shape of a display surface. First, a structured pattern is projected onto the display surface by a projector. An input image of the structured pattern is acquired by a camera in a fixed physical relationship to the projector. From the input image, a mesh of the structured pattern is determined in a coordinate frame of the projector. Coordinates of a texture are determined in the coordinate frame of the projector. The coordinates of the texture are updated according to the display region. The texture then mapped to the mesh, and the textured mesh is rendered on the display surface.

Abstract: A computer implemented method cross-fades intensities of a plurality of overlapping images by identifying pixels in a target image that are only produced by a first source image. The weights of all the corresponding pixels in the first source image are set to one. Pixels in a second source images contributing to the target image are similarly identified and set to one. the weight of each remaining pixel in the first and second images is inversely proportional to a distance to a nearest pixel having a weight of one. Then, the first and second source image can be projected to form the target image.

Abstract: An input device is used to generate input strokes on a display device. The input strokes are acquired and resampled to be evenly spaced. Then, depth values are assigned to the resampled 2D points to form 3D contours. Variational implicit surfaces are fitted to the 3D contours to generate 3D blobs forming the 3D model to be rendered on an output device. The blobs can be merged by guidance strokes, and modified by target strokes.

Abstract: A method forms a mosaic image on a display surface with a multiple projectors. For each projector in turn, a registration image is projected onto the display surface so that a union of the projected registration images forms a polygon. With a camera, for each registration image in turn, a corresponding input image is acquired. A display area on the display surface enclosed by the polygon is then identified, and a single projective matrix between the display area and each input image is determined for each projector. A source image for each projector is warped according to the corresponding homography of the projector. The pixels of the warped source image are weighted according to the single projective matrix, and then the warped and weighted source images are concurrently projected directly onto the display surface to form the mosaic image.

Abstract: A computer implemented method cross-fades intensities of a plurality of overlapping images by identifying pixels in a target image that are only produced by a first source image. The weights of all the corresponding pixels in the first source image are set to one. Pixels in a second source images contributing to the target image are similarly identified and set to one. the weight of each remaining pixel in the first and second images is inversely proportional to a distance to a nearest pixel having a weight of one. Then, the first and second source image can be projected to form the target image.

Abstract: A computer implemented method stimulates motion of a static 3D physical object in a static scene by first acquiring a 3D graphics model of the 3D physical object and the scene. A projector is registered with the 3D physical object, the scene and the 3D model. The model is then segmented into a plurality of parts, and each part is edited with graphics authoring tools to reflect a desired appearance and virtual motion of the part. The edited parts are rendered and projected, in real-time, as a video onto the 3D physical object and scene to give the 3D physical object and the scene the desired appearance and virtual motion.

Abstract: A method calibrates a projector with a camera being a fixed physical relationship relative to each other. An output image is projected onto a display surface for a first and second pose of the projector and the camera relative to a display surface. For each pose, an input image is acquired. For each pose, a projector perspective projection matrix and a camera perspective projection matrix is determined from each input image. For each pose, a transformation from the projector perspective projection matrix and the camera perspective projection matrix to Euclidean form is determined, and the projector intrinsic parameters from the transformations.

Abstract: A computer implemented method determines an intensity of each pixel in an image to be projected onto a surface of 3D physical object to change an appearance of the object. A desired radiance in a particular direction and at a particular distance from a point on the surface of the object when illuminated by the pixel is specified when the pixel is treated as a point emitter. The desired radiance is multiplied by a square of the distance to obtain a first product. A diffuse reflectance at the point is multiplied by the direction to obtain a second product, and the first product is divided by the second product to determine the intensity for the pixel in the image.

Abstract: A computer implemented method animates a 3D physical object by first acquiring a 3D graphics model of the object. The model is edited with graphics authoring tools to reflect a desired appearance of the object. The edited model is rendered as an image considering a user location and a location of a virtual light. Then, intensity values of the image are corrected according to an orientation of a surface of the object and a radiance at the surface. The 3D physical object can finally be illuminated with the corrected image to give the 3D physical object the desired appearance under the virtual light when viewed from the user location.

Abstract: A method blends multiple input images into an output image for any arbitrary view. In the output images, pixels that are produced from only a single input pixel are identified. The weight of the single pixels is set to one. For each remaining pixel in the input images with unassigned weights distances to an image and a depth boundary are measured, and proportional weight, in a range from zero to one, for these remaining pixels are set proportional to the minimum of the two distances. Then, each input image is rendered to the output image according to the blending fields.

Abstract: A computer implemented method registers an image with a 3D physical object by first acquiring a 3D graphics model of an object. Multiple 3D calibration points a surface of the object and corresponding 3D model calibration points in the 3D graphics model are identified. The object is illuminated with a calibration image using a projector at a fixed location. The calibration image is aligned with each of the 3D calibration points on the surface of the 3D physical object to identify corresponding 2D pixels in the calibration image, and then a transformation between the 2D calibration pixels and the corresponding 3D model calibration points is determined to register the projector with the 3D physical object.

Abstract: A method corrects keystoning in a projector arbitrarily oriented with respect to a display surface. An elevation angle, a roll angle, and an azimuth angle of an optical axis of the projector are measured with respect to the display surface. A planar projective transformation matrix is determined from the elevation, roll, and azimuth angles. A source image to be projected by the projector is warped according to the planar projective transformation, and then projected onto the display surface.

Abstract: A method renders a mesh constructed of polygons representing a graphics model one at the time to accentuate geometric features of the mesh. At least one additional polygon is generated at each edge of each polygon of the mesh. Each additional polygon has a predetermined orientation, size, and color. The predetermined orientation of the generated polygons is 180° with respect to the polygon if the polygon is a back-facing polygon to accentuate silhouettes. The predetermined orientation of the generated polygon is a first threshold angle with respect to the polygon if the polygon is a front-facing polygon to accentuate ridges, and the predetermined orientation of the generated polygon is a second threshold angle with respect to the polygon if the polygon is a front-facing polygon to accentuate valleys.

Abstract: A method corrects keystoning in a projector arbitrarily oriented with respect to a display surface. An elevation angle, a roll angle, and an azimuth angle of an optical axis of the projector are measured with respect to the display surface. A planar projective transformation matrix is determined from the elevation, roll, and azimuth angles. A source image to be projected by the projector is warped according to the planar projective transformation, and then projected onto the display surface.