Abstract: Where images are displayed such that unintended light is also included and that light cannot be fully subtracted from the displayed image, an image processor compensates by compensating for the remaining light using perceptual models. In some cases, the perceptual model includes a plurality of user sensitivities and computation is performed, at least in part, based on expected user sensitivity to light pollution in portions of the images. The perceptual model might include a contrast sensitivity function, threshold-vs-intensity, saliency prediction and visual masking. The model might include artist indications of view attention. A light pollution likelihood map might be used to reduce the amount of computation needed, using a likelihood measure to determine an amount of computation to perform.

Abstract: A system and method combines videos for display in real-time. A set of narrow-angle videos and a wide-angle video are acquired of the scene, in which a field of view in the wide-angle video substantially overlaps the fields of view in the narrow-angle videos. Homographies are determined among the narrow-angle videos using the wide-angle video. Temporally corresponding selected images of the narrow-angle videos are transformed and combined into a transformed image. Geometry of an output video is determined according to the transformed image and geometry of a display screen of an output device. The homographies and the geometry of the display screen are stored in a graphic processor unit, and subsequent images in the set of narrow-angle videos are transformed and combined by the graphic processor unit to produce an output video in real-time.

Abstract: A method generates input text with a pointing device at a distance from a writing surface. Motion information of a mobile coordinate frame of the pointing device is sensed relative to a stationary coordinate frame of the writing surface using a motion sensor configured to track motion of the pointing device. The input text is then determined from the motion information. A projection of a track of the motion of the pointing device on the writing surface can also be determined from the motion information, and the track can be displayed on the writing surface as the input text.

Abstract: A method adjusts a pose of a projector with respect to a display surface. A homography HD,P is determined between a display surface and a projector. The homography HD,P is decomposed into rotation and translation parameters expressing a pose MP of the projector. An ideal pose M0 of the projector corresponding to an ideal homography H0 is determined. A pose adjustment MA is determined according to MA=M0(MP)?1. The pose adjustment MA is decomposed into rotation and translation adjustment parameters. Then, the projector is adjusted mechanically to the ideal pose M0 according to the rotation and translation adjustment parameters.

Abstract: A wireless location and identification system includes a controller and a tag. The controller has a projector configured to generate a unique temporal sequence of light intensities for each pixel in an output image of the projector and a wireless transceiver configured to emit an output signal and receive an input signal. The tag includes a photo-sensor configured to sense the unique temporal sequence of light intensities of a particular pixel, a transducer configured to receive the output signal from the transceiver, and a means for modulating, according to the unique temporal sequence of light intensities, the input signal for the transceiver in response to receiving the output signal and sensing the unique temporal sequence of light intensities of the particular pixel to indicate a location of the tag to the controller.

Abstract: A rigidly-coupled projector-camera system is augmented with laser pointers. The projector-camera system and lasers can be used to determine homography between the projector and a display surface, so that a projection of any desired geometry can be made on the display surface.

Abstract: A rigidly-coupled projector-camera system is augmented with laser pointers. The projector-camera system and lasers can be used to determine homography between the projector and a display surface, so that a projection of any desired geometry can be made on the display surface.

Abstract: A system projects multiple output images on a display surface. The system includes multiple projectors. Each projector includes a processing unit. The processing unit includes a microprocessor, a memory and an I/O interface connected by busses. A projector sub-system coupled to the processing unit is for displaying output images on the display surface. A camera sub-system coupled to the processing unit is for acquiring input images reflecting a geometry of the display surface. The camera sub-system is in a fixed physical relationship to the projector sub-system. A network sub-system coupled to the processing unit is for communicating messages between the projectors. Internal sensors coupled to the processing unit are for determining an orientation of the projector sub-system and the camera sub-system with respect to the display surface.

Abstract: An apparatus for projecting an output image on a display surface includes a processing unit. The processing unit includes a microprocessor, a memory and an I/O interface connected by buses. A projector sub-system coupled to the processing unit is for display output images on the display surface. A camera sub-system couple to the processing unit is for acquiring input images reflecting a geometry of the display surface. The camera sub-system is in a fixed physical relationship to the projector sub-system. Internal sensors coupled to the processing unit are for determining an orientation of the projector sub-system and the camera sub-system with respect to the display surface.

Abstract: A system projects multiple output images on a display surface. The system includes multiple projectors. Each projector includes a processing unit. The processing unit includes a microprocessor, a memory and an I/O interface connected by busses. A projector sub-system coupled to the processing unit is for displaying output images on the display surface. A camera sub-system coupled to the processing unit is for acquiring input images reflecting a geometry of the display surface. The camera sub-system is in a fixed physical relationship to the projector sub-system. A network sub-system coupled to the processing unit is for communicating messages between the projectors. Internal sensors coupled to the processing unit are for determining an orientation of the projector sub-system and the camera sub-system with respect to the display surface.

Abstract: A method projects one or more image onto a curved display surface. First, a predetermined structured light pattern is projected onto the display surface. A stereo pair of images is acquired of the projected images on the display surface. Then, a quadric transfer function between the predetermined images and the stereo pair of images, via the display surface, is determined. Thus, an arbitrary output image can be warped according to the quadric transfer function so that when it is projected onto the display surface it appears correct.

Abstract: An apparatus for projecting an output image on a display surface includes a processing unit. The processing unit includes a microprocessor, a memory and an I/O interface connected by buses. A projector sub-system coupled to the processing unit is for displaying output images on the display surface. A camera sub-system coupled to the processing unit is for acquiring input images reflecting a geometry of the display surface. The camera sub-system is in a fixed physical relationship to the projector sub-system. Internal sensors coupled to the processing unit are for determining an orientation of the projector sub-system and the camera sub-system with respect to the display surface.

Abstract: A method projects one or more image onto a curved display surface. First, a predetermined structured light pattern is projected onto the display surface. A stereo pair of images is acquired of the projected images on the display surface. Then, a quadric transfer function between the predetermined images and the stereo pair of images, via the display surface, is determined. Thus, an arbitrary output image can be warped according to the quadric transfer function so that when it is projected onto the display surface it appears correct.

Abstract: A method forms a cluster from a set of projectors. Each projector in the set includes a projector sub-system in a fixed physical relationship to a camera sub-system, and a communication sub-system for sending and receiving messages. A calibrate message is received in the projectors via the communications sub-system. A ready message is broadcast by the projectors using the communications sub-system. A structured pattern is projected sequentially by each of the projectors on a display surface using the projector sub-system. An input image of the structured pattern is acquired sequentially by each of the projectors using the camera sub-system. The projectors are globally aligned with each other and the display surface according to the input images.

Abstract: A method produces an image from a set of discrete sample points. The sample points can define a 3D volume or surface. Each discrete sample point is projected to a screen space. A continuous resampling filter for each sample point is generated in screen space. The continuous resampling filter is a combination of a continuous reconstruction function and a continuous filter function for the sample point in screen space. The continuous resampling filter is then applied to each corresponding discrete sample in the screen space to generate a continuous sample for the image. The continuous samples can be rasterized to pixels using any known rasterization process or method.

Abstract: A method determines a largest rectangle on a display surface. A polygon L is drawn on a first depth plane having a depth z=1 in a depth buffer. A rectangle R is drawn with a predetermined aspect ratio on a second depth plane having a depth z=0. A center of projection is determined with a minimum depth z in a range [0,1] that maps the rectangle R into a largest rectangle S in the first depth plane so that the rectangle S remains completely inside the polygon L.

Abstract: A method displays an image on a display surface. First, structured patterns are projected on the display surface by multiple projectors Pi. Input images of the structured pattern are acquired. Each input image is acquired by a camera Ci in a fixed physical relationship to a corresponding one of the projectors. The correspondences are triangulated to determine a quadric transfer TPiCk. Quadric transfer parameters are determined of the quadric transfer T. Output images from the projectors are warped according to the quadric transfer and the quadric transfer parameters.

Abstract: A rendering system pipeline includes a memory storing shape and shade attributes of a surface of the object. The attributes are arranged as an octree in the memory. The octree includes a plurality of nodes arranged at a plurality of levels, each node storing a plurality of zero-dimensional n-tuples, each n-tuple locally approximating the shape and shade attributes of a portion of the surface of the graphic object, and the n-tuples having a sampling resolution of an image space. A plurality of parallel processing pipelines are connected the memory. The pipelines project the shape and shade attributes of the octree to an image plane having a selected orientation by traversing the n-tuples of the nodes of the octree from a lowest resolution level to a highest resolution level.

Abstract: A method produces an image from a set of discrete sample points. The sample points can define a 3D volume or surface. Each discrete sample point is projected to a screen space. A continuous resampling filter for each sample point is generated in screen space. The continuous resampling filter is a combination of a continuous reconstruction function and a continuous filter function for the sample point in screen space. The continuous resampling filter is then applied to each corresponding discrete sample in the screen space to generate a continuous sample for the image. The continuous samples can be rasterized to pixels using any known rasterization process or method.

Abstract: Provided is a method for representing a graphic object in a memory. A surface of the object is partitioned into a plurality of cells having a grid resolution related to an image plane resolution. Each cell is bounded by eight grid points related to the image plane resolution. A single zero-dimensional surface element is stored in the memory for each cell located on the surface of the object. The surface elements in adjacent cells are connected by links, and attributes of the portion of the object contained in the cell are assigned to each surface element and each link.