Abstract: Two projected images from two projector-camera systems, each defined by characteristics c1=T1p1 and c2=T2p2, respectively, are used to create mosaic composite of a desired image c. Formulas p1=T1?1 (c?T2p2) and p2=T2?1(c?T1p1) are iteratively repeated with p2 initially set to zero until p1 converges to a first mosaic image and p2 converges to a second mosaic image.

Abstract: Light distortion due to light noise or light scattering object in the path of a light beam from a projector to a camera's image sensor in projector-camera systems are mitigated, or eliminated, by a simple modification to a light transport matrix T. For each row in light transport matrix T, matrix entries along a common row are compared, and all but the highest valued entry in the row are zeroed out, i.e. nullified. It is preferred that an array and record notation be used in order to reduce the size of the light transport matrix T, and its modified version to two arrays.

Abstract: A surround visual field framework or system and methods are presented. In an embodiment, a surround visual field system comprises a control signal extractor that obtains a control signal that is related to the input stream. The control signal is provided to a coupling rule that links the control signal to an effect on an element of a surround visual field. The effect is applied to the element of the surround visual field thereby creating a surround visual field that has a characteristic or characteristics which relate to an input audio/visual stream presentation. In one embodiment, the surround visual field is displayed in an area partially surrounding or surrounding the input stream being displayed. In embodiments, the surround visual field may be a rendering of a three-dimensional environment. In embodiments, one or more otherwise idle display areas may be used to display a surround visual field.

Abstract: An image created by a first projector is recreated using a second projector by relating the two projectors to a common point of view, preferably as viewed from a camera. A first transport matrix T1 is captured to relate the first projector to the camera. A second transport matrix T2 is then capture to relate the second projector to the camera. To have a first image p1, as projected by the first projector, reproduced by the second projector, the second projector projects a distorted image defined as (T2?1)(T1)p1. The inverse of T2, as used in this equation is an estimation defined by first creating an intermediate matrix {hacek over (T)} of equal size as T2. If a column in T2 is denoted as Tr and a corresponding column in {hacek over (T)} is denoted as {hacek over (T)}r, then the construction and population of {hacek over (T)} is defined as {hacek over (T)}r=Tr/(?Tr?)2, and the inverse of T2 is estimated as the transpose of {hacek over (T)}.

Abstract: Application of dual photography is simplified by reducing the number of captured images needed to generate a light transport matrix T of (p×q) projection pixel array from (p×q) images to (p+q) images. Manipulation of the light transport matrix is also simplified by replacing the use of a matrix T with an index associating each projection pixel to only non-zero light transport values. By eliminating the use of zero-valued light transport coefficients, the memory and processing requirements for implementing dual photography are greatly reduced. This dual photography technique is applied to the calibration of projector-camera systems. A second method for calibrating projector-camera systems uses a known projection test pattern and a calibrated camera to associate projected markers on a real image to a captured image.

Abstract: Systems and methods for synthesizing a surround visual field of image related to an input image are described. In one embodiment, the surround visual field is displayed in an area partially surrounding or surrounding an input image being displayed. In an embodiment, this surround visual field may comprise a plurality of images selected from a database of still images and/or video images based upon a characteristic or characteristics that relate to the displayed input image.

Abstract: A surround visual field that has a characteristic or characteristics which relate to an audio/visual presentation is described. In one embodiment, the surround visual field is displayed in an area partially surrounding or surrounding the video content being displayed. This surround visual field may be comprised of a plurality of elements that further enhance the effect of the content being displayed. For example, one embodiment of the invention provides for elements within the surround visual field to move in relation to motion within the video content being displayed. Other characteristics of the video content may also be supplemented by the surround visual field or the surround visual field may be authored, at least in part, to correspond to the content itself. In embodiments, the surround visual field may be a rendering of a three-dimensional environment. In embodiments, one or more otherwise idle display areas may be used to display a surround visual field.

Abstract: A surround visual field that has a characteristic or characteristics that relate to an audio/visual presentation is described. In one embodiment, the surround visual field is projected on an area partially surrounding or surrounding video content being displayed on a device. This surround visual field may be comprised of a plurality of elements that further enhance the visual effect of the content being displayed. For example, one embodiment of the invention provides for elements within the surround visual field to move in relation to motion within the video content being displayed. Other characteristics of the video content may also be supplemented by the surround visual field or the surround visual field may simply be authored to correspond to the content itself.

Abstract: Methods and systems are disclosed for processing image frames to reduce the bandwidth requirements. Embodiment of the present invention may include mode-specific image frame rendering in photorealistic and non-photorealistic modes, such as outline and cartoon modes. In embodiments, update regions may be identified and reduced by an edge position mask. In embodiments, update regions may be bounded by rectangles and such regions may be reduced in number by merging regions together using various no-cost or cost approaches. To improve compressibility, regions to be transmitted that do not require updating at the receiver may be encoded as transparent.

Abstract: A method enhances an output image of a 3D object. A set of input images are acquired of a 3D object. Each one of the input images is illuminated by a different one of a set of lights placed at different positions with respect to the 3D object. Boundaries of shadows are detected in the set of input images by comparing the set of input images. The boundaries of shadows that are closer to a direction of the set of lights are marked as depth edge pixels.