Abstract: Methods and systems are provided for displaying images onto an arbitrary surface, using a projector, such that the quality of the images is preserved despite surface imperfections or color variations. Methods and systems are also provided for controlling the appearance of a projection surface. Various embodiments use a detailed radiometric model and a calibration method to determine the pixel values required to be projected by a projector in order for a camera to observe a desired image. Other embodiments use a compensation algorithm that uses a feedback approach to provide the desired image compensation. Geometric mapping may be used to establish a correspondence between points in the images to be displayed by the projector and the corresponding points in the images that are captured by the camera.

Abstract: The present invention presents a framework for separating specular and diffuse reflection components in images and videos. Each pixel of the an M-channel input image illuminated by N light sources is linearly transformed into a new color space having (M-N) channels. For an RGB image with one light source, the new color space has two color channels (U,V) that are free of specularities and a third channel (S) that contains both specular and diffuse components. When used with multiple light sources, the transformation may be used to produce a specular invariant image. A diffuse RGB image can be obtained by applying a non-linear partial differential equation to an RGB image to iteratively erode the specular component at each pixel. An optional third dimension of time may be added for processing video images. After the specular and diffuse components are separated, dichromatic editing may be used to independently process the diffuse and the specular components to add or suppress visual effects.

Abstract: Methods and systems are provided for displaying images onto an arbitrary surface, using a projector, such that the quality of the images is preserved despite surface imperfections or color variations. Methods and systems are also provided for controlling the appearance of a projection surface. Various embodiments use a detailed radiometric model and a calibration method to determine the pixel values required to be projected by a projector in order for a camera to observe a desired image. Other embodiments use a compensation algorithm that uses a feedback approach to provide the desired image compensation. Geometric mapping may be used to establish a correspondence between points in the images to be displayed by the projector and the corresponding points in the images that are captured by the camera.

Abstract: An image-displaying method and apparatus adds, or compensates for, effects associated with environmental lighting shining on the display region, and/or imperfections in the display system hardware or display surface. By detecting the environmental illumination, the system can render an image which simulates 2-d or 3-d content (i.e., objects) as if the content were actually illuminated by the environmental lighting. Information regarding the environmental lighting can also be used to cancel out spurious bright spots caused by environmental lighting patterns shining on the display region. In addition, the image displayed in the display region can be monitored for accuracy, and can be adjusted to correct for errors caused by, e.g., spurious bright spots, imperfections in the display system characteristics, and/or imperfections in or on the surface of the display region.

Abstract: Construction of a three dimensional model of an object based on images of the object being illuminated by different regions of a display in sequence. The images are obtained by a camera facing a direction relatively the same as the display, and the camera is at a relatively fixed position in relation to the object. Construction of the three dimensional model includes finding an estimate of a set of light source vectors representing the different illuminated regions of the display, and finding an estimate of the shape and albedo of the object based on the estimated set of light source vectors.

Abstract: Construction of a three dimensional model of an object based on images of the object being illuminated by different regions of a display in sequence. The images are obtained by a camera facing a direction relatively the same as the display, and the camera is at a relatively fixed position in relation to the object. Construction of the three dimensional model includes finding an estimate of a set of light source vectors representing the different illuminated regions of the display, and finding an estimate of the shape and albedo of the object based on the estimated set of light source vectors.