Abstract: To supplement a video display on a conventional television, a surround video stream may be projected onto wall and other surfaces adjacent the television. The surround video stream may derive from a wide angle lens camera positioned alongside the main camera. The surround video stream may be processed in a local processor to compensate for departures from planar geometry in the wall surfaces. Where no surround video stream is received, a video processor may synthesize a surround video stream from the main video signal. Moving objects represented in the main video signal may be synthesized in the surround video to provide the perception of movement across the viewer's full field of view.

Abstract: A method for determining the position and orientation of a camera, which may not rely on the use of special markers. A set of reference images may be stored, together with camera pose and feature information for each image. A first estimate of camera position is determined by comparing the current camera image with the set of reference images. A refined estimate can be obtained using features from the current image matched in a subset of similar reference images, and in particular, the 3D positions of those features. A consistent 3D model of all stored feature information need not be provided.