Abstract: A method and system for the creation and viewing of stereoscopic immersive images. By creating two immersive images from an offset camera platform, the illusion of depth can be provided by a left and right view in the form of an interactive panoramic image. By capturing two immersive images on a fixture with horizontal separation of the centers of each immersive image, each constructed from a sequence of fisheye images that are captured in a constant direction and seamed together, two files that can be used to produce a stereoscopic display are created. The resulting files can be displayed using any number of stereoscopic displays including dual monitors, one for each eye, or shuttered displays for each eye from a single monitor, or displays with polarized filters directing separate views to each eye.

Abstract: A method and apparatus for sequencing views retrieved from a spherical still image file provide the viewer with the perception of a video performance with a low bandwidth transmission. The method incorporates digital transmission and automatic sequencing of the playback of the view. The apparatus provides video-motion rate images via low bandwidth digital transmissions or small data files from a still image taken of an inanimate environment. The resulting method and apparatus allow the viewer to experience a video display of any environment (for example, real estate locations, malls, museums, and hotels) and view a “video” tour of the location through a low bandwidth transmission.

Abstract: A method for capturing and directly scanning a rectilinear imaging element using a non-linear scan is incorporated into a single chip comprising at least a sensor array and an MSD. The method directly addresses each picture element of an analog image captured with an imaging device having either a partial spherical field of view or a conventional two-dimensional field of view. An image transform processor is used to process the captured image depending upon the particular portion of interest of the image. In the case of a non-linear scan, the image transform processor is provided with the capability of geometrically filtering the portion of interest of the captured image such that a two-dimensional, undistorted image is displayed at the monitor. A CMOS active pixel image sensor (APS) or Charge Injection Diode (CID) camera array are used to capture the image to be scanned. The image transform processor of the present invention is a Mixed-signal Semiconductor Device (MSD).

Abstract: A device for omnidirectional image viewing providing pan-and-tilt orientation, rotation, and magnification within a hemispherical field-of-view that utilizes no moving parts. The imaging device is based on the effect that the image from a fisheye lens, which produces a circular image of an entire hemispherical field-of-view, can be mathematically corrected using high-speed electronic circuitry. More specifically, an incoming fisheye image is captured on a Charge Coupled Diode array in such a way as to remove the distortion caused by the lens by locating the picture pickup elements in a nonlinear manner described herein. As a result, this device can accomplish the functions of pan, tilt, rotation, and zoom throughout a hemispherical field-of-view without the need for any mechanical mechanisms. The preferred embodiment of the image capture device can provide corrected images at standard video frame rates, compatible with standard video equipment.

Abstract: A method of inserting a high resolution image into a low resolution interactive image provides a greater sensation of virtual reality (presence) because increased magnification of the low resolution image, typically a wide angle image, reduces the sensation of virtual presence in the image. For example, according to the invention, as an image of the wall of an art gallery becomes magnified in a virtual presence experience, a rectangular or other planar image portion such as a painting that the user zooms on is replaced with a high resolution image stored and associated in memory. The virtual presence may be achieved by high resolution scanning a desired section of an image portion for overlay into the image scanned into a second memory at lower resolution. The high resolution image for insertion may be a dewarped portion of a fish-eye lens captured interactive image.

Abstract: A method and apparatus for capture of a spherical image is disclosed. The present invention includes at least one camera having a lens with at least a 180.degree. field-of-view for capturing a hemispherical image. In a first embodiment, a second hemispherical image is created corresponding to a mirror image of the hemispherical image captured by the camera. In a second embodiment, two back-to-back cameras capture first and second hemispherical images, respectively. In both embodiments, a converter combines the two images along their outside edges to form a single, spherical image. Finally, the converter stores the complete spherical image for later retrieval and perspective corrected viewing.

Abstract: Apparatus for interactive display of any portion of a spherical image preferably comprises a personal computer or other digital processor apparatus for storing digital data representative of at least one image having a 180 degree or greater field of view (or hemispherical image). In order to view a selected image portion without warp or distortion at the seam between opposite hemispherical images, edge filtering is applied to eliminate a halo effect. Moreover, an opposite hemispherical image may either be obtained by creating a mirror image of a first hemispherical image or by capturing a second hemispherical image by means of an oppositely directed camera and storing the digital image. Equations for image transformation are based on a lens' characteristics including the lens' radius R. An input interface preferably comprises a display including a magnification region and a directional cursor for pointing the direction to a next spherical image.

Abstract: A method and apparatus for the elimination of temporal and spacial distortions from interlaced video signals, particularly those that occur in signals associated with affine transformations. This elimination is particularly of value for signals that have been magnified so as to prevent the visual appearance of reverse movement of moving images. The removal of these distortions is achieved by sequentially inputting the images fields into three field buffers, updating the data in a rotary manner. This data is withdrawn from any two of the field buffers, while the third field buffer is being updated, and averaging the data from the two. When such averaged data is displayed, there is no apparent reverse direction motion to the image. The method and apparatus are applied to a system wherein there is affine transformation to achieve selected pan, tilt, rotation and magnification of images during the correction of distorted images received from a wide angle lens.

Abstract: A system for achieving perspective-corrected views at a location removed from the site of the creation of a distorted wide angle image without the transmission of control signals to the site of image creation. Angles of tilt, pan and rotation, as well as degrees of magnification, are achieved without the use of mechanical devices by using transform algorithms. The system provides for the transmission of signals related to an uncorrected image from a site where this distorted image is created, with the transmitted signals being received at one or more processing sites for creating the perspectively-corrected views. Transmission can be via telephone lines, with the system including signal compression and decompression units. Wireless transmission is also utilized where desired.

Abstract: A method and apparatus for sequencing views retrieved from a spherical still image file provide the viewer the perception of video performance with low bandwidth transmission. The method incorporates digital transmission and automatic sequencing of the playback of the view. The apparatus provides video-motion rate images via low bandwidth digital transmissions or small data files from a still image taken of an inanimate environment. The resulting method and apparatus allows the viewer to experience a video display of any environment (for example, real estate locations, malls, museums, and hotels) and view a "video" tour of the location through a low bandwidth transmission.