Abstract: An information processing device for obtaining placement information regarding an imaging device of markers to be calibrated that are provided upon the imaging device, includes: a first image obtaining unit adapted to obtain a first image photographed with the imaging device; a second image obtaining unit adapted to obtain a second image obtained by photographing the imaging device from a bird's-eye view position; a first detecting unit adapted to detect information relating to image coordinates of reference markers placed in a scene, from the first image; a second detecting unit adapted to detect information relating to image coordinates of markers to be calibrated from the second image; and a calibration information calculating unit adapted to obtain the calibration information using information relating to image coordinates of the reference markers detected by the first detecting unit and the second detecting unit.

Abstract: There is provided an image processing apparatus for describing a real image as a virtual object using space data formed based on a photo image of the real object, and generating a virtual image of the virtual object using the space data. The image processing apparatus captures the photo image of the real object from a real camera viewpoint position while illuminating the real object by an illumination light source placed at a real illumination position. The captured photo image is converted into space data in the form of an object for each pixel, and the space data is stored in a memory together with various illumination conditions at the real illumination position to allow a search at a later time.

Abstract: There is provided an image processing apparatus for describing a real image as a virtual object using space data formed based on a photo image of the real object, and generating a virtual image of the virtual object using the space data. The image processing apparatus captures the photo image of the real object from a real camera viewpoint position while illuminating the real object by an illumination light source placed at a real illumination position. The captured photo image is converted into space data in the form of an object for each pixel, and the space data is stored in a memory together with various illumination conditions at the real illumination position to allow a search at a later time.

Abstract: There is provided an image processing apparatus for describing a real image as a virtual object using space data formed based on a photo image of the real object, and generating a virtual image of the virtual object using the space data. The image processing apparatus captures the photo image of the real object from a real camera viewpoint position while illuminating the real object by an illumination light source placed at a real illumination position. The captured photo image is converted into space data in the form of an object for each pixel, and the space data is stored in a memory together with various illumination conditions at the real illumination position to allow a search at a later time.

Abstract: In an image reproducing method capable of displaying annotations in virtual space constituted by a group of real panoramic images. If an object for which an annotation is to be displayed falls within the field of view at the position of the observer, the object is adopted as the display position of the annotation. If the object is not within the field of view, then the direction of forward travel of the observer is adopted as the annotation display position. If the object is in a state of transition, then the annotation display position is decided by interpolation.

Abstract: In a space rendering method for rendering a virtual space, ray space data of virtual objects in the virtual space are stored in an external database (29). When space data of a virtual object located within a predetermined range from the indicated position is not present in an internal memory (27), the space data is downloaded from the database (29) to the internal memory (27), and the virtual space is rendered on the basis of the downloaded space data.

Abstract: There are disclosed an image processing method and apparatus for generating a panoramic image in which the hue or brightness discontinuities generated at the seams of source images are reduced. According to the image processing method of this invention, upon compositing source images (221, 222) having an overlap portion, the hue or brightness of each source image is converted (H211, H221) using a reference image which has overlap portions with both the source images to be composited, and the converted images (241, 242) are composited, thereby reducing the hue or brightness discontinuities generated at the seam of images.

Abstract: Shakiness of a panoramic video can be reduced by an image processing method comprising: setting a common coordinate system which can be transformed from individual coordinate systems of a plurality of image sensing devices; estimating postures of at least one of the plurality of image sensing devices; calculating an estimated posture of the common coordinate system using at least one of the estimated posture of the plurality of image sensing devices; calculating a correction transform for reducing a shakiness of the common coordinate system using the estimated posture of the common coordinate system; calculating a correction transform for reducing a shakiness of each of the plurality of image sensing devices using the correction transform; applying the corresponding correction transform to a sensed image which is sensed by each of the plurality of image sensing devices; and composing a panoramic image by joining a plurality of transformed sensed images.

Abstract: By simplifying determination of annotation display positions, annotations can be synthesized to a large number of images and the annotation-synthesized images can be then displayed with less work and time. To achieve this, a viewpoint position and a sight line direction on a map are determined, and the annotation display position of an object is determined from the position of the object on the map determined based on observation directions of the object in plural panoramic images, the viewpoint position, and the sight line direction. Then, an annotation image is synthesized to the annotation display position on an actually taken image corresponding to the viewpoint position.

Abstract: There is disclosed a progressive display method upon rendering and displaying a virtual object expressed by RS data. When RS data is generated and recorded on the basis of real image data, map data that represents correspondence between a real image space and ray space is divided into a plurality of layers, and the resolutions of the individual layers are hierarchically changed, thus storing hierarchical map data. Upon rendering a virtual image from an arbitrary viewpoint position, rendering is done by looking up the hierarchical map data in turn in ascending order of resolution. Also, there are disclosed a downloading method of selectively downloading RS data and VRML data, and a rendering method of downloaded data. RS data with high resolution is stored in an external memory, and VRML data having a required memory size is stored in an internal memory. In principle, a virtual image is generated by rendering RS data to allow the user to experience the virtual space.

Abstract: There is disclosed an image data encoding/decoding method and apparatus which can efficiently encode multi-viewpoint image data obtained by sensing a single object from many viewpoints, and can obtain decoded data in units of pixels at high speed. Reference images which are not encoded are set every predetermined number of images (S701), and encoding is done using only the relationship with this reference image. An orthogonal transform is used in encoding, and an inverse transform formula for each pixel in a block is expanded and stored upon computing the orthogonal transform (S704). The coefficients after the orthogonal transform are fixed-length encoded in units of pixels (S705). Upon decoding, fixed-length encoded data corresponding to desired pixels are decoded, and pixel data are decoded by substituting coefficients obtained by decoding in the expansions generated upon encoding.

Abstract: An apparatus includes a camera (201) for sensing a first direction, a camera (202) for sensing a second direction, a mirror (221) for controlling the view of the camera (201) to a first view, and a mirror (222) for controlling the view of the camera (202) to a second view. The mirrors (221, 222) do not share ridge lines with each other, and the lens center of a virtual camera having the first view approximately matches that of a virtual camera having the second view.

Abstract: An image processing apparatus includes recording unit which has recorded image information appended with quantized space information in units of pixels, setting unit for setting a resolution higher than that of the recorded image information, reconstruction unit for reconstructing an image by reading out image information from the recording unit at the recorded resolution irrespective of the resolution set by the setting unit, and interpolation unit for making pixel interpolation of the reconstructed image with the resolution of the reconstructed image matching the resolution set by the setting unit.

Abstract: In order to improve the operationality of a walk-through system using panorama photography images, the system is provided with a view calculating unit for calculating view information in accordance with a user instruction from an operation unit, the view information including view position information and view direction information; a panorama image storing unit for storing a plurality of panorama images; a path storing unit for storing path information of the panorama images; an advancable path calculating unit for calculating advancable path information at a next dividing point in accordance with the view information and the path information; and an image generating unit for generating a cut-out image from the panorama image in accordance with the view information, generating a sign figure representative of the advancable path in accordance with the advancable path information, and synthesizing the cut-out image and the sign figure to generate a display image.

Abstract: An image information processing apparatus is provided to generate, from previously held image data, a display image according to a viewpoint designated by a user, and to communicate with a control apparatus which can communicate with plural image information processing apparatuses respectively generating display images and has a controller for controlling viewpoint information shared by the plural image information processing apparatuses on the basis of viewpoint information sent from the image information processing apparatus. This apparatus comprises a transmitter to calculate the viewpoint information based on a user’s instruction and transmit it to the controller, a receiver to receive from the controller the viewpoint information for generating the display image, and an image generator to read the image data corresponding to the viewpoint information from the previously held image data for generating the display image, and generate and output the display image to a display.

Abstract: An image/map association division displays map data stored in a map data storing division, and sets a plurality of segment points and a “path” (route) sandwiched by two segment points on a map. The image/map association division reproduces video data stored in an image data storing division, and displays the map data stored in the map data storing division. If the route set on the map and desired frames of the video data being reproduced are designated via an operation division, association data for associating the segment points at both ends of the “route” with the designated frames is generated and it is stored in the association data storing division.

Abstract: Each of the panoramic images corresponding to a plurality of positions of a viewpoint is compressed and stored as partial images obtained by dividing each panoramic image by a predetermined field of view. The panoramic image has a field of view wider than a display field of view of an image to be displayed on a display unit. A partial image containing an image to be reproduced is selected based on the information about the position and the direction of a viewpoint and the display field of view, and an image corresponding to the position and the direction of a viewpoint is generated and displayed from the selected partial image. Thus, when virtual space in the walk-through system is designed using the IBR technology, stored image data can be efficiently reproduced.

Abstract: Plural pieces of frame data are generated and held based on image data obtained by capturing images while moving a plurality of capture devices for capturing images in different directions. A frame data group containing consecutive pieces of frame data determined to have been captured at practically the same position can be extracted from the plural pieces of held frame data. Frame data is deleted from the extracted frame data such that one piece of frame data can exist as the data captured at one position. Thus, when the frame data corresponding to a plurality of positions on a map is stored, thinned frame data is stored after being associated with the corresponding position on the map. Therefore, when virtual space in a walk-through system is designed using an IBR technology, panoramic images for reproduction of the virtual space can be efficiently generated and held.