Abstract: A virtual viewpoint image generation method for generating a virtual viewpoint image that is an image of an object viewed from a virtual viewpoint based on plural images of the object taken by plural cameras. Projection planes having a multi-layered structure are set on the images of the object, corresponding to a projection point of a projection plane. Color information of each projection point is determined based on color information of corresponding points, for each of the projection points overlapping when viewed from a reference viewpoint in a space. A degree of probability that the object exists at a distance corresponding to a position of the projection point is determined based on a degree of correlation of the corresponding points.

Abstract: A virtual viewpoint image generation method for generating a virtual viewpoint image that is an image of an object viewed from a virtual viewpoint based on plural images of the object taken by plural cameras is provided.

Abstract: According to the method and apparatus, light beams directed toward virtual visual points are detected from among light beams emitted from or reflected on the surface of an object. The detection is effected by an image pickup device in a plurality of positions lying on a virtual closed surface with which the object is enclosed. The detected light beams are converted into image pickup signals, which are delivered to a display device adapted to display an image toward a visual point of an observer standing or sitting in a place different from a place where any of the virtual visual points is disposed. The image is displayed in such a manner as if light beams were emitted toward the visual point of the observer from various points on the surface of a virtual object disposed in a virtual position corresponding to the relative positions of the real object and any of the virtual visual points.