Abstract: There is disclosed a marker layout method in a mixed reality space, which can reliably detect markers in units of players, even when a plurality of players share a common mixed reality space. According to this invention, markers to be used by only a given player are laid out at positions that cannot be seen from other players. Real objects used in an application that uses a mixed reality space may be used.

Abstract: There is disclosed a marker layout method in a mixed reality space, which can reliably detect markers in units of players, even when a plurality of players share a common mixed reality space. According to this invention, markers to be used by only a given player are laid out at positions that cannot be seen from other players. Real objects used in an application that uses a mixed reality space may be used.

Abstract: This invention provides a mixed reality apparatus and mixed reality presentation method, which can present reality even when a plurality of players share a common mixed reality space. Virtual objects (41–47) are superposed to hide devices such as an HMD and the like that another player wears.

Abstract: There is disclosed a marker layout method in a mixed reality space, which can reliably detect markers in units of players, even when a plurality of players share a common mixed reality space. According to this invention, markers to be used by only a given player are laid out at positions that cannot be seen from other players. Real objects used in an application that uses a mixed reality space may be used.

Abstract: There is disclosed a mixed reality presentation apparatus which generates and displays a three-dimensional virtual image on a see-through display device so as to allow a plurality of players to play a multi-player game in a mixed reality environment. The apparatus has a CCD camera for detecting the mallet positions of the plurality of players, and a sensor for detecting the view point position of each player in the environment of the multi-player game. The apparatus generates a three-dimensional virtual image that represents a game result of the multi-player game that has progressed in accordance with changes in mallet position detected by the CCD camera and is viewed from the view point position of each player detected by the sensor, and outputs the generated image to the corresponding see-through display device. The apparatus determines the motion of each player by detecting infrared rays output from the corresponding mallet on the basis of an image captured by the CCD camera.

Abstract: An augmented reality presentation system that generates and presents a virtual image free from any latency from a real space. This system has a position/posture sensor for time-sequentially inputting viewpoint position/posture information, stereo cameras for inputting a continuous time sequence of a plurality of images, and an image processing apparatus. The image processing apparatus detects a continuous time sequence of depth images ID from the continuous time sequence of input stereo images, estimates the viewpoint position/posture of the observer at a future time at which a three-dimensional image will be presented to the observer, on the basis of changes in previous viewpoint position/posture input from the position/posture sensor, continuously warps the continuously obtained depth images to those at the estimated future viewpoint position/posture, and presents three-dimensional grayscale (or color) images generated according to the warped depth images to the observer.

Abstract: There is disclosed a mixed reality presentation apparatus which generates and displays a three-dimensional virtual image on a see-through display device so as to allow a plurality of players to play a multi-player game in a mixed reality environment. The apparatus has a CCD camera for detecting the mallet positions of the plurality of players, and a sensor for detecting the view point position of each player in the environment of the multi-player game. The apparatus generates a three-dimensional virtual image that represents a game result of the multi-player game that has progressed in accordance with changes in mallet position detected by the CCD camera and is viewed from the view point position of each player detected by the sensor, and outputs the generated image to the corresponding see-through display device. The apparatus determines the motion of each player by detecting infrared rays output from the corresponding mallet on the basis of an image captured by the CCD camera.