Abstract: This invention provides a mixed reality apparatus and mixed reality presentation method, which can present reality even when a plurality of players share a common mixed reality space. Virtual objects (41–47) are superposed to hide devices such as an HMD and the like that another player wears.

Abstract: A game apparatus allows a virtual object to act in a mixed reality space as if it had its own will. A player can play a game with the virtual object. Rules for controlling the action patterns of the virtual object on the basis of the objective of the game, and the relative positional relationship between the virtual object and the real object is pre-stored. The next action pattern of the virtual object is determined based on an operator command, the stored rule(s), a simulation progress status, and geometric information of a real object(s).

Abstract: An information processing method includes steps of: setting a parameter that is used in common with respect to a plurality of objects for changing levels of detail of a model in accordance with a user instruction; inputting information indicative of the size of a respective object; obtaining a distance between the position of a viewpoint and the position of the respective object; determining the level of detail of the model using the parameter, the information indicative of the size, and the distance; and rendering the object using a model corresponding to the determined level of detail.

Abstract: In step S1030, the position and orientation of a stylus operated by the user on the physical space are calculated, and it is detected if the stylus is located on the surface of a real object on the physical space. In step S1040, a virtual index is laid out at the position on the virtual space, which corresponds to the position calculated upon detection. In step S1060, an image of the virtual space including the laid-out virtual index is superimposed on the physical space.

Abstract: There is disclosed a marker layout method in a mixed reality space, which can reliably detect markers in units of players, even when a plurality of players share a common mixed reality space. According to this invention, markers to be used by only a given player are laid out at positions that cannot be seen from other players. Real objects used in an application that uses a mixed reality space may be used.

Abstract: An object level is set as an attribute that specifies a virtual object, and a user level is set for an application program, user, or the like that uses this virtual object, and the attribute of the virtual object is determined in accordance with the object and user levels. For example, a virtual attribute is determined in accordance with the magnitude relationship between the two levels. In this way, when the attribute of the virtual object is to be changed, the user need not select virtual objects to be changed one by one to perform change processes, and can easily change the attributes.

Abstract: In exhibition of a synthesized image which is obtained by synthesizing a virtual world image with a real world image observed from a viewpoint position and direction of a user, data representing a position and orientation of a user is acquired, a virtual image is generated based on the data representing the position and orientation of the user, and the virtual image is synthesized with a real image corresponding to the position and orientation of the user. Based on a measurable area of the position and orientation of the user, area data is set. Based on the data representing the position of the user and the area data, notification related to the measurable area is controlled.

Abstract: A set of objects to be rendered by an identical rendering method is specified from objects which form a virtual space. A hierarchical structure formed by the object included in the specified set is generated (step S206). The objects included in the specified set are rendered by the rendering method common to the objects included in this set in accordance with the generated hierarchical structure (S207-S209).

Abstract: An image combining method for combining an image obtained by image sensing real space with a computer-generated image and displaying the combined image. Mask area color information is determined based on a first real image including an object as the subject of mask area and a second real image not including the object, and the color information is registered. The mask area is extracted from the real image by using the registered mask area color information, and the real image and the computer-generated image are combined by using the mask area.

Abstract: A view transformation matrix that represents the position/attitude of an HMD is generated based on a signal that represents the position/attitude of the HMD (S602). On the other hand, landmarks and their locations are detected based on a captured picture (S604) and a calibration matrix ?Mc is generated using the detected locations of the landmarks (S605). The position/attitude of the HMD is calibrated using the view transformation matrix and calibration matrix ?Mc generated by the above processes (S606), a picture of a virtual object is generated based on external parameters that represent the position/attitude of the calibrated HMD, and a mixed reality picture is generated (S607). The generated mixed reality picture is displayed in the display section (S609).

Abstract: There is provided an information processing method for setting the exclusive control right of a data item by a specific process in a system in which a plurality of clients connected via a network share data including a plurality of data items. In this method, when a desired data item is designated so as to set its exclusive control right, data items which belong to layers lower than the designated data and are related to the designated data item are retrieved on the basis of the hierarchical structure information of the plurality of data items. Then, the exclusive control right is set for the designated data item and retrieved data items.

Abstract: A graphic card (130) renders a virtual space image on a memory (122) according to the position and orientation of a video camera (140) using data indicating the state of a virtual space, 3DCG data loaded from an HDD (123) onto the memory (122), and data indicating the position and orientation of the video camera (140). A real space image captured by the video camera (140) is then acquired. The graphic card (130) superimposes the acquired real space image on the virtual space image rendered on the memory (122) to generate a mixed reality space image on the memory (122), and then outputs the mixed reality space image to a monitor (150). Upon depression of a shutter (160), the mixed reality space image rendered on the memory (122) at that time is output to a printer (170), which prints the mixed reality space image on a print medium such as a paper sheet, OHP film, or the like.

Abstract: A video combining apparatus to superimpose a virtual image such a CG image on a video image of the real world or on a see-through type display device. An area in which the virtual image is not to be displayed can be easily designated by a user. If the user holds a frame with markers in his/her sight, the frame is image-sensed in the video image of the real world. The area designated by the user is detected by detecting the position of the marker in the video image, and the virtual image is not superimposed in this area.

Abstract: When S=0, and a user waves his or her hand five times or more from side to side (S1502), the head of a dolphin appears from the water, and the number L1 of times of status changes is increased by 1 (S1504). When the user waves his or her hand twice or more up and down (S1503), the dolphin jumps from the water, and the number L1 is increased by 1 (S1505). When S=1, and a user waves his or her hand three times or more from side to side, the dolphin disappears into the water, and the number L1 is increased by 1 (S1507). When S=2, and the dolphin jumps into the water, then S=0 (S1509). If S=3, and the dolphin disappears into the water, then S=0 (S1511). Then, it is determined whether or not L1≧3 (S1512). If yes, the process is passed to the communications level 2 (S1513).

Abstract: Three-dimensional geometric data of an architecture is generated, and image mapping data is generated by mapping a texture representing a pattern on the surface of the generated three-dimensional geometric data. A reflection of a virtual space is generated on the basis of the generated three-dimensional geometric data and image mapping data, and is changed in correspondence with movement of the viewpoint and/or the line of sight of the operator, so that the operator can interactively experience the virtual space of the architecture.

Abstract: It is intended to solve the problem that, when an operator performs an operation using two-dimensional input means while seeing a picture frame seen from a viewpoint of the operator, an input operation is difficult to perform when the direction of the line of sight of the operator is unstable, since a designated direction greatly deviates in a world coordinate system. For that purpose, viewpoint information is detected, and an instruction of the operator for operating a position of a pointer image is input. A designated direction in a pointer coordinate system is obtained in accordance with the operator's instruction, and the pointer image is generated based on the designated direction. The pointer coordinate system is changed from the detected viewpoint information in accordance with a specific instruction of the operator.

Abstract: In the present invention, when a CG object is overlapped onto a photographed real scenery image as a background and an image of a photographed real photographic subject is synthesized in front of the overlapped image, an image in which the photographed real background and the photographic subject are photo-taken simultaneously without photo-taking the photographed real background and the photographic subject independently is synthesized with CG. In the present invention, the photographed real image including a specific image is acquired, and area information representing an area of the specific image from the photographed real image, and an area other than the area of the specific image of the photographed real image is synthesized with a computer graphics image by using the area information detected.

Abstract: There is disclosed a mixed reality presentation apparatus which generates and displays a three-dimensional virtual image on a see-through display device so as to allow a plurality of players to play a multi-player game in a mixed reality environment. The apparatus has a CCD camera for detecting the mallet positions of the plurality of players, and a sensor for detecting the view point position of each player in the environment of the multi-player game. The apparatus generates a three-dimensional virtual image that represents a game result of the multi-player game that has progressed in accordance with changes in mallet position detected by the CCD camera and is viewed from the view point position of each player detected by the sensor, and outputs the generated image to the corresponding see-through display device. The apparatus determines the motion of each player by detecting infrared rays output from the corresponding mallet on the basis of an image captured by the CCD camera.

Abstract: There is disclosed a game apparatus which allows a virtual object to act in a mixed reality space as if it had its own will. The game apparatus according to this invention allows a player to play a game with a virtual object in a mixed reality space. A rule for controlling the action of the virtual object on the basis of the objective of the game, and the relative positional relationship between the virtual object and real object is pre-stored. The locations of the player and real object are detected, and the relative positional relationship between the player or real object, and the virtual object is recognized. The next action of the virtual object is determined according to the stored rule, and a virtual image of the virtual object is generated on the basis of the location/posture of the virtual object after the determined action and the location/posture of the viewpoint position of the player, thus presenting the generated virtual image to the player.

Abstract: In an interactive image generation method and apparatus, excellent operability is provided when the operator selects a figure to be operated on from among a plurality of figure units displayed on the picture surface of a display unit. In such a method and apparatus, respective units for measuring the visual point and the direction of the line of sight of the operator observing the display device are provided, and a figure unit displayed at a position viewed by the operator on the picture surface is identified. Accordingly, the operator can be sure of correctly selecting the target figure by a direct operation of looking at the figure, and therefore excellent operability can be obtained.