Abstract: A view transformation matrix that represents the position/attitude of an HMD is generated based on a signal that represents the position/attitude of the HMD (S602). On the other hand, landmarks and their locations are detected based on a captured picture (S604) and a calibration matrix &Dgr;Mc is generated using the detected locations of the landmarks (S605). The position/attitude of the HMD is calibrated using the view transformation matrix and calibration matrix &Dgr;Mc generated by the above processes (S606), a picture of a virtual object is generated based on external parameters that represent the position/attitude of the calibrated HMD, and a mixed reality picture is generated (S607). The generated mixed reality picture is displayed in the display section (S609).

Abstract: There is disclosed a mixed reality presentation apparatus which generates and displays a three-dimensional virtual image on a see-through display device so as to allow a plurality of players to play a multi-player game in a mixed reality environment. The apparatus has a CCD camera for detecting the mallet positions of the plurality of players, and a sensor for detecting the view point position of each player in the environment of the multi-player game. The apparatus generates a three-dimensional virtual image that represents a game result of the multi-player game that has progressed in accordance with changes in mallet position detected by the CCD camera and is viewed from the view point position of each player detected by the sensor, and outputs the generated image to the corresponding see-through display device. The apparatus determines the motion of each player by detecting infrared rays output from the corresponding mallet on the basis of an image captured by the CCD camera.

Abstract: Whether or not an object to be rendered in stereo images is inside of a fusional area is determined on the basis of a focus point and positions of eyes of a viewer. By using characteristics of a view sight of a human in which an object in a fusional area of human eyes can be clearly recognized as a single solid, however, if an object is not in the fusional area, the object is recognized as vague overlapped images, an object which is inside of the fusional area is rendered by using an image generating algorithm capable expressing in high precision. In contrast, an object which is outside of the fusional area is rendered by using an image generating algorithm which requires lighter calculation load than the former image generating algorithm.

Abstract: There is disclosed a user interface apparatus to which the user (player) can easily sensuoulsy become accustomed, and which can accurately recognize instructions (commands) that the user (player) intended. The user interface apparatus has a location/posture sensor (100) attached to the head of the user, and a location/posture sensor (200) attached to his or her hand, analyzes hand action on the basis of the relative position of the location/posture of the hand with respect to those of the head, and estimates the current action state from the analysis result. The apparatus then determines a user instruction (player command) on the basis of the action state.

Abstract: In order to simplify a photographing operation when providing a texture original image, and to remove a useless operation when extracting a necessary region from the texture original image, the necessary region is assigned in an original image, serving as a base for a texture, using characteristic points of a portion onto which the texture is to be mapped, and a quadrangle having a minimum area is extracted from among quadrangles enclosing the assigned region. An image enclosed by the extracted quadrangle is transformed into a rectangular image having a desired size, and the assigned region is transformed into a region in the rectangular image. The obtained rectangular image and data of the characteristic points for assigning the region are output as texture data.

Abstract: When S=0, and a user waves his or her hand five times or more from side to side (S1502), the head of a dolphin appears from the water, and the number L1 of times of status changes is increased by 1 (S1504). When the user waves his or her hand twice or more up and down (S1503), the dolphin jumps from the water, and the number L1 is increased by 1 (S1505). When S=1, and a user waves his or her hand three times or more from side to side, the dolphin disappears into the water, and the number L1 is increased by 1 (S1507). When S=2, and the dolphin jumps into the water, then S=0 (S1509). If S=3, and the dolphin disappears into the water, then S=0 (S1511). Then, it is determined whether or not L1≧3 (S1512). If yes, the process is passed to the communications level 2 (S1513).

Abstract: When the direction of the view line of the dominant eye of the operator moves while the operator watches the image display plane of the image display device, the view line direction measuring device measures such movement and the direction of the view field is moved, within the space, in the moving direction of the view line according to the result of calculation by the arithmetic operation unit. Thus, the image display can be obtained with reduced errors caused by the manual operation and with improved operability.

Abstract: A two-dimensional data generator and a 2D display controller display a two-dimensional plane image based on three-dimensional data read by a three-dimensional data reading unit. A texture amount calculator calculates a texture amount used in rendering a three-dimensional image based on the three-dimensional data at each of a plurality of viewpoints set in the two-dimensional plane. A texture amount exceeding position display controller clearly displays a viewpoint where the calculated texture data amount exceeds a predetermined value in the two-dimensional plane. A texture amount adjusting unit adjusts the data amount of a desired texture.

Abstract: An image processing method and apparatus using the method, allows a target object to be displayed in a 3-D manner. A number of types of shape data with different resolutions for displaying the object are provided and the resolution of shape data used the 3-D image display is decided in accordance with a display condition. The object is displayed in the form of a 3-D image by employing the shape data with the decided resolution.

Abstract: An image processing method and apparatus using the method allows a target object to be displayed in a 3-D manner. A number of types of shape data with different resolutions for displaying the object are provided and the resolution of shape data used for the 3-D image display is decided in accordance with a display condition. The object is displayed in the form of a 3-D image by employing the shape data with the decided resolution.

Abstract: Real-time image processing apparatus and method for displaying two different visual resolutions includes structure and steps for detecting a position on a display screen at which an operator is looking. A center area of a predetermined size is determined and includes the detected position at which the operator is looking and another area different from the center area. Structure and steps are provided for determining a first image generation algorithm for a first image to be displayed on the center area and a second image generation algorithm for a second image to be displayed on another area. The first and second image generation algorithms are different from each other. Structure and steps are provided for generating the first and second images using the first and second image generation algorithms, respectively. Structure and steps are provided for causing a display of the first and second images together and having different visual resolutions.

Abstract: An image processing method and the apparatus thereof for approximating an object shape and reconstructing the corresponding image by subjecting a radial range image to approximating with polygons and reconstructing an image from these polygons execute the following processes. At block B210, reading a radial range image data is executed. At block B220, a plural of different resolution radial range images are generated based upon the read radial range image. At block B230, normal vectors, according to each resolution of a radial range image, are calculated. At block B240, an edge-map having a plural of edges is generated in such a manner that a plural of edges are generated depending upon the resulting normal vectors and the radial range images of different resolutions. At block B250, the edge-maps of all kinds of resolutions are ORed to form a synthesized map. The synthesized map is subjected to correcting crossing and isolated edges. At block B260, each polygon is divided into a plural of triangles.