Abstract: There is provided an integrated information management system which mutually associates the information processing applications for processing the data derived from CAD data with others. In the integrated information management system, the virtual design data generated in a CAD system, the data used in a CAE system, the data used in a DMR system, and the data used in a mockup system are stored in correspondence with the respective conditions used in case of respectively displaying these data. Then, the image acquired by compositing the respective data is generated based on the respective conditions, and the generated image is displayed on an integrated display unit, whereby it is possible for a user to manage these data as the single data by dynamically changing over the data of the respective information processing applications.

Abstract: A technology for enabling an observer to appropriately control an operation panel in accordance with a condition is provided. When an instruction for changing the position of the operation panel is input, the operation panel is disposed at the position of a pen input device. When an instruction for terminating the changing of the position of the operation panel is input, the position and orientation of the operation panel are fixed. An image of virtual objects including the operation panel viewed from a camera is generated, the generated image is superimposed on an image in a real space captured by the camera, and an image obtained by the superimposition is output to a display unit.

Abstract: A three-dimensional CG manipulation apparatus has a real object, a position and orientation sensor provided to the real object, a support base, a position and orientation sensor provided to the support base, a head-mounted display, a position and orientation sensor provided to the head-mounted display, a sensor information acquisition unit for acquiring information from the sensors, a state determination unit for determining the current state of the real object and support base, a CG data management unit for managing CG data to be displayed, and an image generation unit for generating an image to be displayed on the head-mounted display. In a mixed realty system that presents an image formed by superimposing a virtual CG image on a real object to the user, a manipulation such as replacement or the like can be easily made for the virtual CG image without interrupting the user's operation.

Abstract: A display apparatus for displaying a virtual image superposed upon a real world image, which can automatically set the focus of a lens to the virtual image, a virtual world image object having a high importance degree or a real world image object having a high importance degree. The display apparatus has a lens for capturing light from a real world, a lens state control unit for controlling a state of the lens including a focus, a storage unit for storing computer image data, a computer image generation unit for generating a computer image by using the computer image data stored in the storage unit in accordance with lens state information of the lens state and the like; and a synthesis display unit for synthesizing an image captured via the lens and the generated computer image and displaying a synthetic image.

Abstract: Real space image including a simple prototype created based on three-dimensional CAD data is captured by an image input apparatus. A position/orientation measuring apparatus measures positions and orientations of the image input apparatus and simple prototype. An information processor captures position/orientation information representing the position and orientation of the simple prototype in the image captured by the image input apparatus 102. The information processor further extracts a hand area from an image, renders a three-dimensional computer graphic image on the simple prototype, excluding the extracted hand area, in the image based on the position/orientation information and the three-dimensional CAD data, and synthesizes the image and the three-dimensional computer graphic image. Here, the simple prototype has a different color from a color of the hand area.

Abstract: A virtual space image including a feature point is generated by executing software which generates a virtual space image on the basis of a viewpoint and receives a variation upon changing the position and orientation of the viewpoint. The position and orientation of the viewpoint are obtained by using the generated virtual space image. The position and orientation of the viewpoint are acquired. A variation is obtained on the basis of the position and orientation acquired in step S204 and those obtained in step S203. The variation is input to the software. The software updates the position and orientation of the viewpoint on the basis of the variation and outputs a virtual space image generated on the basis of a viewpoint having the updated position and orientation.

Abstract: At the time of using a haptic device to present to a user haptics which a first virtual object superimposed on the haptic device receives from a second virtual object superimposed on a real object, the user is enabled to touch within the second virtual object, regardless of the real object. Accordingly, the haptics received from the second virtual object is obtained using a first haptic event model of the first virtual object and a second haptic event model of the second virtual object, and while the first haptic event model corresponds to computer graphics information of the first virtual object, the shape of the first virtual object differs from that of the haptic device, such that instructions can be made regarding the inside of the real object, using the first virtual object.

Abstract: A measured value of a physical quantity measured using a measuring device within a predetermined region on a real space, and a position where the measuring device performs measurement are acquired (S1001 to S1003). An analytic value of the physical quantity at that position in the predetermined region is calculated (S1004). A first object representing the measured value and a second object representing the analytic value are arranged at a place corresponding to this position on a virtual space having a coordinate system which matches the coordinate system of the real space (S1005, S1006). An image which is seen upon viewing the virtual space on which the first and second objects are arranged from a viewpoint is generated, and the generated image is output (S1008, S1009).

Abstract: There is provided an integrated information management system which mutually associates the information processing applications for processing the data derived from CAD data with others. In the integrated information management system, the virtual design data generated in a CAD system, the data used in a CAE system, the data used in a DMR system, and the data used in a mockup system are stored in correspondence with the respective conditions used in case of respectively displaying these data. Then, the image acquired by compositing the respective data is generated based on the respective conditions, and the generated image is displayed on an integrated display unit, whereby it is possible for a user to manage these data as the single data by dynamically changing over the data of the respective information processing applications.

Abstract: A shadow body generation unit 1711 generates a shadow model defined by a limited numbers of lines extending from a position of a light source to an outline of a hand. If the virtual object is partially or fully included in the shadow model and a position of the virtual object is further away from the position of the light source, the shadow body generation unit 1711 generates a shadow for partially obscured area included in the shadow model.

Abstract: An image presentation system which enables a user observing an image on a first display to recognize an instruction sent from a person seeing an image on a second display to the user. An HMD as the first display detects the position and orientation of the HMD and presents an image to the user. The second display presents an image to the person who gives an instruction to the user. A three-dimensional CG drawing device draws a virtual space image seen from a point of view corresponding to the position and orientation of the HMD and displays the virtual space image on the HMD and the second display. When receiving the instruction, the three-dimensional CG drawing device draws a virtual space image to be displayed on the HMD such that the virtual space image reflects the input instruction.

Abstract: It is intended to solve the problem that, when an operator performs an operation using two-dimensional input means while seeing a picture frame seen from a viewpoint of the operator, an input operation is difficult to perform when the direction of the line of sight of the operator is unstable, since a designated direction greatly deviates in a world coordinate system. For that purpose, viewpoint information is detected, and an instruction of the operator for operating a position of a pointer image is input. A designated direction in a pointer coordinate system is obtained in accordance with the operator's instruction, and the pointer image is generated based on the designated direction. The pointer coordinate system is changed from the detected viewpoint information in accordance with a specific instruction of the operator.

Abstract: A technology for enabling an observer to appropriately control an operation panel in accordance with a condition is provided. When an instruction for changing the position of the operation panel is input, the operation panel is disposed at the position of a pen input device. When an instruction for terminating the changing of the position of the operation panel is input, the position and orientation of the operation panel are fixed. An image of virtual objects including the operation panel viewed from a camera is generated, the generated image is superimposed on an image in a real space captured by the camera, and an image obtained by the superimposition is output to a display unit.

Abstract: A display apparatus for displaying a virtual image superposed upon a real world image, which can automatically set the focus of a lens to the virtual image, a virtual world image object having a high importance degree or a real world image object having a high importance degree. The display apparatus has a lens for capturing light from a real world, a lens state control unit for controlling a state of the lens including a focus, a storage unit for storing computer image data, a computer image generation unit for generating a computer image by using the computer image data stored in the storage unit in accordance with lens state information of the lens state and the like; and a synthesis display unit for synthesizing an image captured via the lens and the generated computer image and displaying a synthetic image.

Abstract: A display apparatus for displaying a virtual image superposed upon a real world image, which can automatically set the focus of a lens to the virtual image, a virtual world image object having a high importance degree or a real world image object having a high importance degree. The display apparatus has a lens for capturing light from a real world, a lens state control unit for controlling a state of the lens including a focus, a storage unit for storing computer image data, a computer image generation unit for generating a computer image by using the computer image data stored in the storage unit in accordance with lens state information of the lens state and the like; and a synthesis display unit for synthesizing an image captured via the lens and the generated computer image and displaying a synthetic image.

Abstract: A three-dimensional CG manipulation apparatus has a real object, a position and orientation sensor provided to the real object, a support base, a position and orientation sensor provided to the support base, a head-mounted display, a position and orientation sensor provided to the head-mounted display, a sensor information acquisition unit for acquiring information from the sensors, a state determination unit for determining the current state of the real object and support base, a CG data management unit for managing CG data to be displayed, and an image generation unit for generating an image to be displayed on the head-mounted display. In a mixed realty system that presents an image formed by superimposing a virtual CG image on a real object to the user, a manipulation such as replacement or the like can be easily made for the virtual CG image without interrupting the user's operation.

Abstract: Real space image including a simple prototype created based on three-dimensional CAD data is captured by an image input apparatus. A position/orientation measuring apparatus measures positions and orientations of the image input apparatus and simple prototype. An information processor captures position/orientation information representing the position and orientation of the simple prototype in the image captured by the image input apparatus 102. The information processor further extracts a hand area from an image, renders a three-dimensional computer graphic image on the simple prototype, excluding the extracted hand area, in the image based on the position/orientation information and the three-dimensional CAD data, and synthesizes the image and the three-dimensional computer graphic image. Here, the simple prototype has a different color from a color of the hand area.

Abstract: A server in an object-oriented distributed processing system has a computer ID management section which assigns a unique computer ID to each of all computers (clients) in the system. A client receives the computer ID from the computer ID management section in first connection to the server and then generates an object having an object ID generated by using the computer ID. Accordingly, the client need not acquire the computer ID in every object generation processing. Hence, an object can quickly be generated.

Abstract: It is intended to solve the problem that, when an operator performs an operation using two-dimensional input means while seeing a picture frame seen from a viewpoint of the operator, an input operation is difficult to perform when the direction of the line of sight of the operator is unstable, since a designated direction greatly deviates in a world coordinate system. For that purpose, viewpoint information is detected, and an instruction of the operator for operating a position of a pointer image is input. A designated direction in a pointer coordinate system is obtained in accordance with the operator's instruction, and the pointer image is generated based on the designated direction. The pointer coordinate system is changed from the detected viewpoint information in accordance with a specific instruction of the operator.

Abstract: A display apparatus for displaying a virtual image superposed upon a real world image, which can automatically set the focus of a lens to the virtual image, a virtual world image object having a high importance degree or a real world image object having a high importance degree. The display apparatus has a lens for capturing light from a real world, a lens state control unit for controlling a state of the lens including a focus, a storage unit for storing computer image data, a computer image generation unit for generating a computer image by using the computer image data stored in the storage unit in accordance with lens state information of the lens state and the like; and a synthesis display unit for synthesizing an image captured via the lens and the generated computer image and displaying a synthetic image.