Abstract: A system and method for navigation within a surgical field are presented. In exemplary embodiments according to the present invention a micro-camera can be provided in a hand-held navigation probe tracked by a tracking system. This enables navigation within an operative scene by viewing real-time images from the viewpoint of the micro-camera within the navigation probe, which are overlaid with computer generated 3D graphics depicting structures of interest generated from pre-operative scans. Various transparency settings of the camera image and the superimposed 3D graphics can enhance the depth perception, and distances between a tip of the probe and any of the superimposed 3D structures along a virtual ray extending from the probe tip can be dynamically displayed in the combined image. In exemplary embodiments of the invention a virtual interface can be displayed adjacent to the combined image on a system display, thus facilitating interaction with various navigation related functions.

Abstract: A guide system for use by a user who performs an operation in a defined three-dimensional region is disclosed, the system including a data processing apparatus for generating images of the subject of the operation in co-registration with the subject, a display for displaying the images to the user, a probe having a position which is visible to the user, and a tracking unit for tracking the location of the probe by the system and transmitting that location to the data processing apparatus, the data processing apparatus being arranged, upon the user moving the probe to a selection region outside and surrounding the defined region, to generate one or more virtual buttons, each of the buttons being associated with a corresponding instruction to the system, the data processing apparatus being arranged to register a selection by the user of any of the virtual buttons, the selection including positioning of the probe in relation to the apparent position of that virtual button, and to modify the computer-generated im

Abstract: A probe to be held by a surgeon who performs an operation within a defined region is proposed. The surgeon employs an image-based guide system having a head-mounted semi-transparent display for displaying computer-generated images of the patient overlying real images of the patient. The position of the probe is tracked by the system and is visible to the surgeon. The computer-generated image includes a line extending from the probe along its longitudinal axis. The surgeon can control the extension of the line, to signal to the system a distance into the patient. The images seen by the user are modified accordingly, to facilitate navigation or simulate an operation.

Abstract: A virtual reality display apparatus is disclosed which includes a display (100) arranged to display an image (130) viewable in three dimensions in an image space and, spaced from the image space, a three-dimensional work space (240), operation of a tool (230) within the work space being viewable in the image space.

Abstract: A system is presented permitting a user to interact a three-dimensional model. The system displays an image of the model in a workspace. A processor of the system defines (i) a virtual plane intersecting with the displayed model and (ii) a correspondence between the virtual plane and a surface. The user positions a tool on the surface to select a point on that surface, and the corresponding position on the virtual plane defines a position in the model in which a change to the model should be made. Since the user moves the tool on the surface, the positioning of the tool is accurate. In particular, the tool is not liable to be jogged away from its desired location if the user operates a control device (such as a button) on the tool.

Abstract: A system and method for controlling the scaling of a 3D computer model in a 3D display system include activating a zoom mode, selecting a model zoom point and setting a zoom scale factor are presented. In exemplary embodiments according to the present invention, a system, in response to the selected model zoom point and the set scale factor, can implements a zoom operation and automatically move a model zoom point from its original position towards an optimum viewing point. In exemplary embodiments according to the present invention, upon a user's activating a zoom mode, selecting a model zoom point and setting a zoom scale factor, a system can simultaneously move a model zoom point to an optimum viewing point. In preferred exemplary embodiments according to the present invention, a system can automatically identify a model zoom point by applying defined rules to visible points of a displayed model that lie in a central viewing area.