Abstract: Systems, apparati and methods for mapping a virtual model of a real object, such as a body part, to the real object are presented. Such virtual model can be generated, for example, from an imaging scan of the object, for example, using MRI, CT, etc. A camera with a probe fixed thereto can be moved relative to the object until a video image of the object captured by the camera appears to coincide on a video screen with the virtual model which is shown fixed on that screen. The position of the camera in a real coordinate system can be sensed, and the position in a virtual coordinate system of the virtual model relative to a virtual camera, by which the view of the virtual model on the screen is notionally captured, can be predetermined and known. From this, the position of the virtual model relative to the object can be mapped and a transform generated to position the object in the virtual coordinate system to approximately coincide with the virtual model.

Abstract: An improved system and method for macroscopic and microscopic surgical navigation and visualization are presented. In exemplary embodiments of the present invention an integrated system can include a computer which has stored three dimensional representations of a patient's internal anatomy, a display, a probe and an operation microscope. In exemplary embodiments of the present invention reference markers can be attached to the probe and the microscope, and the system can also include a tracking system which can track the 3D position and orientation of each of the probe and microscope. In exemplary embodiments of the present invention a system can include means for detecting changes in the imaging parameters of the microscope, such as, for example, magnification and focus, which occur as a result of user adjustment and operation of the microscope.

Abstract: Systems and methods for measuring overlay error in a video-based augmented reality enhanced surgical navigation system are presented. In exemplary embodiments of the present invention the system and method include providing a test object, creating a virtual object which is a computer model of the test object, registering the test object, capturing images of control points on the test object at various positions within an augmented reality system's measurement space, and extracting positions of control points on the test object from the captured images, calculating the positions of the control points in virtual image, and calculating the positional difference of positions of corresponding control points between the respective video and virtual images of the test object. The method and system can further assess if the overlay accuracy meets an acceptable standard.