Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

Abstract: A UI for a HMD system includes a HMD configured to be worn by a surgeon. A tracker is configured to track head gestures by the surgeon. A footswitch is configured to detect foot motion inputs by the surgeon. A computer couples to the HMD, the tracker, and the footswitch. A user interface includes the HMD, tracker, and footswitch. The use interface is configured to: provide to the computer the head gesture in association with the foot motion input, and display an image relating to a surgical procedure on the HMD. The computer is configured to: apply the head gesture received in association with the foot motion input to perform a first action on the HMD system when the HMD system is in a first system mode, and perform a second action on the HMD system when the HMD system is in a second system mode.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: Systems and methods for providing a verification symbol relating to the validity of a conversion of locations between a first image and a second image for surgery are provided. Providing the verification symbol involves receiving a selection of an image in the first image that corresponds to a physical element in a second image and that has a location in a first coordinate system, determining the location in a second coordinate system associated with the second image by employing a conversion of locations, and displaying a verification symbol superimposed with the second image based on the corresponding location in the second coordinate system.

Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

Abstract: System for determining a position of a tool-point-of-interest of a tool, relative to an eye-tissue-of-interest, which includes and imager a tool-tracker and a processor. The imager acquires an image of a tissue-reference-marker. The tool-tracker determines information relating to the P&O of the tool in a reference-coordinate-system. The imager and the tool-tracker are in registration with the reference-coordinate-system. The processor determines the position of the tissue-reference-marker in the reference-coordinate-system, according to the acquired image of the tissue-reference-marker. The processor determines the P&O of the eye-tissue-of-interest in the reference-coordinate-system according to at least the position of the tissue-reference-marker and a relative position between the tissue-reference-marker and the eye-tissue-of-interest. The relative position is pre-determined from a stored-3D-model.

Abstract: A user interface for enabling and controlling functions of a surgical system, comprising: a foot-operated function switch configured to be switched to any one of multiple discrete states by the user's foot; a head tracker configured to track the user's head motions; and a processor coupled to the function switch and head tracker, and configured to: obtain an association between a plurality of sequences comprising at least one of the multiple discrete states, and a plurality of corresponding system functions of the surgical system, receive an indication of at least one of the discrete states from the function switch, identify a system function based on the indication and the association, receive a head motion from the head tracker, and apply the head motion to control the identified system function of the surgical system.

Abstract: Method for verifying registration of a model of an internal-body-part with the internal-body-part in a reference coordinate system. The internal-body-part is at least partially unseen directly by a user. The method includes the procedures of continuously determining a position and orientation of a head-mounted-display in the reference coordinate system, determining a display location of at least one virtual marker, and displaying the virtual marker according to the display location. The display location of the virtual marker is determined according to the expected position of a respective at least one reference point relative to the head-mounted-display. The reference point is directly visible to the user. The relative position between the reference point and the internal-body-part is substantially constant. The position of the reference point in the reference coordinate system is predetermined.

Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

Abstract: A UI for a HMD system includes a HMD configured to be worn by a surgeon. A tracker is configured to track head gestures by the surgeon. A footswitch is configured to detect foot motion inputs by the surgeon. A computer couples to the HMD, the tracker, and the footswitch. A user interface includes the HMD, tracker, and footswitch. The use interface is configured to: provide to the computer the head gesture in association with the foot motion input, and display an image relating to a surgical procedure on the HMD. The computer is configured to: apply the head gesture received in association with the foot motion input to perform a first action on the HMD system when the HMD system is in a first system mode, and perform a second action on the HMD system when the HMD system is in a second system mode.

Abstract: A surgical microscope lighting control system comprising a controller configured to: estimate or determine a lighting need of a surgeon during at least part of a surgical procedure based at least on a viewing status of a region of illumination, wherein the viewing status of the region of illumination is estimated or determined (a) based at least on whether or not the region of illumination is being displayed, or (b) based at least on tracking data of the surgeon or a head-mounted display; determine an adjustment to be made to an illumination provided by a lighting unit of a surgical microscope based on the lighting need; and in response to determining the adjustment, send a first signal to the lighting unit to change the illumination according to the adjustment.

Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

Abstract: A system for registering a coordinate system associated with a model of an object with a reference-coordinate-system, the object includes at least one marker, the system includes a portable-unit, a tracking-system and a processor. The portable unit includes and display and an optical-detection-assembly for acquiring at least one representation of the marker. The tracking-system tracks the position-and-orientation of the portable-unit in the reference-coordinate-system.

Abstract: System for registering a coordinate system associated with a pre-acquired model of an object with a reference coordinate system. The system includes a portable unit which includes a display, a tracking system for tracking the portable unit and a processor. The processor is coupled with the portable unit and with the tracking system. The processor determines the position and orientation of the portable unit. The processor further determines the position of at least one marker located on the object according to at least one of, a tracked pointer and respective position related information. The processor further displays registration related information on the display. At least one of the registration related information and the display location of the registration related information are related to the position and orientation of the portable unit. The position of the at least one marker, in the coordinate system associated with the pre-acquired model, is predetermined.

Abstract: Method for verifying registration of a model of an internal-body-part with the internal-body-part in a reference coordinate system. The internal-body-part is at least partially unseen directly by a user. The method includes the procedures of continuously determining a position and orientation of a head-mounted-display in the reference coordinate system, determining a display location of at least one virtual marker, and displaying the virtual marker according to the display location. The display location of the virtual marker is determined according to the expected position of a respective at least one reference point relative to the head-mounted-display. The reference point is directly visible to the user. The relative position between the reference point and the internal-body-part is substantially constant. The position of the reference point in the reference coordinate system is predetermined.

Abstract: Method for verifying registration of a model of an internal-body-part with the internal-body-part in a reference coordinate system. The internal-body-part is at least partially unseen directly by a user. The method includes the procedures of continuously determining a position and orientation of a head-mounted-display in the reference coordinate system, determining a display location of at least one virtual marker, and displaying the virtual marker according to the display location. The display location of the virtual marker is determined according to the expected position of a respective at least one reference point relative to the head-mounted-display. The reference point is directly visible to the user. The relative position between the reference point and the internal-body-part is substantially constant. The position of the reference point in the reference coordinate system is predetermined.

Abstract: System for determining a position of a tool-point-of-interest of a tool, relative to an eye-tissue-of-interest, which includes and imager a tool-tracker and a processor. The imager acquires an image of a tissue-reference-marker. The tool-tracker determines information relating to the P&O of the tool in a reference-coordinate-system. The imager and the tool-tracker are in registration with the reference-coordinate-system. The processor determines the position of the tissue-reference-marker in the reference-coordinate-system, according to the acquired image of the tissue-reference-marker. The processor determines the P&O of the eye-tissue-of-interest in the reference-coordinate-system according to at least the position of the tissue-reference-marker and a relative position between the tissue-reference-marker and the eye-tissue-of-interest. The relative position is pre-determined from a stored-3D-model.