Abstract: A method for irradiating an image in an optical see-through (OST) head mounted display (HMD) for viewing through, the OST HMD by a user's eye, an object having at least one of known orientation and position and orientation (O/P&O), associated with a first reference frame, the method comprising: generating and irradiating said image for appearing to said user superimposed in an aligned manner to said object, according to predetermined information, eyeball feature position data, and said O/P&O; said predetermined information relates correction data with a plurality of different respective position data values of at least one eyeball feature position of said eye; said predetermined information further includes display corrections of said electro-optical display module with respect to said position data values of said at least one eyeball feature position, with respect to a second reference frame; and said O/P&O is between said second reference and said first reference frame.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: A system for registering a coordinate system associated with a model of an object with a reference-coordinate-system, the object includes at least one marker, the system includes a portable-unit, a tracking-system and a processor. The portable unit includes and display and an optical-detection-assembly for acquiring at least one representation of the marker. The tracking-system tracks the position-and-orientation of the portable-unit in the reference-coordinate-system.

Abstract: Head wearable display (HWD) systems and methods of display reliability verification with respect to the HWD operated by a user are provided, which comprise tracking a position and orientation (P&O) of the HWD relative to hardware element(s) at known position(s), which are selected from a surroundings of the user and are visible to the user through the HWD, calculating position(s) of the hardware element(s) with respect to the HWD, and displaying, in the HWD and according to the calculated position(s), verification symbol(s) that correspond to the hardware element(s). Display reliability verification may be carried out automatically using a camera and an image processing module, optionally with an additional illuminator, which compares the element(s)'s captured locations with the element (s)'s expected location according to the tracking, and indicates possible discrepancies. Discrepancy identification may be used to initiate a correction process or to indicate the presented symbology to be unreliable.

Abstract: A method for irradiating an image in an optical see-through (OST) head mounted display (HMD) for viewing through, the OST HMD by a user's eye, an object having at least one of known orientation and position and orientation (O/P&O), associated with a first reference frame, the method comprising: generating and irradiating said image for appearing to said user superimposed in an aligned manner to said object, according to predetermined information, eyeball feature position data, and said O/P&O; said predetermined information relates correction data with a plurality of different respective position data values of at least one eyeball feature position of said eye; said predetermined information further includes display corrections of said electro-optical display module with respect to said position data values of said at least one eyeball feature position, with respect to a second reference frame; and said O/P&O is between said second reference and said first reference frame.

Abstract: A UI for a HMD system includes a HMD configured to be worn by a surgeon. A tracker is configured to track head gestures by the surgeon. A footswitch is configured to detect foot motion inputs by the surgeon. A computer couples to the HMD, the tracker, and the footswitch. A user interface includes the HMD, tracker, and footswitch. The use interface is configured to: provide to the computer the head gesture in association with the foot motion input, and display an image relating to a surgical procedure on the HMD. The computer is configured to: apply the head gesture received in association with the foot motion input to perform a first action on the HMD system when the HMD system is in a first system mode, and perform a second action on the HMD system when the HMD system is in a second system mode.

Abstract: A method for irradiating an image in an optical see-through (OST) head mounted display (HMD) for viewing through, the OST HMD by a user's eye, an object having at least one of known orientation and position and orientation (O/P&O), associated with a first reference frame, the method comprising: generating and irradiating said image for appearing to said user superimposed in an aligned manner to said object, according to predetermined information, eyeball feature position data, and said O/P&O; said predetermined information relates correction data with a plurality of different respective position data values of at least one eyeball feature position of said eye; said predetermined information further includes display corrections of said electro-optical display module with respect to said position data values of said at least one eyeball feature position, with respect to a second reference frame; and said O/P&O is between said second reference and said first reference frame.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

Abstract: A UI for a HMD system includes a HMD configured to be worn by a surgeon. A tracker is configured to track head gestures by the surgeon. A footswitch is configured to detect foot motion inputs by the surgeon. A computer couples to the HMD, the tracker, and the footswitch. A user interface includes the HMD, tracker, and footswitch. The use interface is configured to: provide to the computer the head gesture in association with the foot motion input, and display an image relating to a surgical procedure on the HMD. The computer is configured to: apply the head gesture received in association with the foot motion input to perform a first action on the HMD system when the HMD system is in a first system mode, and perform a second action on the HMD system when the HMD system is in a second system mode.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: Systems and methods for providing a verification symbol relating to the validity of a conversion of locations between a first image and a second image for surgery are provided. Providing the verification symbol involves receiving a selection of an image in the first image that corresponds to a physical element in a second image and that has a location in a first coordinate system, determining the location in a second coordinate system associated with the second image by employing a conversion of locations, and displaying a verification symbol superimposed with the second image based on the corresponding location in the second coordinate system.

Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.

Abstract: System for determining a position of a tool-point-of-interest of a tool, relative to an eye-tissue-of-interest, which includes and imager a tool-tracker and a processor. The imager acquires an image of a tissue-reference-marker. The tool-tracker determines information relating to the P&O of the tool in a reference-coordinate-system. The imager and the tool-tracker are in registration with the reference-coordinate-system. The processor determines the position of the tissue-reference-marker in the reference-coordinate-system, according to the acquired image of the tissue-reference-marker. The processor determines the P&O of the eye-tissue-of-interest in the reference-coordinate-system according to at least the position of the tissue-reference-marker and a relative position between the tissue-reference-marker and the eye-tissue-of-interest. The relative position is pre-determined from a stored-3D-model.

Abstract: A user interface for enabling and controlling functions of a surgical system, comprising: a foot-operated function switch configured to be switched to any one of multiple discrete states by the user's foot; a head tracker configured to track the user's head motions; and a processor coupled to the function switch and head tracker, and configured to: obtain an association between a plurality of sequences comprising at least one of the multiple discrete states, and a plurality of corresponding system functions of the surgical system, receive an indication of at least one of the discrete states from the function switch, identify a system function based on the indication and the association, receive a head motion from the head tracker, and apply the head motion to control the identified system function of the surgical system.

Abstract: Method for verifying registration of a model of an internal-body-part with the internal-body-part in a reference coordinate system. The internal-body-part is at least partially unseen directly by a user. The method includes the procedures of continuously determining a position and orientation of a head-mounted-display in the reference coordinate system, determining a display location of at least one virtual marker, and displaying the virtual marker according to the display location. The display location of the virtual marker is determined according to the expected position of a respective at least one reference point relative to the head-mounted-display. The reference point is directly visible to the user. The relative position between the reference point and the internal-body-part is substantially constant. The position of the reference point in the reference coordinate system is predetermined.

Abstract: Methods and systems for displaying an image of a medical procedure (e.g., an intraoperative image) with additional information (e.g., data) that can augment the image of the medical procedure are provided. Augmenting the image can include overlaying data from a first image to a second image. Overlaying the data can involve determining, for a point or multiple points in the first image, a matching location or multiple matching locations in a second image. The first image and the second image can be of a patient. Determining the matching location can involve using a rotation and scale invariant geometrical relationship. The matching locations can be used as the basis for the overlay.