Abstract: Systems and methods for mounting a robotic arm for use in robotic-assisted surgery, including a mobile shuttle that includes a support member for mounting the robotic arm that extends at least partially over a gantry of an imaging device. Further embodiments include a mounting apparatus for mounting a robotic arm to a base or support column of an imaging device, to a patient table, to a floor or ceiling of a room, or to a cart that extends over the top surface of the patient table.

Abstract: Embodiments of the invention provide a dental network including a portable dental laser station controllable within a remote access system. The dental laser station can include a dental laser, and a dental handpiece assembly coupled to or including the at least one dental laser. Some embodiments include a processor and a non-transitory computer-readable storage medium including a dental laser management process to exchange dentistry-related parameters between the dental laser station or components and a remote network. Some embodiments include a handpiece assembly structured so that any beam size on the output window or surface is greater than any beam size exiting at the input window or surface. Some embodiments include a laser power supply combination with at least one high voltage (HV) power supply, a coupled or integrated simmer supply, a direct current (DC) supply, and at least one laser configured with a power supply.

Abstract: A surgical tool tracking array can include a first marker holder, a second marker holder, and a tool holder. The first marker holder is configured to couple a first marker to the surgical tracking array in a first plane. The second marker holder is configured to couple a second marker to the surgical tool tracking array in a second plane that is independent and substantially parallel to the first plane. The tool holder is configured to couple a portion of a surgical tool to the surgical tool tracking array in a third plane that is independent from the first plane and the second plane.

Abstract: A sterile drape assembly is disclosed for a surgical robot. The surgical robot has a robotic arm including a plurality of links and a plurality of motorized joints for moving the plurality of links. At least one optical tracking element is located on one or more the links of the robotic arm. The sterile drape assembly has a surgical drape with an arm drape portion adapted to be disposed over the robotic arm and the one or more the links of the robotic arm. A drape belt cooperates with the arm drape portion to cover the at least one optical tracking element located on the one or more the links of the robotic arm.

Abstract: Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

Abstract: A control system configured to control manipulation of a surgical instrument in response to manipulation of a remote surgeon input device, the surgical instrument comprising opposable first and second end effector elements connected to a shaft by an articulated coupling, the articulated coupling comprising a first joint driveable by a first pair of driving elements so as to permit the first end effector element to rotate, and a second joint driveable by a second pair of driving elements so as to permit the second end effector element to rotate, the control system configured to: detect a change of configuration of the surgeon input device to a gripping configuration at time t; respond to the change of configuration of the surgeon input device to the gripping configuration by commanding gripping forces to be applied to the first and second pairs of driving elements, so as to cause the first and second end effector elements to rotate in opposing rotational directions towards each other with a gripping closing fo

Abstract: The various inventions relate to robotic surgical devices, consoles for operating such surgical devices, operating theaters in which the various devices can be used, insertion systems for inserting and using the surgical devices, and related methods.

Abstract: Devices, systems, and methods for measuring the distance and/or depth to a target bone for surgery using a robotic surgical system. The surgical robot system may be configured to depict the distance from a guide tube of the robot to a target bone of a patient as a vector. The vector may represent a view of the guide tube when the guide tube's central axis is coincident with a line of intersection of two viewplanes of a 2D image of the target bone, for example, one viewplane being sagittal and one viewplane being axial.

Abstract: A system, device, and method is provided that improves the point collection process during bone registration for computer-assisted surgical procedures. A user is guided in the point collection process by projecting a set of points directly on the bone with a tracked digitizer probe following a rough registration of the bone. The system, device, and method therefore negates the need for the user to constantly look-up on an instructional display monitor and make the complicated mappings between the displayed instructions on the monitor and the actual bone.

Abstract: A device or system to adapt navigation trackers from various manufacturers to a variety of instruments to be navigated during a surgical procedure is disclosed. An adapter for coupling a navigation tracking array to an instrument including a drive shaft and a tracking device holder. The drive shaft can include a handle interface, an instrument connection, and an intermediate section including a circular locking groove extends proximally from a positioning flange. The tracking device holder can be configured to secure a navigation tracking array to the drive shaft and include an elongated body and a locking button. The elongated body can include an inner bore extending along a longitudinal length of the elongated body and adapted to receive the intermediate section of the drive shaft. The locking button can retain the tracking device holder along the drive shaft while allowing for rotation about the longitudinal axis.

Abstract: Systems, methods, and techniques for customizing connectors for connecting standardized implant components together or to a part of a patient. The connectors are customized based on medical imagery of the patient and/or other patient data and may use additive or subtractive manufacturing techniques. The connectors can be manufactured at the point of use and used with standardized components.

Abstract: Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

Abstract: Disclosed herein are gross positioning systems for use with robotic surgical devices to provide gross positioning of the robotic surgical devices. The gross positioning systems have a base, a first arm link operably coupled to the base, a second arm link operably coupled to the first arm link, a third arm link operably coupled to the second arm link, and a slidable coupling component slidably coupled to the third arm link.

Abstract: A method of imaging a surgical site is disclosed. The method comprises obtaining, by a controller of an automated surgical hub system, first image data of a surgical site, controlling, by the controller, at least one illumination source to illuminate a visible surface of the surgical site in a first manner by projecting structured light onto the visible surface, obtaining, by the controller, second image data of the visible surface of the surgical site under illumination in the first manner by the at least one illumination source, calculating, by the controller, a three-dimensional model of the visible surface based on the second image data obtained by the controller, and integrating, by the controller, the three-dimensional model of the visible surface with the first image data of the surgical site. The second image data is based on sensing the structured light projected onto the visible surface.

Abstract: A Robotic control system has a wand, which emits multiple narrow beams of light, which fall on a light sensor array, or with a camera, a surface, defining the wand's changing position and attitude which a computer uses to direct relative motion of robotic tools or remote processes, such as those that are controlled by a mouse, but in three dimensions and motion compensation means and means for reducing latency.

Abstract: A stapling assembly comprising a shaft, an end effector, and a firing system is disclosed. The shaft comprises an articulation joint. The end effector comprises a staple cartridge, a first jaw, and a second jaw movable relative to the first jaw from an open position to a closed position. The firing system comprises a threaded drive screw and a firing member. The firing member comprises a first jaw-engaging feature, a second jaw-engaging feature, a cutting blade, a body, and a plurality of removable sidewall inserts comprising grooves. The body defines a longitudinal passage and a plurality of lateral windows. The longitudinal passage is configured to receive the threaded drive screw. The lateral windows are configured to receive the sidewall inserts. The grooves are configured to laterally engage the threaded drive screw. The threaded drive screw is rotatable in order to drive the firing member distally during a firing motion.

Abstract: The present disclosure relates to surgical port assemblies including a plurality of inflatable members for applying a force to a portion of a shaft of a surgical instrument which is inserted through an interior space of the surgical port assembly, and to surgical systems including a surgical port assembly, an endoscopic camera, and a control mechanism for controlling inflation and deflation of the plurality of inflatable members of the surgical port assembly.

Abstract: A robotic surgical tool includes an elongate shaft, an end effector arranged at a distal end of the shaft and including opposing first and second jaws, and an articulable wrist that interposes the end effector and the distal end, the wrist including a linkage providing one or more lateral arms receivable within a corresponding one or more grooves defined in the first and second jaws, wherein mounting the linkage to the first and second jaws at the corresponding one or more groove generates a jaw pivot where the first and second jaws pivot between open and closed positions.

Abstract: A user interface device for controlling a robot manipulator having an end effector comprising at least one movable element, the user interface device comprising: a body for being held by a user, the body comprising an elongate grip portion configured to be gripped by one or more of a user's second to fourth fingers; a trigger extending transversely to the direction of elongation of the grip portion, the trigger being supported by the body so as to be capable of rotating relative to the body about a rotation axis passing through the grip portion; and a drive mechanism at least partially housed in the grip portion, the drive mechanism being coupled to the trigger for applying a torque to the trigger.

Abstract: A robotic surgical tool includes a handle providing a first drive input and a second drive input, an elongate shaft extendable through the handle and having an end effector arranged at a distal end thereof, and a rack extending along a portion of the shaft and operatively coupled to a knife located at the end effector. Actuation of the first drive input transitions the rack between a locked configuration, where the rack is locked to the shaft, and a released configuration, where the rack is released from the shaft. Actuation of the second drive input with the rack in the locked configuration drives the rack and causes z-axis translation of the shaft through the handle. Actuation of the second drive input with the rack in the released configuration drives the rack relative to the shaft and thereby advances or retracts the knife at the end effector.

Abstract: Devices, Systems, and Methods for changing the trajectory of a surgical implant from an initial trajectory when first penetrating the skin of a patient to a final trajectory when the surgical implant is to be inserted into a bone of the patient. A surgical robotic system may be used to determine the initial and final trajectories and to move the surgical instrument from the initial trajectory to the final trajectory.

Abstract: A method for a robotic surgical system includes displaying a graphical user interface on a display to a user, wherein the graphical user interface includes a plurality of reconfigurable display panels, receiving a user input at one or more user input devices, wherein the user input indicates a selection of at least one software application relating to the robotic surgical system, and rendering content from the at least one selected software application among the plurality of reconfigurable display panels.

Abstract: A robotic surgical system includes a robotic manipulator that includes a mounting fixture defining a longitudinal channel, and a surgical tool removably coupleable to the mounting fixture. The surgical tool including a tool housing matable with the mounting fixture, an elongate shaft extending from the tool housing and receivable within the channel, and a latching mechanism provided on the elongate shaft and comprising one or more retention tabs biased radially outward with one or more biasing members. The one or more retention tabs are movable between a deployed state, where the one or more retention tabs protrude radially outward through a corresponding one or more slots to engage the mounting fixture, and a retracted state, where the one or more retention tabs are urged radially inward through the one or more slots to disengage the mounting fixture.

Abstract: Surgical robotic systems, and methods of controlling such systems based on a user's grip on a user interface device, are described. During a surgical procedure, a surgical robotic system generates control commands to actuate a component of the surgical robotic system. The component can be a surgical tool that is actuated to move based on tracking data from the user interface device. The component can be the user interface device, which is actuated to render haptic feedback to the user's hand based on load data from a surgical robotic arm holding the surgical tool. In either case, the actuation is based on a center of rotation of the user interface device that corresponds to the user's grip on the user interface device. Other embodiments are described and claimed.

Abstract: Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

Abstract: Apparatus and related methods for assisting tool use includes one or more motors, a wrist support and a shaft coupled to the one or more motors. The shaft includes a coupling to couple to a tool to enable a user resting a hand with the wrist on the wrist support to hold and manipulate the tool with one or more fingers. The apparatus can include a controller configured to: receive position data indicative of a position of an active end of the tool; receive constraint data indicative of one or more regions of space in which the active end should not be positioned; and process the position and constraint data to control the one or more motors to bias the active end out of a region indicated by the constraint data when a position indicated by the position data is within the region indicated by the constraint data.

Abstract: A laparoscopic surgical apparatus for performing a surgical procedure through a single incision in a patient's body includes a gross positioning arm supported on a moveable platform, the gross positioner including a head; at least one articulated tool positioning apparatus coupled via a tool controller to an underside of the head, the articulated tool positioning apparatus being configured to receive a tool for performing surgical operations, the tool controller being actuated by the head to cause movements of the articulated tool positioning apparatus for performing surgical operations; and wherein the gross positioner is configured to permit the head to be positioned to facilitate insertion of the articulated tool positioning apparatus through the incision into the patient's body.

Abstract: A teleoperative system includes a first medical instrument connected to and movable by a first manipulator assembly, a second medical instrument connected to and movable by a second manipulator assembly, a first alignment component positioned on at least one of the first manipulator assembly or the second manipulator assembly; a second alignment component positioned on an entry port; and a control system. The second medical instrument is sized and shaped to fit and move within the first medical instrument. The control system is configured to determine, based on the first and second alignment components, a position and orientation of the first medical instrument with respect to the entry port.

Abstract: Haptic feedback from a robotic surgical tool can be adjusted based on intra-operative assessment of the accuracy of a pre-operative surgical navigational plans. Navigational reference points are identified in at least one pre-operative image. At least one haptic response is identified for interactions between at least one robotic surgical tool and at least one navigational reference point. At least one intra-operative image is compared to the pre-operative image to determine the relative position of at least two corresponding navigational reference points in the images. The reference points' relative position determines a confidence level in the accuracy of the pre-operative navigational reference point. The haptic response is adjusted in timing, location, type, or amplitude based upon the confidence level. Tolerances and surgical navigation plan may also be updated and altered based on the confidence level.

Abstract: An apparatus for controlling the angular direction of energy emitted from a plurality of energy delivery devices. The apparatus includes a plurality of rods, each rod mechanically coupled to one of the energy delivery devices, to a stationary plate, and to a moveable plate. The stationary plate includes holes that are configured to receive a portion of a first rotatable joint that is mechanically coupled to each rod. The moveable plate includes holes that are configured to receive a portion of a second rotatable joint, the second rotatable joint slidingly engaging a portion of the respective rod. The angle of each rod changes when the moveable plate is moved in any direction with respect to the stationary plate. Changing the rod angle changes the angular direction of the energy emitted from the energy delivery devices such that the energy passes through an intended focal position.

Abstract: An articulable wrist for an end effector includes a first linkage, a second linkage rotatably coupled to the first linkage at a first articulation joint, and a flexible member extending at least partially through a central channel cooperatively defined by the first and second linkages. A first pivot guide is rotatably coupled to the second linkage at the first articulation joint and rotatable about a first pivot axis extending through the first articulation joint, the first pivot guide defining a central aperture alignable with the central channel and sized to accommodate the flexible member therethrough. The first pivot guide supports an outer diameter of the flexible member at the first articulation joint and prevents the flexible member from flexing beyond the first pivot axis during articulation.

Abstract: Robotic medical systems can be capable of kinematic optimization using shared robotic degrees-of-freedom. A robotic medical system can include a patient platform, an adjustable arm support coupled to the patient platform, and at least one robotic arm coupled to the adjustable arm support. The at least one robotic arm can be coupled to a medical tool. The robotic medical system includes a first link and a second link. Each of the first link and the second link includes a first end coupled to the adjustable arm support and a second end coupled to a base of the patient platform, for rotating the adjustable arm support relative to the patient platform. The robotic medical system can also include a processor configured to adjust a position of the adjustable arm support and the at least one robotic arm while maintaining a remote center of movement of the medical tool.

Abstract: A system for treating a target tissue of a patient comprises a first robotic arm coupled to a treatment probe for treating the target tissue of the patient, and a second robotic arm coupled to an imaging probe for imaging the target tissue of the patient. The system further comprises one or more computing devices operably coupled with the first robotic arm and the second robotic arm, the one or more computing devices configured to execute instructions for controlling movement of one or more of the first robotic arm or the second robotic arm. The treatment probe and/or imaging probe may be constrained to be moved only within an allowable range of motion.

Abstract: A method of constructing a system comprising one or more surgical arms, comprising: providing: a plurality of modular units, each modular unit comprising at least one surgical arm attached to at least one motor unit configured for actuating movement of the surgical arm; coupling one or more modular units to each other in an attachment configuration; displaying on a user interface one or both of an indication of the attachment configuration and a selection of an attachment configuration.

Abstract: A tracking method includes obtaining first characteristic information of a target object through a first camera; obtaining second characteristic information of the target object through a second camera; tracking the target object based on the first characteristic information through the first camera; obtaining attitude information of a first gimbal to which the first camera is mounted; and adjusting an attitude of a second gimbal to which the second camera is mounted based on the attitude information of the first gimbal to maintain consistency between the attitude of the second camera and an attitude of the first camera.

Abstract: A driving device includes a corrector, an actuator, and a position sensor. The actuator includes a nut connected to a movable part, a ball screw shaft onto which the nut is screwed, and a pulse motor that drives to rotate the ball screw shaft. The corrector includes a correction amount map in which a position correction amount for calibrating a predictable error is mapped for each position of the movable part. The corrector estimates an ideal movement position to which the movable part moves based on a command signal and refers to the correction amount map to calculate the position correction amount corresponding to a present position detected by the position sensor. The corrector generates a correction signal by correcting the command signal so as to reduce the difference between a corrected present position obtained by correcting the present position by the position correction amount and the ideal movement position.

Abstract: The present disclosure relates to an intracranial guide for use in a medical procedure, such as to evacuate a subdural hematoma or to relieve an intracerebral hemorrhage. The intracranial guide generally includes a guide cannula to be received within a portion of a cranial port. The cranial port is configured to be anchored in a burr hole to be formed in the patient's cranium. The guide cannula includes at least one channel that may be used to guide a catheter to a targeted portion of the patient's anatomy or to apply a suction force within the patient's cranium.

Abstract: A surface tracking-based surgical robot system for drilling operations includes surface scanning equipment, a robot arm, and a workstation. To perform a drilling operation, surface information for the target surgery area and the surgical tool held by the robot arm is simultaneously collected with the same surface scanning equipment. A preoperative 3D image of a surgical area and a CAD model of the surgical tool are registered to the collected surface information, through which the relative position between a surgical path and the surgical tool is obtained. Using this relative position, the robot arm aligns to the predefined surgical path using a feedback control method running on a workstation. The drilling operation is then autonomously executed by the robot arm or manually performed under the guidance of the surgical tool held by the robot arm.

Abstract: A surgical guide tool and methodology includes a non patient-specific platform including one or more supports for attaching to a body part of a subject. A non patient-specific block has a top planar surface and a bottom planar surface, and includes a guide aperture extending from the top planar surface to the bottom planar surface for guiding a surgical instrument in making at least one of a cut and a drill hole. An intermediate module is removably positioned between the platform and the block. The intermediate module has patient-specific dimensions such that the guide aperture has a desired alignment relative to the body part when the surgical guide tool is attached to the body part of the patient and the intermediate module is positioned between the platform and the block.

Abstract: A drill guide fixture may be configured to prepare a skull for attachment of a cranial insertion fixture. The drill guide fixture may include a central drill guide and a bone anchor guide at a base of the drill guide fixture. The central drill guide may define a central drill guide hole therethrough, wherein the central drill guide hole has a first opening at a base of the drill guide fixture and a second opening spaced apart from the base of the drill guide fixture. The bone anchor drill guide may define a bone anchor drill guide hole therethrough, and the bone anchor drill guide hole may be offset from the central drill guide hole in a direction that is perpendicular with respect to a direction of the central drill guide hole. Related cranial insertion fixtures, robotic systems, and methods are also discussed.

Abstract: The present disclosure generally relates to the field of robotics and computer animation, more particularly, method and apparatus to solve the inverse kinematics problem to control a kinematic chain such as a robot arm or an animation character's skeleton to reach a target position. The new method simulates a kinematic chain whose links and joints are elastic and can be distorted. The method distorts the kinematic chain to move its end to the target position, calculates distortions, and iteratively adjusts link and joint configurations of the kinematic chain to reduce distortions while keeping its end at the target position until a solution with near zero distortions is found. The resulting link and joint configurations of the simulated kinematic chain then can be used for the actual kinematic chain to reach the same target position.

Abstract: A surgery manipulator arm according to an embodiment may include an arm body and a translation mechanism provided to a distal end portion of the arm body. The translation mechanism includes: a proximal side unit connected to the distal end portion of the arm body; a distal side unit including a tool holding part to which a surgical tool is attached; a connection unit connecting the proximal and distal side units; and an electrical wiring circuit electrically connecting the proximal and distal side units. The connection unit includes first and second pulleys; and a belt member wound around the first and second pulleys. The proximal and distal side units are attached to first and second attachment positions of the belt member such that the distal side unit moves in a direction opposite to a direction in which the proximal side unit moves in association with movements of the belt member.

Abstract: A surgical system comprising a generator and a surgical instrument configured to receive power from the generator is disclosed. The surgical instrument comprises a housing, a shaft defining a longitudinal axis, an end effector, and an internal charge accumulator. The housing comprises a motor. The end effector is operably responsive to actuations from the electric motor, transitionable between an open and closed configuration, and rotatable about an articulation axis transverse to the longitudinal axis. The generator is incapable of supplying a sufficient power directly to the motor to perform the actuations. The internal charge accumulator is in electric communication with the generator and supplies power to the motor. The internal charge accumulator is chargeable by the generator to a threshold value at a charge rate dependent on a charge level of the internal charge accumulator. The charge rate is independent of a charge expenditure by the surgical instrument.

Abstract: A force transmission mechanism for a teleoperated surgical instrument includes a drive pulley, a drive cable operably coupled with the drive pulley, a driven pulley operably coupled with the drive cable, and an actuation member operably coupled to the driven pulley. The actuation member is configured to transmit force to actuate an end effector of the surgical instrument. Rotational motion of the driven pulley causes translational movement of the actuation element to actuate the end effector. Methods relate to operating a force transmission mechanism.

Abstract: Disclosed are systems, devices, and methods for planning a procedure for treatment of tissue in a patient's lungs. An exemplary method includes generating a three-dimensional (3D) model of the patient's lungs, displaying the 3D model of the patient's lungs, selecting a target location in the tissue of the patient's lungs as displayed on the 3D model, identifying a point on a pleural surface of the patient's lungs with access to the target location, determining an access path between the target location and the identified point on the pleural surface, calculating a risk of injury to intervening structures between the identified point on the pleural surface and the target location, based on the determined access path, and displaying the access path and the calculated risk of injury for the access path on the 3D model.

Abstract: A surgery manipulator arm according to an embodiment may include an arm body and a translation mechanism provided to a distal end portion of the arm body. The translation mechanism includes: a proximal side unit connected to the distal end portion of the arm body; a distal side unit including a tool holding part to which a surgical tool is attached; a connection unit connecting the proximal and distal side units; and an electrical wiring circuit electrically connecting the proximal and distal side units. The connection unit includes first and second pulleys; and a belt member wound around the first and second pulleys. The proximal and distal side units are attached to first and second attachment positions of the belt member such that the distal side unit moves in a direction opposite to a direction in which the proximal side unit moves in association with movements of the belt member.

Abstract: A surgical instrument includes an articulation assembly having a dual threaded rod, a first nut, a second nut, a first articulation rod, and a second articulation rod. The dual threaded rod includes a body, a first thread encircling at least a portion of the body in a first direction, and a second thread encircling at least a portion of the body in a second, opposite direction. Rotation of the dual threaded rod in a first direction relative to the elongated portion causes the first nut to move distally relative to the dual threaded rod. Rotation of the dual threaded rod in the first direction relative to the elongated portion causes the second nut to move proximally relative to the dual threaded rod. The first articulation rod is coupled to the first nut and the end effector, and the second articulation rod is coupled to the second nut and the end effector.

Abstract: A registration system including a bone pin guide and a bone pin clamp. The bone pin guide may include a guide body, a first guide including a first guide through-hole having a first longitudinal axis, and a second guide including a second guide through-hole having a second longitudinal axis. The bone pin guide may guide first and second bone pins into a bone via the first and second guides. The bone pin clamp may include a clamp body, first, second, and third clamp through-holes extending through the clamp body, a plurality of registration indents defined on the clamp body, and a clamping mechanism including at least one adjustable fastener. The bone pin clamp may receive the first and second bone pins in the first and third clamp through-holes and guide a third bone pin into the bone via the second clamp through-hole.

Abstract: Methods and systems for performing computer-assisted image-guided surgery, including robotically-assisted surgery. A method of displaying image data includes displaying image data of a patient on a handheld display device, tracking the handheld display device using a motion tracking system, and modifying the image data displayed in response to changes in the position and orientation of the handheld display device. Further embodiments include a sterile case for a handheld display device, display devices on a robotic arm, and methods and systems for performing image-guided surgery using multiple reference marker devices fixed to a patient.

Abstract: A method for checking a safety area of a robot with an augmented reality human machine interface (AR-HMI) that comprises a display and a video camera. The method includes: acquiring, at the AR-HMI, a robot type of the robot, displaying, in the display of the AR-HMI, a virtual robot image of at least part of a robot of the robot type in a manner such that the virtual robot image overlays an actual robot image of the robot of the robot type in the video camera of the AR-HMI, aligning a position of the virtual robot image with a position of the actual robot image by moving the AR-HMI in three-dimensional space, confirming the alignment of the position between the virtual robot image and the actual robot image, and displaying a virtual first safety cell area around the virtual robot image in the confirmed position as an overlay of the actual robot image in the display of the AR-HMI.