Abstract: A surgical system, method, and non-transitory computer readable medium involving a robotic manipulator configured to move a surgical instrument relative to virtual boundaries. A navigation system tracks each of a first object, a second object, and the surgical instrument. The first object is moveable relative to the second object. One or more controllers associate a first virtual boundary with the first object and associate a second virtual boundary with the second object. The first virtual boundary is moveable in relation to the second virtual boundary. The controller(s) control the robotic manipulator in relation to the first virtual boundary to facilitate interaction of the surgical instrument with the first object. The controller(s) control the robotic manipulator in relation to the second virtual boundary to avoid interaction of the surgical instrument with the second object.

Abstract: A surgical system and method involve a manipulator including a plurality of links and joints and a tool coupled to the manipulator. A navigation system includes a localizer, a first tracker coupled to the robotic manipulator or the tool, and a second tracker coupled to a workpiece. Controller(s) determine, from the navigation system, a pose of the tool relative to the workpiece. The controller(s) control the robotic manipulator to facilitate removal of a first portion from the workpiece with the tool and sense interaction between the tool and the workpiece during removal of the first portion to detect a density of the workpiece. The controller(s) control the robotic manipulator to facilitate removal of a second portion from the workpiece with the tool, wherein a cutting depth for the second portion is based, at least in part, on the detected density.

Abstract: A head-mounted device (HMD) and method for assisting a user during a surgical procedure. The HMD has a camera and display supported by a head-mountable structure. The display is positionable in front of eyes of the user. A controller accesses workflow data defining workflow steps associated with the surgical procedure. The controller obtains data from the camera related to an environment of the surgical procedure. The camera data is monitored to detect a deviation or a potential deviation from one or more of the workflow steps. The controller generates an instruction/recommendation to assist the user in taking action to address the deviation or the potential deviation. The instruction/recommendation is specifically tailored to workflow responsibilities of the user. A computer-generated image related to the instruction or the recommendation is provided on the display.

Abstract: A surgical robotic system and method involve a manipulator including a plurality of links and joints and a tool coupled to the manipulator. Controller(s) generate a first tool path to remove a first portion of material from the bone and control the manipulator to position the tool for movement along the first tool path to remove the first portion. The controller(s) sense interaction between the tool and the bone during movement of the tool along the first tool path and generate a second tool path to remove a second portion of material from the bone. Generation of the second tool path is based, at least in part, on the sensed interaction between the tool and the bone during movement along the first tool path. The controller(s) control the manipulator to position the tool for movement along the second tool path to remove the second portion.

Abstract: A surgical workflow system for assisting a surgical procedure comprises a workflow controller. The workflow controller is configured to access a pre-scripted workflow having a plurality of workflow steps associated with the surgical procedure, obtain camera video data of the surgical procedure, monitor the surgical procedure from the camera video data, predict occurrence of an anticipated deviation from one or more of the workflow steps of the pre-scripted workflow, generate event information to address the predicted occurrence of the anticipated deviation, and automatically respond to the predicted occurrence of the anticipated deviation by being configured to transmit the event information to a participant of the surgical procedure through an information conveyor device.

Abstract: A surgical system, method and CAD program are provided. The surgical system includes a digitization device including a pointer tip to contact a target site and actuatable control input(s). A surgical tool can manipulate the target site. A navigation system tracks a state of the digitization device. Controller(s) receive the tracked state of the digitization device and display, within a virtual reference frame, a virtual representation of the pointer tip. In response to actuation of the control input(s), the controller(s) register virtual reference points within the virtual reference frame based on the pose of the virtual representation of the pointer tip and enable arrangement of one or more geometrical design objects within the virtual reference frame relative to the registered virtual reference points to generate a virtual boundary that defines a region of the target site to be avoided by the surgical tool.

Abstract: A surgical system for manipulating an anatomy includes a surgical tool, a robotic manipulator configured to support and move the surgical tool, and one or more controllers that activate a first virtual boundary delineating a first portion of the anatomy that is allowed to be removed by the surgical tool from a second portion of the anatomy that is protected from removal by the surgical tool. The one or more controllers control the robotic manipulator for enabling the surgical tool to perform fine cutting of the first portion in relation to the first virtual boundary. The one or more controllers control the robotic manipulator for enabling the surgical tool to perform bulk cutting of the second portion of the anatomy.

Abstract: A mixed reality system includes a head-mounted device (HMD) having an HMD coordinate system and a camera to capture images. A localizer has a localizer coordinate system and position sensors supported by a housing to track a pose of a real object. Registration markers are configured to be recognized from the captured images of the camera of the HMD. The registration markers are disposed on the housing of the localizer in a predetermined spatial relationship with respect to the localizer coordinate system. At least one controller is configured to utilize the registration markers recognized from the captured images to register the localizer coordinate system and the HMD coordinate system.

Abstract: Systems and methods for calibrating ultrasound imaging directed towards a bone region. An ultrasound imaging device generates a first steered frame and a second steered frame, wherein the first steered frame and the second steered frame are directed towards the bone region at different angles from one another and are superimposed with one another. Parameters of each of the first steered frame and the second steered frame are applied to a cost function that outputs an estimated propagation speed of ultrasound waves to the bone region for optimizing an appearance of the first steered frame and the second steered frame. The ultrasound imaging device is calibrated based on the estimated propagation speed.

Abstract: A surgical system, method and CAD program are provided for facilitating surgical planning. A digitization device has a pointer tip and one or more control inputs. A navigation system tracks the digitization device. The CAD program generates a virtual reference frame and receives the tracked state of the digitization device from the navigation system. The CAD program renders, within the virtual reference frame, a virtual representation of the pointer tip of the digitization device having a pose of the pointer tip derived from its tracked state. In response to actuation of the control input(s) of the digitization device, the CAD program registers local virtual reference(s) within the virtual reference frame at a location relative to the pose of the virtual representation of the pointer tip and enables arrangement of geometrical design object(s) within the virtual reference frame relative to the registered local virtual reference(s) to facilitate surgical planning.

Abstract: Surgical systems and methods for generating a tool path. A manipulator is configured to support and move a surgical instrument. Controller(s) obtain data that defines a volume of tissue to be removed from a surgical site. The controller(s) operate the manipulator to move the surgical instrument to remove first portions of the volume and acquire data defining the first portions removed from the volume. The controller(s) identify, based on the volume and the acquired data, additional portions of the volume of tissue that require removal. The controller(s) generate a tool path that passes through the additional portions and operate the manipulator to move the surgical instrument along the tool path to remove the additional portions.

Abstract: A surgical system for manipulating an anatomy includes a surgical tool, a robotic manipulator configured to support and move the surgical tool, and one or more controllers that activate a first virtual boundary delineating a first portion of the anatomy that is allowed to be removed by the surgical tool from a second portion of the anatomy that is protected from removal by the surgical tool. The one or more controllers control the robotic manipulator for enabling the surgical tool to perform bulk cutting of the first portion in relation to the first virtual boundary. The one or more controllers control the robotic manipulator for enabling the surgical tool to perform fine cutting of the second portion of the anatomy.

Abstract: Disclosed are systems, methods, and techniques for registering a HMD coordinate system of a head-mounted display (HMD) and a localizer coordinate system of a surgical navigation localizer. A camera of the HMD captures at least one image of a registration device having a registration coordinate system and a plurality of registration markers. The registration markers are analyzed in the at least one image to determine a pose of the HMD coordinate system relative to the registration coordinate system. One or more position sensors comprised in the localizer detect a plurality of tracking markers comprised in the registration device to determine a pose of the registration coordinate system relative to the localizer coordinate system. The HMD coordinate system and the localizer coordinate system are registered using the registration device, wherein positions of the registration markers are known with respect to positions of the tracking markers in the registration coordinate system.

Abstract: A workflow is disclosed to accurately register ultrasound imaging to co-modality imaging. The ultrasound imaging is segmented with a convolutional neural network to detect a surface of the object. The ultrasound imaging is calibrated to reflect a variation in propagation speed of the ultrasound waves through the object by minimizing a cost function that sums the differences between the first and second steered frames, and compares the first and second steered frames of the ultrasound imaging with a third frame of the ultrasound imaging that is angled between the first and second steered frames. The ultrasound imaging is temporarily calibrated with respect to a tracking coordinate system by creating a point cloud of the surface and calculating a set of projection values of the point cloud to a vector. The ultrasound imaging, segmented and calibrated, is automatically registered to the co-modality imagine.

Abstract: A plate for attaching to an anatomic structure with fasteners. The plate has a body with a top surface and a bottom surface opposite the top surface. The body defines one or more openings to receive a respective one of the one or more fasteners. The bottom surface is concave to define a space to accommodate a portion of the anatomic structure. A bone pad surface extends from the bottom surface. A spike extends away from the bone pad surface. An extension arm can be coupled to the plate and the extension arm can support a tracking head to implement a surgical tracking assembly.

Abstract: A tool path generator utilizes a solid body model of a volume to generate a tool path for a manipulator to remove material of the volume with an energy applicator in a semi-autonomous mode. A material logger monitors movement of the energy applicator according to a cutting path taken by a practitioner in the manual mode, identifies material of the volume to which the energy applicator has been applied in the manual mode, and updates the solid body model based on the identified material. The tool path generator modifies the tool path based on the updated solid body model such that, for the semi-autonomous mode, the modified tool path accounts for the identified material of the volume to which the energy applicator has been applied in the manual mode.

Abstract: A robotic system and methods are disclosed. A common axis is defined for an instrument and an energy applicator extending from the instrument. A manipulator has a plurality of links and actuators configured to move the links to position the instrument and energy applicator. A force/torque sensor coupled to the manipulator generates an output in response to forces/torques applied to the instrument. Controller(s) defines a centering point that intersects the common axis. Controller(s) model the instrument and the energy applicator as a virtual rigid body and determine forces/torques to apply to the virtual rigid body, which are determined, in part, based on the output of the force/torque sensor. Controller(s) control the manipulator to advance the energy applicator based on the determined forces/torques applied to the virtual rigid body and reorient the instrument such that the common axis pivots about the centering point during advancement of the energy applicator.

Abstract: Surgical systems, computer-implemented methods, and software programs for generating a milling path for a bone. The implementations involve obtaining a virtual model of the bone, a resection volume defined relative to the virtual model of the bone, and a reference guide defined with respect to the resection volume. Section planes are successively arranged along the reference guide, and each section plane intersects the reference guide and intersects the resection volume. A section path is generated within each section plane and is defined relative to the resection volume. Transition segments are generated to connect section paths of section planes. The milling path is then generated by combining the section paths and the transition segments.

Abstract: A plate for attaching to an anatomic structure with fasteners. A body defines openings for receiving the fasteners, and includes a bottom surface that is concave. The plate includes bone pad surface, and a spike extends away from the bone pad surface. The bone pad surface is oriented at an angle relative to the bottom surface to prevent further penetration of the spike into the anatomic structure beyond a predetermined depth. The bone pad surface may be oriented at an obtuse angle relative to the bottom surface. The bone pad surfaces may be planar or concave, or contoured to a corresponding profile of the anatomic structure. The spikes may be pyramidal or conical. At least one side of the spike may be integral and continuous with the bottom surface. The side may have a radius of curvature equal to that of the bottom surface.

Abstract: Surgical systems, computer-implemented methods, and software programs for producing a patient-specific virtual boundary configured to constrain movement and/or operation of a surgical tool in response to the surgical tool interacting with the patient-specific virtual boundary. The implementations include obtaining a generic virtual boundary including a generic surface with a generic edge, and positioning the generic virtual boundary relative to a virtual anatomical model such that the generic surface intersects the virtual anatomical model. The implementations include computing an intersection of the generic surface and the virtual anatomical model to define a cross-sectional contour of the virtual anatomical model, and morphing the generic edge to the cross-sectional contour to produce a customized surface with a patient-specific edge.