Abstract: A surgical system includes an AR headset and a AR headset controller. The AR headset is configured to be worn by a user during a surgical procedure and has a see-through display screen configured to display an AR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The AR headset also includes an opacity filter positioned between at least one of the user's eyes and the real-world scene when the see-through display screen is viewed by the user. The opacity filter provides opaqueness to light from the real-world scene. The AR headset controller communicates with a navigation controller to receive navigation information from the navigation controller which provides guidance to the user during the surgical procedure on an anatomical structure, and generates the AR image based on the navigation information for display on the see-through display screen.

Abstract: The present disclosure is directed to augmented reality navigation systems and methods of their use that, inter alia, address the need for systems and methods of robotic surgical system navigation with reduced distraction to surgeons. Augmented reality navigation systems disclosed herein enable a surgeon to maintain focus on a surgical site and/or surgical tool being used in a surgical procedure while obtaining a wide range of navigational information relevant to the procedure. Navigational information can appear in the augmented reality navigation system as being presented on virtual displays that sit in a natural field of view of a surgeon during a procedure. Navigational information can also appear to be overlaid over a patient's anatomy. Augmented reality navigation systems comprise a head mounted display comprising an at least partially transparent display screen, at least one detector connected to the head mounted display for identifying real-world features, and a computer subsystem.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: A virtual model a planned instrument attachment can be provided to ensure correct selection of a physical instrument attachment. An XR headset controller can generate a shape and a pose of the virtual model of the planned instrument attachment based on predetermined information associated with the planned instrument attachment and based on a pose of an instrument relative to the XR headset. An XR headset can display the virtual model on a see-through display screen of the XR headset that is configured to allow at least a portion of a real-world scene to pass therethrough.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: A surgical robot system includes a robot having a robot base and a robot arm coupled to the robot base, and a surgical retractor. The surgical retractor includes a retractor frame, a coupler, blades, a force and/or torque sensor, and a force and/or torque feedback determination unit. The retractor frame includes arms that are translatably and/or pivotably connected to the retractor frame. The coupler releasably attaches the retractor frame to the robot arm. The blades are each coupled to and extend away from a distal end of one of the arms. The force and/or torque sensor is connected to the blades and indicates an amount of force and/or torque being applied to the blades from contact with material of a surgical site. The force and/or torque feedback determination unit determines the amount of force and/or torque being applied to the blades based on the indication.

Abstract: A surgical robot positions an end effector that guides movement of a surgical tool during a surgical procedure on a patient anatomical structure. A tracking system determines a pose of the anatomical structure and a pose of the end effector and/or the surgical tool. A navigation controller determines a target pose for the surgical tool based on a surgical plan and based on the pose of the anatomical structure, and generates steering information based on the target pose for the surgical tool, the pose of the anatomical structure, and the pose of the surgical tool and/or the end effector. The steering information indicates where the surgical tool and/or the end effector need to be moved. An AR headset controller receives the steering information from the navigation controller and displays a graphical representation of the steering information and/or the target pose for the surgical tool on a see-through display screen.

Abstract: A surgical robot positions an end effector that guides movement of a surgical tool during a surgical procedure on a patient anatomical structure. A tracking system determines a pose of the anatomical structure and a pose of the end effector and/or the surgical tool. A navigation controller determines a target pose for the surgical tool based on a surgical plan and based on the pose of the anatomical structure, and generates steering information based on the target pose for the surgical tool, the pose of the anatomical structure, and the pose of the surgical tool and/or the end effector. The steering information indicates where the surgical tool and/or the end effector need to be moved. An AR headset controller receives the steering information from the navigation controller and displays a graphical representation of the steering information and/or the target pose for the surgical tool on a see-through display screen.

Abstract: A surgical system includes an AR headset and a AR headset controller. The AR headset is configured to be worn by a user during a surgical procedure and has a see-through display screen configured to display an AR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The AR headset also includes an opacity filter positioned between at least one of the user's eyes and the real-world scene when the see-through display screen is viewed by the user. The opacity filter provides opaqueness to light from the real-world scene. The AR headset controller communicates with a navigation controller to receive navigation information from the navigation controller which provides guidance to the user during the surgical procedure on an anatomical structure, and generates the AR image based on the navigation information for display on the see-through display screen.

Abstract: A method and system for determining an extent of matter removed from a targeted anatomical structure are disclosed. The method includes acquiring an initial representation of a targeted anatomical structure and then removing matter from the targeted anatomical structure. An instrument is then navigated within the targeted anatomical structure. The instrument includes a tracking array, and a relative position of the instrument within the targeted anatomical structure is determined by the tracking array. The method includes recording the relative position of the instrument within the targeted anatomical structure to determine a final representation of the targeted anatomical structure. Finally, the method includes determining an extent of matter removed from the targeted anatomical structure by comparing the initial representation of the targeted anatomical structure with the final representation of the targeted anatomical structure.

Abstract: A robotic system may include a robot base and a rod feeding subassembly coupled to the robot base that includes a feeding actuator configured to selectively move a surgical rod. The robotic system may include a brake subassembly coupled to the robot base that includes a brake actuator configured to receive the surgical rod from the rod feeding subassembly, and selectively fix a first portion of the surgical rod with respect to the brake subassembly. The robotic system may include a bending subassembly coupled to the robot base that includes a bending actuator configured to selectively rotate to engage a second portion of the surgical rod and bend the second portion of the surgical rod with respect to the first portion of the surgical rod so that the first portion and the second portion of the surgical rod define a first bend angle.

Abstract: A surgical system includes an AR headset and a AR headset controller. The AR headset is configured to be worn by a user during a surgical procedure and has a see-through display screen configured to display an AR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The AR headset also includes an opacity filter positioned between at least one of the user's eyes and the real-world scene when the see-through display screen is viewed by the user. The opacity filter provides opaqueness to light from the real-world scene. The AR headset controller communicates with a navigation controller to receive navigation information from the navigation controller which provides guidance to the user during the surgical procedure on an anatomical structure, and generates the AR image based on the navigation information for display on the see-through display screen.

Abstract: A method and system for determining an extent of matter removed from a targeted anatomical structure are disclosed. The method includes acquiring an initial representation of a targeted anatomical structure and then removing matter from the targeted anatomical structure. An instrument is then navigated within the targeted anatomical structure. The instrument includes a tracking array, and a relative position of the instrument within the targeted anatomical structure is determined by the tracking array. The method includes recording the relative position of the instrument within the targeted anatomical structure to determine a final representation of the targeted anatomical structure. Finally, the method includes determining an extent of matter removed from the targeted anatomical structure by comparing the initial representation of the targeted anatomical structure with the final representation of the targeted anatomical structure.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: A surgical robot system includes a robot having a robot base and a robot arm coupled to the robot base, and a surgical retractor. The surgical retractor includes a retractor frame, a coupler, blades, a force and/or torque sensor, and a force and/or torque feedback determination unit. The retractor frame includes arms that are translatably and/or pivotably connected to the retractor frame. The coupler releasably attaches the retractor frame to the robot arm. The blades are each coupled to and extend away from a distal end of one of the arms. The force and/or torque sensor is connected to the blades and indicates an amount of force and/or torque being applied to the blades from contact with material of a surgical site. The force and/or torque feedback determination unit determines the amount of force and/or torque being applied to the blades based on the indication.

Abstract: A surgical robot system includes a robot having a robot base and a robot arm coupled to the robot base, and a surgical retractor. The surgical retractor includes a retractor frame, a coupler, blades, a force and/or torque sensor, and a force and/or torque feedback determination unit. The retractor frame includes arms that are translatably and/or pivotably connected to the retractor frame. The coupler releasably attaches the retractor frame to the robot arm. The blades are each coupled to and extend away from a distal end of one of the arms. The force and/or torque sensor is connected to the blades and indicates an amount of force and/or torque being applied to the blades from contact with material of a surgical site. The force and/or torque feedback determination unit determines the amount of force and/or torque being applied to the blades based on the indication.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: A virtual model a planned instrument attachment can be provided to ensure correct selection of a physical instrument attachment. An XR headset controller can generate a shape and a pose of the virtual model of the planned instrument attachment based on predetermined information associated with the planned instrument attachment and based on a pose of an instrument relative to the XR headset. An XR headset can display the virtual model on a see-through display screen of the XR headset that is configured to allow at least a portion of a real-world scene to pass therethrough.

Abstract: The present disclosure is directed to augmented reality navigation systems and methods of their use that, inter alia, address the need for systems and methods of robotic surgical system navigation with reduced distraction to surgeons. Augmented reality navigation systems disclosed herein enable a surgeon to maintain focus on a surgical site and/or surgical tool being used in a surgical procedure while obtaining a wide range of navigational information relevant to the procedure. Navigational information can appear in the augmented reality navigation system as being presented on virtual displays that sit in a natural field of view of a surgeon during a procedure. Navigational information can also appear to be overlaid over a patient’s anatomy. Augmented reality navigation systems comprise a head mounted display comprising an at least partially transparent display screen, at least one detector connected to the head mounted display for identifying real-world features, and a computer subsystem.

Abstract: A method and system for determining an extent of matter removed from a targeted anatomical structure are disclosed. The method includes acquiring an initial representation of a targeted anatomical structure and then removing matter from the targeted anatomical structure. An instrument is then navigated within the targeted anatomical structure. The instrument includes a tracking array, and a relative position of the instrument within the targeted anatomical structure is determined by the tracking array. The method includes recording the relative position of the instrument within the targeted anatomical structure to determine a final representation of the targeted anatomical structure. Finally, the method includes determining an extent of matter removed from the targeted anatomical structure by comparing the initial representation of the targeted anatomical structure with the final representation of the targeted anatomical structure.