Abstract: A robotic device (160) is configured to operate an interventional device (101) comprising an outer device and an inner device movably positioned with the outer device. A method for controlling the robotic device (160) includes receiving image data from an image of a portion of the interventional device (101) and a branched intersection of a plurality of branches of an anatomical structure. The method also includes analyzing the image data to measure at least one of a location or an orientation of a distal portion of the outer device and of a distal portion of the inner device in the image. The method further includes determining a path for the interventional device (101), and controlling, based on a plurality of modules of predefined motions stored in a memory (151), the robotic device (160) to operate the interventional device (101) through the path by a sequence of the predefined motions. The method further includes displaying the path on a display (180).

Abstract: A thrombectomy device (10) includes a retrieval device (12) configured to deploy and subsequently retrieve an associated tethered self-expanding stent (2), the retrieval device including a guidewire (14) having a tip (13) that is radiopaque. At least one electronic processor (20) is programmed to: receive a time sequence of images (35) of extension of the guidewire through a clot during a thrombectomy procedure being performed using the thrombectomy device: determine a geometric change of the tip of the guidewire; identify a completion of the extension of the guidewire through the clot based on the geometric change of the tip of the guidewire; and respond to the identification of the completion of the extension of the guidewire through the clot by: outputting an indication (36) that the guidewire is extended completely through the clot; and/or controlling a robot (16) to stop the extension of the guidewire through the clot.

Abstract: A system for aiding a user to perform a medical ultrasound examination comprises a memory comprising instruction data representing a set of instructions; a processor; and a display. The processor is configured to communicate with the memory and to execute the set of instructions. The set of instructions, when executed by the processor, cause the processor to: i) receive a real-time sequence of ultrasound images captured by an ultrasound probe during the medical ultrasound examination; ii) use a model trained using a machine learning process to take an image frame in the real-time sequence of ultrasound images as input, and output a predicted relevance of one or more image components in the image frame to the medical ultrasound examination being performed; and iii) highlight to the user, in real-time on the display, image components that are predicted by the model to be relevant to the medical ultrasound examination, for further consideration by the user.

Abstract: A surgical instrument has a surgical tool that has a proximal end and a distal end, and an optical sensor that has at least a portion attached to the surgical tool. The surgical tool has a portion that is suitable to provide a reference portion of the surgical tool, and the optical sensor has an end fixed relative to the reference portion of the surgical tool such that the reference portion of the surgical tool can be detected along with tissue that is proximate or in contact with the distal end of the surgical tool while in use.

Abstract: A visual tracking and annotation system for surgical intervention includes an image acquisition and display system arranged to obtain image streams of a surgical region of interest and of a surgical instrument proximate the surgical region of interest and to display acquired images to a user; a tracking system configured to track the surgical instrument relative to the surgical region of interest; a data storage system in communication with the image acquisition and display system and the tracking system; and a data processing system in communication with the data storage system, the image acquisition and display system and the tracking system. The data processing system is configured to annotate images displayed to the user in response to an input signal from the user.

Abstract: According to some embodiments of the present invention, a cooperatively controlled robot includes a robotic actuator assembly comprising a tool holder and a force sensor, a control system adapted to communicate with the robotic actuator assembly and the force sensor, and an output system in communication with the control system. The tool holder is configured to receive a tool to be manipulated by a user. The control system is configured to receive an instruction from a user to switch from a robot control mode into a user interface control mode. The force sensor is configured to measure at least one of a force and a torque applied to the tool, and the control system is configured to receive an indication of the at least one of a force and a torque applied to the tool and manipulate the output system based on the indication.

Abstract: A combined teleoperative-cooperative controllable robotic system includes a robotic actuator assembly, a control system adapted to communicate with the robotic actuator assembly, and a teleoperation unit adapted to communicate with the control system. The control system is configured to control at least a first portion of the robotic actuator assembly in response to at least one of a force or a torque applied to at least a second portion of the robotic actuator assembly by a first user for cooperative control. The control system is further configured to control at least a third portion of the robotic actuator assembly in response to input by a second user from the teleoperation unit for teleoperative control.

Abstract: According to some embodiments of the present invention, a cooperatively controlled robot includes a robotic actuator assembly comprising a tool holder and a force sensor, a control system adapted to communicate with the robotic actuator assembly and the force sensor, and an output system in communication with the control system. The tool holder is configured to receive a tool to be manipulated by a user. The control system is configured to receive an instruction from a user to switch from a robot control mode into a user interface control mode. The force sensor is configured to measure at least one of a force and a torque applied to the tool, and the control system is configured to receive an indication of the at least one of a force and a torque applied to the tool and manipulate the output system based on the indication.

Abstract: A combined teleoperative-cooperative controllable robotic system includes a robotic actuator assembly, a control system adapted to communicate with the robotic actuator assembly, and a teleoperation unit adapted to communicate with the control system. The control system is configured to control at least a first portion of the robotic actuator assembly in response to at least one of a force or a torque applied to at least a second portion of the robotic actuator assembly by a first user for cooperative control. The control system is further configured to control at least a third portion of the robotic actuator assembly in response to input by a second user from the teleoperation unit for teleoperative control.

Abstract: A visual tracking and annotation system for surgical intervention includes an image acquisition and display system arranged to obtain image streams of a surgical region of interest and of a surgical instrument proximate the surgical region of interest and to display acquired images to a user; a tracking system configured to track the surgical instrument relative to the surgical region of interest; a data storage system in communication with the image acquisition and display system and the tracking system; and a data processing system in communication with the data storage system, the image acquisition and display system and the tracking system. The data processing system is configured to annotate images displayed to the user in response to an input signal from the user.

Abstract: A surgical instrument has a surgical tool that has a proximal end and a distal end, and an optical sensor that has at least a portion attached to the surgical tool. The surgical tool has a portion that is suitable to provide a reference portion of the surgical tool, and the optical sensor has an end fixed relative to the reference portion of the surgical tool such that the reference portion of the surgical tool can be detected along with tissue that is proximate or in contact with the distal end of the surgical tool while in use.