Abstract: A control unit for a robot system including a robot with a rigid proximal portion having a remote center of motion (RCM), a flexible distal portion, and an image acquisition device. The control unit includes a processor that receives images from the image acquisition device; generates a first deployment path to a first target position based on the images; generates a second deployment path to a second target position from the first target position based on the images; generates first guidance information for positioning the rigid proximal portion along the first deployment path; generates second guidance information for positioning the flexible distal portion along the second deployment path; and deploys the first guidance information to the rigid proximal portion for guiding the rigid proximal portion to the first target position, and deploys the second guidance information to the flexible distal portion for guiding the flexible interface distal portion to the second target position.

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Abstract: A image guided motion scaled surgical robotic system (160) employs a surgical robotic arm (168) and an image guided motion scaled surgical controller (162). In operation, responsive to an input signal indicative of a user defined motion of the surgical robotic arm (168) within an anatomical region, the image guided motion scaled surgical controller (162) controls an actuated motion of the surgical robotic arm (168) within the anatomical region based on a map (164) of a motion scale delineated within an imaging of the anatomical region.

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Abstract: Computer implemented system (C-SYS) and related methods for controlling one or more devices in a procedure performed in relation to a patient. A shape sensing system is used to acquire shape measurement data. A predictor logic (PL) predicts based on this shape measurements an anatomical location, procedure type, or phase of such a procedure. The System may support navigation of a device in the patient. No imagery need to be acquired during the procedure for navigation. The predictor logic (PL) may be based on a machine learning model. Systems (TS, TDS) and methods for training such as model and for generating training data are also described herein.

Abstract: A positioning controller (50) including an imaging predictive model (80) and inverse control predictive model (70). In operation, the controller (50) applies the imaging predictive model (80) to imaging data generated by an imaging device (40) to render a predicted navigated pose of the imaging device (40), and applies the control predictive model (70) to error positioning data derived from a differential aspect between a target pose of the imaging device (40) and the predicted navigated pose of the imaging device (40) to render a predicted corrective positioning motion of the imaging device (40) (or a portion of the interventional device associated with this imaging device) to the target pose.

Abstract: A robotic surgical system employing a treatment catheter (30) (e.g., a thermoablation catheter or a cyroablation catheter), and an articulated robot (40) including a plurality of linkages and one or more joints interconnecting the linkages for navigating the treatment catheter (30) within an anatomical region. The robotic surgical system further employs a robot controller (41) for controlling a navigation by the articulated robot (40) of the treatment catheter (30) along a intraoperative treatment path within the anatomical region relative to the anatomical structure derived from a planned treatment path within the anatomical region relative to the anatomical structure based on a registration between the articulated robot (40) and a preoperative image (21a) illustrative of the planned treatment path within the anatomical region relative to the anatomical structure.

Abstract: A system for visualizing an anatomical target includes an imaging device (105) configured to collect real-time images of an anatomical target. A three-dimensional model (136) is generated from pre- or intra-operative images and includes images of structures below a surface of the anatomical target not visible in the images from the scope. An image processing module (148) is configured to generate an overlay (107) registered to the real-time images and to indicate the structures below the surface and a depth of the structures below the surface. A display device (118) is configured to concurrently display the real-time images and the overlay.

Abstract: A multi-stage robot (10) comprises a sequential series arrangement of a flexible robot arm (30), a robot platform (40), a snake robot arm (50) and an end-effector (60). In operation, the multi-state robot (10) is introduced through an incision or an anatomical opening into an anatomical region enclosing an anatomical structure, and the snake robot arm (50) and the end-effector (60) are further introduced through an incision or an anatomical opening into the anatomical structure. The robot platform (40) is thereafter attached to the incision or the anatomical opening of the anatomical structure to facilitate an actuation of the snake robot arm (50) relative to the robot platform (40) to thereby target position the end-effector (60) within the anatomical structure. The multi-stage robot (10) may further comprise a robot base at the proximal end of the multi-stage robot (10) and attachable to the incision or the anatomical opening into the anatomical region.

Abstract: A system for visualizing an anatomical target includes an imaging device (105) configured to collect real-time images of an anatomical target. A three-dimensional model (136) is generated from pre- or intra-operative images and includes images of structures below a surface of the anatomical target not visible in the images from the scope. An image processing module (148) is configured to generate an overlay (107) registered to the real-time images and to indicate the structures below the surface and a depth of the structures below the surface. A display device (118) is configured to concurrently display the real-time images and the overlay.

Abstract: Various embodiments of the present disclosure encompass a visual endoscopic guidance device employing an endoscopic viewing controller (20) for controlling a display of an endoscopic view (11) of an anatomical structure, and a visual guidance controller (130) for controlling of a display one or more guided manipulation anchors (50-52) within the display of the endoscopic view (11) of the anatomical structure. A guided manipulation anchor (50-52) is representative of location marking and/or a motion directive of a guided manipulation of the anatomical structure. The visual guidance controller (130) further controls a display of a hidden feature anchor relative to the display of the endoscopic view (11) of the anatomical structure. The hidden feature anchor (53) being representative of a position (e.g., a location and/or an orientation) of a guided visualization of the hidden feature of the anatomical structure.

Abstract: An imaging device positioning system for monitoring an anatomical region (10). The imaging device positioning system employs an imaging device (20) for generating an image (21) of an anatomical region (10). The imaging device positioning system further employs an imaging device controller (30) for controlling a positioning of the imaging device (20) relative to the anatomical region (10). During a generation by the imaging device (20) of the image (21) of the anatomical region (10), the imaging device controller (30) adapts the positioning of the imaging device (20) relative to the anatomical region (10) to a physiological condition of the anatomical region (10) extracted from the image (21) of the anatomical region (10).

Abstract: A force sensed surface scanning system (20) employs a scanning robot (41) and a surface scanning controller (50). The scanning robot (41) includes a surface scanning end-effector (43) for generating force sensing data informative of a contact force applied by the surface scanning end-effector (43) to an anatomical organ. In operation, the surface scanning controller (50) controls a surface scanning of the anatomical organ by the surface scanning end-effector (43) including the surface scanning end-effector (43) generating the force sensing data, and further constructs an intraoperative volume model of the anatomical organ responsive to the force sensing data generated by the surface scanning end-effector (43) indicating a defined surface deformation offset of the anatomical organ.

Abstract: An optical shape sensing system includes an attachment mechanism (130) being configured to secure an optical shape sensing fiber to an instrument, the optical shape sensing fiber being connected to the instrument and configured to identify a position and orientation of the instrument. An optical shape sensing module (115) is configured to receive feedback from the optical shape sensing fiber and register the position of the instrument relative to an operating environment. A position response module (144) is configured to provide feedback to an operator based on position or orientation of the instrument to guide usage of the instrument.

Abstract: An imaging device positioning system for monitoring an anatomical region (10). The imaging device positioning system employs an imaging device (20) for generating an image (21) of an anatomical region (10). The imaging device positioning system further employs an imaging device controller (30) for controlling a positioning of the imaging device (20) relative to the anatomical region (10). During a generation by the imaging device (20) of the image (21) of the anatomical region (10), the imaging device controller (30) adapts the positioning of the imaging device (20) relative to the anatomical region (10) to a physiological condition of the anatomical region (10) extracted from the image (21) of the anatomical region (10).

Abstract: An imaging device positioning system for monitoring an anatomical region (10). The imaging device positioning system employs an imaging device (20) for generating an image (21) of an anatomical region (10). The imaging device positioning system further employs a imaging device controller (30) for controlling a positioning of the imaging device (20) relative to the anatomical region (10). During a generation by the imaging device (20) of the image (21) of the anatomical region (10), the imaging device controller (30) adapts the control of the positioning of the imaging device (20) relative to the anatomical region (10) to a physiological condition of the anatomical region (10) extracted from the image (21) of the anatomical region (10).

Abstract: A force sensed surface scanning system (20) employs a scanning robot (41) and a surface scanning controller (50). The scanning robot (41) includes a surface scanning end-effector (43) for generating force sensing data informative of a contact force applied by the surface scanning end-effector (43) to an anatomical organ. In operation, the surface scanning controller (50) controls a surface scanning of the anatomical organ by the surface scanning end-effector (43) including the surface scanning end-effector (43) generating the force sensing data, and further constructs an intraoperative volume model of the anatomical organ responsive to the force sensing data generated by the surface scanning end-effector (43) indicating a defined surface deformation offset of the anatomical organ.

Abstract: An intervention system employing an interventional robot (30), an interventional imaging modality (10) and an interventional controller (70). In 5 operation, the interventional controller (70) navigates an anatomical roadmap (82) of an anatomical region of a patient in accordance with an interventional plan to thereby control a navigation of the interventional robot (30) within the anatomical region in accordance with the anatomical roadmap (82).

Abstract: A system for providing a perspective for a virtual image includes an intraoperative imaging system (110) having a transducer (146) configured to generate an image data set for a region. A shape sensing enabled device (102) is configured to have at least a portion of the shape sensing enabled device positioned relative to the region. The shape sensing enabled device has a coordinate system registered with a coordinate system of the intraoperative imaging system. An image generation module (148) is configured to render a virtual image (152) of at least a portion of the region using the image data set wherein the virtual image includes a vantage point relative to a position on the shape sensing enabled device.

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.