Abstract: A training data collection method for an interventional device (130) including a portion of an interventional device (140) and sensors (332) adapted to provide position and/or orientation and/or shape information with at least a part of the sensors being affixed to said portion of device (140). The method involves controlling one or more motion variables of the interventional device (130) in accordance with a pre-defined data point pattern, and determining, from shape data derived from said information, an estimating of a pose of said device portion (140) and an estimating of a positioning motion of the interventional device (130). The method further involves a storage of a temporal data sequence for the interventional device (130) derived from the estimated pose of the end-effector (140) for each data point, the estimated positioning motion of the interventional device (130) for each data point, and the motion variable(s) of the interventional device (130) for each data point.

Abstract: A control unit for a robot system including a robot with a rigid proximal portion having a remote center of motion (RCM), a flexible distal portion, and an image acquisition device. The control unit includes a processor that receives images from the image acquisition device; generates a first deployment path to a first target position based on the images; generates a second deployment path to a second target position from the first target position based on the images; generates first guidance information for positioning the rigid proximal portion along the first deployment path; generates second guidance information for positioning the flexible distal portion along the second deployment path; and deploys the first guidance information to the rigid proximal portion for guiding the rigid proximal portion to the first target position, and deploys the second guidance information to the flexible distal portion for guiding the flexible interface distal portion to the second target position.

Abstract: A image guided motion scaled surgical robotic system (160) employs a surgical robotic arm (168) and an image guided motion scaled surgical controller (162). In operation, responsive to an input signal indicative of a user defined motion of the surgical robotic arm (168) within an anatomical region, the image guided motion scaled surgical controller (162) controls an actuated motion of the surgical robotic arm (168) within the anatomical region based on a map (164) of a motion scale delineated within an imaging of the anatomical region.

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Abstract: A positioning controller (50) including an imaging predictive model (80) and inverse control predictive model (70). In operation, the controller (50) applies the imaging predictive model (80) to imaging data generated by an imaging device (40) to render a predicted navigated pose of the imaging device (40), and applies the control predictive model (70) to error positioning data derived from a differential aspect between a target pose of the imaging device (40) and the predicted navigated pose of the imaging device (40) to render a predicted corrective positioning motion of the imaging device (40) (or a portion of the interventional device associated with this imaging device) to the target pose.

Abstract: A robotic surgical system employing a treatment catheter (30) (e.g., a thermoablation catheter or a cyroablation catheter), and an articulated robot (40) including a plurality of linkages and one or more joints interconnecting the linkages for navigating the treatment catheter (30) within an anatomical region. The robotic surgical system further employs a robot controller (41) for controlling a navigation by the articulated robot (40) of the treatment catheter (30) along a intraoperative treatment path within the anatomical region relative to the anatomical structure derived from a planned treatment path within the anatomical region relative to the anatomical structure based on a registration between the articulated robot (40) and a preoperative image (21a) illustrative of the planned treatment path within the anatomical region relative to the anatomical structure.

Abstract: A multi-stage robot (10) comprises a sequential series arrangement of a flexible robot arm (30), a robot platform (40), a snake robot arm (50) and an end-effector (60). In operation, the multi-state robot (10) is introduced through an incision or an anatomical opening into an anatomical region enclosing an anatomical structure, and the snake robot arm (50) and the end-effector (60) are further introduced through an incision or an anatomical opening into the anatomical structure. The robot platform (40) is thereafter attached to the incision or the anatomical opening of the anatomical structure to facilitate an actuation of the snake robot arm (50) relative to the robot platform (40) to thereby target position the end-effector (60) within the anatomical structure. The multi-stage robot (10) may further comprise a robot base at the proximal end of the multi-stage robot (10) and attachable to the incision or the anatomical opening into the anatomical region.

Abstract: A system for visualizing an anatomical target includes an imaging device (105) configured to collect real-time images of an anatomical target. A three-dimensional model (136) is generated from pre- or intra-operative images and includes images of structures below a surface of the anatomical target not visible in the images from the scope. An image processing module (148) is configured to generate an overlay (107) registered to the real-time images and to indicate the structures below the surface and a depth of the structures below the surface. A display device (118) is configured to concurrently display the real-time images and the overlay.

Abstract: Various embodiments of the present disclosure encompass a visual endoscopic guidance device employing an endoscopic viewing controller (20) for controlling a display of an endoscopic view (11) of an anatomical structure, and a visual guidance controller (130) for controlling of a display one or more guided manipulation anchors (50-52) within the display of the endoscopic view (11) of the anatomical structure. A guided manipulation anchor (50-52) is representative of location marking and/or a motion directive of a guided manipulation of the anatomical structure. The visual guidance controller (130) further controls a display of a hidden feature anchor relative to the display of the endoscopic view (11) of the anatomical structure. The hidden feature anchor (53) being representative of a position (e.g., a location and/or an orientation) of a guided visualization of the hidden feature of the anatomical structure.

Abstract: An imaging device positioning system for monitoring an anatomical region (10). The imaging device positioning system employs an imaging device (20) for generating an image (21) of an anatomical region (10). The imaging device positioning system further employs an imaging device controller (30) for controlling a positioning of the imaging device (20) relative to the anatomical region (10). During a generation by the imaging device (20) of the image (21) of the anatomical region (10), the imaging device controller (30) adapts the positioning of the imaging device (20) relative to the anatomical region (10) to a physiological condition of the anatomical region (10) extracted from the image (21) of the anatomical region (10).

Abstract: A force sensed surface scanning system (20) employs a scanning robot (41) and a surface scanning controller (50). The scanning robot (41) includes a surface scanning end-effector (43) for generating force sensing data informative of a contact force applied by the surface scanning end-effector (43) to an anatomical organ. In operation, the surface scanning controller (50) controls a surface scanning of the anatomical organ by the surface scanning end-effector (43) including the surface scanning end-effector (43) generating the force sensing data, and further constructs an intraoperative volume model of the anatomical organ responsive to the force sensing data generated by the surface scanning end-effector (43) indicating a defined surface deformation offset of the anatomical organ.

Abstract: An optical shape sensing system includes an attachment mechanism (130) being configured to secure an optical shape sensing fiber to an instrument, the optical shape sensing fiber being connected to the instrument and configured to identify a position and orientation of the instrument. An optical shape sensing module (115) is configured to receive feedback from the optical shape sensing fiber and register the position of the instrument relative to an operating environment. A position response module (144) is configured to provide feedback to an operator based on position or orientation of the instrument to guide usage of the instrument.

Abstract: An imaging device positioning system for monitoring an anatomical region (10). The imaging device positioning system employs an imaging device (20) for generating an image (21) of an anatomical region (10). The imaging device positioning system further employs a imaging device controller (30) for controlling a positioning of the imaging device (20) relative to the anatomical region (10). During a generation by the imaging device (20) of the image (21) of the anatomical region (10), the imaging device controller (30) adapts the control of the positioning of the imaging device (20) relative to the anatomical region (10) to a physiological condition of the anatomical region (10) extracted from the image (21) of the anatomical region (10).

Abstract: An intervention system employing an interventional robot (30), an interventional imaging modality (10) and an interventional controller (70). In 5 operation, the interventional controller (70) navigates an anatomical roadmap (82) of an anatomical region of a patient in accordance with an interventional plan to thereby control a navigation of the interventional robot (30) within the anatomical region in accordance with the anatomical roadmap (82).

Abstract: A system for providing a perspective for a virtual image includes an intraoperative imaging system (110) having a transducer (146) configured to generate an image data set for a region. A shape sensing enabled device (102) is configured to have at least a portion of the shape sensing enabled device positioned relative to the region. The shape sensing enabled device has a coordinate system registered with a coordinate system of the intraoperative imaging system. An image generation module (148) is configured to render a virtual image (152) of at least a portion of the region using the image data set wherein the virtual image includes a vantage point relative to a position on the shape sensing enabled device.

Abstract: A system for controlling a robotic tool includes a memory that stores instructions and a processor that executes the instructions. When executed by the processor, the instructions cause the system to perform a process that includes monitoring sequential motion of tissue in a three-dimensional space. The process also includes projecting locations and corresponding times when the tissue will be at projected locations in the three-dimensional space. An identified location of the tissue in the three-dimensional space is identified based on the projected locations. A trajectory of the robotic tool is set to meet the tissue at the identified location at a projected time corresponding to the identified location.

Abstract: An endoscopic imaging system (10) employing an endoscope (20) and an endoscope guidance controller (30). In operation, endoscope (20) generates an endoscopic video (23) of an anatomical structure within an anatomical region. Endoscopic guidance controller (30), responsive to a registration between the endoscopic video (23) and a volume image (44) of the anatomical region, controls a user interaction (50) with a graphical user interface (31) including one or more interactive planar slices (32) of the volume image (44), and responsive to the user interaction (50) with the graphical user interface (31), endoscopic guidance controller (30) controls a positioning of the endoscope (20) relative to the anatomical structure derived from the interactive planar slices (32) of the volume image (44).

Abstract: A system may generally comprise a tracking device, an ultrasound device and a processing unit. A position and orientation of the ultrasound device may be traceable by the tracking device. The processing unit may be configured (i) to receive 3D information of a region of interest in relation to a marker, with both the region of interest and the marker being located within a body, (ii) to determine the position of the marker relative to the ultrasound device based on an ultrasound image of the body including the marker, and (iii) to determine the position and orientation of the ultrasound device relative to the tracking device. The system may further comprise a visualization device and the processing unit may further be configured to generate a visualization of the region of interest in relation to an outer surface of the body.

Abstract: Registration of a surgical image acquisition device (e.g. an endoscope) using preoperative and live contour signatures of an anatomical object is described. A control unit includes a processor configured to compare the real-time contour signature to the database of preoperative contour signatures of the anatomical object to generate a group of potential contour signature matches for selection of a final contour match. Registration of an image acquisition device to the surgical site is realized based upon an orientation corresponding to the selected final contour signature match.

Abstract: A force sensed surface scanning system (20) employs a scanning robot (41) and a surface scanning controller (50). The scanning robot (41) includes a surface scanning end-effector (43) for generating force sensing data informative of a contact force applied by the surface scanning end-effector (43) to an anatomical organ. In operation, the surface scanning controller (50) controls a surface scanning of the anatomical organ by the surface scanning end-effector (43) including the surface scanning end-effector (43) generating the force sensing data, and further constructs an intraoperative volume model of the anatomical organ responsive to the force sensing data generated by the surface scanning end-effector (43) indicating a defined surface deformation offset of the anatomical organ.