Abstract: Various embodiments of the present disclosure encompass a visual endoscopic guidance device employing an endoscopic viewing controller (20) for controlling a display of an endoscopic view (11) of an anatomical structure, and a visual guidance controller (130) for controlling of a display one or more guided manipulation anchors (50-52) within the display of the endoscopic view (11) of the anatomical structure. A guided manipulation anchor (50-52) is representative of location marking and/or a motion directive of a guided manipulation of the anatomical structure. The visual guidance controller (130) further controls a display of a hidden feature anchor relative to the display of the endoscopic view (11) of the anatomical structure. The hidden feature anchor (53) being representative of a position (e.g., a location and/or an orientation) of a guided visualization of the hidden feature of the anatomical structure.

Abstract: An imaging device positioning system for monitoring an anatomical region (10). The imaging device positioning system employs an imaging device (20) for generating an image (21) of an anatomical region (10). The imaging device positioning system further employs an imaging device controller (30) for controlling a positioning of the imaging device (20) relative to the anatomical region (10). During a generation by the imaging device (20) of the image (21) of the anatomical region (10), the imaging device controller (30) adapts the positioning of the imaging device (20) relative to the anatomical region (10) to a physiological condition of the anatomical region (10) extracted from the image (21) of the anatomical region (10).

Abstract: A force sensed surface scanning system (20) employs a scanning robot (41) and a surface scanning controller (50). The scanning robot (41) includes a surface scanning end-effector (43) for generating force sensing data informative of a contact force applied by the surface scanning end-effector (43) to an anatomical organ. In operation, the surface scanning controller (50) controls a surface scanning of the anatomical organ by the surface scanning end-effector (43) including the surface scanning end-effector (43) generating the force sensing data, and further constructs an intraoperative volume model of the anatomical organ responsive to the force sensing data generated by the surface scanning end-effector (43) indicating a defined surface deformation offset of the anatomical organ.

Abstract: An optical shape sensing system includes an attachment mechanism (130) being configured to secure an optical shape sensing fiber to an instrument, the optical shape sensing fiber being connected to the instrument and configured to identify a position and orientation of the instrument. An optical shape sensing module (115) is configured to receive feedback from the optical shape sensing fiber and register the position of the instrument relative to an operating environment. A position response module (144) is configured to provide feedback to an operator based on position or orientation of the instrument to guide usage of the instrument.

Abstract: An imaging device positioning system for monitoring an anatomical region (10). The imaging device positioning system employs an imaging device (20) for generating an image (21) of an anatomical region (10). The imaging device positioning system further employs an imaging device controller (30) for controlling a positioning of the imaging device (20) relative to the anatomical region (10). During a generation by the imaging device (20) of the image (21) of the anatomical region (10), the imaging device controller (30) adapts the positioning of the imaging device (20) relative to the anatomical region (10) to a physiological condition of the anatomical region (10) extracted from the image (21) of the anatomical region (10).

Abstract: An imaging device positioning system for monitoring an anatomical region (10). The imaging device positioning system employs an imaging device (20) for generating an image (21) of an anatomical region (10). The imaging device positioning system further employs a imaging device controller (30) for controlling a positioning of the imaging device (20) relative to the anatomical region (10). During a generation by the imaging device (20) of the image (21) of the anatomical region (10), the imaging device controller (30) adapts the control of the positioning of the imaging device (20) relative to the anatomical region (10) to a physiological condition of the anatomical region (10) extracted from the image (21) of the anatomical region (10).

Abstract: A force sensed surface scanning system (20) employs a scanning robot (41) and a surface scanning controller (50). The scanning robot (41) includes a surface scanning end-effector (43) for generating force sensing data informative of a contact force applied by the surface scanning end-effector (43) to an anatomical organ. In operation, the surface scanning controller (50) controls a surface scanning of the anatomical organ by the surface scanning end-effector (43) including the surface scanning end-effector (43) generating the force sensing data, and further constructs an intraoperative volume model of the anatomical organ responsive to the force sensing data generated by the surface scanning end-effector (43) indicating a defined surface deformation offset of the anatomical organ.

Abstract: An intervention system employing an interventional robot (30), an interventional imaging modality (10) and an interventional controller (70). In 5 operation, the interventional controller (70) navigates an anatomical roadmap (82) of an anatomical region of a patient in accordance with an interventional plan to thereby control a navigation of the interventional robot (30) within the anatomical region in accordance with the anatomical roadmap (82).

Abstract: A system for providing a perspective for a virtual image includes an intraoperative imaging system (110) having a transducer (146) configured to generate an image data set for a region. A shape sensing enabled device (102) is configured to have at least a portion of the shape sensing enabled device positioned relative to the region. The shape sensing enabled device has a coordinate system registered with a coordinate system of the intraoperative imaging system. An image generation module (148) is configured to render a virtual image (152) of at least a portion of the region using the image data set wherein the virtual image includes a vantage point relative to a position on the shape sensing enabled device.

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Abstract: A system for controlling a robotic tool includes a memory that stores instructions and a processor that executes the instructions. When executed by the processor, the instructions cause the system to perform a process that includes monitoring sequential motion of tissue in a three-dimensional space. The process also includes projecting locations and corresponding times when the tissue will be at projected locations in the three-dimensional space. An identified location of the tissue in the three-dimensional space is identified based on the projected locations. A trajectory of the robotic tool is set to meet the tissue at the identified location at a projected time corresponding to the identified location.

Abstract: An endoscopic imaging system (10) employing an endoscope (20) and an endoscope guidance controller (30). In operation, endoscope (20) generates an endoscopic video (23) of an anatomical structure within an anatomical region. Endoscopic guidance controller (30), responsive to a registration between the endoscopic video (23) and a volume image (44) of the anatomical region, controls a user interaction (50) with a graphical user interface (31) including one or more interactive planar slices (32) of the volume image (44), and responsive to the user interaction (50) with the graphical user interface (31), endoscopic guidance controller (30) controls a positioning of the endoscope (20) relative to the anatomical structure derived from the interactive planar slices (32) of the volume image (44).

Abstract: A system for visualizing an anatomical target includes an imaging device (105) configured to collect real-time images of an anatomical target. A three-dimensional model (136) is generated from pre- or intra-operative images and includes images of structures below a surface of the anatomical target not visible in the images from the scope. An image processing module (148) is configured to generate an overlay (107) registered to the real-time images and to indicate the structures below the surface and a depth of the structures below the surface. A display device (118) is configured to concurrently display the real-time images and the overlay.

Abstract: A system may generally comprise a tracking device, an ultrasound device and a processing unit. A position and orientation of the ultrasound device may be traceable by the tracking device. The processing unit may be configured (i) to receive 3D information of a region of interest in relation to a marker, with both the region of interest and the marker being located within a body, (ii) to determine the position of the marker relative to the ultrasound device based on an ultrasound image of the body including the marker, and (iii) to determine the position and orientation of the ultrasound device relative to the tracking device. The system may further comprise a visualization device and the processing unit may further be configured to generate a visualization of the region of interest in relation to an outer surface of the body.

Abstract: Registration of a surgical image acquisition device (e.g. an endoscope) using preoperative and live contour signatures of an anatomical object is described. A control unit includes a processor configured to compare the real-time contour signature to the database of preoperative contour signatures of the anatomical object to generate a group of potential contour signature matches for selection of a final contour match. Registration of an image acquisition device to the surgical site is realized based upon an orientation corresponding to the selected final contour signature match.

Abstract: A force sensed surface scanning system (20) employs a scanning robot (41) and a surface scanning controller (50). The scanning robot (41) includes a surface scanning end-effector (43) for generating force sensing data informative of a contact force applied by the surface scanning end-effector (43) to an anatomical organ. In operation, the surface scanning controller (50) controls a surface scanning of the anatomical organ by the surface scanning end-effector (43) including the surface scanning end-effector (43) generating the force sensing data, and further constructs an intraoperative volume model of the anatomical organ responsive to the force sensing data generated by the surface scanning end-effector (43) indicating a defined surface deformation offset of the anatomical organ.

Abstract: Various embodiments of the present disclosure encompass manipulative endoscopic guidance device employing an endoscopic viewing controller (20) for controlling a display of an endoscopic view (11) of an anatomical structure, and a manipulative guidance controller (30) for controlling a display of one or more guided manipulation anchors (50-52) within the display of the endoscopic view (11) of the anatomical structure. A guided manipulation anchor (50-52) is representative of a location marking and/or a motion directive of a guided manipulation of the anatomical structure (e.g., grasping, pulling, pushing, sliding, reorienting, tilting, removing, or repositioning of the anatomical structure).

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Abstract: A mixed reality device (30) employing a mixed reality display (40) for visualizing a virtual augmentation of a physical anatomical model, and a mixed reality controller (50) for controlling a visualization by the mixed reality display (40) of the virtual augmentation of the physical anatomical model including a mixed reality interaction between the physical anatomical model and a virtual anatomical model. The mixed reality controller (50) may employ a mixed reality registration module (51) for controlling a spatial registration between the physical anatomical model within a physical space and the virtual anatomical model within a virtual space, and a mixed reality interaction module for controlling the mixed reality interaction between the physical anatomical model and the virtual anatomical model based on the spatial registration between the physical anatomical model within the physical space and the virtual anatomical model within the virtual space.

Abstract: A system for visualizing an anatomical target includes an imaging device (105) configured to collect real-time images of an anatomical target. A three-dimensional model (136) is generated from pre- or intra-operative images and includes images of structures below a surface of the anatomical target not visible in the images from the scope. An image processing module (148) is configured to generate an overlay (107) registered to the real-time images and to indicate the structures below the surface and a depth of the structures below the surface. A display device (118) is configured to concurrently display the real-time images and the overlay.