Abstract: A methodology is for deriving a guidance route to any selected site including an unplanned ROI site observed in a radiologic imaging view or endoscopic video view on an assisted-endoscopy system during a live surgical endoscopic procedure based on a preloaded initial procedure plan. The initial procedure plan can be updated by identifying a new site s at the unplanned ROI on one of graphical visualization tools of an image-guided endoscope system as a new examination destination and automatically computing the new navigation airway route that leads to the new examination destination.

Abstract: A methodology is for deriving a guidance route to any selected site including an unplanned ROI site observed in a radiologic imaging view or endoscopic video view on an assisted-endoscopy system during a live surgical endoscopic procedure based on a preloaded initial procedure plan. The initial procedure plan can be updated by identifying a new site s at the unplanned ROI on one of graphical visualization tools of an image-guided endoscope system as a new examination destination and automatically computing the new navigation airway route that leads to the new examination destination.

Abstract: A method for planning and guiding an endoscopic procedure, taking place in a hollow structure inside of a multi-organ cavity, that compensates for image-to-body divergence, first derives a procedure plan based on two scans of the multi-organ cavity at different volumes, which includes computing anatomical models for each scan, defining a region of interest (ROI) in the in the first scan, determining a route leading through the hollow structure to the ROI, deriving guidance cues that instruct how to maneuver the endoscope along the route toward the ROI, computing a 3D transformation that maps points in the first scan to corresponding points in the second scan, using the transformation to convert the route for the first scan into a corresponding route in the space of the second scan, and deriving guidance cues for the second scan that instruct how to maneuver the endoscope along the route toward the ROI.

Abstract: A two-stage method for guiding an endoscope and second device toward a target destination near the ROI includes navigation and localization. The endoscope is navigated near the vicinity of the ROI according to a pre-procedure plan. When the ROI location is reached, the second device's tip is pushed far enough through the endoscope so that its tip is outside the endoscope and in the endoscope's video view. Then a two-phase registration mechanism is used: i. Phase 1: Align the endoscope by registering the endoscope's video to a virtual bronchoscope's simulated video stream; ii. Phase 2: Align the second device by registering the second device's shape in the endoscope's video to a virtual second device model.

Abstract: A method for planning and guiding an endoscopic procedure includes obtaining a first scan of a chest cavity at near total lung capacity, obtaining a second scan of the chest cavity at near functional residual capacity, generating a virtual chest cavity based at least in part on the first scan and the second scan, defining one or more regions of interest (ROI) in the virtual chest cavity, determining a route to the one or more ROIs based on the virtual chest cavity, directing endoscope hardware through an airway to the one or more ROIs along the predetermined route, monitoring, by a processor, a real-time position of the endoscope hardware relative to an expected position along the predetermined route, and performing an examination of the one or more ROIs when the real-time position of the endoscope hardware corresponds to an expected ROI location.

Abstract: A two-stage method for guiding an endoscope and second device toward a target destination near the ROI includes navigation and localization. The endoscope is navigated near the vicinity of the ROI according to a pre-procedure plan. When the ROI location is reached, the second device's tip is pushed far enough through the endoscope so that its tip is outside the endoscope and in the endoscope's video view. Then a two-phase registration mechanism is used: i. Phase 1: Align the endoscope by registering the endoscope's video to a virtual bronchoscope's simulated video stream; ii. Phase 2: Align the second device by registering the second device's shape in the endoscope's video to a virtual second device model.

Abstract: A methodology is for deriving a guidance route to any selected site including an unplanned ROI site observed in a radiologic imaging view or endoscopic video view on an assisted-endoscopy system during a live surgical endoscopic procedure based on a preloaded initial procedure plan. The initial procedure plan can be updated by identifying a new site s at the unplanned ROI on one of graphical visualization tools of an image-guided endoscope system as a new examination destination and automatically computing the new navigation airway route that leads to the new examination destination.

Abstract: A method for planning a tour visiting a set of target diagnostic sites via endoscopy passing through a hollow organ system includes computing a 3D virtual space of the hollow organ system based on the 3D imaging scan depicting the diagnostic sites and hollow organ system, computing a series of preliminary endoscopic routes leading to each diagnostic site including a set of contiguous device poses through the hollow organ system that connect each target diagnostic site to all of the other target diagnostic sites, and computing an optimal tour having a minimum cost corresponding to the smallest set of contiguous poses that visit all of the target diagnostic sites once and only once, where the cost between each pair of diagnostic sites is defined as the distance accumulated by the smallest set of contiguous poses connecting the pair of diagnostic sites together within the hollow organ system.

Abstract: A method for planning a tour visiting a set of target diagnostic sites via endoscopy passing through a hollow organ system includes computing a 3D virtual space of the hollow organ system based on the 3D imaging scan depicting the diagnostic sites and hollow organ system, computing a series of preliminary endoscopic routes leading to each diagnostic site including a set of contiguous device poses through the hollow organ system that connect each target diagnostic site to all of the other target diagnostic sites, and computing an optimal tour having a minimum cost corresponding to the smallest set of contiguous poses that visit all of the target diagnostic sites once and only once, where the cost between each pair of diagnostic sites is defined as the distance accumulated by the smallest set of contiguous poses connecting the pair of diagnostic sites together within the hollow organ system.

Abstract: A global registration system and method identifies bronchoscope position without the need for significant bronchoscope maneuvers, technician intervention, or electromagnetic sensors. Virtual bronchoscopy (VB) renderings of a 3D airway tree are obtained including VB views of branch positions within the airway tree. At least one real bronchoscopic (RB) video frame is received from a bronchoscope inserted into the airway tree. An algorithm according to the invention is executed on a computer to identify the several most likely branch positions having a VB view closest to the received RB view, and the 3D position of the bronchoscope within the airway tree is determined in accordance with the branch position identified in the VB view. The preferred embodiment involves a fast local registration search over all the branches in a global airway-bifurcation search space, with the weighted normalized sum of squares distance metric used for finding the best match.

Abstract: This invention relates generally to medical imaging and, in particular, to a method and system for automatic lymph node station mapping, automatic path or route report generation. A computer-based system for automatically locating the central chest lymph-node stations in a 3D MDCT image is described. Automated analysis methods extract the airway tree, airway-tree centerlines, aorta, pulmonary artery, lungs, key skeletal structures, and major-airway labels. Geometrical and anatomical cues arising from the extracted structures are used to localize the major nodal stations. The system calculates and displays the nodal stations in 3D. Visualization tools within the system enable the user to interact with the stations to locate visible lymph nodes.

Abstract: A global registration system and method identifies bronchoscope position without the need for significant bronchoscope maneuvers, technician intervention, or electromagnetic sensors. Virtual bronchoscopy (VB) renderings of a 3D airway tree are obtained including VB views of branch positions within the airway tree. At least one real bronchoscopic (RB) video frame is received from a bronchoscope inserted into the airway tree. An algorithm according to the invention is executed on a computer to identify the several most likely branch positions having a VB view closest to the received RB view, and the 3D position of the bronchoscope within the airway tree is determined in accordance with the branch position identified in the VB view. The preferred embodiment involves a fast local registration search over all the branches in a global airway-bifurcation search space, with the weighted normalized sum of squares distance metric used for finding the best match.

Abstract: This invention relates generally to medical imaging and, in particular, to a method and system for automatic lymph node station mapping, automatic path or route report generation. A computer-based system for automatically locating the central chest lymph-node stations in a 3D MDCT image is described. Automated analysis methods extract the airway tree, airway-tree centerlines, aorta, pulmonary artery, lungs, key skeletal structures, and major-airway labels. Geometrical and anatomical cues arising from the extracted structures are used to localize the major nodal stations. The system calculates and displays the nodal stations in 3D. Visualization tools within the system enable the user to interact with the stations to locate visible lymph nodes.

Abstract: Two system-level bronchoscopy guidance solutions are presented. The first incorporates a global-registration algorithm to provide the physician with updated navigational and guidance information during bronchoscopy. The system can handle general navigation to a region of interest (ROI), as well as adverse events, and it requires minimal commands so that it can be directly controlled by the physician. The second solution visualizes the global picture of all the bifurcations and their relative orientations in advance and suggests the maneuvers needed by the bronchoscope to approach the ROI. Guided bronchoscopy results using human airway-tree phantoms demonstrate the potential of the two solutions.

Abstract: Methods and apparatus assist in planning routes through hollow, branching organs in patients to optimize subsequent endoscopic procedures. Information is provided about the organ and a follow-on endoscopic procedure associated with the organ. The most appropriate navigable route or routes to a target region of interest (ROI) within the organ are then identified given anatomical, endoscopic-device, or procedure-specific constraints derived from the information provided. The method may include the step of modifying the viewing direction at each site along a route to give physically meaningful navigation directions or to reflect the requirements of a follow-on live endoscopic procedure. An existing route may further be extended, if necessary, to an ROI beyond the organ. The information provided may include anatomical constraints that define locations or organs to avoid; anatomical constraints that confine the route within specific geometric locations; or a metric for selecting the most appropriate route.

Abstract: This invention relates generally to medical imaging and, in particular, to a method and system for reconstructing a model path through a branched tubular organ. Novel methodologies and systems segment and define accurate endoluminal surfaces in airway trees, including small peripheral bronchi. An automatic algorithm is described that searches the entire lung volume for airway branches and poses airway-tree segmentation as a global graph-theoretic optimization problem. A suite of interactive segmentation tools for cleaning and extending critical areas of the automatically segmented result is disclosed. A model path is reconstructed through the airway tree.

Abstract: Methods and apparatus assist in planning routes through hollow, branching organs in patients to optimize subsequent endoscopic procedures. Information is provided about the organ and a follow-on endoscopic procedure associated with the organ. The most appropriate navigable route or routes to a target region of interest (ROI) within the organ are then identified given anatomical, endoscopic-device, or procedure-specific constraints derived from the information provided. The method may include the step of modifying the viewing direction at each site along a route to give physically meaningful navigation directions or to reflect the requirements of a follow-on live endoscopic procedure. An existing route may further be extended, if necessary, to an ROI beyond the organ. The information provided may include anatomical constraints that define locations or organs to avoid; anatomical constraints that confine the route within specific geometric locations; or a metric for selecting the most appropriate route.

Abstract: Methods and apparatus assist in planning routes through hollow, branching organs in patients to optimize subsequent endoscopic procedures. Information is provided about the organ and a follow-on endoscopic procedure associated with the organ. The most appropriate navigable route or routes to a target region of interest (ROI) within the organ are then identified given anatomical, endoscopic-device, or procedure-specific constraints derived from the information provided. The method may include the step of modifying the viewing direction at each site along a route to give physically meaningful navigation directions or to reflect the requirements of a follow-on live endoscopic procedure. An existing route may further be extended, if necessary, to an ROI beyond the organ. The information provided may include anatomical constraints that define locations or organs to avoid; anatomical constraints that confine the route within specific geometric locations; or a metric for selecting the most appropriate route.

Abstract: Methods and apparatus provide continuous guidance of endoscopy during a live procedure. A data-set based on 3D image data is pre-computed including reference information representative of a predefined route through a body organ to a final destination. A plurality of live real endoscopic (RE) images are displayed as an operator maneuvers an endoscope within the body organ. A registration and tracking algorithm registers the data-set to one or more of the RE images and continuously maintains the registration as the endoscope is locally maneuvered. Additional information related to the final destination is then presented enabling the endoscope operator to decide on a final maneuver for the procedure. The reference information may include 3D organ surfaces, 3D routes through an organ system, or 3D regions of interest (ROIs), as well as a virtual endoscopic (VE) image generated from the precomputed data-set.

Abstract: Fast and continuous registration between two imaging modalities makes it possible to completely determine the rigid transformation between multiple sources at real-time or near real-time frame-rates in order to localize video cameras and register the two sources. A set of reference images are computed or captured within a known environment, with corresponding depth maps and image gradients defining a reference source. Given one frame from a real-time or near-real time video feed, and starting from an initial guess of viewpoint, a real-time video frame is warped to the nearest viewing site of the reference source. An image difference is computed between the warped video frame and the reference image. Steps are repeated for each frame until the viewpoint converges or the next video frame becomes available. The final viewpoint gives an estimate of the relative rotation and translation between the camera at that particular video frame and the reference source.