Patents by Inventor William E. Higgins
William E. Higgins has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12349859Abstract: A two-stage method for guiding an endoscope and second device toward a target destination near the ROI includes navigation and localization. The endoscope is navigated near the vicinity of the ROI according to a pre-procedure plan. When the ROI location is reached, the second device's tip is pushed far enough through the endoscope so that its tip is outside the endoscope and in the endoscope's video view. Then a two-phase registration mechanism is used: i. Phase 1: Align the endoscope by registering the endoscope's video to a virtual bronchoscope's simulated video stream; ii. Phase 2: Align the second device by registering the second device's shape in the endoscope's video to a virtual second device model.Type: GrantFiled: January 25, 2023Date of Patent: July 8, 2025Assignee: The Penn State Research FoundationInventors: William E. Higgins, Wennan Zhao
-
Publication number: 20250143539Abstract: A method for planning and guiding an endoscopic procedure includes obtaining a first scan of a chest cavity at near total lung capacity, obtaining a second scan of the chest cavity at near functional residual capacity, generating a virtual chest cavity based at least in part on the first scan and the second scan, defining one or more regions of interest (ROI) in the virtual chest cavity, determining a route to the one or more ROIs based on the virtual chest cavity, directing endoscope hardware through an airway to the one or more ROIs along the predetermined route, monitoring, by a processor, a real-time position of the endoscope hardware relative to an expected position along the predetermined route, and performing an examination of the one or more ROIs when the real-time position of the endoscope hardware corresponds to an expected ROI location.Type: ApplicationFiled: November 25, 2024Publication date: May 8, 2025Inventors: William E. Higgins, Yuxuan He
-
Publication number: 20250134347Abstract: A two-stage method for guiding an endoscope and second device toward a target destination near the ROI includes navigation and localization. The endoscope is navigated near the vicinity of the ROI according to a pre-procedure plan. When the ROI location is reached, the second device's tip is pushed far enough through the endoscope so that its tip is outside the endoscope and in the endoscope's video view. Then a two-phase registration mechanism is used: i. Phase 1: Align the endoscope by registering the endoscope's video to a virtual bronchoscope's simulated video stream; ii. Phase 2: Align the second device by registering the second device's shape in the endoscope's video to a virtual second device model.Type: ApplicationFiled: January 25, 2023Publication date: May 1, 2025Inventors: William E. Higgins, Wennan Zhao
-
Publication number: 20250107855Abstract: A methodology is for deriving a guidance route to any selected site including an unplanned ROI site observed in a radiologic imaging view or endoscopic video view on an assisted-endoscopy system during a live surgical endoscopic procedure based on a preloaded initial procedure plan. The initial procedure plan can be updated by identifying a new site s at the unplanned ROI on one of graphical visualization tools of an image-guided endoscope system as a new examination destination and automatically computing the new navigation airway route that leads to the new examination destination.Type: ApplicationFiled: November 25, 2024Publication date: April 3, 2025Inventors: William E. Higgins, Yuxuan He, Vahid Daneshpajooh, Qi Chang
-
Patent number: 12245824Abstract: A method for planning a tour visiting a set of target diagnostic sites via endoscopy passing through a hollow organ system includes computing a 3D virtual space of the hollow organ system based on the 3D imaging scan depicting the diagnostic sites and hollow organ system, computing a series of preliminary endoscopic routes leading to each diagnostic site including a set of contiguous device poses through the hollow organ system that connect each target diagnostic site to all of the other target diagnostic sites, and computing an optimal tour having a minimum cost corresponding to the smallest set of contiguous poses that visit all of the target diagnostic sites once and only once, where the cost between each pair of diagnostic sites is defined as the distance accumulated by the smallest set of contiguous poses connecting the pair of diagnostic sites together within the hollow organ system.Type: GrantFiled: January 25, 2023Date of Patent: March 11, 2025Assignee: The Penn State Research FoundationInventors: William E. Higgins, Trevor Kuhlengel
-
Publication number: 20250017661Abstract: A method for planning a tour visiting a set of target diagnostic sites via endoscopy passing through a hollow organ system includes computing a 3D virtual space of the hollow organ system based on the 3D imaging scan depicting the diagnostic sites and hollow organ system, computing a series of preliminary endoscopic routes leading to each diagnostic site including a set of contiguous device poses through the hollow organ system that connect each target diagnostic site to all of the other target diagnostic sites, and computing an optimal tour having a minimum cost corresponding to the smallest set of contiguous poses that visit all of the target diagnostic sites once and only once, where the cost between each pair of diagnostic sites is defined as the distance accumulated by the smallest set of contiguous poses connecting the pair of diagnostic sites together within the hollow organ system.Type: ApplicationFiled: January 25, 2023Publication date: January 16, 2025Inventors: William E. Higgins, Trevor Kuhlengel
-
Patent number: 10667679Abstract: A global registration system and method identifies bronchoscope position without the need for significant bronchoscope maneuvers, technician intervention, or electromagnetic sensors. Virtual bronchoscopy (VB) renderings of a 3D airway tree are obtained including VB views of branch positions within the airway tree. At least one real bronchoscopic (RB) video frame is received from a bronchoscope inserted into the airway tree. An algorithm according to the invention is executed on a computer to identify the several most likely branch positions having a VB view closest to the received RB view, and the 3D position of the bronchoscope within the airway tree is determined in accordance with the branch position identified in the VB view. The preferred embodiment involves a fast local registration search over all the branches in a global airway-bifurcation search space, with the weighted normalized sum of squares distance metric used for finding the best match.Type: GrantFiled: March 22, 2018Date of Patent: June 2, 2020Assignee: The Penn State Research FoundationInventors: William E. Higgins, Rahul Khare, Scott A. Merritt
-
Patent number: 10482606Abstract: This invention relates generally to medical imaging and, in particular, to a method and system for automatic lymph node station mapping, automatic path or route report generation. A computer-based system for automatically locating the central chest lymph-node stations in a 3D MDCT image is described. Automated analysis methods extract the airway tree, airway-tree centerlines, aorta, pulmonary artery, lungs, key skeletal structures, and major-airway labels. Geometrical and anatomical cues arising from the extracted structures are used to localize the major nodal stations. The system calculates and displays the nodal stations in 3D. Visualization tools within the system enable the user to interact with the stations to locate visible lymph nodes.Type: GrantFiled: May 16, 2017Date of Patent: November 19, 2019Assignee: The Penn State Research FoundationInventors: William E. Higgins, Jason D. Gibbs, Kun-Chang Yu, Michael W. Graham, Kongkuo Lu
-
Publication number: 20180220883Abstract: A global registration system and method identifies bronchoscope position without the need for significant bronchoscope maneuvers, technician intervention, or electromagnetic sensors. Virtual bronchoscopy (VB) renderings of a 3D airway tree are obtained including VB views of branch positions within the airway tree. At least one real bronchoscopic (RB) video frame is received from a bronchoscope inserted into the airway tree. An algorithm according to the invention is executed on a computer to identify the several most likely branch positions having a VB view closest to the received RB view, and the 3D position of the bronchoscope within the airway tree is determined in accordance with the branch position identified in the VB view. The preferred embodiment involves a fast local registration search over all the branches in a global airway-bifurcation search space, with the weighted normalized sum of squares distance metric used for finding the best match.Type: ApplicationFiled: March 22, 2018Publication date: August 9, 2018Inventors: William E. Higgins, Rahul Khare, Scott A. Merritt
-
Publication number: 20170345155Abstract: This invention relates generally to medical imaging and, in particular, to a method and system for automatic lymph node station mapping, automatic path or route report generation. A computer-based system for automatically locating the central chest lymph-node stations in a 3D MDCT image is described. Automated analysis methods extract the airway tree, airway-tree centerlines, aorta, pulmonary artery, lungs, key skeletal structures, and major-airway labels. Geometrical and anatomical cues arising from the extracted structures are used to localize the major nodal stations. The system calculates and displays the nodal stations in 3D. Visualization tools within the system enable the user to interact with the stations to locate visible lymph nodes.Type: ApplicationFiled: May 16, 2017Publication date: November 30, 2017Inventors: William E. Higgins, Jason D. Gibbs, Kun-Chang Yu, Michael W. Graham, Kongkuo Lu
-
Patent number: 9757021Abstract: Two system-level bronchoscopy guidance solutions are presented. The first incorporates a global-registration algorithm to provide the physician with updated navigational and guidance information during bronchoscopy. The system can handle general navigation to a region of interest (ROI), as well as adverse events, and it requires minimal commands so that it can be directly controlled by the physician. The second solution visualizes the global picture of all the bifurcations and their relative orientations in advance and suggests the maneuvers needed by the bronchoscope to approach the ROI. Guided bronchoscopy results using human airway-tree phantoms demonstrate the potential of the two solutions.Type: GrantFiled: January 31, 2012Date of Patent: September 12, 2017Assignee: The Penn State Research FoundationInventors: William E. Higgins, Rahul Khare
-
Patent number: 9675420Abstract: Methods and apparatus assist in planning routes through hollow, branching organs in patients to optimize subsequent endoscopic procedures. Information is provided about the organ and a follow-on endoscopic procedure associated with the organ. The most appropriate navigable route or routes to a target region of interest (ROI) within the organ are then identified given anatomical, endoscopic-device, or procedure-specific constraints derived from the information provided. The method may include the step of modifying the viewing direction at each site along a route to give physically meaningful navigation directions or to reflect the requirements of a follow-on live endoscopic procedure. An existing route may further be extended, if necessary, to an ROI beyond the organ. The information provided may include anatomical constraints that define locations or organs to avoid; anatomical constraints that confine the route within specific geometric locations; or a metric for selecting the most appropriate route.Type: GrantFiled: May 18, 2015Date of Patent: June 13, 2017Assignee: The Penn State Research FoundationInventors: William E. Higgins, Jason D. Gibbs
-
Patent number: 9672631Abstract: This invention relates generally to medical imaging and, in particular, to a method and system for reconstructing a model path through a branched tubular organ. Novel methodologies and systems segment and define accurate endoluminal surfaces in airway trees, including small peripheral bronchi. An automatic algorithm is described that searches the entire lung volume for airway branches and poses airway-tree segmentation as a global graph-theoretic optimization problem. A suite of interactive segmentation tools for cleaning and extending critical areas of the automatically segmented result is disclosed. A model path is reconstructed through the airway tree.Type: GrantFiled: February 16, 2009Date of Patent: June 6, 2017Assignee: The Penn State Research FoundationInventors: William E. Higgins, Jason D. Gibbs, Kun-Chang Yu, Michael W. Graham, Kongkuo Lu
-
Publication number: 20150257847Abstract: Methods and apparatus assist in planning routes through hollow, branching organs in patients to optimize subsequent endoscopic procedures. Information is provided about the organ and a follow-on endoscopic procedure associated with the organ. The most appropriate navigable route or routes to a target region of interest (ROI) within the organ are then identified given anatomical, endoscopic-device, or procedure-specific constraints derived from the information provided. The method may include the step of modifying the viewing direction at each site along a route to give physically meaningful navigation directions or to reflect the requirements of a follow-on live endoscopic procedure. An existing route may further be extended, if necessary, to an ROI beyond the organ. The information provided may include anatomical constraints that define locations or organs to avoid; anatomical constraints that confine the route within specific geometric locations; or a metric for selecting the most appropriate route.Type: ApplicationFiled: May 18, 2015Publication date: September 17, 2015Inventors: William E. Higgins, Jason D. Gibbs
-
Patent number: 9037215Abstract: Methods and apparatus assist in planning routes through hollow, branching organs in patients to optimize subsequent endoscopic procedures. Information is provided about the organ and a follow-on endoscopic procedure associated with the organ. The most appropriate navigable route or routes to a target region of interest (ROI) within the organ are then identified given anatomical, endoscopic-device, or procedure-specific constraints derived from the information provided. The method may include the step of modifying the viewing direction at each site along a route to give physically meaningful navigation directions or to reflect the requirements of a follow-on live endoscopic procedure. An existing route may further be extended, if necessary, to an ROI beyond the organ. The information provided may include anatomical constraints that define locations or organs to avoid; anatomical constraints that confine the route within specific geometric locations; or a metric for selecting the most appropriate route.Type: GrantFiled: January 24, 2008Date of Patent: May 19, 2015Assignee: The Penn State Research FoundationInventors: William E. Higgins, Jason D. Gibbs
-
Patent number: 8672836Abstract: Methods and apparatus provide continuous guidance of endoscopy during a live procedure. A data-set based on 3D image data is pre-computed including reference information representative of a predefined route through a body organ to a final destination. A plurality of live real endoscopic (RE) images are displayed as an operator maneuvers an endoscope within the body organ. A registration and tracking algorithm registers the data-set to one or more of the RE images and continuously maintains the registration as the endoscope is locally maneuvered. Additional information related to the final destination is then presented enabling the endoscope operator to decide on a final maneuver for the procedure. The reference information may include 3D organ surfaces, 3D routes through an organ system, or 3D regions of interest (ROIs), as well as a virtual endoscopic (VE) image generated from the precomputed data-set.Type: GrantFiled: January 30, 2008Date of Patent: March 18, 2014Assignee: The Penn State Research FoundationInventors: William E. Higgins, Scott A. Merritt, Lav Rai, Jason D. Gibbs, Kun-Chang Yu
-
Patent number: 8675935Abstract: Fast and continuous registration between two imaging modalities makes it possible to completely determine the rigid transformation between multiple sources at real-time or near real-time frame-rates in order to localize video cameras and register the two sources. A set of reference images are computed or captured within a known environment, with corresponding depth maps and image gradients defining a reference source. Given one frame from a real-time or near-real time video feed, and starting from an initial guess of viewpoint, a real-time video frame is warped to the nearest viewing site of the reference source. An image difference is computed between the warped video frame and the reference image. Steps are repeated for each frame until the viewpoint converges or the next video frame becomes available. The final viewpoint gives an estimate of the relative rotation and translation between the camera at that particular video frame and the reference source.Type: GrantFiled: November 16, 2011Date of Patent: March 18, 2014Assignee: The Penn State Research FoundationInventors: William E. Higgins, Scott A. Merritt, Lav Rai
-
Publication number: 20120203067Abstract: A technician-free strategy enables real-time guidance of bronchoscopy. The approach uses measurements of the bronchoscope's movement to predict its position in 3D virtual space. To achieve this, a bronchoscope model, defining the device's shape in the airway tree to a given point p, provides an insertion depth to p. In real time, the invention compares an observed bronchoscope insertion depth and roll angle, measured by an optical sensor, to precalculated insertion depths along a predefined route in the virtual airway tree to predict a bronchoscope's location and orientation.Type: ApplicationFiled: January 31, 2012Publication date: August 9, 2012Applicant: The Penn State Research FoundationInventors: William E. Higgins, Jason D. Gibbs, Duane C. Cornish
-
Publication number: 20120203065Abstract: Two system-level bronchoscopy guidance solutions are presented. The first incorporates a global-registration algorithm to provide the physician with updated navigational and guidance information during bronchoscopy. The system can handle general navigation to a region of interest (ROI), as well as adverse events, and it requires minimal commands so that it can be directly controlled by the physician. The second solution visualizes the global picture of all the bifurcations and their relative orientations in advance and suggests the maneuvers needed by the bronchoscope to approach the ROI. Guided bronchoscopy results using human airway-tree phantoms demonstrate the potential of the two solutions.Type: ApplicationFiled: January 31, 2012Publication date: August 9, 2012Applicant: The Penn State Research FoundationInventors: William E. Higgins, Rahul Khare
-
Publication number: 20120082351Abstract: Fast and continuous registration between two imaging modalities makes it possible to completely determine the rigid transformation between multiple sources at real-time or near real-time frame-rates in order to localize video cameras and register the two sources. A set of reference images are computed or captured within a known environment, with corresponding depth maps and image gradients defining a reference source. Given one frame from a real-time or near-real time video feed, and starting from an initial guess of viewpoint, a real-time video frame is warped to the nearest viewing site of the reference source. An image difference is computed between the warped video frame and the reference image. Steps are repeated for each frame until the viewpoint converges or the next video frame becomes available. The final viewpoint gives an estimate of the relative rotation and translation between the camera at that particular video frame and the reference source.Type: ApplicationFiled: November 16, 2011Publication date: April 5, 2012Applicant: The Penn State Research FoundationInventors: William E. Higgins, Scott A. Merritt, Lav Rai