Patents by Inventor Xiaoyao Fan
Xiaoyao Fan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230320649Abstract: A surgical guidance system has two cameras to provide stereo image stream of a surgical field; and a stereo viewer. The system has a 3D surface extraction module that generates a first 3D model of the surgical field from the stereo image streams; a registration module for co-registering annotating data with the first 3D model; and a stereo image enhancer for graphically overlaying at least part of the annotating data onto the stereo image stream to form an enhanced stereo image stream for display, where the enhanced stereo stream enhances a surgeon’s perception of the surgical field. The registration module has an alignment refiner to adjust registration of the annotating data with the 3D model based upon matching of features within the 3D model and features within the annotating data; and in an embodiment, a deformation modeler to deform the annotating data based upon a determined tissue deformation.Type: ApplicationFiled: May 31, 2023Publication date: October 12, 2023Applicant: The Trustees of Dartmouth CollegeInventors: David W. ROBERTS, Keith D. PAULSEN, Alexander HARTOV, Songbai JI, Xiaoyao FAN
-
Patent number: 11690558Abstract: A surgical guidance system has two cameras to provide stereo image stream of a surgical field; and a stereo viewer. The system has a 3D surface extraction module that generates a first 3D model of the surgical field from the stereo image streams; a registration module for co-registering annotating data with the first 3D model; and a stereo image enhancer for graphically overlaying at least part of the annotating data onto the stereo image stream to form an enhanced stereo image stream for display, where the enhanced stereo stream enhances a surgeon's perception of the surgical field. The registration module has an alignment refiner to adjust registration of the annotating data with the 3D model based upon matching of features within the 3D model and features within the annotating data; and in an embodiment, a deformation modeler to deform the annotating data based upon a determined tissue deformation.Type: GrantFiled: September 27, 2021Date of Patent: July 4, 2023Assignee: The Trustees of Dartmouth CollegeInventors: David W. Roberts, Keith D. Paulsen, Alexander Hartov, Songbai Ji, Xiaoyao Fan
-
Patent number: 11406471Abstract: This invention provides a hand-held stereovision (HHS) system that is an efficient, accurate, and radiation-free imaging device to acquire intraoperative profiles of the exposed spine in prone position. The reconstructed intraoperative stereovision surfaces (iSV) are registered with preoperative CT (pCT; supine position) in a nonrigid fashion to generate updated CT images (uCT) and correct for vertebral posture and alignment changes. Updated CT images are uploaded to a commercial navigation system for surgical navigation.Type: GrantFiled: October 7, 2019Date of Patent: August 9, 2022Assignee: The Trustees of Dartmouth CollegeInventors: Keith D. Paulsen, Xiaoyao Fan, Songbai Ji, Sohail K. Mirza
-
Publication number: 20220007991Abstract: A surgical guidance system has two cameras to provide stereo image stream of a surgical field; and a stereo viewer. The system has a 3D surface extraction module that generates a first 3D model of the surgical field from the stereo image streams; a registration module for co-registering annotating data with the first 3D model; and a stereo image enhancer for graphically overlaying at least part of the annotating data onto the stereo image stream to form an enhanced stereo image stream for display, where the enhanced stereo stream enhances a surgeon's perception of the surgical field. The registration module has an alignment refiner to adjust registration of the annotating data with the 3D model based upon matching of features within the 3D model and features within the annotating data; and in an embodiment, a deformation modeler to deform the annotating data based upon a determined tissue deformation.Type: ApplicationFiled: September 27, 2021Publication date: January 13, 2022Inventors: David W. ROBERTS, Keith D. PAULSEN, Alexander HARTOV, Songbai JI, Xiaoyao FAN
-
Patent number: 11129562Abstract: A surgical guidance system has two cameras to provide stereo image stream of a surgical field; and a stereo viewer. The system has a 3D surface extraction module that generates a first 3D model of the surgical field from the stereo image streams; a registration module for co-registering annotating data with the first 3D model; and a stereo image enhancer for graphically overlaying at least part of the annotating data onto the stereo image stream to form an enhanced stereo image stream for display, where the enhanced stereo stream enhances a surgeon's perception of the surgical field. The registration module has an alignment refiner to adjust registration of the annotating data with the 3D model based upon matching of features within the 3D model and features within the annotating data; and in an embodiment, a deformation modeler to deform the annotating data based upon a determined tissue deformation.Type: GrantFiled: February 10, 2020Date of Patent: September 28, 2021Assignee: THE TRUSTEES OF DARTMOUTH COLLEGEInventors: David W. Roberts, Keith D. Paulsen, Alexander Hartov, Songbai Ji, Xiaoyao Fan
-
Publication number: 20200170535Abstract: A surgical guidance system has two cameras to provide stereo image stream of a surgical field; and a stereo viewer. The system has a 3D surface extraction module that generates a first 3D model of the surgical field from the stereo image streams; a registration module for co-registering annotating data with the first 3D model; and a stereo image enhancer for graphically overlaying at least part of the annotating data onto the stereo image stream to form an enhanced stereo image stream for display, where the enhanced stereo stream enhances a surgeon's perception of the surgical field. The registration module has an alignment refiner to adjust registration of the annotating data with the 3D model based upon matching of features within the 3D model and features within the annotating data; and in an embodiment, a deformation modeler to deform the annotating data based upon a determined tissue deformation.Type: ApplicationFiled: February 10, 2020Publication date: June 4, 2020Inventors: David W. ROBERTS, Keith D. PAULSEN, Alexander HARTOV, Songbai JI, Xiaoyao FAN
-
Patent number: 10568535Abstract: A surgical guidance system has two cameras to provide stereo image stream of a surgical field; and a stereo viewer. The system has a 3D surface extraction module that generates a first 3D model of the surgical field from the stereo image streams; a registration module for co-registering annotating data with the first 3D model; and a stereo image enhancer for graphically overlaying at least part of the annotating data onto the stereo image stream to form an enhanced stereo image stream for display, where the enhanced stereo stream enhances a surgeon's perception of the surgical field. The registration module has an alignment refiner to adjust registration of the annotating data with the 3D model based upon matching of features within the 3D model and features within the annotating data; and in an embodiment, a deformation modeler to deform the annotating data based upon a determined tissue deformation.Type: GrantFiled: December 2, 2016Date of Patent: February 25, 2020Assignee: THE TRUSTEES OF DARTMOUTH COLLEGEInventors: David W. Roberts, Keith D. Paulsen, Alexander Hartov, Songbai Ji, Xiaoyao Fan
-
Patent number: 9456200Abstract: A system for, and method of, extracting a surface profile from a stereo pair of images obtained at an arbitrary setting S of an optical system, includes determining surface profile reconstruction parameters for images obtained with the optical system at a reference setting So of the optical system; determining warping parameters for a digital image processor for warping images obtained with the optical system at the arbitrary setting S into images corresponding to the reference setting So; obtaining the stereo pair of images from at least one camera of the optical system; warping the stereo pair of images into images corresponding to the reference setting So, and using the surface profile reconstruction parameters to determine the surface profile. In a particular embodiment, the surface profile is passed to a computer model of tissue deformation and used to determine an intra-surgery location of a tumor or other anatomic feature of tissue.Type: GrantFiled: January 4, 2013Date of Patent: September 27, 2016Assignee: THE TRUSTEES OF DARTMOUTH COLLEGEInventors: Songbai Ji, Xiaoyao Fan, Keith D. Paulsen, David W. Roberts, Alex Hartov
-
Patent number: 9336592Abstract: A system and method for determining intraoperative locations of a lesion in tissue from lesion locations determined in preoperative imaging includes determining three dimensional locations of surface features of the organ in the preoperative images. A preoperative surface map is extracted from stereo images annotated with surface features from preoperative images. An intraoperative surface map of the organ is extracted from stereo images, and surface features are identified in the stereo images corresponding to surface features annotated into the preoperative surface map. Three dimensional displacements of the surface features are determined and used to constrain a computer model of deformation of the organ. In embodiments, the model of deformation is adapted or constrained to model locations and dimensions of surgical cavities using an optical flow method and/or locations of surgical instruments in the organ. The model of deformation is used to determine intraoperative locations for the lesion.Type: GrantFiled: February 1, 2013Date of Patent: May 10, 2016Assignee: THE TRUSTEES OF DARTMOUTH COLLEGEInventors: Xiaoyao Fan, David W. Roberts, Keith D. Paulsen, Songbai Ji, Alex Hartov
-
Publication number: 20140369584Abstract: A system and method for determining intraoperative locations of a lesion in tissue from lesion locations determined in preoperative imaging includes determining three dimensional locations of surface features of the organ in the preoperative images. A preoperative surface map is extracted from stereo images annotated with surface features from preoperative images. An intraoperative surface map of the organ is extracted from stereo images, and surface features are identified in the stereo images corresponding to surface features annotated into the preoperative surface map. Three dimensional displacements of the surface features are determined and used to constrain a computer model of deformation of the organ. In embodiments, the model of deformation is adapted or constrained to model locations and dimensions of surgical cavities using an optical flow method and/or locations of surgical instruments in the organ. The model of deformation is used to determine intraoperative locations for the lesion.Type: ApplicationFiled: February 1, 2013Publication date: December 18, 2014Inventors: Xiaoyao Fan, David W. Roberts, Keith D. Paulsen, Songbai Ji, Alex Hartov
-
Publication number: 20140362186Abstract: A system for, and method of, extracting a surface profile from a stereo pair of images obtained at an arbitrary setting S of an optical system, includes determining surface profile reconstruction parameters for images obtained with the optical system at a reference setting So of the optical system; determining warping parameters for a digital image processor for warping images obtained with the optical system at the arbitrary setting S into images corresponding to the reference setting So; obtaining the stereo pair of images from at least one camera of the optical system; warping the stereo pair of images into images corresponding to the reference setting So, and using the surface profile reconstruction parameters to determine the surface profile. In a particular embodiment, the surface profile is passed to a computer model of tissue deformation and used to determine an intra-surgery location of a tumor or other anatomic feature of tissue.Type: ApplicationFiled: January 4, 2013Publication date: December 11, 2014Applicant: THE TRUSTEES OF DARTMOUTH COLLEGEInventors: Songbai Ji, Xiaoyao Fan, Keith D. Paulsen, David W. Roberts, Alex Hartov