Abstract: A method and system for model-based fusion of pre-operative image data and intra-operative fluoroscopic images is disclosed. A fluoroscopic image and an ultrasound image are received. The ultrasound image is mapped to a 3D coordinate system of a fluoroscopic image acquisition device used to acquire the fluoroscopic image. Contours of an anatomical structure are detected in the ultrasound image, and a transformation is calculated between the ultrasound image and a pre-operative CT image based on the contours and a patient-specific physiological model extracted from the pre-operative CT image. A final mapping is determined between the CT image and the fluoroscopic image based on the transformation between the ultrasound image and physiological model and the mapping of the ultrasound image to the 3D coordinate system of the fluoroscopic image acquisition device. The CT image or the physiological model can then be projected into the fluoroscopic image.

Abstract: A method for real-time fusion of a 2D cardiac ultrasound image with a 2D cardiac fluoroscopic image includes acquiring real time synchronized US and fluoroscopic images, detecting a surface contour of an aortic valve in the 2D cardiac ultrasound (US) image relative to an US probe, detecting a pose of the US probe in the 2D cardiac fluoroscopic image, and using pose parameters of the US probe to transform the surface contour of the aortic valve from the 2D cardiac US image to the 2D cardiac fluoroscopic image.

Abstract: A method and system for non-invasive hemodynamic assessment of aortic coarctation from medical image data, such as magnetic resonance imaging (MRI) data is disclosed. Patient-specific lumen anatomy of the aorta and supra-aortic arteries is estimated from medical image data of a patient, such as contrast enhanced MRI. Patient-specific aortic blood flow rates are estimated from the medical image data of the patient, such as velocity encoded phase-contrasted MRI cine images. Patient-specific inlet and outlet boundary conditions for a computational model of aortic blood flow are calculated based on the patient-specific lumen anatomy, the patient-specific aortic blood flow rates, and non-invasive clinical measurements of the patient. Aortic blood flow and pressure are computed over the patient-specific lumen anatomy using the computational model of aortic blood flow and the patient-specific inlet and outlet boundary conditions.

Abstract: A method and system for modeling the pulmonary trunk in 4D image data, such as 4D CT data, and model-based percutaneous pulmonary valve implantation (PPVI) intervention is disclosed. A patient-specific dynamic pulmonary trunk data is generated from 4D image data of a patient. The patient is automatically classified as suitable for PPVI intervention or not suitable for PPVI intervention based on the generated patient-specific dynamic pulmonary trunk model.

Abstract: A method and system for intraoperative guidance in an off-pump mitral valve repair procedure is disclosed. A plurality of patient-specific models of the mitral valve are generated, each from pre-operative image data obtained using a separate imaging modality. The pre-operative image data from the separate imaging modalities are fused into a common coordinate system by registering the plurality of patient-specific models. A model of the mitral valve is estimated in real-time in intraoperative image data using a fused physiological prior resulting from the registering of the plurality of patient-specific models.

Abstract: A method and system for generating a patient specific anatomical heart model is disclosed. Volumetric image data, such as computed tomography (CT), echocardiography, or magnetic resonance (MR) image data of a patient's cardiac region is received. Individual models for multiple heart components, such as the left ventricle (LV) endocardium, LV epicardium, right ventricle (RV), left atrium (LA), right atrium (RA), mitral valve, aortic valve, aorta, and pulmonary trunk, are estimated in said volumetric cardiac image data. A multi-component patient specific anatomical heart model is generated by integrating the individual models for each of the heart components. Fluid Structure Interaction (FSI) simulations are performed on the patient specific anatomical model, and patient specific clinical parameters are extracted based on the patient specific heart model and the FSI simulations. Disease progression modeling and risk stratification are performed based on the patient specific clinical parameters.

Abstract: A method and system for automatic aortic valve calcification evaluation is disclosed. A patient-specific aortic valve model in a 3D medical image volume, such as a 3D computed tomography (CT) volume. Calcifications in a region of the 3D medical image volume defined based on the aortic valve model. A 2D calcification plot is generated that shows locations of the segmented calcifications relative to aortic valve leaflets of the patient-specific aortic valve model. The 2D calcification plot can be used for assessing the suitability of a patient for a Transcatheter Aortic Valve Replacement (TAVI) procedure, as well as risk assessment, positioning of an aortic valve implant, and selection of a type of aortic valve implant.

Abstract: A method and system for model-based fusion of multi-modal volumetric images is disclosed. A first patient-specific model of an anchor anatomical structure is detected in a first medical image acquired using a first imaging modality, and a second patient-specific model of the anchor anatomical structure is detected in a second medical image acquired using a second imaging modality. A weighted mapping function is determined based on the first patient-specific model of the anchor anatomical structure and the second patient-specific model of the anchor anatomical structure using learned weights to minimize mapping error with respect to a target anatomical structure. The target anatomical structure from the first medical image to the second medical image using the weighted mapping function. In an application of this model-based fusion to transcatheter valve therapies, the trachea bifurcation is used as the anchor anatomical structure and the aortic valve is the target anatomical structure.

Abstract: A method and system for automated intervention planning for transcatheter aortic valve implantations using computed tomography (CT) data is disclosed. A patient-specific aortic valve model is detected in a CT volume of a patient. The patient-specific aortic valve model is detected by detecting a global location of the patient-specific aortic valve model in the CT volume, detecting aortic valve landmarks based on the detected global location, and fitting an aortic root surface model. Angulation parameters of a C-arm imaging device for acquiring intra-operative fluoroscopic images and anatomical measurements of the aortic valve are automatically determined based on the patient-specific aortic valve model.

Abstract: Different intracardiac echocardiography volumes are stitched together. Different volumes of a patient are scanned with ICE. To stitch the volumes together, creating a larger volume, the volumes are spatially aligned. The alignment is based on feature, surface, or both feature and surface matching of the ICE volumes with a preoperative model of the same patient. The matching with the model indicates a relative position of the ICE volumes with each other. Using machine-trained classifiers may speed performance, allowing for real-time assembling of a volume from ICE data as the catheter is moved within the patient.

Abstract: A method and system for registering ultrasound images and physiological models to x-ray fluoroscopy images is disclosed. A fluoroscopic image and an ultrasound image, such as a Transesophageal Echocardiography (TEE) image, are received. A 2D location of an ultrasound probe is detected in the fluoroscopic image. A 3D pose of the ultrasound probe is estimated based on the detected 2D location of the ultrasound probe in the fluoroscopic image. The ultrasound image is mapped to a 3D coordinate system of a fluoroscopic image acquisition device used to acquire the fluoroscopic image based on the estimated 3D pose of the ultrasound probe. The ultrasound image can then be projected into the fluoroscopic image using a projection matrix associated with the fluoroscopic image. A patient specific physiological model can be detected in the ultrasound image and projected into the fluoroscopic image.

Abstract: A method and system for fusion of multi-modal volumetric images is disclosed. A first image acquired using a first imaging modality is received. A second image acquired using a second imaging modality is received. A model and of a target anatomical structure and a transformation are jointly estimated from the first and second images. The model represents a model of the target anatomical structure in the first image and the transformation projects a model of the target anatomical structure in the second image to the model in the first image. The first and second images can be fused based on estimated transformation.

Abstract: Valve treatment simulation is performed from patient specific imaging data for therapy planning. A model of the valve may be generated from the patient specific data automatically or with very minimal user indication of anatomy locations relative to an image. Any characteristics for the valve not extracted from images of the patient may be added to create a volumetric model. Added characteristics include chordae, such as chordae length and leaflet fiber direction. The characteristics may be adjusted based on user feedback and/or comparison with images of the patient. The effect of therapy on closure of the valve may be simulated from the model. For instance, mitral clip intervention is simulated on the patient-specific model. Valves are deformed according to the clip location. Valve closure is then simulated to predict effect of the therapy in terms of mitral regurgitation.

Abstract: Physically-constrained modeling of a heart is provided. Patient-specific data may be used to estimate heart anatomy locations. A model is applied to the data for estimation. For increased accuracy of estimation, the biomechanics of the heart, such as the valve, may be used to constrain the estimation. By applying a dynamic system between estimated anatomy locations of different times, the locations may be deformed or refined. The modeled heart and/or valve may be used to estimate hemodynamics. The resulting velocities or other motion information may be used to emulate ultrasound Doppler imaging for comparing with acquired ultrasound Doppler data. The comparison may validate the modeling.

Abstract: A system and method for regression-based segmentation of the mitral valve in 2D+t cardiac magnetic resonance (CMR) slices is disclosed. The 2D+t CMR slices are acquired according to a mitral valve-specific acquisition protocol introduced herein. A set of mitral valve landmarks is detected in each 2D CMR slice and mitral valve contours are estimated in each 2D CMR slice based on the detected landmarks. A full mitral valve model is reconstructed from the mitral valve contours estimated in the 2D CMR slices using a trained regression model. Each 2D CMR slice may be a cine image acquired over a full cardiac cycle. In this case, the segmentation method reconstructs a patient-specific 4D dynamic mitral valve model from the 2D+t CMR image data.

Abstract: A method and system for generating a patient specific anatomical heart model is disclosed. A sequence of volumetric image data, such as computed tomography (CT), echocardiography, or magnetic resonance (MR) image data of a patient's cardiac region is received. A multi-component patient specific 4D geometric model of the heart and aorta estimated from the sequence of volumetric cardiac imaging data. A patient specific 4D computational model based on one or more of personalized geometry, material properties, fluid boundary conditions, and flow velocity measurements in the 4D geometric model is generated. Patient specific material properties of the aortic wall are estimated using the 4D geometrical model and the 4D computational model. Fluid Structure Interaction (FSI) simulations are performed using the 4D computational model and estimated material properties of the aortic wall, and patient specific clinical parameters are extracted based on the FSI simulations.

Abstract: A method and system for intraoperative guidance in an off-pump mitral valve repair procedure is disclosed. A plurality of patient-specific models of the mitral valve are generated, each from pre-operative image data obtained using a separate imaging modality. The pre-operative image data from the separate imaging modalities are fused into a common coordinate system by registering the plurality of patient-specific models. A model of the mitral valve is estimated in real-time in intraoperative image data using a fused physiological prior resulting from the registering of the plurality of patient-specific models.

Abstract: A method and system for patient-specific modeling of the whole heart anatomy, dynamics, hemodynamics, and fluid structure interaction from 4D medical image data is disclosed. The anatomy and dynamics of the heart are determined by estimating patient-specific parameters of a physiological model of the heart from the 4D medical image data for a patient. The patient-specific anatomy and dynamics are used as input to a 3D Navier-Stokes solver that derives realistic hemodynamics, constrained by the local anatomy, along the entire heart cycle. Fluid structure interactions are determined iteratively over the heart cycle by simulating the blood flow at a given time step and calculating the deformation of the heart structure based on the simulated blood flow, such that the deformation of the heart structure is used in the simulation of the blood flow at the next time step.

Abstract: A method and system for providing medical decision support based on virtual organ models and learning based discriminative distance functions is disclosed. A patient-specific virtual organ model is generated from medical image data of a patient. One or more similar organ models to the patient-specific organ model are retrieved from a plurality of previously stored virtual organ models using a learned discriminative distance function. The patient-specific valve model can be classified into a first class or a second class based on the previously stored organ models determined to be similar to the patient-specific organ model.

Abstract: A method and system for virtual percutaneous valve implantation is disclosed. A patient-specific anatomical model of a heart valve is estimated based on 3D cardiac medical image data and an implant model representing a valve implant is virtually deployed into the patient-specific anatomical model of the heart valve. A library of implant models, each modeling geometrical properties of a corresponding valve implant, is maintained. The implant models maintained in the library are virtually deployed into the patient specific anatomical model of the heart valve to select an implant type and size and deployment location and orientation for percutaneous valve implantation.