Abstract: Systems and methods for personalized sudden cardiac death risk prediction that generates fingerprints of imaging features of cardiac structure and function. One or more fingerprints and clinical data may be used to generate a risk score. The output risk score may be used to predict the time of death in order to select high-risk patients for implantable cardioverter-defibrillator treatment.

Abstract: Systems and methods for predicting a patient specific risk of cardiac events for cardiac arrhythmia are provided. A medical image sequence of a heart of a patient is received. Cardiac function features are extracted from the medical image sequence. Additional features are extracted from patient data of the patient. A patient specific risk of a cardiac event is predicted based on the extracted cardiac function features and the extracted additional features.

Abstract: The disclosure relates to a method of determining a transformation between coordinate frames of sets of image data. The method includes receiving a model of a structure extracted from first source image data, the first source image data being generated according to a first imaging modality and having a first data format, wherein the model has a second data format, different from the first data format. The method also includes determining, using an intelligent agent, a transformation between coordinate frames of the model and first target image data, the first target image data being generated according to a second imaging modality different to the first imaging modality.

Abstract: A correspondence between a source image and a reference image is determined. A generative model corresponds to a prior probability distribution of deformation fields, each deformation field corresponding to a respective coordinate transformation. A conditional model generates a style transfer probability distribution of reference images, given a source image and a deformation field. The first image data is the source image, and the second image data is the reference image. An initial first deformation field is determined. An update process is iteratively performed until convergence to update the first deformation field, to generate a converged deformation field representing the correspondence between the source image and the reference image.

Abstract: For robotically operating a catheter, translation and/or rotation manipulation is provided along the shaft or away from the handle, such as near a point of access to the patient. A worm drive arrangement may allow for both translation and rotation of the shaft. Some control may be provided by robotic manipulation of the handle, while other control (e.g., fine adjustments) are made by robotic manipulation of the shaft.

Abstract: For robotically operating a catheter, a medical catheter is controlled by rotation of the catheter as well as steering in one or more planes of a distal end of the catheter. To robotically rotate the catheter, a handle is rotated. The steering is performed separately using one or more knobs on the handle. The rotation of the handle complicates the robotic control of the knob. A mechanical decoupling is used so that rotation of the handle maintains the position of the knob relative to the handle. Gearing or transmission is used to avoid independent control of the knob and handle rotation. In an alternative or additional approach, the handle may be robotically controlled while also guiding the catheter shaft spaced away from the handle, allowing fine-tuned control of the catheter at the access point to the patient.

Abstract: A method and system for 3D/3D medical image registration. A digitally reconstructed radiograph (DRR) is rendered from a 3D medical volume based on current transformation parameters. A trained multi-agent deep neural network (DNN) is applied to a plurality of regions of interest (ROIs) in the DRR and a 2D medical image. The trained multi-agent DNN applies a respective agent to each ROI to calculate a respective set of action-values from each ROI. A maximum action-value and a proposed action associated with the maximum action value are determined for each agent. A subset of agents is selected based on the maximum action-values determined for the agents. The proposed actions determined for the selected subset of agents are aggregated to determine an optimal adjustment to the transformation parameters and the transformation parameters are adjusted by the determined optimal adjustment.

Abstract: A system and method for multi-modality fusion for 3D printing of a patient-specific organ model is disclosed. A plurality of medical images of a target organ of a patient from different medical imaging modalities are fused. A holistic mesh model of the target organ is generated by segmenting the target organ in the fused medical images from the different medical imaging modalities. One or more spatially varying physiological parameter is estimated from the fused medical images and the estimated one or more spatially varying physiological parameter is mapped to the holistic mesh model of the target organ. The holistic mesh model of the target organ is 3D printed including a representation of the estimated one or more spatially varying physiological parameter mapped to the holistic mesh model. The estimated one or more spatially varying physiological parameter can be represented in the 3D printed model using a spatially material property (e.g.

Abstract: A method of training a computer system for use in determining a transformation between coordinate frames of image data representing an imaged subject. The method trains a learning agent according to a machine learning algorithm, to determine a transformation between respective coordinate frames of a number of different views of an anatomical structure simulated using a 3D model. The views are images containing labels. The learning agent includes a domain classifier comprising a feature map generated by the learning agent during the training operation. The classifier is configured to generate a classification output indicating whether image data is synthesized or real images data. Training includes using unlabeled real image data to training the computer system to determine a transformation between a coordinate frame of a synthesized view of the imaged structure and a view of the structure within a real image.

Abstract: A method and system for 3D/3D medical image registration. A digitally reconstructed radiograph (DRR) is rendered from a 3D medical volume based on current transformation parameters. A trained multi-agent deep neural network (DNN) is applied to a plurality of regions of interest (ROIs) in the DRR and a 2D medical image. The trained multi-agent DNN applies a respective agent to each ROI to calculate a respective set of action-values from each ROI. A maximum action-value and a proposed action associated with the maximum action value are determined for each agent. A subset of agents is selected based on the maximum action-values determined for the agents. The proposed actions determined for the selected subset of agents are aggregated to determine an optimal adjustment to the transformation parameters and the transformation parameters are adjusted by the determined optimal adjustment.

Abstract: Systems and methods for performing a medical imaging analysis task using a machine learning based motion model are provided. One or more medical images of an anatomical structure are received. One or more feature vectors are determined. The one or more feature vectors are mapped to one or more motion vectors using the machine learning based motion model. One or more deformation fields representing motion of the anatomical structure are determined based on the one or more motion vectors and at least one of the one or more medical images. A medical imaging analysis task is performed using the one or more deformation fields.

Abstract: Systems and methods are provided for enhancing a medical image. An initial medical image having an initial field of view is received. An augmented medical image having an expanded field of view is generated using a trained machine learning model. The expanded field of view comprises the initial field of view and an augmentation region. The augmented medical image is output.

Abstract: In personalized object creation, for implants, medical imaging is used to derive a model personalized to a patient. The model may be of a dynamic structure, such as part of the cardiovascular system, and is used to print the implant itself. The model may be used to print a mold to create the implant, a scaffold on which to grow tissue, and/or tissue itself. In another or additional approach, the medical imaging information is used to determine tissue properties. Differences in a material property of the anatomy is mapped to different materials used by a multi-material 3D printer, resulting in a printed object reflecting the size, shape, and/or other material property of the anatomy of the patient.

Abstract: A method and system for interactive patient-specific simulation of liver tumor ablation is disclosed. A patient-specific anatomical model of the liver and circulatory system of the liver is estimated from 3D medical image data of a patient. A computational domain is generated from the patient-specific anatomical model of the liver. Blood flow in the liver and the circulatory system of the liver is simulated based on the patient-specific anatomical model. Heat diffusion due to ablation is simulated based on a virtual ablation probe position and the simulated blood flow in the liver and the circulatory system of the liver by solving a bio-heat equation for each node on the level-set representation using a Lattice-Boltzmann method (LBM) implementation. Cellular necrosis in the liver is computed based on the simulated heat diffusion. Visualizations of a computed necrosis region and temperature maps of the liver are generated.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: A method and system for estimating physiological heart measurements from medical images and clinical data disclosed. A patient-specific anatomical model of the heart is generated from medical image data of the patient. A patient-specific multi-physics computational heart model is generated based on the patient-specific anatomical model by personalizing parameters of a cardiac electrophysiology model, a cardiac biomechanics model, and a cardiac hemodynamics model based on medical image data and clinical measurements of the patient. Cardiac function of the patient is simulated using the patient-specific multi-physics computational heart model. The parameters can be personalized by inverse problem algorithms based on forward model simulations or the parameters can be personalized using a machine-learning based statistical model.

Abstract: Intelligent multi-scale image parsing determines the optimal size of each observation by an artificial agent at a given point in time while searching for the anatomical landmark. The artificial agent begins searching image data with a coarse field-of-view and iteratively decreases the field-of-view to locate the anatomical landmark. After searching at a coarse field-of view, the artificial agent increases resolution to a finer field-of-view to analyze context and appearance factors to converge on the anatomical landmark. The artificial agent determines applicable context and appearance factors at each effective scale.

Abstract: Systems and methods are provided for identifying pathological changes in follow up medical images. Reference image data is acquired. Follow up image data is acquired. A deformation field is generated for the reference image data and the follow up data using a machine-learned network trained to generate deformation fields describing healthy, anatomical deformation between input reference image data and input follow up image data. The reference image data and the follow up image data are aligned using the deformation field. The co-aligned reference image data and follow up image data are analyzed for changes due to pathological phenomena.

Abstract: A method of training a computer system for use in determining a transformation between coordinate frames of image data representing an imaged subject. The method trains a learning agent according to a machine learning algorithm, to determine a transformation between respective coordinate frames of a number of different views of an anatomical structure simulated using a 3D model. The views are images containing labels. The learning agent includes a domain classifier comprising a feature map generated by the learning agent during the training operation. The classifier is configured to generate a classification output indicating whether image data is synthesized or real images data. Training includes using unlabeled real image data to training the computer system to determine a transformation between a coordinate frame of a synthesized view of the imaged structure and a view of the structure within a real image.

Abstract: For three-dimensional rendering, a machine-learnt model is trained to generate representation vectors for rendered images formed with different rendering parameter settings. The distances between representation vectors of the images to a reference are used to select the rendered image and corresponding rendering parameters that provides a consistency with the reference. In an additional or different embodiment, optimized pseudo-random sequences are used for physically-based rendering. The random number generator seed is selected to improve the convergence speed of the renderer and to provide higher quality images, such as providing images more rapidly for training compared to using non-optimized seed selection.