Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: Systems and methods for predicting a patient specific risk of cardiac events for cardiac arrhythmia are provided. A medical image sequence of a heart of a patient is received. Cardiac function features are extracted from the medical image sequence. Additional features are extracted from patient data of the patient. A patient specific risk of a cardiac event is predicted based on the extracted cardiac function features and the extracted additional features.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: CT and PET are registered, providing a spatial alignment to be used in attenuation correction for PET reconstruction. A model for machine learning is defined to generate a deformation field. The model is trained with loss based, in part, on the attenuation corrected PET data rather than or in addition to loss based on the uncorrected PET or the generated deformation field. Due to the nature of the mapping from CT to attenuation, a separate, pre-trained network is used to form the attenuation corrected PET data in training the model.

Abstract: For registration of medical images with deep learning, a neural network is designed to include a diffeomorphic layer in the architecture. The network may be trained using supervised or unsupervised approaches. By enforcing the diffeomorphic characteristic in the architecture of the network, the training of the network and application of the learned network may provide for more regularized and realistic registration.

Abstract: Systems and methods for medical image registration are provided. A first input medical image and a second input medical image of one or more anatomical objects arc received. For each respective anatomical object of the one or more anatomical objects, a region of interest comprising the respective anatomical object is detected in one of the first input medical image or the second input medical image, the region of interest is extracted from the first input medical image and from the second input medical image, and a motion distribution of the respective anatomical object is determined from one of the region of interest extracted from the first input medical image or the region of interest extracted from the second input medical image using a motion model specific to the respective anatomical object. The first input medical image and the second input medical image are registered based on the motion distribution of each respective anatomical object of the one or more anatomical objects to generate a fused image.

Abstract: Systems and methods for performing a medical imaging analysis task using a machine learning based motion model are provided. One or more medical images of an anatomical structure are received. One or more feature vectors are determined. The one or more feature vectors are mapped to one or more motion vectors using the machine learning based motion model. One or more deformation fields representing motion of the anatomical structure are determined based on the one or more motion vectors and at least one of the one or more medical images. A medical imaging analysis task is performed using the one or more deformation fields.

Abstract: Systems and methods for personalized sudden cardiac death risk prediction that generates fingerprints of imaging features of cardiac structure and function. One or more fingerprints and clinical data may be used to generate a risk score. The output risk score may be used to predict the time of death in order to select high-risk patients for implantable cardioverter-defibrillator treatment.

Abstract: CT and PET are registered, providing a spatial alignment to be used in attenuation correction for PET reconstruction. A model for machine learning is defined to generate a deformation field. The model is trained with loss based, in part, on the attenuation corrected PET data rather than or in addition to loss based on the uncorrected PET or the generated deformation field. Due to the nature of the mapping from CT to attenuation, a separate, pre-trained network is used to form the attenuation corrected PET data in training the model.

Abstract: Systems and methods for personalized sudden cardiac death risk prediction that generates fingerprints of imaging features of cardiac structure and function. One or more fingerprints and clinical data may be used to generate a risk score. The output risk score may be used to predict the time of death in order to select high-risk patients for implantable cardioverter-defibrillator treatment.

Abstract: Systems and methods for predicting a patient specific risk of cardiac events for cardiac arrhythmia are provided. A medical image sequence of a heart of a patient is received. Cardiac function features are extracted from the medical image sequence. Additional features are extracted from patient data of the patient. A patient specific risk of a cardiac event is predicted based on the extracted cardiac function features and the extracted additional features.

Abstract: Systems and methods for performing a medical imaging analysis task using a machine learning based motion model are provided. One or more medical images of an anatomical structure are received. One or more feature vectors are determined. The one or more feature vectors are mapped to one or more motion vectors using the machine learning based motion model. One or more deformation fields representing motion of the anatomical structure are determined based on the one or more motion vectors and at least one of the one or more medical images. A medical imaging analysis task is performed using the one or more deformation fields.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: A method and system for computer-based motion estimation and modeling in a medical image sequence of a patient is disclosed. A medical image sequence of a patient is received. A plurality of frames of the medical image sequence are input to a trained deep neural network. Diffeomorphic deformation fields representing estimated motion between the frames of the medical image sequence input to the trained deep neural network are generated. Future motion, or motion between frames, is predicted from the medical image sequence and at least one predicted next frame is generated using the trained deep neural network. An encoding of the observed motion in the medical image sequence is also generated, which is used for motion classification (e.g., normal or abnormal) or motion synthesis to generate synthetic data.

Abstract: Embodiments can provide a method for atlas-based contouring, comprising constructing a relevant atlas database; selecting one or more optimal atlases from the relevant atlas database; propagating one or more atlases; fusing the one or more atlases; and assessing the quality of one or more propagated contours.

Abstract: A method and system for computer-based motion estimation and modeling in a medical image sequence of a patient is disclosed. A medical image sequence of a patient is received. A plurality of frames of the medical image sequence are input to a trained deep neural network. Diffeomorphic deformation fields representing estimated motion between the frames of the medical image sequence input to the trained deep neural network are generated. Future motion, or motion between frames, is predicted from the medical image sequence and at least one predicted next frame is generated using the trained deep neural network. An encoding of the observed motion in the medical image sequence is also generated, which is used for motion classification (e.g., normal or abnormal) or motion synthesis to generate synthetic data.

Abstract: For registration of medical images with deep learning, a neural network is designed to include a diffeomorphic layer in the architecture. The network may be trained using supervised or unsupervised approaches. By enforcing the diffeomorphic characteristic in the architecture of the network, the training of the network and application of the learned network may provide for more regularized and realistic registration.

Abstract: Embodiments can provide a method for atlas-based contouring, comprising constructing a relevant atlas database; selecting one or more optimal atlases from the relevant atlas database; propagating one or more atlases; fusing the one or more atlases; and assessing the quality of one or more propagated contours.