Abstract: Systems and methods for generating a synthetic image are provided. An input medical image in a first modality is received. A synthetic image in a second modality is generated from the input medical image. The synthetic image is upsampled to increase a resolution of the synthetic image. An output image is generated to simulate image processing of the upsampled synthetic image. The output image is output.

Abstract: Systems and methods for generating a synthesized medical image are provided. An input medical image is received. A synthesized segmentation mask is generated. The input medical image is masked based on the synthesized segmentation mask. The masked input medical image has an unmasked portion and a masked portion. An initial synthesized medical image is generated using a trained machine learning based generator network. The initial synthesized medical image includes a synthesized version of the unmasked portion of the masked input medical image and synthesized patterns in the masked portion of the masked input medical image. The synthesized patterns is fused with the input medical image to generate a final synthesized medical image.

Abstract: Systems and methods for automatically navigating a catheter in a patient are provided. An image of a current view of a catheter in a patient is received. A set of actions of a robotic navigation system for navigating the catheter from the current view towards a target view is determined using a machine learning based network. The catheter is automatically navigated in the patient from the current view towards the target view using the robotic navigation system based on the set of actions.

Abstract: DCE MR images are obtained from a MR scanner and under a free-breathing protocol is provided. A neural network assigns a perfusion metric to DCE MR images. The neural network includes an input layer configured to receive at least one DCE MR image representative of a first contrast enhancement state and of a first respiratory motion state and at least one further DCE MR image representative of a second contrast enhancement state and of a second respiratory motion state. The neural network further includes an output layer configured to output at least one perfusion metric based on the at least one DCE MR image and the at least one further DCE MR image. The neural network with interconnections between the input layer and the output layer is trained by a plurality of datasets, each of the datasets having an instance of the at least one DCE MR image and of the at least one further DCE MR image for the input layer and the at least one perfusion metric for the output layer.

Abstract: CT and PET are registered, providing a spatial alignment to be used in attenuation correction for PET reconstruction. A model for machine learning is defined to generate a deformation field. The model is trained with loss based, in part, on the attenuation corrected PET data rather than or in addition to loss based on the uncorrected PET or the generated deformation field. Due to the nature of the mapping from CT to attenuation, a separate, pre-trained network is used to form the attenuation corrected PET data in training the model.

Abstract: Systems and methods for generating a synthetic image are provided. An input medical image in a first modality is received. A synthetic image in a second modality is generated from the input medical image. The synthetic image is upsampled to increase a resolution of the synthetic image. An output image is generated to simulate image processing of the upsampled synthetic image. The output image is output.

Abstract: Systems and methods for assessing a disease are provided. Medical imaging data of lungs of a patient is received. The lungs are segmented from the medical imaging data and abnormality regions associated with a disease are segmented from the medical imaging data. An assessment of the disease is determined based on the segmented lungs and the segmented abnormality regions. The disease may be COVID-19 (coronavirus disease 2019) or diseases, such as, e.g., SARS (severe acute respiratory syndrome), MERS (Middle East respiratory syndrome), or other types of viral and non-viral pneumonia.

Abstract: Systems and methods for medical image registration are provided. A first input medical image and a second input medical image of one or more anatomical objects arc received. For each respective anatomical object of the one or more anatomical objects, a region of interest comprising the respective anatomical object is detected in one of the first input medical image or the second input medical image, the region of interest is extracted from the first input medical image and from the second input medical image, and a motion distribution of the respective anatomical object is determined from one of the region of interest extracted from the first input medical image or the region of interest extracted from the second input medical image using a motion model specific to the respective anatomical object. The first input medical image and the second input medical image are registered based on the motion distribution of each respective anatomical object of the one or more anatomical objects to generate a fused image.

Abstract: A method and system for 3D/3D medical image registration. A digitally reconstructed radiograph (DRR) is rendered from a 3D medical volume based on current transformation parameters. A trained multi-agent deep neural network (DNN) is applied to a plurality of regions of interest (ROIs) in the DRR and a 2D medical image. The trained multi-agent DNN applies a respective agent to each ROI to calculate a respective set of action-values from each ROI. A maximum action-value and a proposed action associated with the maximum action value are determined for each agent. A subset of agents is selected based on the maximum action-values determined for the agents. The proposed actions determined for the selected subset of agents are aggregated to determine an optimal adjustment to the transformation parameters and the transformation parameters are adjusted by the determined optimal adjustment.

Abstract: Systems and methods for generating a synthesized medical image are provided. An input medical image is received. A synthesized segmentation mask is generated. The input medical image is masked based on the synthesized segmentation mask. The masked input medical image has an unmasked portion and a masked portion. An initial synthesized medical image is generated using a trained machine learning based generator network. The initial synthesized medical image includes a synthesized version of the unmasked portion of the masked input medical image and synthesized patterns in the masked portion of the masked input medical image. The synthesized patterns is fused with the input medical image to generate a final synthesized medical image.

Abstract: Systems and methods for assessing a disease are provided. Medical imaging data of lungs of a patient is received. The lungs are segmented from the medical imaging data and abnormality regions associated with a disease are segmented from the medical imaging data. An assessment of the disease is determined based on the segmented lungs and the segmented abnormality regions. The disease may be COVID-19 (coronavirus disease 2019) or diseases, such as, e.g., SARS (severe acute respiratory syndrome), MERS (Middle East respiratory syndrome), or other types of viral and non-viral pneumonia.

Abstract: In a method and apparatus for training a computer system for use in classification of an image by processing image data representing the image, image data are compressed and then loaded into a programmable quantum annealing device that includes a Restricted Boltzmann Machine. The Restricted Boltzmann Machine is trained to act as a classifier of image data, thereby providing a trained Restricted Boltzmann Machine; and, the trained Restricted Boltzmann Machine is used to initialize a neural network for image classification thereby providing a trained computer system for use in classification of an image.

Abstract: CT and PET are registered, providing a spatial alignment to be used in attenuation correction for PET reconstruction. A model for machine learning is defined to generate a deformation field. The model is trained with loss based, in part, on the attenuation corrected PET data rather than or in addition to loss based on the uncorrected PET or the generated deformation field. Due to the nature of the mapping from CT to attenuation, a separate, pre-trained network is used to form the attenuation corrected PET data in training the model.

Abstract: A method and system for 3D/3D medical image registration. A digitally reconstructed radiograph (DRR) is rendered from a 3D medical volume based on current transformation parameters. A trained multi-agent deep neural network (DNN) is applied to a plurality of regions of interest (ROIs) in the DRR and a 2D medical image. The trained multi-agent DNN applies a respective agent to each ROI to calculate a respective set of action-values from each ROI. A maximum action-value and a proposed action associated with the maximum action value are determined for each agent. A subset of agents is selected based on the maximum action-values determined for the agents. The proposed actions determined for the selected subset of agents are aggregated to determine an optimal adjustment to the transformation parameters and the transformation parameters are adjusted by the determined optimal adjustment.

Abstract: A method of training a computer system for use in determining a transformation between coordinate frames of image data representing an imaged subject. The method trains a learning agent according to a machine learning algorithm, to determine a transformation between respective coordinate frames of a number of different views of an anatomical structure simulated using a 3D model. The views are images containing labels. The learning agent includes a domain classifier comprising a feature map generated by the learning agent during the training operation. The classifier is configured to generate a classification output indicating whether image data is synthesized or real images data. Training includes using unlabeled real image data to training the computer system to determine a transformation between a coordinate frame of a synthesized view of the imaged structure and a view of the structure within a real image.

Abstract: A method and system for 3D/3D medical image registration. A digitally reconstructed radiograph (DRR) is rendered from a 3D medical volume based on current transformation parameters. A trained multi-agent deep neural network (DNN) is applied to a plurality of regions of interest (ROIs) in the DRR and a 2D medical image. The trained multi-agent DNN applies a respective agent to each ROI to calculate a respective set of action-values from each ROI. A maximum action-value and a proposed action associated with the maximum action value are determined for each agent. A subset of agents is selected based on the maximum action-values determined for the agents. The proposed actions determined for the selected subset of agents are aggregated to determine an optimal adjustment to the transformation parameters and the transformation parameters are adjusted by the determined optimal adjustment.

Abstract: A method of training a computer system for use in determining a transformation between coordinate frames of image data representing an imaged subject. The method trains a learning agent according to a machine learning algorithm, to determine a transformation between respective coordinate frames of a number of different views of an anatomical structure simulated using a 3D model. The views are images containing labels. The learning agent includes a domain classifier comprising a feature map generated by the learning agent during the training operation. The classifier is configured to generate a classification output indicating whether image data is synthesized or real images data. Training includes using unlabeled real image data to training the computer system to determine a transformation between a coordinate frame of a synthesized view of the imaged structure and a view of the structure within a real image.

Abstract: In a method and apparatus for training a computer system for use in classification of an image by processing image data representing the image, image data are compressed and then loaded into a programmable quantum annealing device that includes a Restricted Boltzmann Machine. The Restricted Boltzmann Machine is trained to act as a classifier of image data, thereby providing a trained Restricted Boltzmann Machine; and, the trained Restricted Boltzmann Machine is used to initialize a neural network for image classification thereby providing a trained computer system for use in classification of an image.

Abstract: A method and system for 3D/3D medical image registration. A digitally reconstructed radiograph (DRR) is rendered from a 3D medical volume based on current transformation parameters. A trained multi-agent deep neural network (DNN) is applied to a plurality of regions of interest (ROIs) in the DRR and a 2D medical image. The trained multi-agent DNN applies a respective agent to each ROI to calculate a respective set of action-values from each ROI. A maximum action-value and a proposed action associated with the maximum action value are determined for each agent. A subset of agents is selected based on the maximum action-values determined for the agents. The proposed actions determined for the selected subset of agents are aggregated to determine an optimal adjustment to the transformation parameters and the transformation parameters are adjusted by the determined optimal adjustment.