Abstract: A method and system for determining fractional flow reserve (FFR) for a coronary artery stenosis of a patient is disclosed. In one embodiment, medical image data of the patient including the stenosis is received, a set of features for the stenosis is extracted from the medical image data of the patient, and an FFR value for the stenosis is determined based on the extracted set of features using a trained machine-learning based mapping. In another embodiment, a medical image of the patient including the stenosis of interest is received, image patches corresponding to the stenosis of interest and a coronary tree of the patient are detected, an FFR value for the stenosis of interest is determined using a trained deep neural network regressor applied directly to the detected image patches.

Abstract: The present invention relates to an improved method for marker-free detection of a cell type of at least one cell in a medium using microfluidics and digital holographic microscopy, as well as a device, particular for carrying out the method.

Abstract: A computer-implemented method for deriving biopsy results in a non-invasive manner includes acquiring a plurality of training data items. Each training data item comprises non-invasive patient data and one or more biopsy derived scores associated with an individual. The method further includes extracting a plurality of features from the non-invasive patient data based on the one or more biopsy derived scores and training a predictive model to generate a predicted biopsy score based on the plurality of features and the one or more biopsy derived scores.

Abstract: A method and system for interactive patient-specific simulation of liver tumor ablation is disclosed. A patient-specific anatomical model of the liver and circulatory system of the liver is estimated from 3D medical image data of a patient. A computational domain is generated from the patient-specific anatomical model of the liver. Blood flow in the liver and the circulatory system of the liver is simulated based on the patient-specific anatomical model. Heat diffusion due to ablation is simulated based on a virtual ablation probe position and the simulated blood flow in the liver and the circulatory system of the liver by solving a bio-heat equation for each node on the level-set representation using a Lattice-Boltzmann method (LBM) implementation. Cellular necrosis in the liver is computed based on the simulated heat diffusion. Visualizations of a computed necrosis region and temperature maps of the liver are generated.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: A method and system for estimating physiological heart measurements from medical images and clinical data disclosed. A patient-specific anatomical model of the heart is generated from medical image data of the patient. A patient-specific multi-physics computational heart model is generated based on the patient-specific anatomical model by personalizing parameters of a cardiac electrophysiology model, a cardiac biomechanics model, and a cardiac hemodynamics model based on medical image data and clinical measurements of the patient. Cardiac function of the patient is simulated using the patient-specific multi-physics computational heart model. The parameters can be personalized by inverse problem algorithms based on forward model simulations or the parameters can be personalized using a machine-learning based statistical model.

Abstract: A computer-implemented method is for displaying a graphical user interface containing a selection element to select one risk assessment computer program out of a patient-related subset of a plurality of risk assessment computer programs of a patient on a display unit for an user. In an embodiment, the method includes retrieving a set of disease-related workflows; retrieving a plurality of risk assessment computer programs; selecting a disease-related dataset from the patient-related data record; determining at least one of the disease-related workflow stages from the set of disease-related workflows based on the selected disease-related dataset; determining a patient-related subset of the plurality of risk assessment computer programs based on the determined at least one of the disease-related workflow stage; and displaying the graphical user interface.

Abstract: A method and system for calculating a volume of resected tissue from a stream of intraoperative images is disclosed. A stream of 2D/2.5D intraoperative images of resected tissue of a patient is received. The 2D/2.5D intraoperative images in the stream are acquired at different angles with respect to the resected tissue. A resected tissue surface is segmented in each of the 2D/2.5D intraoperative images. The segmented resected tissue surfaces are stitched to generate a 3D point cloud representation of the resected tissue surface. A 3D mesh representation of the resected tissue surface is generated from the 3D point cloud representation of the resected tissue surface. The volume of the resected tissue is calculated from the 3D mesh representation of the resected tissue surface.

Abstract: A method for analyzing digital holographic microscopy (DHM) data for hematology applications includes receiving a DHM image acquired using a digital holographic microscopy system and identifying one or more erythrocytes in the DHM image. For each respective erythrocyte included in the one or more erythrocytes, a cell thickness value for the respective erythrocyte using a parametric model is estimated, and a cell volume value is calculated for the respective erythrocyte using the cell thickness value.

Abstract: In order to reduce computation time and provide more accurate solutions for bi-directional, multi-modal image registration, a learning-based unsupervised multi-modal deformable image registration method that does not require any aligned image pairs or anatomical landmarks is provided. A bi-directional registration function is learned based on disentangled shape representation by optimizing a similarity criterion defined on both latent space and image space.

Abstract: A cell visualization system includes a digital holographic microscopy (DHM) device, a training device, and a virtual staining device. The DHM device produces DHM images of cells and the virtual staining device colorizes the DHM images based on an algorithm generated by the training device using generative adversarial networks and unpaired training data. A computer-implemented method for producing a virtually stained DHM image includes acquiring an image conversion algorithm which was trained using the generative adversarial networks, receiving a DHM image with depictions of one or more cells and virtually staining the DHM image by processing the DHM image using the image conversion algorithm. The virtually stained DHM image includes digital colorization of the one or more cells to imitate the appearance of a corresponding actually stained cell.

Abstract: A system for performing adaptive focusing of a microscopy device comprises a microscopy device configured to acquire microscopy images depicting cells and one or more processors executing instructions for performing a method that includes extracting pixels from the microscopy images. Each set of pixels corresponds to an independent cell. The method further includes using a trained classifier to assign one of a plurality of image quality labels to each set of pixels indicating the degree to which the independent cell is in focus. If the image quality labels corresponding to the sets of pixels indicate that the cells are out of focus, a focal length adjustment for adjusting focus of the microscopy device is determined using a trained machine learning model. Then, executable instructions are sent to the microscopy device to perform the focal length adjustment.

Abstract: Systems and methods for image classification include receiving imaging data of in-vivo or excised tissue of a patient during a surgical procedure. Local image features are extracted from the imaging data. A vocabulary histogram for the imaging data is computed based on the extracted local image features. A classification of the in-vivo or excised tissue of the patient in the imaging data is determined based on the vocabulary histogram using a trained classifier, which is trained based on a set of sample images with confirmed tissue types.

Abstract: A method for analyzing digital holographic microscopy (DHM) data for hematology applications includes receiving a plurality of DHM images acquired using a digital holographic microscopy system. One or more connected components are identified in each of the plurality of DHM images and one or more training white blood cell images are generated from the one or more connected components. A classifier is trained to identify a plurality of white blood cell types using the one or more training white blood cell images. The classifier may be applied to a new white blood cell image to determine a plurality of probability values, each respective probability value corresponding to one of the plurality of white blood cell types. The new white blood cell image and the plurality of probability values may then be presented in a graphical user interface.

Abstract: Systems and methods for image classification include receiving imaging data of in-vivo or excised tissue of a patient during a surgical procedure. Local image features are extracted from the imaging data. A vocabulary histogram for the imaging data is computed based on the extracted local image features. A classification of the in-vivo or excised tissue of the patient in the imaging data is determined based on the vocabulary histogram using a trained classifier, which is trained based on a set of sample images with confirmed tissue types.

Abstract: Embodiments relate to non-invasively determining coronary circulation parameters during a rest state and a hyperemic state for a patient. The blood flow in the coronary arteries during a hyperemic state provides a functional assessment of the patient's coronary vessel tree. Imaging techniques are used to obtain an anatomical model of the patient's coronary tree. Rest boundary conditions are computed based on non-invasive measurements taken at a rest state, and estimated hyperemic boundary conditions are computed. A feedback control system performs a simulation matching the rest state utilizing a model based on the anatomical model and a plurality of controllers, each controller relating to respective output variables of the coronary tree. The model parameters are adjusted for the output variables to be in agreement with the rest state measurements, and the hyperemic boundary conditions are accordingly adjusted.

Abstract: A computer-implemented method for performing deformable registration between Magnetic Resonance (MR) and Ultrasound (US) images include receiving an MR volume depicting an organ and segmenting the organ from the MR volume to yield a first 3D point representation of the organ in MR coordinates. Additionally, a US volume depicting an organ is received and the organ is segmented from the US volume to yield a second 3D point representation of the organ in US coordinates. Next, a plurality of point correspondences between the first 3D point representation and the second 3D point representation are determined. Then, a biomechanical model is applied to register the MR volume to the US volume. The plurality of point correspondences are used as displacement boundary conditions for the biomechanical model.

Abstract: A cell visualization system includes a digital holographic microscopy (DHM) device, a training device, and a virtual staining device. The DHM device produces DHM images of cells and the virtual staining device colorizes the DHM images based on an algorithm generated by the training device using generative adversarial networks and unpaired training data. A computer-implemented method for producing a virtually stained DHM image includes acquiring an image conversion algorithm which was trained using the generative adversarial networks, receiving a DHM image with depictions of one or more cells and virtually staining the DHM image by processing the DHM image using the image conversion algorithm. The virtually stained DHM image includes digital colorization of the one or more cells to imitate the appearance of a corresponding actually stained cell.

Abstract: For decision support in a medical therapy, machine learning provides a machine-learned generator for generating a prediction of outcome for therapy personalized to a patient. The outcome prediction may be used to determine dose. To assist in decision support, a regression analysis of the cohort used for machine training relates the outcome from the machine-learned generator to the dose and an actual control time (e.g., time-to-event). The dose that minimizes side effects while minimizing risk of failure to a time for any given patient is determined from the outcome for that patient and a calibration from the regression analysis.

Abstract: Imaging from sequential scans is aligned based on patient information. A three-dimensional distribution of a patient-related object or objects, such as an outer surface of the patient or an organ in the patient, is stored with any results (e.g., images and/or measurements). Rather than the entire scan volume, the three-dimensional distributions from the different scans are used to align between the scans. The alignment allows diagnostically useful comparison between the scans, such as guiding an imaging technician to more rapidly determine the location of a same lesion for size comparison.