Abstract: Systems and methods are provided for automatic segmentation of a vessel. A sequence of image slices containing a vessel is acquired. Features maps are generated for each of the image slices using a trained fully convolutional neural network. A trained bi-directional recurrent neural network generates a segmented image based on the feature maps.

Abstract: A method and system for determining fractional flow reserve (FFR) for a coronary artery stenosis of a patient is disclosed. In one embodiment, medical image data of the patient including the stenosis is received, a set of features for the stenosis is extracted from the medical image data of the patient, and an FFR value for the stenosis is determined based on the extracted set of features using a trained machine-learning based mapping. In another embodiment, a medical image of the patient including the stenosis of interest is received, image patches corresponding to the stenosis of interest and a coronary tree of the patient are detected, an FFR value for the stenosis of interest is determined using a trained deep neural network regressor applied directly to the detected image patches.

Abstract: For topogram predication from surface data, a sensor captures the outside surface of a patient. A generative adversarial network (GAN) generates the topogram representing an interior organ based on the outside surface of the patient. To further adapt to specific patients, internal landmarks are used in the topogram prediction. The topogram generated by one generator of the GAN may be altered based on landmarks generated by another generator.

Abstract: Machine learning is used to train a network to predict the location of an internal body marker from surface data. A depth image or other image of the surface of the patient is used to determine the locations of anatomical landmarks. The training may use a loss function that includes a term to limit failure to predict a landmark and/or off-centering of the landmark. The landmarks may then be used to configure medical scanning and/or for diagnosis.

Abstract: A system and method includes creation of a combined network comprising an image segmentation network and an image representation network, the combined network to generate an image descriptor based on an input query image, training of the combined network based on a plurality of first images and a segmentation mask associated with each of the plurality of first images, reception of a first input query image, use of the combined network to generate an image descriptor based on the first input query image, determination of a matching image descriptor from a plurality of stored image descriptors, determination of a camera pose associated with the matching image descriptor, registration of the first input query image with image data based on the determined camera pose, generation of a composite image based on the registered first input query image and image data, and presentation of the composite image.

Abstract: A system and method includes creation of a combined network comprising an image segmentation network and an image representation network, the combined network to generate an image descriptor based on an input query image, training of the combined network based on a plurality of first images and a segmentation mask associated with each of the plurality of first images, reception of a first input query image, use of the combined network to generate an image descriptor based on the first input query image, determination of a matching image descriptor from a plurality of stored image descriptors, determination of a camera pose associated with the matching image descriptor, registration of the first input query image with image data based on the determined camera pose, generation of a composite image based on the registered first input query image and image data, and presentation of the composite image.

Abstract: A system and method includes generation of a first map of first descriptors based on pixels of a first two-dimensional depth image, where a location of each first descriptor in the first map corresponds to a location of a respective pixel of a first two-dimensional depth image, generation of a second map of second descriptors based on pixels of the second two-dimensional depth image, where a location of each second descriptor in the second map corresponds to a location of a respective pixel of the second two-dimensional depth image, upsampling of the first map of descriptors using a first upsampling technique to generate an upsampled first map of descriptors, upsampling of the second map of descriptors using a second upsampling technique to generate an upsampled second map of descriptors, generation of a descriptor difference map based on differences between descriptors of the upsampled first map of descriptors and descriptors of the upsampled second map of descriptors, generation of a geodesic preservation m

Abstract: A system includes: a movable X-ray tube scanner; a range sensor movable with the X-ray tube scanner; an X-ray detector positioned to detect X-rays from the X-ray tube passing through a standing subject between the X-ray tube and the X-ray detector; and a processor configured for automatically controlling the X-ray tube scanner to transmit X-rays to a region of interest of the patient while the subject is standing between the X-ray tube and the X-ray detector.

Abstract: A system and method includes acquisition of first surface data of a patient in a first pose using a first imaging modality, acquisition of second surface data of the patient in a second pose using a second imaging modality, combination of the first surface data and the second surface data to generate combined surface data, for each point of the combined surface data, determination of a weight associated with the first surface data and a weight associated with the second surface data, detection of a plurality of anatomical landmarks based on the first surface data, initialization of a first polygon mesh by aligning a template polygon mesh to the combined surface data based on the detected anatomical landmarks, deformation of the first polygon mesh based on the combined surface data, a trained parametric deformable model, and the determined weights, and storage of the deformed first polygon mesh.

Abstract: Embodiments of a medical imaging device and a method controlling one or more parameters of a medical imaging device are disclosed. In an embodiment, a method includes receiving image data representing a first image of an object to be imaged using the radiation source and detecting a plurality of positions of respective predetermined features in the first image. Based upon the detected positions, a boundary of an imaging area of the object to be imaged is determined. Based on the determined boundary, one or more parameters of the radiation source unit are controlled.

Abstract: A method and system for determining fractional flow reserve (FFR) for a coronary artery stenosis of a patient is disclosed. In one embodiment, medical image data of the patient including the stenosis is received, a set of features for the stenosis is extracted from the medical image data of the patient, and an FFR value for the stenosis is determined based on the extracted set of features using a trained machine-learning based mapping. In another embodiment, a medical image of the patient including the stenosis of interest is received, image patches corresponding to the stenosis of interest and a coronary tree of the patient are detected, an FFR value for the stenosis of interest is determined using a trained deep neural network regressor applied directly to the detected image patches.

Abstract: A method and system for classification of endoscopic images is disclosed. An initial trained deep network classifier is used to classify endoscopic images and determine confidence scores for the endoscopic images. The confidence score for each endoscopic image classified by the initial trained deep network classifier is compared to a learned confidence threshold. For endoscopic images with confidence scores higher than the learned threshold value, the classification result from the initial trained deep network classifier is output. Endoscopic images with confidence scores lower than the learned confidence threshold are classified using a first specialized network classifier built on a feature space of the initial trained deep network classifier.

Abstract: A method and a system for automatically aligning a positionable X-ray source of an X-ray system in alignment with a mobile X-ray detector is disclosed where the X-ray system detects the position of the mobile X-ray detector using a 3D camera and then driving the positionable X-ray source to a position in alignment with the mobile X-ray detector.

Abstract: A method for controlling a scanner comprises: sensing an outer surface of a body of a subject to collect body surface data, using machine learning to predict a surface of an internal organ of the subject based on the body surface data, and controlling the scanner based on the predicted surface of the internal organ.

Abstract: A method and system for determining fractional flow reserve (FFR) for a coronary artery stenosis of a patient is disclosed. In one embodiment, medical image data of the patient including the stenosis is received, a set of features for the stenosis is extracted from the medical image data of the patient, and an FFR value for the stenosis is determined based on the extracted set of features using a trained machine-learning based mapping. In another embodiment, a medical image of the patient including the stenosis of interest is received, image patches corresponding to the stenosis of interest and a coronary tree of the patient are detected, an FFR value for the stenosis of interest is determined using a trained deep neural network regressor applied directly to the detected image patches.

Abstract: A method and system for anatomical landmark detection in medical images using deep neural networks is disclosed. For each of a plurality of image patches centered at a respective one of a plurality of voxels in the medical image, a subset of voxels within the image patch is input to a trained deep neural network based on a predetermined sampling pattern. A location of a target landmark in the medical image is detected using the trained deep neural network based on the subset of voxels input to the trained deep neural network from each of the plurality of image patches.

Abstract: A method and apparatus for X-ray tube scanner automation using a 3D camera is disclosed. An RGBD image of a patient on a patient table is received from a 3D camera mounted on an X-ray tube. A transformation between a coordinate system of the 3D camera and a coordinate system of the patient table is calculated. A patient model is estimated from the RGBD image of the patient. The X-ray tube is automatically controlled to acquire an X-ray image of a region of interest of the patient based on the patient model.

Abstract: For human body representation, bone length or other size characteristic that varies within the population is incorporated into the geometric model of the skeleton. The geometric model may be normalized for shape or tissue modeling, allowing modeling of the shape without dedicating aspects of the data-driven shape model to the length or other size characteristic. Given the same number or extent of components of the data-driven shape model, greater or finer details of the shape may be modeled since components are not committed to the size characteristic.

Abstract: Robust calcification tracking is provided in fluoroscopic imagery. A patient with an inserted catheter is scanned over time. A processor detects the catheter in the patient from the scanned image data. The processor tracks the movement of the catheter. The processor also detects a structure represented in the data. The structure is detected as a function of movement with a catheter. The processor tracks the movement of the structure using sampling based on a previous location of the structure in the patient. The processor may output an image of the structure.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.