Abstract: A 2D medical image is colorized. In one approach, a deep-learnt classifier is trained to colorize from color 2D medical images. The color 2D medical images for training are cinematically rendered from slabs to add color. In another approach, a deep machine-learnt generator creates slices as if adjacent to the 2D medical image. The slices and 2D medical image form a slab, which is cinematically rendered to add color. The result is a colorized 2D medical image.

Abstract: Methods and systems for artificial intelligence based medical image segmentation are disclosed. In a method for autonomous artificial intelligence based medical image segmentation, a medical image of a patient is received. A current segmentation context is automatically determined based on the medical image and at least one segmentation algorithm is automatically selected from a plurality of segmentation algorithms based on the current segmentation context. A target anatomical structure is segmented in the medical image using the selected at least one segmentation algorithm.

Abstract: In a method, a computer and a medical computer for automatic failure analysis in order to provide a cause of failure of the medical imaging apparatus during operation, input data are read into the computer that include raw data or image data, acquired by the imaging apparatus. A set of performance indicators in the input data is calculated by the computer. A trained neural network system is accessed with the calculated performance indicators, in order to provide result data that, in the case of a failure, identify a failure source.

Abstract: A 2D medical image is colorized. In one approach, a deep-learnt classifier is trained to colorize from color 2D medical images. The color 2D medical images for training are cinematically rendered from slabs to add color. In another approach, a deep machine-learnt generator creates slices as if adjacent to the 2D medical image. The slices and 2D medical image form a slab, which is cinematically rendered to add color. The result is a colorized 2D medical image.

Abstract: A method and apparatus for automated boundary delineation of a tubular structure in a 3D medical image of a patient using an infinitely recurrent neural network (IRNN) is disclosed. An unraveled cross-section image corresponding to a portion of a tubular structure is extracted from 3D medical image. The unraveled cross-section image is divided into a plurality of image chunks. A boundary of the portion of the tubular structure is detected based on the plurality of image chunks using a trained IRNN. The trained IRNN repeatedly inputs a sequential data stream, including the plurality of image chunks of the unraveled cross-section image, for a plurality of iterations while preserving a memory state between iterations, and detects, for each image chunk of the unraveled cross-section image input to the trained IRNN in the sequential data stream, a corresponding section of the boundary of the portion of the tubular structure.

Abstract: For breast cancer detection with an x-ray scanner, a cascade of multiple classifiers is trained or used. One or more of the classifiers uses a deep-learnt network trained on non-x-ray data, at least initially, to extract features. Alternatively or additionally, one or more of the classifiers is trained using classification of patches rather than pixels and/or classification with regression to create additional cancer-positive partial samples.

Abstract: A method for training a segmentation correction model includes performing an iterative model training process over a plurality of iterations. During each iteration, an initial segmentation estimate for an image is provided to a human annotators via an annotation interface. The initial segmentation estimate identifies one or more anatomical areas of interest within the image. Interactions with the annotation interface are automatically monitored to record annotation information comprising one or more of (i) segmentation corrections made to the initial segmentation estimate by the annotators via the annotation interface, and (ii) interactions with the annotation interface performed by the annotators while making the corrections. A base segmentation machine learning model is trained to automatically create a base segmentation based on the image. Additionally, a segmentation correction machine learning model is trained to automatically perform the segmentation corrections based on the image.

Abstract: To assist a physician in diagnosis of trauma involving abdominal pain, scan data representing the patient is partitioned by organ and/or region. Separate machine-learnt classifiers are provided for each organ and/or region. The classifiers are trained to indicate a likelihood of cause of the pain. By outputting results from the collection of organ and/or regions specific classifiers, the likeliest causes and associated organs and/or regions may be used by the physician to speed, confirm, or guide diagnosis of the source of abdominal pain.

Abstract: For patient positioning for scanning, a current pose of a patient is compared to a desired pose. The desired pose may be based on a protocol or a pose of the same patient in a previous examination. Any differences in pose, such as arm position, leg position, head orientation, and/or torso orientation (e.g., laying on side, back, or stomach), are communicated. By changing the current pose of the patient to be more similar to the desired pose, a more consistent and/or registerable dataset may be acquired by scanning the patient.

Abstract: A method and apparatus for automated prostate tumor detection and classification in multi-parametric magnetic resonance imaging (MRI) is disclosed. A multi-parametric MRI image set of a patient, including a plurality of different types of MRI images, is received. Simultaneous detection and classification of prostate tumors in the multi-parametric MRI image set of the patient are performed using a trained multi-channel image-to-image convolutional encoder-decoder that inputs multiple MRI images of the multi-parametric MRI image set of the patient and includes a plurality of output channels corresponding to a plurality of different tumor classes. For each output channel, the trained image-to image convolutional encoder-decoder generates a respective response map that provides detected locations of prostate tumors of the corresponding tumor class in the multi-parametric MRI image set of the patient.

Abstract: For breast cancer detection with an x-ray scanner, a cascade of multiple classifiers is trained or used. One or more of the classifiers uses a deep-learnt network trained on non-x-ray data, at least initially, to extract features. Alternatively or additionally, one or more of the classifiers is trained using classification of patches rather than pixels and/or classification with regression to create additional cancer-positive partial samples.

Abstract: A method for computing image-derived biomarkers includes receiving image data defining a three-dimensional image volume representative of an anatomical region of interest. Features characterizing local variations of intensity in the image data using an intensity model are identified. The features are used to perform one or more modeling computations directly on the image data to derive information related to a biomarker of interest.

Abstract: A machine-learnt classifier is used for more anonymous data transfer. Deep learning, such as neural network machine learning, results in a classifier with multiple distinct layers. Each layer processes the output of a preceding layer. As compared to the input to the layer, the output is different. By applying a subset of layers locally, the resulting output may be provided to a cloud server for application to the remaining layers. Since the output of a layer of the deep-learnt classifier is different than the input, the information transmitted to and available at the cloud server is more anonymous or different than the original data, yet the cloud server may apply the latest machine learnt classifier as the remaining layers.

Abstract: A single level machine-learnt classifier is used in medical imaging. A gross or large structure is located using any approach, including non-ML approaches such as region growing or level-sets. Smaller portions of the structure are located using ML applied to relatively small patches (small relative to the organ or overall structure of interest). The classification of small patches allows for a simple ML approach specific to a single scale or at a voxel/pixel level. The use of small patches may allow for providing classification as a service (e.g., cloud-based classification) since partial image data is to be transmitted. The use of small patches may allow for feedback on classification and updates to the ML. The use of small patches may allow for the creation of a labeled library of classification partially based on ML. Given a near complete labeled library, a simple matching of patches or a lookup can replace ML classification for faster throughput.

Abstract: A 2D medical image is colorized. In one approach, a deep-learnt classifier is trained to colorize from color 2D medical images. The color 2D medical images for training are cinematically rendered from slabs to add color. In another approach, a deep machine-learnt generator creates slices as if adjacent to the 2D medical image. The slices and 2D medical image form a slab, which is cinematically rendered to add color. The result is a colorized 2D medical image.

Abstract: Tissue is characterized using machine-learnt classification. The prognosis, diagnosis or evidence in the form of a similar case is found by machine-learnt classification from features extracted from frames of medical scan data. The texture features for tissue characterization may be learned using deep learning. Using the features, therapy response is predicted from magnetic resonance functional measures before and after treatment in one example. Using the machine-learnt classification, the number of measures after treatment may be reduced as compared to RECIST for predicting the outcome of the treatment, allowing earlier termination or alteration of the therapy.

Abstract: A method of visualizing spinal nerves includes receiving a 3D image volume depicting a spinal cord and a plurality of spinal nerves. For each spinal nerve, a 2D spinal nerve image is generated by defining a surface within the 3D volume comprising the spinal nerve. The surface is curved such that it passes through the spinal cord while encompassing the spinal nerve. Then, the 2D spinal nerve images are generated based on voxels on the surface included in the 3D volume. A visualization of the 2D spinal images is presented in a graphical user interface that allows each 2D spinal image to be viewed simultaneously.

Abstract: Apparatuses and methods are provided for projecting a display of information for an x-ray device. The display of information is projected on the patient, on the table 205 area or on a combination thereof. A compact projector 207 is provided to project the display of information on a previously unused region of the patient and table 207, and provides a source of diagnostic and safety information without further crowding the room. The projected display of information may be a system state, a patient state, a surgical tool position or another relevant image. A compact sensor or range scanner 209 may be employed to capture three-dimensional distance information in the x-ray system. The three-dimensional distance information may be used to reduce distortion in the projected image, selectively darken regions of the projected image, automatically configure the x-ray system, capture inputs from the operator and improve safety in the x-ray system.

Abstract: A method for depicting an airway tree of a patient includes: (a) generating an iodine map of the airway tree from dual energy computed tomography (DECT) imaging data acquired from the patient; (b) defining a region of interest of the airway tree from the DECT imaging data; (c) rendering at least a portion of the airway tree based on information derived from the iodine map and the defined region of interest; and (d) displaying a graphical image of at least a portion of the airway tree on a user interface. Systems for depicting an airway tree of a patient are described.

Abstract: A method of evaluating airway wall density and inflammation including: segmenting a bronchial tree to create an airway wall map; for each branch, taking a set of locations that form the wall of each branch from the map and sampling the value in a virtual non-contrast image of the bronchial tree and, given a set of samples of pre-contrast densities, computing a value to yield a bronchial wall density for each branch to yield density measures; for each branch, taking the set of locations that form the wall of each branch from the map and sampling the value in a contrast agent map of the bronchial tree and, given the set of samples of contrast agent intake, computing a value to yield a bronchial wall uptake for each branch to yield inflammation measures; and using the density and inflammation measures to determine treatment or predict outcome for a patient.