Abstract: Mechanisms are provided to improve an output of a trained machine learning (ML) computer model based on label co-occurrence statistics. For a corpus, label vector representations of the knowledge data structures are generated. Co-occurrence scores for each pairing of labels, across the label vector representations, are generated. A vector output of the ML computer model is received and a knowledge driven reasoning (KDR) computer model is configured with threshold(s) and delta value(s) specifying condition(s) of a co-occurrence of a first label in the output with a second label in the plurality of labels which, if present, causes the delta value(s) to be applied to modify a probability value associated with the second label in the output of the ML computer model. The KDR computer model is executed on the output of the ML computer model to modify probability value(s) in the output.

Abstract: Disease detection from medical images is provided. In various embodiments, a medical image of a patient is read. The medical image is provided to a trained anatomy segmentation network. A feature map is received from the trained anatomy segmentation network. The feature map indicates the location of at least one feature within the medical image. The feature map is provided to a trained classification network. The trained classification network was pre-trained on a plurality of feature map outputs of the segmentation network. A disease detection is received from the trained classification network. The disease detection indicating the presence or absence of a predetermined disease.

Abstract: A method and system for automatically inferring a subject's body position in a two-dimensional image produced by a medical-imaging system are disclosed. The image is labeled with a body position selected from a semantically meaningful set of candidate positions sequenced in order of their relative locations in a subject's body. A processor performs procedures that each identify a class of image features related to pixel intensity, such as a histogram of gradients, local binary patterns, or Haar-like features. A second set of procedures employs applications of a pretrained convolutional neural network that has learned to recognize features of a specific class of medical images. The results of both types of procedures are then mapped by a pretrained support-vector machine onto candidate image labels, which are mathematically combined into a single, semantically meaningful, label most likely to identify a body position of the subject shown by the image.

Abstract: Methods and systems are directed to training an artificial intelligence engine. One system includes an electronic processor configured obtain a set of reports corresponding to a set of medical images, determine a label for a finding of interest, and identify one or more ambiguous reports in the set of repots. Ambiguous reports do not include a positive label or a negative label for the finding of interest. The electronic processor is also configured to generate an annotation for each of the one or more ambiguous reports in the set of reports, and train the artificial intelligence engine using a training set including the annotation for each of the one or more ambiguous reports and non-ambiguous reports in the set of reports. A result of the training is generation of a classification model for the label for the finding of interest.

Abstract: A neural network apparatus receives, as input from a user device, digital imaging information and the clinical information for an aneurysm patient and generates, using a neural network trained for aneurysm outcome prediction, the digital imaging information, and the clinical information, an outcome prediction for at least one intrasaccular implant device for implant in an aneurysm sac identified in the digital imaging information and having a highest predicted likelihood of complete occlusion of the aneurysm sac from a set of potential treatment devices. The apparatus is further configured to output, for display on a device, an identification of the at least one intrasaccular implant device and the outcome prediction for each of the at least one intrasaccular implant device.

Abstract: An ergonomic adjustment mechanism comprising a vertical adjustment mechanism to move master robotic arms along a vertical axis. An exemplary vertical adjustment mechanism includes a main shaft extended along a horizontal axis between a first end and a second end, where the horizontal axis may be perpendicular to the vertical axis. The vertical adjustment mechanism further includes a linear actuator coupled to the horizontal beam to actuate a translational movement of the horizontal beam along the vertical axis. The ergonomic adjustment mechanism further includes a horizontal adjustment mechanism to move exemplary master robotic arms along the horizontal axis. The horizontal adjustment mechanism includes a horizontal sliding rail that is mounted on the horizontal beam. Master robotic arms may be slidably mounted on the sliding rail, where the master robotic arms are slidable on the sliding rail along the horizontal axis.

Abstract: Mechanisms are provided to implement a machine learning training model. The machine learning training model trains an image generator of a generative adversarial network (GAN) to generate medical images approximating actual medical images. The machine learning training model augments a set of training medical images to include one or more generated medical images generated by the image generator of the GAN. The machine learning training model trains a machine learning model based on the augmented set of training medical images to identify anomalies in medical images. The trained machine learning model is applied to new medical image inputs to classify the medical images as having an anomaly or not.

Abstract: Mechanisms are provided to improve an output of a trained machine learning (ML) computer model based on label co-occurrence statistics. For a corpus, label vector representations of the knowledge data structures are generated. Co-occurrence scores for each pairing of labels, across the label vector representations, are generated. A vector output of the ML computer model is received and a knowledge driven reasoning (KDR) computer model is configured with threshold(s) and delta value(s) specifying condition(s) of a co-occurrence of a first label in the output with a second label in the plurality of labels which, if present, causes the delta value(s) to be applied to modify a probability value associated with the second label in the output of the ML computer model. The KDR computer model is executed on the output of the ML computer model to modify probability value(s) in the output.

Abstract: Methods and systems for performing transfer learning with basis scaling and pruning. One method includes obtaining a pre-trained deep convolutional neural network (DCNN), decomposing each weight matrix of the DCNN, and decomposing each convolutional layer by applying the respective decomposed weight matrix to the convolution layer to form a first layer which comprises the left matrix for convolution, and a second layer which comprises the right matrix for convolution. The method also includes providing a basis-scaling convolutional layer having a weight matrix that is derived by a function of singular values and the right singular vectors and training the basis scaling factors of the basis-scaling convolutional layers.

Abstract: A computer-implemented method, a computer program product, and a computer system for introducing channel-scaling layers in a deep neural network. A computer receives a pre-trained deep neural network including convolutional layers followed by respective ones of activation layers, adds channel-scaling layers after the respective ones of the activation layers, where each of the channel-scaling layers includes scaling weights. The computer trains the scaling weights in the channel-scale layers. The computer removes, in the convolutional layers, channels whose corresponding scaling weights are lower than a predetermined threshold. The computer removes the channel-scaling layers. In response to determining that at least one convergence criterion is met, the computer provides a finally trained deep neural network.

Abstract: An automatic extraction of disease-specific features from Doppler images to help diagnose valvular diseases is provided. The method includes the steps of obtaining a raw Doppler image from a series of images of an echocardiogram, isolating a region of interest from the raw Doppler image, the region of interest including a Doppler image and an ECG signal, and depicting at least one heart cycle, determining a velocity envelope of the Doppler image in the region of interest, extracting the ECG signal to synchronize the ECG signal with the Doppler image over the at least one heart cycle, within the region of interest, calculating a value of a clinical feature based on the extracted ECG signal synchronized with the velocity envelope, and comparing the value of the clinical feature with clinical guidelines associated with the clinical feature to determine a diagnosis of a disease.

Abstract: Image segmentation based on the combination of a deep learning network and a shape-guided deformable model is provided. In various embodiments, a time sequence of images is received. The sequence of images is provided to a convolutional network to obtain a sequence of preliminary segmentations. The sequence of preliminary segmentations labels a region of interest in each of the images of the sequence. A reference and auxiliary mask are generated from the sequence of preliminary segmentations. The reference mask corresponds to the region of interest. The auxiliary mask corresponds to areas outside the region of interest. A final segmentation corresponding to the region of interest is generated for each of the sequence of images by applying a deformable model to the composite mask with reference to the auxiliary mask.

Abstract: Mechanisms are provided to implement a machine learning training model. The machine learning training model trains an image generator of a generative adversarial network (GAN) to generate medical images approximating actual medical images. The machine learning training model augments a set of training medical images to include one or more generated medical images generated by the image generator of the GAN. The machine learning training model trains a machine learning model based on the augmented set of training medical images to identify anomalies in medical images. The trained machine learning model is applied to new medical image inputs to classify the medical images as having an anomaly or not.

Abstract: A cross-modality neural network transform for semi-automatic medical image annotation is provided. In various embodiments, an input medical image is mapped to a first vector in a text vector space. The first vector corresponds to the features of the medical image. A set of predetermined vectors is searched for a closest one of the predetermined vectors to the first vector. From the closest one of the predetermined vectors, one or more keywords is determined describing the input medical image.

Abstract: Mechanisms are provided to implement an automated medical imaging report generator which receives an input medical image and inputs the input medical image into a machine learning (ML) computer model trained to predict finding labels based on patterns of image features extracted from the medical image. The ML computer model generates a prediction of a finding label applicable to the input medical image in terms of a finding label prediction output vector. Based on the finding label prediction output vector, a lookup operation is performed, in a medical report database of previously processed medical imaging report data structures, to find a matching medical imaging report data structure corresponding to the finding label. An output medical imaging report is generated for the input medical image based on natural language content of the matching medical imaging report data structure.

Abstract: Workflows for automatic measurement of Doppler is provided. In various embodiments, a plurality of frames of a medical video are read. A mode label indicative of a mode of each of the plurality of frames is determined. At least one of the plurality of frames is provided to a trained feature generator. The at least one of the plurality of frames have the same mode label. At least one feature vector is obtained from the trained feature generator corresponding to the at least one of the plurality of frames. At least one feature vector is provided to a trained classifier. A valve label indicative of a valve is obtained from the trained classifier corresponding to the at least one of the plurality of frames. One or more measurement is extracted indicative of a disease condition from those of the at least one of the plurality of frames matching a predetermined valve label.

Abstract: Methods and systems for determining a diagnostically unacceptable medical image. One system includes at least one electronic processor configured to receive a new medical image captured via a medical imaging device. The at least one electronic processor is also configured to determine a classification of the new medical image using a model developed with machine learning using training information that includes a plurality of medical images and an associated classification for each medical image, each associated classification identifying whether the associated medical image is diagnostically unacceptable, wherein the classification of the new medical image indicates whether the new medical image is diagnostically unacceptable.

Abstract: Annotation of large image datasets is provided. In various embodiments, a plurality of medical images is received. At least one collection is formed containing a subset of the plurality of medical images. One or more image from the at least one collection is provided to each of a plurality of remote users. An annotation template is provided to each of the plurality of remote users. Annotations for the one or more image are received from each of the plurality of remote users. The annotations and the plurality of medical images are stored together.

Abstract: A cross-modality neural network transform for semi-automatic medical image annotation is provided. In various embodiments, an input medical image is mapped to a first vector in a text vector space. The first vector corresponds to the features of the medical image. A set of predetermined vectors is searched for a closest one of the predetermined vectors to the first vector. From the closest one of the predetermined vectors, one or more keywords is determined describing the input medical image.

Abstract: Annotation of large image datasets is provided. In various embodiments, a plurality of medical images is received. At least one collection is formed containing a subset of the plurality of medical images. One or more image from the at least one collection is provided to each of a plurality of remote users. An annotation template is provided to each of the plurality of remote users. Annotations for the one or more image are received from each of the plurality of remote users. The annotations and the plurality of medical images are stored together.