Abstract: The present disclosure relates to a method that provides a pre-treatment image of a region of tissue to a deep learning model. The pre-treatment image includes at least one lesion. The deep learning model has been trained to generate a first prediction as to whether the region of tissue will respond to medical treatment. A set of radiomic features are extracted from the pre-treatment image and are provided to a machine learning model. The machine learning model has been trained to generate a second prediction as to whether the region of tissue will respond to the medical treatment based on the set of radiomic features. The deep learning model is controlled to generate the first prediction and the machine learning model is controlled to generate the second prediction. A classification of the region of tissue as a responder or non-responder is generated based on the first and second prediction.

Abstract: The present disclosure relates to a method. The method may be performed by accessing data derived from one or more routine clinical medical imaging scans including a lesion in which the lesion and associated vasculature are segmented in a three-dimensional segmentation. At least two features are extracted from the three-dimensional segmentation of the associated vasculature. The at least two features include at least one feature indicative of a morphology of the associated vasculature or a portion thereof, and at least one feature indicative of a function of the associated vasculature or a portion thereof. The at least two features, and/or one or more statistics of the at least two features, are provided to a machine learning model trained to make a prediction concerning the lesion. The prediction concerning the lesion is received from the machine learning model.

Abstract: Embodiments discussed herein facilitate determination of a response to treatment and/or a prognosis for a tumor based at least in part on features of tumor-associated vasculature (TAV). One example embodiment is a method, comprising: accessing a medical imaging scan of a tumor, wherein the tumor is segmented on the medical imaging scan; segmenting tumor-associated vasculature (TAV) associated with the tumor based on the medical imaging scan; extracting one or more features from the TAV; providing the one or more features extracted from the TAV to a trained machine learning model; and receiving, from the machine learning model, one of a predicted response to a treatment for the tumor or a prognosis for the tumor.

Abstract: Embodiments discussed herein facilitate determination of whether lesions are benign or malignant. One example embodiment is a method, comprising: accessing medical imaging scan(s) that are each associated with distinct angle(s) and each comprise a segmented region of interest (ROI) of that medical imaging scan comprising a lesion associated with a first region and a second region; providing the first region(s) of the medical imaging scan(s) to trained first deep learning (DL) model(s) of an ensemble and the second region(s) of the medical imaging scan(s) to trained second DL model(s) of the ensemble; and receiving, from the ensemble of DL models, an indication of whether the lesion is a benign architectural distortion (AD) or a malignant AD.

Abstract: Embodiments discussed herein facilitate training and/or employing a combined model employing machine learning and deep learning outputs to generate prognoses for treatment of tumors. One example embodiment can extract radiomic features from a tumor and a peri-tumoral region; provide the intra-tumoral and peri-tumoral features to two separate machine learning models; provide the segmented tumor and peri-tumoral region to two separate deep learning models; receive predicted prognoses from each of the machine learning models and each of the deep learning models; provide the predicted prognoses to a combined machine learning model; and receive a combined predicted prognosis for the tumor from the combined machine learning model.

Abstract: The present disclosure relates to a method of determining a prognostic outlook for patients having metastatic breast cancer. The method includes receiving imaging data from an image of a patient that is receiving or that is to receive cycline dependent kinase 4 and 6 (CDK 4/6) inhibitor therapy for hormone receptor-positive (HR+) metastatic breast cancer. Radiomic heterogeneity features are extracted from imaging data associated with a metastasis within the imaging. A prognostic marker is determined from the radiomic heterogeneity features. The prognostic marker is indicative of a response of the patient to CDK 4/6 inhibitor therapy for HR+ metastatic breast cancer.

Abstract: A system and method are provided for identifying a multimodal biomarker of a prognostic prediction, using a deep learning framework trained to analyze different modality data, including radiomic image data, pathology image data, and molecular image data to obtain unimodal embedding predictions from those modality data and generate multimodal embedding predictions, through application of a loss minimization and attention-based fusion processes.

Abstract: Embodiments discussed herein facilitate determination of whether lesions are benign or malignant. One example embodiment is a method, comprising: accessing medical imaging scan(s) that are each associated with distinct angle(s) and each comprise a segmented region of interest (ROI) of that medical imaging scan comprising a lesion associated with a first region and a second region; providing the first region(s) of the medical imaging scan(s) to trained first deep learning (DL) model(s) of an ensemble and the second region(s) of the medical imaging scan(s) to trained second DL model(s) of the ensemble; and receiving, from the ensemble of DL models, an indication of whether the lesion is a benign architectural distortion (AD) or a malignant AD.

Abstract: Embodiments discussed herein facilitate determination of a response to treatment and/or a prognosis for a tumor based at least in part on features of tumor-associated vasculature (TAV). One example embodiment is a method, comprising: accessing a medical imaging scan of a tumor, wherein the tumor is segmented on the medical imaging scan; segmenting tumor-associated vasculature (TAV) associated with the tumor based on the medical imaging scan; extracting one or more features from the TAV; providing the one or more features extracted from the TAV to a trained machine learning model; and receiving, from the machine learning model, one of a predicted response to a treatment for the tumor or a prognosis for the tumor.

Abstract: Embodiments discussed herein facilitate training and/or employing a combined model employing machine learning and deep learning outputs to generate prognoses for treatment of tumors. One example embodiment can extract radiomic features from a tumor and a peri-tumoral region; provide the intra-tumoral and peri-tumoral features to two separate machine learning models; provide the segmented tumor and peri-tumoral region to two separate deep learning models; receive predicted prognoses from each of the machine learning models and each of the deep learning models; provide the predicted prognoses to a combined machine learning model; and receive a combined predicted prognosis for the tumor from the combined machine learning model.

Abstract: Embodiments access a pre-neoadjuvant chemotherapy (NAC) radiological image of a region of tissue demonstrating breast cancer (BCa), the region of tissue including a tumoral region, the image having a plurality of pixels; extract a set of patches from the tumoral region; provide the set of patches to a convolutional neural network (CNN) configured to discriminate tissue that will experience pathological complete response (pCR) post-NAC from tissue that will not; receive, from the CNN, a pixel-level localized patch probability of pCR; compute a distribution of predictions across analyzed patches based on the pixel-level localized patch probability; classify the region of tissue as a responder or non-responder based on the distribution of predictions, and display the classification. Embodiments may further generate a probability mask based on the pixel-level localized patch probability; and generate a heatmap of likelihood of response to NAC based on the probability mask and the pre-NAC radiological image.

Abstract: Embodiments access a radiological image of tissue having a tumoral volume and a peritumoral volume; define a vasculature associated with the tumoral volume; generate a Cartesian two-dimensional (2D) vessel network representation; compute a first set of localized Hough transforms based on the Cartesian 2D vessel network representation; generate a first aggregated set of peak orientations based on the first set of Hough transforms; generate a spherical 2D vessel network representation; compute a second set of localized Hough transforms based on the spherical 2D vessel network representation; generate a second aggregated set of peak orientations based on the second set of Hough transforms; generate a vascular network organization descriptor based on the aggregated peak orientations; compute a probability that the tissue is a member of a positive class based on the vascular network organization descriptor; classify the ROI based on the probability; and display the classification.

Abstract: Embodiments access a radiological image of tissue having a tumoral volume and a peritumoral volume; define a vasculature associated with the tumoral volume; generate a Cartesian two-dimensional (2D) vessel network representation; compute a first set of localized Hough transforms based on the Cartesian 2D vessel network representation; generate a first aggregated set of peak orientations based on the first set of Hough transforms; generate a spherical 2D vessel network representation; compute a second set of localized Hough transforms based on the spherical 2D vessel network representation; generate a second aggregated set of peak orientations based on the second set of Hough transforms; generate a vascular network organization descriptor based on the aggregated peak orientations; compute a probability that the tissue is a member of a positive class based on the vascular network organization descriptor; classify the ROI based on the probability; and display the classification.

Abstract: Embodiments predict response to neoadjuvant chemotherapy (NAC) in breast cancer (BCa) from pre-treatment dynamic contrast enhanced magnetic resonance imaging (DCE-MRI).

Abstract: Embodiments access a pre-neoadjuvant chemotherapy (NAC) radiological image of a region of tissue demonstrating breast cancer (BCa), the region of tissue including a tumoral region, the image having a plurality of pixels; extract a set of patches from the tumoral region; provide the set of patches to a convolutional neural network (CNN) configured to discriminate tissue that will experience pathological complete response (pCR) post-NAC from tissue that will not; receive, from the CNN, a pixel-level localized patch probability of pCR; compute a distribution of predictions across analyzed patches based on the pixel-level localized patch probability; classify the region of tissue as a responder or non-responder based on the distribution of predictions, and display the classification. Embodiments may further generate a probability mask based on the pixel-level localized patch probability; and generate a heatmap of likelihood of response to NAC based on the probability mask and the pre-NAC radiological image.

Abstract: Methods, apparatus, and other embodiments distinguish disease phenotypes and mutational status using co-occurrence of local anisotropic gradient orientations (CoLIAGe) and Laws features. One example apparatus includes a set of circuits that acquires a radiologic image (e.g., MRI image) of a region of tissue demonstrating breast cancer, computes a gradient orientation for a pixel in the MRI image, computes a significant orientation for the pixel based on the gradient orientation, constructs a feature vector that captures a discretized entropy distribution for the image based on the significant orientation, extracts a set of texture features from the MRI image, and classifies the phenotype of the breast cancer based on the feature vector and the set of texture features. Embodiments of example apparatus may generate and display a heatmap of entropy values for the image. Example methods and apparatus may operate substantially in real-time, or may operate in two, three, or more dimensions.

Abstract: Methods, apparatus, and other embodiments distinguish disease phenotypes and mutational status using co-occurrence of local anisotropic gradient orientations (CoLIAGe) and Laws features. One example apparatus includes a set of circuits that acquires a radiologic image (e.g., MRI image) of a region of tissue demonstrating breast cancer, computes a gradient orientation for a pixel in the MRI image, computes a significant orientation for the pixel based on the gradient orientation, constructs a feature vector that captures a discretized entropy distribution for the image based on the significant orientation, extracts a set of texture features from the MRI image, and classifies the phenotype of the breast cancer based on the feature vector and the set of texture features. Embodiments of example apparatus may generate and display a heatmap of entropy values for the image. Example methods and apparatus may operate substantially in real-time, or may operate in two, three, or more dimensions.

Abstract: Systems and methods for establishing a serial treatment plan to correct a muscular-skeletal deformity of a subject are described herein. A method can include receiving an image of a portion of the subject's body having the muscular-skeletal deformity, processing the image of the portion of the subject's body to establish a quantitative measure of the muscular-skeletal deformity, and determining a therapeutic state to correct the muscular-skeletal deformity. The therapeutic state can include an adjustment of the portion of the subject's body. In addition, at least one characteristic of the adjustment of the portion of the subject's body can be related to the quantitative measure of the muscular-skeletal deformity.