Abstract: Methods and systems for automatically triaging an image study of a patient generated as part of a medical imaging procedure. One system includes a computing device including an electronic processor. The electronic processor is configured to submit at least a portion of the image study to a cognitive system, the cognitive system configured to analyze the image study using a model developed using machine learning, receive, from the cognitive system, a BI-RADS classification assigned to the image study using the model, and automatically triage the image study based on the classification assigned to the image study by the cognitive system.

Abstract: Methods and systems for automatically triaging an image study of a patient generated as part of a medical imaging procedure. One system includes a computing device including an electronic processor. The electronic processor is configured to receive, from a cognitive system applying a model developed using computer vision and machine learning techniques based on deep learning methodology to classify image studies, a classification assigned to the image study using the model, and automatically generate a structured report for the image study based on the classification assigned by the model, the structured report accessible by a radiologist via a structured reporting system.

Abstract: Methods and systems for automatically triaging an image study of a patient generated as part of a medical imaging procedure. One system includes a computing device including an electronic processor. The electronic processor is configured to submit at least a portion of the image study to a cognitive system, the cognitive system configured to analyze the image study using a model developed using machine learning, receive, from the cognitive system, a BI-RADS classification assigned to the image study using the model, and automatically triage the image study based on the classification assigned to the image study by the cognitive system.

Abstract: An illustrative embodiment of a computer-implemented process for non-leading computer aided detection of features of interest in a dataset, designates a particular formation using a computer recognizable gesture to identify a gestured location in an analyzed view of the dataset in response to a user identifying the particular formation in the analyzed view. The dataset is generated by a computer and representative of a portion of an object characterized by the dataset. Responsive to identifying the gestured location, the particular formation is displayed to the user, and a composition is revealed including additional structural imagery, functional imagery and findings resulting from machine learning and analysis. Responsive to revealing the composition to the user, the user is prompted to select performance of accept selection, reject selection or modify selection with regard to the particular formation displayed.

Abstract: Mechanisms are provided for implementing a patient complexity classification (PCC) computing system. The PCC computing system receives medical image study data for a patient that comprises one or more medical image data structures and one or more corresponding medical image metadata data structures. A natural language processing engine of the PCC computing system performs natural language processing on the medical image metadata data structure to extract features indicative of at least one of patient or medical image characteristics. A complexity classifier of the PCC computing system evaluates the extracted features to determine a patient complexity indicating a complexity of a medical condition of the patient. Routing logic associated with the PCC computing system routes the one or more medical image data structures and one or more corresponding medical image metadata data structures to one or more downstream patient evaluation computing systems based on the determined patient complexity.

Abstract: An embodiment of the invention may include a method, computer program product and computer system for object detection and identification. The method, computer program product and computer system may include computing device which may receive an image from an imaging device. The image may be a medical image. The computing device may detect one or more potential indicators of disease in the image using a first algorithm and determine areas of potential disease in the image using an artificial intelligence algorithm. The computing device may determine a correlation between the determined areas of potential disease in the image and the one or more potential indicators of disease for the image. The computing device may, in response to determining a positive correlation, identify one or more of the potential indicators of disease for annotation and generate a report indicating one or more potential indicators of disease was found in the image.

Abstract: Mechanisms are provided for implementing a patient complexity classification (PCC) computing system. The PCC computing system receives medical image study data for a patient that comprises one or more medical image data structures and one or more corresponding medical image metadata data structures. A natural language processing engine of the PCC computing system performs natural language processing on the medical image metadata data structure to extract features indicative of at least one of patient or medical image characteristics. A complexity classifier of the PCC computing system evaluates the extracted features to determine a patient complexity indicating a complexity of a medical condition of the patient. Routing logic associated with the PCC computing system routes the one or more medical image data structures and one or more corresponding medical image metadata data structures to one or more downstream patient evaluation computing systems based on the determined patient complexity.

Abstract: A computer system generates a clinical summary for a patient based on machine learning. One or more templates are generated, each indicating medical information for a corresponding clinical summary with respect to a medical condition of a patient. Preferences for medical information for each corresponding clinical summary are learned based on a history of desired medical information for clinical summaries for the medical condition. The learned preferences are applied to the one or more templates. A clinical summary is generated with respect to the medical condition of the patient based on the one or more templates with the learned preferences. Embodiments of the present invention further include a method and program product for generating a clinical summary for a patient based on machine learning in substantially the same manner described above.

Abstract: Methods and systems for verifying a manually-generated report for a medical image. One system comprises an electronic processor configured to receive a first report for the medical image generated by a first radiologist, receive a second report for the medical image generated by a cognitive system, and automatically compare the first report and the second report to detect a discrepancy between the first report and the second report. The electronic processor is also configured to, in response to not detecting a discrepancy between the first report and the second report, submitting the first report for the medical image. The electronic processor is also configured to, in response to detecting a discrepancy between the first report and the second report, assign the medical image to a second radiologist, receive a third report for the medical image generated by the second radiologist, and submit the third report for the medical image.

Abstract: A method, computer system, and a computer program product for dynamically altering at least one image is provided. The present invention may include receiving a plurality of data, wherein the received plurality of data includes at least one existing medical image. The present invention may also include determining that one or more user instructions for the received existing image were received. The present invention may then include implementing the one or more user instructions on the received existing medical image. The present invention may also include altering the received existing medical image based on the one or more implemented user instructions and a medical knowledge base.

Abstract: A method, computer system, and a computer program product for automatic labeling to train a machine learning algorithm is provided. The present invention may include labeling a medical image with at least one finding from a corresponding medical report. The present invention may include determining a localization information from the labeled medical image. The present invention may include training the machine learning algorithm with the determined localization information. The present invention may include detecting at least one candidate in a test medical image. The present invention may include generating a discrepancy list between the at least one detected candidate in the test medical image and at least one human-reported finding in a corresponding test medical report. The present invention may include, in response to determining that the generated discrepancy list is above a threshold, retraining the trained machine learning algorithm until the generated discrepancy list is below the threshold.

Abstract: Mechanisms are provided for implementing a patient complexity classification (PCC) computing system. The PCC computing system receives medical image study data for a patient that comprises one or more medical image data structures and one or more corresponding medical image metadata data structures. A natural language processing engine of the PCC computing system performs natural language processing on the medical image metadata data structure to extract features indicative of at least one of patient or medical image characteristics. A complexity classifier of the PCC computing system evaluates the extracted features to determine a patient complexity indicating a complexity of a medical condition of the patient. Routing logic associated with the PCC computing system routes the one or more medical image data structures and one or more corresponding medical image metadata data structures to one or more downstream patient evaluation computing systems based on the determined patient complexity.

Abstract: A method, computer system, and a computer program product for dynamically altering at least one image is provided. The present invention may include receiving a plurality of data, wherein the received plurality of data includes at least one existing medical image. The present invention may also include determining that one or more user instructions for the received existing image were received. The present invention may then include implementing the one or more user instructions on the received existing medical image. The present invention may also include altering the received existing medical image based on the one or more implemented user instructions and a medical knowledge base.

Abstract: A method of performing image based analysis of food. The method includes receiving, with an electronic processor, image data captured by an image capture device, analyzing the image data to identify a food represented in the image data, and determining a characteristic of the food identified in the image data. The method further includes accessing medical information of a user, determining a level of risk associated with the user ingesting the food identified in the image data based on the medical information of the user, and outputting a notification, where the notification providing information related to the level of risk associated with the user ingesting the food identified in the image data.

Abstract: A method, computer system, and a computer program product for dynamically altering at least one image is provided. The present invention may include receiving a plurality of data, wherein the received plurality of data includes at least one existing medical image. The present invention may also include determining that one or more user instructions for the received existing image were received. The present invention may then include implementing the one or more user instructions on the received existing medical image. The present invention may also include altering the received existing medical image based on the one or more implemented user instructions and a medical knowledge base.

Abstract: Methods and systems for automatically analyzing clinical images using rules and image analytics. One system includes a server including an electronic processor and an interface for communicating with at least one data source. The electronic processor is configured to receive training information from the at least one data source over the interface. The training information includes a plurality of images and graphical reporting associated with each of the plurality of images. The electronic processor is also configured to perform machine learning to develop a model using the training information and receive an image for analysis. The electronic processor is also configured to determine a set of rules for the image and automatically process the image using the model and the set of rules to generate a diagnosis for the image.

Abstract: A method of performing image based analysis of food. The method includes receiving, with an electronic processor, image data captured by an image capture device, analyzing the image data to identify a food represented in the image data, and determining a characteristic of the food identified in the image data. The method further includes accessing medical information of a user, determining a level of risk associated with the user ingesting the food identified in the image data based on the medical information of the user, and outputting a notification, where the notification providing information related to the level of risk associated with the user ingesting the food identified in the image data.

Abstract: Methods and systems for automatically mapping biopsy locations to pathology results. One system includes a server including an electronic processor and an interface for communicating with at least one data source and at least one pathology result source. The electronic processor is configured to receive an image from the at least one data source over the interface. The electronic processor is also configured to receive a biopsy location. The biopsy location includes a three-dimensional position mapped to a position within the image. The electronic processor is also configured to automatically locate an electronic pathology result for the biopsy location within the at least one pathology result source over the interface. The electronic processor is also configured to generate an electronic correlation between the biopsy location and the electronic pathology result. The electronic processor is also configured to display the image with the biopsy location marked within the image.

Abstract: Methods and systems for verifying a manually-generated report for a medical image. One system comprises an electronic processor configured to receive a first report for the medical image generated by a first radiologist, receive a second report for the medical image generated by a cognitive system, and automatically compare the first report and the second report to detect a discrepancy between the first report and the second report. The electronic processor is also configured to, in response to not detecting a discrepancy between the first report and the second report, submitting the first report for the medical image. The electronic processor is also configured to, in response to detecting a discrepancy between the first report and the second report, assign the medical image to a second radiologist, receive a third report for the medical image generated by the second radiologist, and submit the third report for the medical image.

Abstract: Methods and systems for automatically triaging an image study of a patient generated as part of a medical imaging procedure. One system includes a computing device including an electronic processor. The electronic processor is configured to receive, from a cognitive system applying a model developed using computer vision and machine learning techniques based on deep learning methodology to classify image studies, a classification assigned to the image study using the model, and automatically generate a structured report for the image study based on the classification assigned by the model, the structured report accessible by a radiologist via a structured reporting system.