Abstract: The present disclosure relates to a method and a system for generating anatomical labels of an anatomical structure. The method includes receiving an anatomical structure with an extracted centerline, or a medical image containing the anatomical structure with the extracted centerline; and predicting the anatomical labels of the anatomical structure based on the centerline of the anatomical structure, by utilizing a trained deep learning network. The deep learning network includes a branched network, a Graph Neural Network, a Recurrent Neural Network and a Probability Graph Model, which are connected sequentially in series. The branched network includes at least two branch networks in parallel. The method in the disclosure can automatically generate the anatomical labels of the whole anatomical structure in medical image end to end and provide high prediction accuracy and reliability.

Abstract: Embodiments of the disclosure provide systems and methods for analyzing a medical image containing a vessel structure using a sequential model. An exemplary system includes a communication interface configured to receive the medical image and the sequential model. The sequential model includes a vessel extraction sub-model and a lesion analysis sub-model. The vessel extraction sub-model and the lesion analysis sub-model are independently or jointly trained. The exemplary system also includes at least one processor configured to apply the vessel extraction sub-model on the received medical image to extract location information of the vessel structure. The at least one processor also applies the lesion analysis sub-model on the received medical image and the location information extracted by the vessel extraction sub-model to obtain a lesion analysis result of the vessel structure. The at least one processor further outputs the lesion analysis result of the vessel structure.

Abstract: Embodiments of the disclosure provide methods and systems for multi-modality joint analysis of a plurality of vascular images. The exemplary system may include a communication interface configured to receive the plurality of vascular images acquired using a plurality of imaging modalities. The system may further include at least one processor, configured to extract a plurality of vessel models for a vessel of interest from the plurality of vascular images. The plurality of vessel models are associated with the plurality of imaging modalities, respectively. The at least one processor is also configured to fuse the plurality of vessel models associated with the plurality of imaging modalities to generate a fused model for the vessel of interest. The at least one processor is further configured to provide a diagnostic analysis result based on the fused model of the vessel of interest.

Abstract: Embodiments of the disclosure provide methods and systems for joint abnormality detection and physiological condition estimation from a medical image. The exemplary method may include receiving, by at least one processor, the medical image acquired by an image acquisition device. The medical image includes an anatomical structure. The method may further include applying, by the at least one processor, a joint learning model to determine an abnormality condition and a physiological parameter of the anatomical structure jointly based on the medical image. The joint learning model satisfies a predetermined constraint relationship between the abnormality condition and the physiological parameter.

Abstract: The disclosure provides a method, device and a computer-readable medium for performing three-dimensional blood vessel reconstruction. The device includes an interface configured to receive a single-view two-dimensional image of a blood vessel of a patient, where the single-view two-dimensional image is a projection image acquired in a predetermined projection direction. The device further includes a processor configured to estimate three-dimensional information of the blood vessel from the single-view two-dimensional image using an inference model, and reconstruct a three-dimensional model of the blood vessel based on the three-dimensional information.

Abstract: Methods and Systems for generating a centerline for an object in an image and computer readable medium are provided. The method includes receiving an image containing the object. The method also includes generating the centerline of the object, by a processor, using a reinforcement learning network configured to predict movement of a virtual agent that traces the centerline in the image. The reinforcement learning network is further configured to perform at least one auxiliary task that detects a bifurcation in a trajectory of the object. The reinforcement learning network is trained by maximizing a cumulative reward and minimizing an auxiliary loss of the at least one auxiliary task. Additionally, the method includes displaying the centerline of the object.

Abstract: A computer-implemented method for predicting a blood vessel stenosis is disclosed. The method may include extracting a blood vessel path and its centerline based on the image of the blood vessel. The method may further include determining a candidate stenosis for the blood vessel path and identifying image blocks along the centerline of the blood vessel path within a range of candidate stenosis for the blood vessel path determined based on the candidate stenosis. The method may also include determining a degree of stenosis for the blood vessel path by applying a trained learning network comprising a convolutional neural network and a recurrent neural network on the image blocks within the range of candidate stenosis.

Abstract: Embodiments of the disclosure provide systems and methods for generating a diagnosis report based on a medical image of a patient. The system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system further includes at least one processor. The at least one processor is configured to detect a medical condition based on the medical image and automatically generate text information describing the medical condition. The at least one processor is further configured to construct the diagnosis report, where the diagnosis report includes at least one image view showing the medical condition and a report view including the text information describing the medical condition. The system also includes a display configured to display the diagnosis report.

Abstract: Embodiments of the disclosure provide systems and methods for detecting a medical condition of a subject. The system includes a communication interface configured to receive a sequence of images acquired from the subject by an image acquisition device and an end-to-end multi-task learning model. The end-to-end multi-task learning model includes an encoder, a Convolutional Recurrent Neural Network (ConvRNN), and at least one of a decoder and a classifier. The system further includes at least one processor configured to extract feature maps from the images using the encoder, capture contextual information between adjacent images in the sequence using the ConvRNN, and detect medical condition of the subject using the classifier based on the extracted feature maps of the image slices and the contextual information or segment each image slice using the decoder to obtain a region of interest indicative of the medical condition based on the extracted feature maps.

Abstract: Systems and methods for generating a centerline for an object in an image are provided. An exemplary method includes receiving an image containing the object. The method also includes detecting at least one bifurcation of the object using a trained bifurcation learning network based on the image. The method further includes extracting the centerline of the object based on a constraint condition that the centerline passes through the detected bifurcation.

Abstract: The disclosure provides a method, device and a computer-readable medium for performing three-dimensional blood vessel reconstruction. The device includes an interface configured to receive a single-view two-dimensional image of a blood vessel of a patient, where the single-view two-dimensional image is a projection image acquired in a predetermined projection direction. The device further includes a processor configured to estimate three-dimensional information of the blood vessel from the single-view two-dimensional image using an inference model, and reconstruct a three-dimensional model of the blood vessel based on the three-dimensional information.

Abstract: Embodiments of the disclosure provide methods and systems for multi-modality joint analysis of a plurality of vascular images. The exemplary system may include a communication interface configured to receive the plurality of vascular images acquired using a plurality of imaging modalities. The system may further include at least one processor, configured to extract a plurality of vessel models for a vessel of interest from the plurality of vascular images. The plurality of vessel models are associated with the plurality of imaging modalities, respectively. The at least one processor is also configured to fuse the plurality of vessel models associated with the plurality of imaging modalities to generate a fused model for the vessel of interest. The at least one processor is further configured to provide a diagnostic analysis result based on the fused model of the vessel of interest.

Abstract: The present disclosure is directed to a computer-implemented method and system for anatomical tree structure analysis. The method includes receiving model inputs for a set of positions in an anatomical tree structure. The method further includes applying, by a processor, a learning network to the model inputs. The learning network comprises a set of encoders and a neural network modeling the anatomical tree structure, wherein each encoder provides features extracted from the model input at a corresponding position. The neural network has a plurality of nodes constructed according to the anatomical tree structure and each node is configured to process the extracted features from one or more of the encoders. The method additionally includes providing an output of the learning network as an analysis result of the anatomical tree structure analysis.

Abstract: Embodiments of the disclosure provide systems and methods for generating a report based on a medical image of a patient. An exemplary system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system may further include at least one processor. The at least one processor is configured to automatically determine keywords from a natural language description of the medical image generated by applying a learning network to the medical image. The at least one processor is further configured to generate the report describing the medical image of the patient based on the keywords. The at least one processor is also configured to provide the report for display.

Abstract: A method and system can be used for disease quantification modeling of an anatomical tree structure. The method may include obtaining a centerline of an anatomical tree structure and generating a graph neural network including a plurality of nodes based on a graph. Each node corresponds to a centerline point and edges are defined by the centerline, with an input of each node being a disease related feature or an image patch for the corresponding centerline point and an output of each node being a disease quantification parameter. The method also includes obtaining labeled data of one or more nodes, the number of which is less than a total number of the nodes in the graph neural network. Further, the method includes training the graph neural network by transferring information between the one or more nodes and other nodes based on the labeled data of the one or more nodes.

Abstract: The disclosure relates to systems and methods for evaluating a blood vessel. The method includes receiving image data of the blood vessel acquired by an image acquisition device, and predicting, by a processor, blood vessel condition parameters of the blood vessel by applying a deep learning model to the acquired image data of the blood vessel. The deep learning model maps a sequence of image patches on the blood vessel to blood vessel condition parameters on the blood vessel, where in the mapping the entire sequence of image patches contribute to the blood vessel condition parameters. The method further includes providing the blood vessel condition parameters of the blood vessel for evaluating the blood vessel.

Abstract: The present disclosure is directed to a computer-implemented method and system for anatomical tree structure analysis. The method includes receiving model inputs for a set of positions in an anatomical tree structure. The method further includes applying, by a processor, a set of encoders to the model inputs. Each encoder is configured to extract features from the model input at a corresponding position. The method also includes applying, by the processor, a tree structured network to the extracted features. The tree structured network has a plurality of nodes each connected to one or more of the encoders, and information propagates among the nodes of the tree structured network according to spatial constraints of the anatomical tree structure. The method additionally includes providing an output of the tree structured network as an analysis result of the anatomical tree structure analysis.

Abstract: The present disclosure relates to a method and a system for generating anatomical labels of an anatomical structure. The method includes receiving an anatomical structure with an extracted centerline, or a medical image containing the anatomical structure with the extracted centerline; and predicting the anatomical labels of the anatomical structure based on the centerline of the anatomical structure, by utilizing a trained deep learning network. The deep learning network includes a branched network, a Graph Neural Network, a Recurrent Neural Network and a Probability Graph Model, which are connected sequentially in series. The branched network includes at least two branch networks in parallel. The method in the disclosure can automatically generate the anatomical labels of the whole anatomical structure in medical image end to end and provide high prediction accuracy and reliability.

Abstract: A method and system can be used for disease quantification modeling of an anatomical tree structure. The method may include obtaining a centerline of an anatomical tree structure and generating a graph neural network including a plurality of nodes based on a graph. Each node corresponds to a centerline point and edges are defined by the centerline, with an input of each node being a disease related feature or an image patch for the corresponding centerline point and an output of each node being a disease quantification parameter. The method also includes obtaining labeled data of one or more nodes, the number of which is less than a total number of the nodes in the graph neural network. Further, the method includes training the graph neural network by transferring information between the one or more nodes and other nodes based on the labeled data of the one or more nodes.

Abstract: Embodiments of the disclosure provide systems and methods for analyzing medical images using a learning model. The system receives a medical image acquired by an image acquisition device. The system may additionally include at least one processor configured to apply the learning model to perform an image analysis task on the medical image. The learning model is trained jointly with an error estimator using training images comprising a first set of labeled images and a second set of unlabeled images. The error estimator is configured to estimate an error of the learning model associated with performing the image analysis task.