Abstract: The disclosure provides a method, device and a computer-readable medium for performing three-dimensional blood vessel reconstruction. The device includes an interface configured to receive a single-view two-dimensional image of a blood vessel of a patient, where the single-view two-dimensional image is a projection image acquired in a predetermined projection direction. The device further includes a processor configured to estimate three-dimensional information of the blood vessel from the single-view two-dimensional image using an inference model, and reconstruct a three-dimensional model of the blood vessel based on the three-dimensional information.

Abstract: Methods and Systems for generating a centerline for an object in an image and computer readable medium are provided. The method includes receiving an image containing the object. The method also includes generating the centerline of the object, by a processor, using a reinforcement learning network configured to predict movement of a virtual agent that traces the centerline in the image. The reinforcement learning network is further configured to perform at least one auxiliary task that detects a bifurcation in a trajectory of the object. The reinforcement learning network is trained by maximizing a cumulative reward and minimizing an auxiliary loss of the at least one auxiliary task. Additionally, the method includes displaying the centerline of the object.

Abstract: The disclosure relates to a computer-implemented method for analyzing an image sequence of a periodic physiological activity, a system, and a medium. The method includes receiving the image sequence from an imaging device, and the image sequence has a plurality of images. The method further includes identifying at least one feature portion in a selected image, which moves responsive to the periodic physiological activity. The method also includes detecting, by a processor, the corresponding feature portions in other images of the image sequence and determining, by the processor, a phase of a the selected image in the image sequence based on the motion of the feature portion.

Abstract: A computer-implemented method for predicting a blood vessel stenosis is disclosed. The method may include extracting a blood vessel path and its centerline based on the image of the blood vessel. The method may further include determining a candidate stenosis for the blood vessel path and identifying image blocks along the centerline of the blood vessel path within a range of candidate stenosis for the blood vessel path determined based on the candidate stenosis. The method may also include determining a degree of stenosis for the blood vessel path by applying a trained learning network comprising a convolutional neural network and a recurrent neural network on the image blocks within the range of candidate stenosis.

Abstract: Embodiments of the disclosure provide systems and methods for generating a diagnosis report based on a medical image of a patient. The system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system further includes at least one processor. The at least one processor is configured to detect a medical condition based on the medical image and automatically generate text information describing the medical condition. The at least one processor is further configured to construct the diagnosis report, where the diagnosis report includes at least one image view showing the medical condition and a report view including the text information describing the medical condition. The system also includes a display configured to display the diagnosis report.

Abstract: Systems and methods for generating a centerline for an object in an image are provided. An exemplary method includes receiving an image containing the object. The method also includes detecting at least one bifurcation of the object using a trained bifurcation learning network based on the image. The method further includes extracting the centerline of the object based on a constraint condition that the centerline passes through the detected bifurcation.

Abstract: Embodiments of the disclosure provide systems and methods for detecting a medical condition of a subject. The system includes a communication interface configured to receive a sequence of images acquired from the subject by an image acquisition device and an end-to-end multi-task learning model. The end-to-end multi-task learning model includes an encoder, a Convolutional Recurrent Neural Network (ConvRNN), and at least one of a decoder and a classifier. The system further includes at least one processor configured to extract feature maps from the images using the encoder, capture contextual information between adjacent images in the sequence using the ConvRNN, and detect medical condition of the subject using the classifier based on the extracted feature maps of the image slices and the contextual information or segment each image slice using the decoder to obtain a region of interest indicative of the medical condition based on the extracted feature maps.

Abstract: The disclosure relates to a method, a system, and a computer-readable medium for prognosis management based on medical information of a patient. The method may include receiving the medical information including at least a medical image of the patient reflecting a morphology of an object associated with the patient at a first time, The method may further include predicting a progression condition of the object at a second time based on the medical information of the first time, where the progression condition is indicative of a prognosis risk, and the second time is after the first time. The method may also include generating a prognosis image at the second time reflecting the morphology of the object at the second time based on the medical information of the first time. The method may additionally include providing the progression condition of the object at the second time and the prognosis image at the second time to an information management system for presentation to a user.

Abstract: The disclosure relates to a method for prognosis management based on medical information of a patient, a device, and a medium. The method includes acquiring, by a processor, medical information of the patient at a first time. The method further includes receiving the medical information of the patient at a first time. The method may further include predicting, by a processor, a progression condition of an object associated with the patient at a second time based on the acquired medical information of the first time. The progression condition is indicative of a prognosis risk, and the second time is after the first time. The method may also include outputting the predicted progression condition to an information management system. The method is helpful for users to understand the potential prognosis risk of the object at the second time to aid users in making treatment decisions.

Abstract: The disclosure provides a method, device and a computer-readable medium for performing three-dimensional blood vessel reconstruction. The device includes an interface configured to receive a single-view two-dimensional image of a blood vessel of a patient, where the single-view two-dimensional image is a projection image acquired in a predetermined projection direction. The device further includes a processor configured to estimate three-dimensional information of the blood vessel from the single-view two-dimensional image using an inference model, and reconstruct a three-dimensional model of the blood vessel based on the three-dimensional information.

Abstract: Embodiments of the disclosure provide methods and systems for multi-modality joint analysis of a plurality of vascular images. The exemplary system may include a communication interface configured to receive the plurality of vascular images acquired using a plurality of imaging modalities. The system may further include at least one processor, configured to extract a plurality of vessel models for a vessel of interest from the plurality of vascular images. The plurality of vessel models are associated with the plurality of imaging modalities, respectively. The at least one processor is also configured to fuse the plurality of vessel models associated with the plurality of imaging modalities to generate a fused model for the vessel of interest. The at least one processor is further configured to provide a diagnostic analysis result based on the fused model of the vessel of interest.

Abstract: Method, system, device and medium for determining a blood flow velocity in a vessel are provided. An example method includes receiving a 3D model of the vessel, which is reconstructed based on X-ray angiography images of the vessel. The method further includes specifying a segment of the 3D model by a start landmark and a termination landmark. Moreover, the method includes determining the blood flow velocity based on length of the segment and perfusion time for the segment by normalizing the blood flow velocity to correspond to a cardiac cycle. The method has a better accuracy in calculating blood flow velocity, and requires no additional modalities other than the original X-ray angiogram sequences used to visualize coronary arteries.

Abstract: The present disclosure is directed to a computer-implemented method and system for anatomical tree structure analysis. The method includes receiving model inputs for a set of positions in an anatomical tree structure. The method further includes applying, by a processor, a learning network to the model inputs. The learning network comprises a set of encoders and a neural network modeling the anatomical tree structure, wherein each encoder provides features extracted from the model input at a corresponding position. The neural network has a plurality of nodes constructed according to the anatomical tree structure and each node is configured to process the extracted features from one or more of the encoders. The method additionally includes providing an output of the learning network as an analysis result of the anatomical tree structure analysis.

Abstract: Embodiments of the disclosure provide systems and methods for processing unstructured texts in a medical record. A disclosed system includes at least one processor configured to determine a plurality of word representations of an unstructured text and tag entities in the unstructured text by performing a named entity recognition task on the plurality of word representations. The at least one processor is further configured to determine position embeddings based on positions of words in the unstructured text relative to positions of the tagged entities and concatenate the plurality of word representations with the position embeddings. The at least one processor is also configured to determine relation labels between pairs of tagged entities by performing a relationship extraction task on the concatenated word representations and position embeddings.

Abstract: Embodiments of the disclosure provide systems and methods for generating a report based on a medical image of a patient. An exemplary system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system may further include at least one processor. The at least one processor is configured to automatically determine keywords from a natural language description of the medical image generated by applying a learning network to the medical image. The at least one processor is further configured to generate the report describing the medical image of the patient based on the keywords. The at least one processor is also configured to provide the report for display.

Abstract: Embodiments of the disclosure provide systems and methods for segmenting an image. An exemplary system includes a communication interface configured to receive the image acquired by an image acquisition device. The system further includes a memory configured to store a multi-level learning network comprising a plurality of convolution blocks cascaded at multiple levels. The system also includes a processor configured to apply a first convolution block and a second convolution block of the multi-level learning network to the image in series. The first convolution block is applied to the image and the second convolution block is applied to a first output of the first convolution block. The processor is further configured to concatenate the first output of the first convolution block and a second output of the second convolution block to obtain a feature map and obtain a segmented image based on the feature map.

Abstract: A method and system can be used for disease quantification modeling of an anatomical tree structure. The method may include obtaining a centerline of an anatomical tree structure and generating a graph neural network including a plurality of nodes based on a graph. Each node corresponds to a centerline point and edges are defined by the centerline, with an input of each node being a disease related feature or an image patch for the corresponding centerline point and an output of each node being a disease quantification parameter. The method also includes obtaining labeled data of one or more nodes, the number of which is less than a total number of the nodes in the graph neural network. Further, the method includes training the graph neural network by transferring information between the one or more nodes and other nodes based on the labeled data of the one or more nodes.

Abstract: The disclosure relates to systems and methods for evaluating a blood vessel. The method includes receiving image data of the blood vessel acquired by an image acquisition device, and predicting, by a processor, blood vessel condition parameters of the blood vessel by applying a deep learning model to the acquired image data of the blood vessel. The deep learning model maps a sequence of image patches on the blood vessel to blood vessel condition parameters on the blood vessel, where in the mapping the entire sequence of image patches contribute to the blood vessel condition parameters. The method further includes providing the blood vessel condition parameters of the blood vessel for evaluating the blood vessel.

Abstract: Embodiments of the disclosure provide methods and systems for representation learning from a biomedical image with a sparse convolution. The exemplary system may include a communication interface configured to receive the biomedical image acquired by an image acquisition device. The system may further include at least one processor, configured to extract a structure of interest from the biomedical image. The at least one processor is also configured to generate sparse data representing the structure of interest and input features corresponding to the sparse data. The at least one processor is further configured to apply a sparse-convolution-based model to the biomedical image, the sparse data, and the input features to generate a biomedical processing result for the biomedical image. The sparse-convolution-based model performs one or more neural network operations including the sparse convolution on the sparse data and the input features.

Abstract: The present disclosure is directed to a computer-implemented method and system for anatomical tree structure analysis. The method includes receiving model inputs for a set of positions in an anatomical tree structure. The method further includes applying, by a processor, a set of encoders to the model inputs. Each encoder is configured to extract features from the model input at a corresponding position. The method also includes applying, by the processor, a tree structured network to the extracted features. The tree structured network has a plurality of nodes each connected to one or more of the encoders, and information propagates among the nodes of the tree structured network according to spatial constraints of the anatomical tree structure. The method additionally includes providing an output of the tree structured network as an analysis result of the anatomical tree structure analysis.