Abstract: In example embodiments, techniques are provided for classifying elements of infrastructure models using a convolutional graph neural network (GNN). Graph-structured data structures are generated from infrastructure models, in which nodes represent elements and edges represent contextual relationships among elements (e.g., based on proximity, functionality, parent-child relationships, etc.). During training, the GNN learns embeddings from the nodes and edges of the graph-structured data structures, the embeddings capturing contextual clues that distinguish between elements that may share similar geometry (e.g., cross section, volume, surface area, etc.), yet serve different purposes.

Abstract: In example embodiments, techniques are provided that use two different ML models (a symbol association ML model and a link association ML model), one to extract associations between text labels and one to extract associations between symbols and links, in a schematic diagram (e.g., P&ID) in an image-only format. The two models may use different ML architectures. For example, the symbol association ML model may use a deep learning neural network architecture that receives for each possible text label and symbol pair both a context and a request, and produces a score indicating confidence the pair is associated. The link association ML model may use a gradient boosting tree architecture that receives for each possible text label and link pair a set of multiple features describing at least the geometric relationship between the possible text label and link pair and produces a score indicating confidence the pair is associated.

Abstract: In example embodiments, a software service may employ a neural network to learn a non-linear mapping that transforms element features into embeddings. The neural network may be trained to distribute the embeddings in multi-dimensional embedding space, such that distance between the embeddings is meaningful to the class or category classification, or property prediction, task at hand. The neural network may be trained using weakly supervised machine learning, using weakly labeled infrastructure models. Embeddings for groups may be used to determine prototypes. Elements of an infrastructure model may be classified into classes or categories, or their properties predicted, as the case may be, by finding a nearest prototype.