Abstract: An automatic concrete dam defect image description generation method based on graph attention network, including: 1) extract the local grid features and whole image features of the defect image and conduct image coding by using multi-layer convolutional neural network; 2) construct the grid feature interaction graph, and fuse and encode the grid visual features and global image features of the defect image; 3) update and optimize the global and local features through the graph attention network, and fully utilize the improved visual features for defect description. The invention constructs the grid feature interaction graph, updates the node information by using the graph attention network, and realizes the feature extraction task as the graph node classification task. The invention can capture the global image information of the defect image and the potential interaction of local grid features, and the generated description text can accurately and coherently describe the defect information.

Abstract: A method for extracting a dam emergency event based on a dual attention mechanism is provided. The method includes: performing data preprocessing, building a dependency graph, building a dual attention network, and filling a document-level argument. The performing data preprocessing includes labeling a dam emergency corpus and encoding sentences. Building a dependency graph includes assisting a model to mine a syntactic relation based on a dependency. Building a dual attention network includes weighing and fusing an attention network based on a graph transformer network (GTN) and capturing key semantic information in the sentence. Filling a document-level argument includes filling a document-level argument by detecting a key sentence and ordering a semantic similarity. The method introduces a dependency and overcomes the long-range dependency problem based on the dual attention mechanism, thus achieving high identification accuracy and reducing a lot of labor costs.

Abstract: Disclosed is an intelligent recognition method for a time sequence image of a concrete dam defect. The method includes: extracting a feature sequence of the time sequence image containing the concrete dam defect; matching a located defect with a real defect by using an objective function; adding a loss term based on a tight sensing intersection-over-union to a loss function of a model so as to pay attention to integrity of a defect sequence and improve accuracy; and extracting a defect feature and recognizing a defect type after completing defect location. According to the present disclosure, the time sequence image of the concrete dam defect is detected effectively, so that a defect in a long image sequence can be located and the defect type can be recognized accurately.

Abstract: A time-series image description method for dam defects based on local self-attention mechanism is provided, including: performing frame sampling on an input time-series image of dam defect, extracting a feature sequence using a convolutional neural network and using the sequence as an input to a self-attention encoder, where the encoder includes a Transformer network based on a variable self-attention mechanism that dynamically establishes contextual feature relations for each frame; generating description text using a long short term memory (LSTM) network based on a local attention mechanism to enable each word predicted to be feature related to an image frame, improving text generation accuracy by establishing a contextual dependency between image and text. A dynamic mechanism is added to the present application for calculating the global self-attention of image frames, and LSTM networks with added local attention directly establish the correspondence between image and text modal data.

Abstract: A method for extracting a dam emergency event based on a dual attention mechanism is provided. The method includes: performing data preprocessing, building a dependency graph, building a dual attention network, and filling a document-level argument. The performing data preprocessing includes labeling a dam emergency corpus and encoding sentences. Building a dependency graph includes assisting a model to mine a syntactic relation based on a dependency. Building a dual attention network includes weighing and fusing an attention network based on a graph transformer network (GTN) and capturing key semantic information in the sentence. Filling a document-level argument includes filling a document-level argument by detecting a key sentence and ordering a semantic similarity. The method introduces a dependency and overcomes the long-range dependency problem based on the dual attention mechanism, thus achieving high identification accuracy and reducing a lot of labor costs.