Abstract: An identification method of seabed weak echoes in airborne LiDAR bathymetry and a system thereof are provided, which belong to the technical field of marine surveying and mapping. The method includes: dividing sea area laser pulses into surface-seabed pulses or seabed-undefined pulses based on preprocessed data; using two-stage local maximum method to determine potential seabed echo positions of ALB waveforms and pre-generate seabed points; defining an ellipsoid neighborhood related to density and extracting spatial features of a pre-generated point cloud; constructing a BP neural network to identify seabed points in the pre-generated point cloud, and optimizing the identification result of the seabed points based on a laser pulse echo sequence and point cloud density.

Abstract: The disclosure relates to systems and methods of improved attention for neural networks. A system may access a first array of entries and a second array of entries, wherein the first array represents a first word embedding generated from one or more first characters of an input and the second array represents a second word embedding from the one or more second characters of the input. A system may generate at least a first difference matrix based on the first array and at least a second difference matrix based on the second array. A system may determine a difference value based on vector based at least in part on the difference value. A system may provide the context vector to subsequent layers of a neural network.