Abstract: The present invention provides a method and system for multi-modal remote sensing image hybrid matching with multi-dimensional oriented self-similarity features. The method comprises: hybrid feature coarse matching is executed by rapidly extracting the image's self-similarity features using the offset mean filtering method and describing the feature points using the directional information of the self-similarity features. Through this coarse matching, an affine transformation model between multi-modal images is estimated, and an initial affine transformation is applied to the matched image. Next, the multi-dimensional oriented self-similarity feature fine matching is performed by constructing multi-dimensional oriented self-similarity template features using the multi-channel self-similarity map obtained from the hybrid feature coarse matching stage.