Abstract: An ear detection method with deep learning pairwise model based on contextual information belongs to the field of biometric recognition technologies, and addresses a problem that an ear location cannot be found in a large scene, especially in a background image containing a whole body. The method includes: performing preprocessing and object labeling on images; modifying an Oquab network to be a local model for four classes through transfer learning and training the local model; training two pairwise models of head and ear as well as body and head based on the local model; and performing joint detection for an ear through the local model, the two pairwise models and body features. The method uses a hierarchical relationship from large to small to establish contextual information, which can reduce the interference of other features and detect the location of the ear more accurately.