Abstract: Provided are methods and systems for classifying a search engine crawler. An example system for classifying a search engine crawler can include a proxy, a classifier module, and a blocking module. The proxy can be operable to receive a request from the search engine crawler. The proxy may be further operable to route the request to the classifier module. The classifier module may be operable to classify the search engine crawler. The classification may be performed based on attributes associated with the search engine crawler. Based on the classification, the blocking module may be operable to selectively block the request.