Abstract: Disclosed are a method, a device, and a program for retrieving image data by using a deep learning algorithm. According to an embodiment of the inventive concept, a method of retrieving image data includes calculating, by a server, an individual appearance property for a plurality of appearance classification criteria by entering image data into an appearance property recognition model and generating, by the server, appearance description data by combining a plurality of individual appearance properties calculated for the image data. The appearance classification criteria are specific classification criteria for describing an appearance of a specific product and include a plurality of individual appearance properties that express various appearance properties in an identical classification criterion of the product.