Abstract: Systems and methods are provided for medical image classification of images from varying sources. A set of microscopic medical images are acquired, and a first neural network module configured to reduce each of the set of microscopic medical images to a feature representation is generated. The first neural network module, a second neural network module, and a third neural network module are trained on at least a subset of the set of microscopic medical images. The second neural network module is trained to receive feature representation associated with an image of the microscopic images and classify the image into one of a first plurality of output classes. The third neural network module is trained to receive the feature representation, classify the image into one of a second plurality of output classes based on the feature representation, and provide feedback to the first neural network module.