Abstract: Systems and methods for processing digital medical images to infer metadata from those images are disclosed. In some aspects, digital medical images may be processed to infer metadata by receiving a plurality of digital medical images, receiving a prompt, the prompt being a request for a specific type of metadata to be inferred from the plurality of digital medical images, determining, using a trained foundation model, at least one feature descriptor from the plurality of digital medical images based on the prompt, and providing for output the at least one feature descriptor for each of the plurality of digital medical images.

Abstract: The neural network includes an encoder, a common decoder, and a residual decoder. The encoder encodes input images into a latent space. The latent space disentangles unique features from other common features. The common decoder decodes common features resident in the latent space to generate translated images which lack the unique features. The residual decoder decodes unique features resident in the latent space to generate image deltas corresponding to the unique features. The neural network combines the translated images with the image deltas to generate combined images that may include both common features and unique features. The combined images can be used to drive autoencoding. Once training is complete, the residual decoder can be modified to generate segmentation masks that indicate any regions of a given input image where a unique feature resides.