Abstract: Systems and methods for automatically extracting one or more salient images from a surgical video stream are described. A plurality of records including annotated images from recorded surgical procedures are used as training data to generate an image extraction machine learning model. Features, extracted from the training data, are used as inputs to the image extraction machine learning model in a training phase, which outputs salient images. After training, features extracted from the surgical video stream are input into the trained image extraction machine learning model to output the one or more salient images from the surgical video stream.