Abstract: In a general aspect, medical images are segmented by a medical image segmentation system. In some aspects, a medical image segmentation method includes obtaining a medical image comprising a series of images; obtaining a surrogate context based on a support set of images; identifying a query set of images; providing the surrogate context, the support set of images and the query set of images as inputs to a machine learning process; and segmenting the query set by operation of the machine learning process executed on a computer system, wherein executing the machine learning process produces segmentation information of the query set. The support set of images includes a first subset of the series of images and the query set of images includes a second subset of the series of images.