Abstract: Embodiments of the disclosure provide systems and methods for segmenting a medical image. The system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system also includes a memory configured to store a plurality of learning networks jointly trained using first training images of a first imaging modality and second training images of a second imaging modality. The system further includes a processor, configured to segment the medical image using a segmentation network selected from the plurality of learning networks.