Abstract: The invention discloses an attention-based joint image and feature adaptive semantic segmentation method. First, the image adaptation procedure is used to transform the source domain image Xs to a target-domain-like image Xs-t with an appearance similar with the target domain image Xt, to reduce the domain gap between the source domain and the target domain at the image appearance level; then using the feature adaptation procedure to align the features between Xs-t and Xt in the semantic prediction space and the image generation space, respectively, to extract the domain-invariant features, to reduce the domain difference between Xs-t and Xt. In addition, the present invention introduces an attention module in the feature adaptation procedure to help the feature adaptation procedure pay more attention to image regions worthy of attention. Finally, combining the image adaptation procedure and the feature adaptation procedure in the end-to-end manner.

Abstract: The invention discloses an attention-based joint image and feature adaptive semantic segmentation method. First, the image adaptation procedure is used to transform the source domain image Xs to a target-domain-like image Xs-t with an appearance similar with the target domain image Xt, to reduce the domain gap between the source domain and the target domain at the image appearance level; then using the feature adaptation procedure to align the features between Xs-t and Xt in the semantic prediction space and the image generation space, respectively, to extract the domain-invariant features, to reduce the domain difference between Xs-t and Xt. In addition, the present invention introduces an attention module in the feature adaptation procedure to help the feature adaptation procedure pay more attention to image regions worthy of attention. Finally, combining the image adaptation procedure and the feature adaptation procedure in the end-to-end manner.