Adversarial Learning for Semi-Supervised Semantic Segmentation

We propose a method for semi-supervised semantic segmentation using an adversarial network. While most existing discriminators are trained to classify input images as real or fake on the image level, we design a discriminator in a fully convolutional manner to differentiate the predicted probability maps from the ground truth segmentation distribution with the consideration of the spatial resolution. We show that the proposed discriminator can be used to improve semantic segmentation accuracy by coupling the adversarial loss with the standard cross entropy loss of the proposed model. In addition, the fully convolutional discriminator enables semi-supervised learning through discovering the trustworthy regions in predicted results of unlabeled images, thereby providing additional supervisory signals. In contrast to existing methods that utilize weakly-labeled images, our method leverages unlabeled images to enhance the segmentation model. Experimental results on the PASCAL VOC 2012 and Cityscapes datasets demonstrate the effectiveness of the proposed algorithm.

PDF Abstract ICLR 2018 PDF ICLR 2018 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Semi-Supervised Semantic Segmentation Cityscapes 12.5% labeled Adversarial (DeepLab v2 ImageNet pre-trained) Validation mIoU 57.1% # 27
Semi-Supervised Semantic Segmentation Cityscapes 50% labeled Adversarial (DeepLab v2 ImageNet pre-trained) Validation mIoU 65.70% # 18
Semi-Supervised Semantic Segmentation Pascal VOC 2012 12.5% labeled Adversarial Validation mIoU 64.3% # 30
Semi-Supervised Semantic Segmentation Pascal VOC 2012 2% labeled Adversarial (DeepLab v2 ImageNet pre-trained) Validation mIoU 49.2% # 12
Semi-Supervised Semantic Segmentation Pascal VOC 2012 5% labeled Adversarial (DeepLab v2 ImageNet pre-trained) Validation mIoU 59.1% # 14

Results from Other Papers


Task Dataset Model Metric Name Metric Value Rank Uses Extra
Training Data
Source Paper Compare
Semi-Supervised Semantic Segmentation Cityscapes 25% labeled Adversarial (DeepLab v2 ImageNet pre-trained) Validation mIoU 60.5% # 24

Methods


No methods listed for this paper. Add relevant methods here