ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation

Semantic segmentation is a key problem for many computer vision tasks. While approaches based on convolutional neural networks constantly break new records on different benchmarks, generalizing well to diverse testing environments remains a major challenge. In numerous real world applications, there is indeed a large gap between data distributions in train and test domains, which results in severe performance loss at run-time. In this work, we address the task of unsupervised domain adaptation in semantic segmentation with losses based on the entropy of the pixel-wise predictions. To this end, we propose two novel, complementary methods using (i) entropy loss and (ii) adversarial loss respectively. We demonstrate state-of-the-art performance in semantic segmentation on two challenging "synthetic-2-real" set-ups and show that the approach can also be used for detection.

PDF Abstract CVPR 2019 PDF CVPR 2019 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Image-to-Image Translation GTAV-to-Cityscapes Labels ADVENT mIoU 44.8 # 19
Synthetic-to-Real Translation GTAV-to-Cityscapes Labels AdvEnt(with MinEnt) mIoU 45.5 # 57
Domain Adaptation Panoptic SYNTHIA-to-Cityscapes ADVENT mPQ 28.1 # 4
Domain Adaptation Panoptic SYNTHIA-to-Mapillary ADVENT mPQ 18.3 # 4
Domain Adaptation SYNTHIA-to-Cityscapes ADVENT (ResNet-101) mIoU 41.2 # 25
Image-to-Image Translation SYNTHIA-to-Cityscapes ADVENT mIoU (13 classes) 48 # 20

Methods


No methods listed for this paper. Add relevant methods here