Conservative-Progressive Collaborative Learning for Semi-supervised Semantic Segmentation

30 Nov 2022  ·  Siqi Fan, Fenghua Zhu, Zunlei Feng, Yisheng Lv, Mingli Song, Fei-Yue Wang ·

Pseudo supervision is regarded as the core idea in semi-supervised learning for semantic segmentation, and there is always a tradeoff between utilizing only the high-quality pseudo labels and leveraging all the pseudo labels. Addressing that, we propose a novel learning approach, called Conservative-Progressive Collaborative Learning (CPCL), among which two predictive networks are trained in parallel, and the pseudo supervision is implemented based on both the agreement and disagreement of the two predictions. One network seeks common ground via intersection supervision and is supervised by the high-quality labels to ensure a more reliable supervision, while the other network reserves differences via union supervision and is supervised by all the pseudo labels to keep exploring with curiosity. Thus, the collaboration of conservative evolution and progressive exploration can be achieved. To reduce the influences of the suspicious pseudo labels, the loss is dynamic re-weighted according to the prediction confidence. Extensive experiments demonstrate that CPCL achieves state-of-the-art performance for semi-supervised semantic segmentation.

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Semi-Supervised Semantic Segmentation Cityscapes 12.5% labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 74.6% # 12
Semi-Supervised Semantic Segmentation Cityscapes 25% labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 76.98% # 13
Semi-Supervised Semantic Segmentation Cityscapes 50% labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 78.17% # 13
Semi-Supervised Semantic Segmentation Cityscapes 6.25% labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 69.92% # 11
Semi-Supervised Semantic Segmentation Pascal VOC 2012 12.5% labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 73.74% # 16
Semi-Supervised Semantic Segmentation Pascal VOC 2012 12.5% labeled CPCL (DeepLab v3+ with ResNet-101) Validation mIoU 76.4% # 10
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 183 labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 67.02 # 8
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 25% labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 74.58 # 17
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 25% labeled CPCL (DeepLab v3+ with ResNet-101) Validation mIoU 77.16 # 11
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 366 labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 72.14 # 7
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 50% CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 75.3% # 12
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 50% CPCL (DeepLab v3+ with ResNet-101) Validation mIoU 77.67% # 8
Semi-Supervised Semantic Segmentation Pascal VOC 2012 6.25% labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 71.66 # 10
Semi-Supervised Semantic Segmentation Pascal VOC 2012 6.25% labeled CPCL (DeepLab v3+ with ResNet-101) Validation mIoU 73.44 # 8
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 732 labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 74.25 # 8
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 92 labeled CPCL (DeepLab v3+ with ResNet-50) Validation mIoU 61.88 # 8

Methods


No methods listed for this paper. Add relevant methods here