Weakly Supervised Instance Segmentation by Learning Annotation Consistent Instances

ECCV 2020  ·  Aditya Arun, C. V. Jawahar, M. Pawan Kumar ·

Recent approaches for weakly supervised instance segmentations depend on two components: (i) a pseudo label generation model that provides instances which are consistent with a given annotation; and (ii) an instance segmentation model, which is trained in a supervised manner using the pseudo labels as ground-truth. Unlike previous approaches, we explicitly model the uncertainty in the pseudo label generation process using a conditional distribution. The samples drawn from our conditional distribution provide accurate pseudo labels due to the use of semantic class aware unary terms, boundary aware pairwise smoothness terms, and annotation aware higher order terms. Furthermore, we represent the instance segmentation model as an annotation agnostic prediction distribution. In contrast to previous methods, our representation allows us to define a joint probabilistic learning objective that minimizes the dissimilarity between the two distributions. Our approach achieves state of the art results on the PASCAL VOC 2012 data set, outperforming the best baseline by 4.2% mAP@0.5 and 4.8% mAP@0.75.

PDF Abstract ECCV 2020 PDF ECCV 2020 Abstract


Results from the Paper

Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val Arun et al. mAP@0.5 50.9 # 4
mAP@0.25 59.7 # 4
mAP@0.7 30.2 # 4
mAP@0.75 28.5 # 2


No methods listed for this paper. Add relevant methods here