Bounding Box Tightness Prior for Weakly Supervised Image Segmentation

3 Oct 2021  ·  Juan Wang, Bin Xia ·

This paper presents a weakly supervised image segmentation method that adopts tight bounding box annotations. It proposes generalized multiple instance learning (MIL) and smooth maximum approximation to integrate the bounding box tightness prior into the deep neural network in an end-to-end manner. In generalized MIL, positive bags are defined by parallel crossing lines with a set of different angles, and negative bags are defined as individual pixels outside of any bounding boxes. Two variants of smooth maximum approximation, i.e., $\alpha$-softmax function and $\alpha$-quasimax function, are exploited to conquer the numeral instability introduced by maximum function of bag prediction. The proposed approach was evaluated on two pubic medical datasets using Dice coefficient. The results demonstrate that it outperforms the state-of-the-art methods. The codes are available at \url{https://github.com/wangjuan313/wsis-boundingbox}.

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Weakly-supervised instance segmentation COCO 2017 val BBTP (ResNet-101) AP 21.1 # 2
AP@50 45.5 # 2
AP@75 17.2 # 2
AP@S 11.2 # 2
AP@M 22.0 # 2
AP@L 29.8 # 2

Methods


No methods listed for this paper. Add relevant methods here