Co-Saliency Detection via Mask-Guided Fully Convolutional Networks With Multi-Scale Label Smoothing

In image co-saliency detection problem, one critical issue is how to model the concurrent pattern of the co-salient parts, which appears both within each image and across all the relevant images. In this paper, we propose a hierarchical image co-saliency detection framework as a coarse to fine strategy to capture this pattern. We first propose a mask-guided fully convolutional network structure to generate the initial co-saliency detection result. The mask is used for background removal and it is learned from the high-level feature response maps of the pre-trained VGG-net output. We next propose a multi-scale label smoothing model to further refine the detection result. The proposed model jointly optimizes the label smoothness of pixels and superpixels. Experiment results on three popular image co-saliency detection benchmark datasets including iCoseg, MSRC and Cosal2015 demonstrate the remarkable performance compared with the state-of-the-art methods.

PDF Abstract

Datasets


Results from the Paper


Ranked #8 on Co-Salient Object Detection on CoCA (S-measure metric)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Co-Salient Object Detection CoCA CSMG S-measure 0.627 # 8
max F-measure 0.499 # 8
mean E-measure 0.606 # 10
Mean F-measure 0.390 # 10

Results from Other Papers


Task Dataset Model Metric Name Metric Value Rank Source Paper Compare
Co-Salient Object Detection CoSal2015 CSMG MAE 0.130 # 10
S-measure 0.774 # 10
max F-measure 0.784 # 10
max E-measure 0.842 # 10
Co-Salient Object Detection CoSOD3k CSMG S-measure 0.711 # 10
max E-measure 0.804 # 9
max F-measure 0.709 # 9
MAE 0.157 # 10

Methods