JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detection

CVPR 2020  ·  Keren Fu, Deng-Ping Fan, Ge-Peng Ji, Qijun Zhao ·

This paper proposes a novel joint learning and densely-cooperative fusion (JL-DCF) architecture for RGB-D salient object detection. Existing models usually treat RGB and depth as independent information and design separate networks for feature extraction from each... Such schemes can easily be constrained by a limited amount of training data or over-reliance on an elaborately-designed training process. In contrast, our JL-DCF learns from both RGB and depth inputs through a Siamese network. To this end, we propose two effective components: joint learning (JL), and densely-cooperative fusion (DCF). The JL module provides robust saliency feature learning, while the latter is introduced for complementary feature discovery. Comprehensive experiments on four popular metrics show that the designed framework yields a robust RGB-D saliency detector with good generalization. As a result, JL-DCF significantly advances the top-1 D3Net model by an average of ~1.9% (S-measure) across six challenging datasets, showing that the proposed framework offers a potential solution for real-world applications and could provide more insight into the cross-modality complementarity task. The code will be available at https://github.com/kerenfu/JLDCF/. read more

PDF Abstract CVPR 2020 PDF CVPR 2020 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
RGB-D Salient Object Detection DES JL-DCF S-Measure 92.9 # 8
Average MAE 0.022 # 8
max E-Measure 96.8 # 4
max F-Measure 91.9 # 6
RGB-D Salient Object Detection NJU2K JL-DCF S-Measure 90.3 # 8
Average MAE 0.043 # 10
max E-Measure 94.4 # 5
max F-Measure 90.3 # 7
RGB-D Salient Object Detection NLPR JL-DCF S-Measure 92.5 # 5
Average MAE 0.022 # 2
max F-Measure 91.6 # 5
max E-Measure 96.2 # 3
RGB-D Salient Object Detection SIP JL-DCF S-Measure 87.9 # 5
max E-Measure 92.3 # 4
max F-Measure 88.5 # 4
Average MAE 0.051 # 6
RGB-D Salient Object Detection STERE JL-DCF S-Measure 90.5 # 5
Average MAE 0.042 # 8
max F-Measure 90.1 # 5
max E-Measure 94.6 # 3

Methods


No methods listed for this paper. Add relevant methods here