Attention-based Ensemble for Deep Metric Learning

Deep metric learning aims to learn an embedding function, modeled as deep neural network. This embedding function usually puts semantically similar images close while dissimilar images far from each other in the learned embedding space. Recently, ensemble has been applied to deep metric learning to yield state-of-the-art results. As one important aspect of ensemble, the learners should be diverse in their feature embeddings. To this end, we propose an attention-based ensemble, which uses multiple attention masks, so that each learner can attend to different parts of the object. We also propose a divergence loss, which encourages diversity among the learners. The proposed method is applied to the standard benchmarks of deep metric learning and experimental results show that it outperforms the state-of-the-art methods by a significant margin on image retrieval tasks.

PDF Abstract ECCV 2018 PDF ECCV 2018 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Metric Learning CARS196 ABE-8-512 R@1 85.2 # 27
Metric Learning CUB-200-2011 ABE-8-512 R@1 60.6 # 26
Image Retrieval In-Shop ABE-8 R@1 87.3 # 7
Image Retrieval SOP ABE-8 R@1 76.3 # 12

Methods


No methods listed for this paper. Add relevant methods here