Background Learnable Cascade for Zero-Shot Object Detection

9 Oct 2020  ·  Ye Zheng, Ruoran Huang, Chuanqi Han, Xi Huang, Li Cui ·

Zero-shot detection (ZSD) is crucial to large-scale object detection with the aim of simultaneously localizing and recognizing unseen objects. There remain several challenges for ZSD, including reducing the ambiguity between background and unseen objects as well as improving the alignment between visual and semantic concept. In this work, we propose a novel framework named Background Learnable Cascade (BLC) to improve ZSD performance. The major contributions for BLC are as follows: (i) we propose a multi-stage cascade structure named Cascade Semantic R-CNN to progressively refine the alignment between visual and semantic of ZSD; (ii) we develop the semantic information flow structure and directly add it between each stage in Cascade Semantic RCNN to further improve the semantic feature learning; (iii) we propose the background learnable region proposal network (BLRPN) to learn an appropriate word vector for background class and use this learned vector in Cascade Semantic R CNN, this design makes \Background Learnable" and reduces the confusion between background and unseen classes. Our extensive experiments show BLC obtains significantly performance improvements for MS-COCO over state-of-the-art methods.

PDF Abstract


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Zero-Shot Object Detection MS-COCO BLC mAP 14.70 # 7
Recall 54.68 # 7
Generalized Zero-Shot Object Detection MS-COCO BLC HM(mAP) 19.20 # 7
HM(Recall) 53.92 # 7
Zero-Shot Object Detection PASCAL VOC'07 BLC mAP 55.20 # 6


No methods listed for this paper. Add relevant methods here