Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization

ICCV 2017  ·  Krishna Kumar Singh, Yong Jae Lee ·

We propose `Hide-and-Seek', a weakly-supervised framework that aims to improve object localization in images and action localization in videos. Most existing weakly-supervised methods localize only the most discriminative parts of an object rather than all relevant parts, which leads to suboptimal performance. Our key idea is to hide patches in a training image randomly, forcing the network to seek other relevant parts when the most discriminative part is hidden. Our approach only needs to modify the input image and can work with any network designed for object localization. During testing, we do not need to hide any patches. Our Hide-and-Seek approach obtains superior performance compared to previous methods for weakly-supervised object localization on the ILSVRC dataset. We also demonstrate that our framework can be easily extended to weakly-supervised action localization.

PDF Abstract ICCV 2017 PDF ICCV 2017 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Weakly Supervised Action Localization THUMOS 2014 Hide-and-seek mAP@0.5 6.8 # 26
mAP@0.1:0.7 - # 21

Methods


No methods listed for this paper. Add relevant methods here