Deep Learning for Person Re-identification: A Survey and Outlook

13 Jan 2020  ยท  Mang Ye, Jianbing Shen, Gaojie Lin, Tao Xiang, Ling Shao, Steven C. H. Hoi ยท

Person re-identification (Re-ID) aims at retrieving a person of interest across multiple non-overlapping cameras. With the advancement of deep neural networks and increasing demand of intelligent video surveillance, it has gained significantly increased interest in the computer vision community. By dissecting the involved components in developing a person Re-ID system, we categorize it into the closed-world and open-world settings. The widely studied closed-world setting is usually applied under various research-oriented assumptions, and has achieved inspiring success using deep learning techniques on a number of datasets. We first conduct a comprehensive overview with in-depth analysis for closed-world person Re-ID from three different perspectives, including deep feature representation learning, deep metric learning and ranking optimization. With the performance saturation under closed-world setting, the research focus for person Re-ID has recently shifted to the open-world setting, facing more challenging issues. This setting is closer to practical applications under specific scenarios. We summarize the open-world Re-ID in terms of five different aspects. By analyzing the advantages of existing methods, we design a powerful AGW baseline, achieving state-of-the-art or at least comparable performance on twelve datasets for FOUR different Re-ID tasks. Meanwhile, we introduce a new evaluation metric (mINP) for person Re-ID, indicating the cost for finding all the correct matches, which provides an additional criteria to evaluate the Re-ID system for real applications. Finally, some important yet under-investigated open issues are discussed.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Person Re-Identification CUHK03-C AGW (ResNet-50) Rank-1 5.90 # 6
mAP 3.45 # 7
mINP 0.46 # 5
Person Re-Identification Market-1501-C AGW (ResNet-50) Rank-1 31.90 # 11
mAP 12.13 # 7
mINP 0.35 # 8
Person Re-Identification MSMT17-C AGW (ResNet-50) Rank-1 22.77 # 3
mAP 6.53 # 3
mINP 0.08 # 1
Cross-Modal Person Re-Identification RegDB-C AGW (ResNet-50) Rank-1 (Visible to Thermal) 45.44 # 1
mAP (Visbile to Thermal) 43.09 # 1
mINP (Visible to Thermal) 32.88 # 1
Rank-1 (Thermal to Visible) 67.54 # 1
mAP (Thermal to Visible) 41.37 # 1
mINP (Thermal to Visible) 6.00 # 1
Person Re-Identification SYSU-MM01-C AGW (ResNet-50) Rank-1 (All Search) 34.42 # 1
mAP (All Search) 29.99 # 1
mINP (All Search) 14.73 # 1
Rank-1 (Indoor Search) 33.80 # 1
mAP (Indoor Search) 40.98 # 1
mINP (Indoor Search) 35.39 # 1

Methods


No methods listed for this paper. Add relevant methods here