Body Part-Based Representation Learning for Occluded Person Re-Identification

7 Nov 2022  ยท  Vladimir Somers, Christophe De Vleeschouwer, Alexandre Alahi ยท

Occluded person re-identification (ReID) is a person retrieval task which aims at matching occluded person images with holistic ones. For addressing occluded ReID, part-based methods have been shown beneficial as they offer fine-grained information and are well suited to represent partially visible human bodies. However, training a part-based model is a challenging task for two reasons. Firstly, individual body part appearance is not as discriminative as global appearance (two distinct IDs might have the same local appearance), this means standard ReID training objectives using identity labels are not adapted to local feature learning. Secondly, ReID datasets are not provided with human topographical annotations. In this work, we propose BPBreID, a body part-based ReID model for solving the above issues. We first design two modules for predicting body part attention maps and producing body part-based features of the ReID target. We then propose GiLt, a novel training scheme for learning part-based representations that is robust to occlusions and non-discriminative local appearance. Extensive experiments on popular holistic and occluded datasets show the effectiveness of our proposed method, which outperforms state-of-the-art methods by 0.7% mAP and 5.6% rank-1 accuracy on the challenging Occluded-Duke dataset. Our code is available at https://github.com/VlSomers/bpbreid.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Person Re-Identification DukeMTMC-reID BPBreID Rank-1 92.4 # 10
mAP 84.2 # 23
Person Re-Identification DukeMTMC-reID BPBreID (RK) Rank-1 93.9 # 5
mAP 92.9 # 3
Person Re-Identification Market-1501 BPBreID (RK) Rank-1 96.4 # 12
mAP 95.3 # 6
Person Re-Identification Market-1501 BPBreID Rank-1 95.7 # 30
mAP 89.4 # 46
Person Re-Identification Occluded-DukeMTMC BPBreID Rank-1 75.1 # 1
mAP 62.5 # 2
Person Re-Identification Occluded REID BPBreID Rank-1 82.9 # 2
mAP 75.2 # 1
Person Re-Identification P-DukeMTMC-reID BPBreID Rank-1 93.0 # 1
mAP 83.2 # 1

Methods