MSINet: Twins Contrastive Search of Multi-Scale Interaction for Object ReID

Neural Architecture Search (NAS) has been increasingly appealing to the society of object Re-Identification (ReID), for that task-specific architectures significantly improve the retrieval performance. Previous works explore new optimizing targets and search spaces for NAS ReID, yet they neglect the difference of training schemes between image classification and ReID. In this work, we propose a novel Twins Contrastive Mechanism (TCM) to provide more appropriate supervision for ReID architecture search. TCM reduces the category overlaps between the training and validation data, and assists NAS in simulating real-world ReID training schemes. We then design a Multi-Scale Interaction (MSI) search space to search for rational interaction operations between multi-scale features. In addition, we introduce a Spatial Alignment Module (SAM) to further enhance the attention consistency confronted with images from different sources. Under the proposed NAS scheme, a specific architecture is automatically searched, named as MSINet. Extensive experiments demonstrate that our method surpasses state-of-the-art ReID methods on both in-domain and cross-domain scenarios. Source code available in https://github.com/vimar-gu/MSINet.

PDF Abstract CVPR 2023 PDF CVPR 2023 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Person Re-Identification Market-1501 MSINet (2.3M w/o RK) Rank-1 95.3 # 52
mAP 89.6 # 43
Person Re-Identification MSMT17 MSINet (2.3M w/o RK) Rank-1 81 # 26
mAP 59.6 # 26
Vehicle Re-Identification VehicleID Large MSINet (2.3M w/o RK) Rank-1 77.9 # 8
Rank-5 91.7 # 7
Vehicle Re-Identification VeRi-776 MSINet (2.3M w/o RK) mAP 78.8 # 12
Rank-1 96.8 # 7

Methods


No methods listed for this paper. Add relevant methods here