CORE-ReID: Comprehensive Optimization and Refinement through Ensemble Fusion in Domain Adaptation for Person Re-Identification
This study introduces a novel framework, βComprehensive Optimization and Refinement through Ensemble Fusion in Domain Adaptation for Person Re-identification (CORE-ReID)β, to address an Unsupervised Domain Adaptation (UDA) for Person Re-identification (ReID). The framework utilizes CycleGAN to generate diverse data that harmonize differences in image characteristics from different camera sources in the pre-training stage. In the fine-tuning stage, based on a pair of teacherβstudent networks, the framework integrates multi-view features for multi-level clustering to derive diverse pseudo-labels. A learnable Ensemble Fusion component that focuses on fine grained local information within global features is introduced to enhance learning comprehensiveness and avoid ambiguity associated with multiple pseudo-labels. Experimental results on three common UDAs in Person ReID demonstrated significant performance gains over state-of-the-art approaches. Additional enhancements, such as Efficient Channel Attention Block and Bidirectional Mean Feature Normalization mitigate deviation effects and the adaptive fusion of global and local features using the ResNet-based model, further strengthening the framework. The proposed framework ensures clarity in fusion features, avoids ambiguity, and achieves high accuracy in terms of Mean Average Precision, Top-1, Top-5, and Top-10, positioning it as an advanced and effective solution for UDA in Person ReID.
PDFCode
Datasets
Results from the Paper
Task | Dataset | Model | Metric Name | Metric Value | Global Rank | Benchmark |
---|---|---|---|---|---|---|
Unsupervised Domain Adaptation | CUHK03 to Market | CORE-ReID | mAP | 83.6 | # 2 | |
R1 | 93.6 | # 2 | ||||
R5 | 97.3 | # 2 | ||||
R10 | 98.7 | # 1 | ||||
Unsupervised Domain Adaptation | CUHK03 to MSMT | CORE-ReID | R1 | 67.3 | # 2 | |
mAP | 40.4 | # 2 | ||||
R5 | 79.0 | # 2 | ||||
R10 | 83.1 | # 2 | ||||
Unsupervised Person Re-Identification | DukeMTMC-reID->Market-1501 | CORE-ReID | mAP | 84.4 | # 1 | |
Rank-1 | 93.6 | # 1 | ||||
Rank-10 | 98.7 | # 1 | ||||
Rank-5 | 97.7 | # 1 | ||||
Unsupervised Person Re-Identification | DukeMTMC-reID->MSMT17 | CORE-ReID | mAP | 45.2 | # 1 | |
Rank-1 | 72.2 | # 1 | ||||
Rank-10 | 86.3 | # 1 | ||||
Rank-5 | 82.9 | # 1 | ||||
Unsupervised Domain Adaptation | Duke to Market | CORE-ReID | mAP | 84.4 | # 1 | |
rank-1 | 93.6 | # 1 | ||||
rank-5 | 97.7 | # 1 | ||||
rank-10 | 98.7 | # 1 | ||||
Unsupervised Domain Adaptation | Duke to MSMT | CORE-ReID | mAP | 45.2 | # 1 | |
rank-1 | 72.2 | # 1 | ||||
rank-5 | 82.9 | # 1 | ||||
rank-10 | 86.3 | # 1 | ||||
Unsupervised Person Re-Identification | Market-1501->DukeMTMC-reID | CORE-ReID | mAP | 74.8 | # 1 | |
Rank-1 | 84.8 | # 1 | ||||
Rank-10 | 94.4 | # 1 | ||||
Rank-5 | 92.4 | # 2 | ||||
Unsupervised Person Re-Identification | Market-1501->MSMT17 | CORE-ReID | mAP | 41.9 | # 1 | |
Rank-1 | 69.5 | # 1 | ||||
Rank-10 | 84.4 | # 1 | ||||
Rank-5 | 80.3 | # 1 | ||||
Unsupervised Domain Adaptation | Market to CUHK03 | CORE-ReID | mAP | 62.9 | # 2 | |
R1 | 61.0 | # 2 | ||||
R5 | 79.6 | # 2 | ||||
R10 | 87.2 | # 2 | ||||
Unsupervised Domain Adaptation | Market to Duke | CORE-ReID | mAP | 74.8 | # 1 | |
rank-1 | 84.8 | # 2 | ||||
rank-5 | 92.4 | # 1 | ||||
rank-10 | 94.4 | # 1 | ||||
Unsupervised Domain Adaptation | Market to MSMT | CORE-ReID | mAP | 41.9 | # 2 | |
rank-1 | 69.5 | # 2 | ||||
rank-5 | 80.3 | # 2 | ||||
rank-10 | 84.4 | # 2 |