Align and Distill: Unifying and Improving Domain Adaptive Object Detection
Object detectors often perform poorly on data that differs from their training set. Domain adaptive object detection (DAOD) methods have recently demonstrated strong results on addressing this challenge. Unfortunately, we identify systemic benchmarking pitfalls that call past results into question and hamper further progress: (a) Overestimation of performance due to underpowered baselines, (b) Inconsistent implementation practices preventing transparent comparisons of methods, and (c) Lack of generality due to outdated backbones and lack of diversity in benchmarks. We address these problems by introducing: (1) A unified benchmarking and implementation framework, Align and Distill (ALDI), enabling comparison of DAOD methods and supporting future development, (2) A fair and modern training and evaluation protocol for DAOD that addresses benchmarking pitfalls, (3) A new DAOD benchmark dataset, CFC-DAOD, enabling evaluation on diverse real-world data, and (4) A new method, ALDI++, that achieves state-of-the-art results by a large margin. ALDI++ outperforms the previous state-of-the-art by +3.5 AP50 on Cityscapes to Foggy Cityscapes, +5.7 AP50 on Sim10k to Cityscapes (where ours is the only method to outperform a fair baseline), and +2.0 AP50 on CFC Kenai to Channel. Our framework, dataset, and state-of-the-art method offer a critical reset for DAOD and provide a strong foundation for future research. Code and data are available: https://github.com/justinkay/aldi and https://github.com/visipedia/caltech-fish-counting.
PDF AbstractCode
Datasets
CFC-DAOD
Foggy Cityscapes
Sim10k
CFC
| Task | Dataset | Model | Metric Name | Metric Value | Global Rank | Benchmark |
|---|---|---|---|---|---|---|
| Unsupervised Domain Adaptation | CFC-DAOD | ALDI++ | AP@0.5 | 76.1 | # 1 | |
| Unsupervised Domain Adaptation | CFC-DAOD | UMT (with ALDI) | AP@0.5 | 61.2 | # 5 | |
| Unsupervised Domain Adaptation | CFC-DAOD | SADA (with ALDI) | AP@0.5 | 58.9 | # 6 | |
| Unsupervised Domain Adaptation | CFC-DAOD | PT (with ALDI) | AP@0.5 | 69.0 | # 4 | |
| Unsupervised Domain Adaptation | CFC-DAOD | MIC (with ALDI) | AP@0.5 | 74.1 | # 2 | |
| Unsupervised Domain Adaptation | CFC-DAOD | AT (with ALDI) | AP@0.5 | 69.1 | # 3 | |
| Unsupervised Domain Adaptation | Cityscapes to Foggy Cityscapes | ALDI++ | mAP@0.5 | 66.8 | # 1 | |
| Unsupervised Domain Adaptation | Cityscapes to Foggy Cityscapes | SADA (with ALDI) | mAP@0.5 | 54.2 | # 6 | |
| Unsupervised Domain Adaptation | Cityscapes to Foggy Cityscapes | PT (with ALDI) | mAP@0.5 | 59.2 | # 5 | |
| Unsupervised Domain Adaptation | Cityscapes to Foggy Cityscapes | UMT (with ALDI) | mAP@0.5 | 61.4 | # 4 | |
| Unsupervised Domain Adaptation | Cityscapes to Foggy Cityscapes | MIC (with ALDI) | mAP@0.5 | 61.7 | # 3 | |
| Unsupervised Domain Adaptation | Cityscapes to Foggy Cityscapes | AT (with ALDI) | mAP@0.5 | 63.3 | # 2 | |
| Unsupervised Domain Adaptation | SIM10K to Cityscapes | UMT (with ALDI) | mAP@0.5 | 58.7 | # 7 | |
| Unsupervised Domain Adaptation | SIM10K to Cityscapes | MIC (with ALDI) | mAP@0.5 | 73.1 | # 2 | |
| Unsupervised Domain Adaptation | SIM10K to Cityscapes | SADA (with ALDI) | mAP@0.5 | 71.8 | # 4 | |
| Unsupervised Domain Adaptation | SIM10K to Cityscapes | PT (with ALDI) | mAP@0.5 | 70.6 | # 5 | |
| Unsupervised Domain Adaptation | SIM10K to Cityscapes | AT (with ALDI) | mAP@0.5 | 72.0 | # 3 | |
| Unsupervised Domain Adaptation | SIM10K to Cityscapes | ALDI++ | mAP@0.5 | 78.2 | # 1 |
