Discriminative Adversarial Domain Generalization with Meta-learning based Cross-domain Validation

1 Nov 2020  ·  Keyu Chen, Di Zhuang, J. Morris Chang ·

The generalization capability of machine learning models, which refers to generalizing the knowledge for an "unseen" domain via learning from one or multiple seen domain(s), is of great importance to develop and deploy machine learning applications in the real-world conditions. Domain Generalization (DG) techniques aim to enhance such generalization capability of machine learning models, where the learnt feature representation and the classifier are two crucial factors to improve generalization and make decisions. In this paper, we propose Discriminative Adversarial Domain Generalization (DADG) with meta-learning-based cross-domain validation. Our proposed framework contains two main components that work synergistically to build a domain-generalized DNN model: (i) discriminative adversarial learning, which proactively learns a generalized feature representation on multiple "seen" domains, and (ii) meta-learning based cross-domain validation, which simulates train/test domain shift via applying meta-learning techniques in the training process. In the experimental evaluation, a comprehensive comparison has been made among our proposed approach and other existing approaches on three benchmark datasets. The results shown that DADG consistently outperforms a strong baseline DeepAll, and outperforms the other existing DG algorithms in most of the evaluation cases.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Domain Generalization Office-Home DADG (ResNet-18) Average Accuracy 62.22 # 37
Domain Generalization PACS DADG (AlexNet) Average Accuracy 72.11 # 103
Domain Generalization PACS DADG (Resnet-18) Average Accuracy 80.38 # 86
Domain Generalization VLCS DADG (ResNet-18) Average Accuracy 78.21 # 26
Domain Generalization VLCS DADG (AlexNet) Average Accuracy 74.46 # 30

Methods


No methods listed for this paper. Add relevant methods here