Bridging Adversarial and Statistical Domain Transfer via Spectral Adaptation Networks

25 Feb 2021  ·  Christoph Raab, Philipp Väth, Peter Meier, Frank-Michael Schleif ·

Statistical and adversarial adaptation are currently two extensive categories of neural network architectures in unsupervised deep domain adaptation. The latter has become the new standard due to its good theoretical foundation and empirical performance. However, there are two shortcomings. First, recent studies show that these approaches focus too much on easily transferable features and thus neglect important discriminative information. Second, adversarial networks are challenging to train. We addressed the first issue by the alignment of transferable spectral properties within an adversarial model to balance the focus between the easily transferable features and the necessary discriminatory features, while at the same time limiting the learning of domain-specific semantics by relevance considerations. Second, we stabilized the discriminator networks training procedure by Spectral Normalization employing the Lipschitz continuous gradients. We provide a theoretical and empirical evaluation of our improved approach and show its effectiveness in a performance study on standard benchmark data sets against various other state of the art methods.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Domain Adaptation ImageCLEF-DA ASAN Accuracy 88.6 # 9
Domain Adaptation Office-31 ASAN Average Accuracy 90.0 # 11
Domain Adaptation Office-Home ASAN Accuracy 68.6 # 21

Methods