GAN Feature Matching

Introduced by Salimans et al. in Improved Techniques for Training GANs

Feature Matching is a regularizing objective for a generator in generative adversarial networks that prevents it from overtraining on the current discriminator. Instead of directly maximizing the output of the discriminator, the new objective requires the generator to generate data that matches the statistics of the real data, where we use the discriminator only to specify the statistics that we think are worth matching. Specifically, we train the generator to match the expected value of the features on an intermediate layer of the discriminator. This is a natural choice of statistics for the generator to match, since by training the discriminator we ask it to find those features that are most discriminative of real data versus data generated by the current model.

Letting $\mathbf{f}\left(\mathbf{x}\right)$ denote activations on an intermediate layer of the discriminator, our new objective for the generator is defined as: $ ||\mathbb{E}_{x\sim p_{data} } \mathbf{f}\left(\mathbf{x}\right) − \mathbb{E}_{\mathbf{z}∼p_{\mathbf{z}}\left(\mathbf{z}\right)}\mathbf{f}\left(G\left(\mathbf{z}\right)\right)||^{2}_{2} $. The discriminator, and hence $\mathbf{f}\left(\mathbf{x}\right)$, are trained as with vanilla GANs. As with regular GAN training, the objective has a fixed point where G exactly matches the distribution of training data.

Source: Improved Techniques for Training GANs

Latest Papers

Imbalanced Data Learning by Minority Class Augmentation using Capsule Adversarial Networks
Pourya ShamsolmoaliMasoumeh ZareapoorLinlin ShenAbdul Hamid SadkaJie Yang
Feature Quantization Improves GAN Training
| Yang ZhaoChunyuan LiPing YuJianfeng GaoChangyou Chen
Learning the Loss Functions in a Discriminative Space for Video Restoration
Younghyun JoJaeyeon KangSeoung Wug OhSeonghyeon NamPeter VajdaSeon Joo Kim
Image Fine-grained Inpainting
| Zheng HuiJie LiXiumei WangXinbo Gao
Semi-Supervised Self-Growing Generative Adversarial Networks for Image Recognition
Haoqian WangZhiwei XuJun XuWangpeng AnLei ZhangQionghai Dai
Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning
| Arnab Kumar MondalJose DolzChristian Desrosiers
A Generative Model of Textures Using Hierarchical Probabilistic Principal Component Analysis
Aiga SuzukiHayaru Shouno
Out-of-domain Detection based on Generative Adversarial Network
Seonghan RyuSangjun KooHwanjo YuGary Geunbae Lee
Adversarial Training for Adverse Conditions: Robust Metric Localisation using Appearance Transfer
Horia PoravWill MaddernPaul Newman
Novelty Detection with GAN
Mark KligerShachar Fleishman
Bayesian GAN
| Yunus SaatciAndrew G. Wilson
Bayesian GAN
| Yunus SaatchiAndrew Gordon Wilson
CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training
| Jianmin BaoDong ChenFang WenHouqiang LiGang Hua
Improved Techniques for Training GANs
| Tim SalimansIan GoodfellowWojciech ZarembaVicki CheungAlec RadfordXi Chen


🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign