Feature Quantization Improves GAN Training

The instability in GAN training has been a long-standing problem despite remarkable research efforts. We identify that instability issues stem from difficulties of performing feature matching with mini-batch statistics, due to a fragile balance between the fixed target distribution and the progressively generated distribution... (read more)

PDF Abstract ICML 2020 PDF
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK BENCHMARK
Image-to-Image Translation anime-to-selfie FQ-GAN Kernel Inception Distance 10.23 # 1
Conditional Image Generation CIFAR-10 FQ-GAN Inception score 8.50 # 9
FID 5.34 # 3
Conditional Image Generation CIFAR-100 FQ-GAN Inception Score 9.74 # 2
FID 7.15 # 1
Image Generation FFHQ FQ-GAN FID 3.19 # 3
Conditional Image Generation ImageNet 128x128 FQ-GAN FID 13.77 # 9
Inception score 54.36 # 9
Conditional Image Generation ImageNet64x64 FQ-GAN Inception Score 25.96 # 2
FID 9.67 # 2
Image-to-Image Translation selfie-to-anime FQ-GAN Kernel Inception Distance 11.40 # 1

Methods used in the Paper


METHOD TYPE
Softmax
Output Functions
ReLU
Activation Functions
Conditional Batch Normalization
Normalization
Residual Block
Skip Connection Blocks
TTUR
Optimization
GAN Hinge Loss
Loss Functions
Residual Connection
Skip Connections
Non-Local Operation
Image Feature Extractors
Non-Local Block
Image Model Blocks
Truncation Trick
Latent Variable Sampling
Linear Layer
Feedforward Networks
Dot-Product Attention
Attention Mechanisms
Projection Discriminator
Discriminators
Spectral Normalization
Normalization
Off-Diagonal Orthogonal Regularization
Regularization
Adam
Stochastic Optimization
Batch Normalization
Normalization
Early Stopping
Regularization
1x1 Convolution
Convolutions
SAGAN Self-Attention Module
Attention Modules
SAGAN
Generative Adversarial Networks
GAN Feature Matching
Regularization
BigGAN
Generative Models
Adaptive Instance Normalization
Normalization
R1 Regularization
Regularization
Leaky ReLU
Activation Functions
Dense Connections
Feedforward Networks
Feedforward Network
Feedforward Networks
StyleGAN
Generative Models
Convolution
Convolutions
GAN
Generative Models