Adversarially Learned Inference

We introduce the adversarially learned inference (ALI) model, which jointly learns a generation network and an inference network using an adversarial process. The generation network maps samples from stochastic latent variables to the data space while the inference network maps training examples in data space to the space of latent variables. An adversarial game is cast between these two networks and a discriminative network is trained to distinguish between joint latent/data-space samples from the generative network and joint samples from the inference network. We illustrate the ability of the model to learn mutually coherent inference and generation networks through the inspections of model samples and reconstructions and confirm the usefulness of the learned representations by obtaining a performance competitive with state-of-the-art on the semi-supervised SVHN and CIFAR10 tasks.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Image Generation CIFAR-10 ALI Inception score 5.34 # 71
Image-to-Image Translation Cityscapes Labels-to-Photo BiGAN Class IOU 0.02 # 5
Per-class Accuracy 6% # 5
Per-pixel Accuracy 19% # 12
Image-to-Image Translation Cityscapes Photo-to-Labels BiGAN Per-pixel Accuracy 41% # 5
Per-class Accuracy 13% # 3
Class IOU 0.07 # 4