FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models

A promising class of generative models maps points from a simple distribution to a complex distribution through an invertible neural network. Likelihood-based training of these models requires restricting their architectures to allow cheap computation of Jacobian determinants... (read more)

PDF Abstract ICLR 2019 PDF ICLR 2019 Abstract

Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Density Estimation BSDS300 FFJORD NLL -157.4 # 1
Density Estimation Caltech-101 FFJORD Negative ELBO 104.03 # 1
Density Estimation CIFAR-10 FFJORD NLL 3.4 # 1
Image Generation CIFAR-10 FFJORD bits/dimension 3.4 # 25
Density Estimation Freyfaces FFJORD Negative ELBO 4.39 # 1
Density Estimation MNIST FFJORD NLL 0.99 # 1
Negative ELBO 82.82 # 1
Density Estimation OMNIGLOT FFJORD Negative ELBO 98.33 # 1
Density Estimation UCI GAS FFJORD Log-likelihood 8.59 # 3
Density Estimation UCI HEPMASS FFJORD Log-likelihood -14.92 # 1
NLL 14.92 # 1
Density Estimation UCI MINIBOONE FFJORD Log-likelihood -10.43 # 1
NLL 10.43 # 1
Density Estimation UCI POWER FFJORD Log-likelihood 0.46 # 3
NLL -0.46 # 1

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet