Augmented Neural ODEs

We show that Neural Ordinary Differential Equations (ODEs) learn representations that preserve the topology of the input space and prove that this implies the existence of functions Neural ODEs cannot represent. To address these limitations, we introduce Augmented Neural ODEs which, in addition to being more expressive models, are empirically more stable, generalize better and have a lower computational cost than Neural ODEs.

PDF Abstract NeurIPS 2019 PDF NeurIPS 2019 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Image Classification CIFAR-10 ANODE Percentage correct 60.6 # 225
Image Classification MNIST Augmented Neural Ordinary Differential Equation Percentage error 0.37 # 21
Accuracy 99.63 # 14
Image Classification MNIST ANODE Percentage error 1.8 # 73
Accuracy 98.2 # 23
Image Classification SVHN ANODE Percentage error 16.5 # 48

Methods


No methods listed for this paper. Add relevant methods here