Relational recurrent neural networks

NeurIPS 2018 Adam SantoroRyan FaulknerDavid RaposoJack RaeMike ChrzanowskiTheophane WeberDaan WierstraOriol VinyalsRazvan PascanuTimothy Lillicrap

Memory-based neural networks model temporal data by leveraging an ability to remember information for long periods. It is unclear, however, whether they also have an ability to perform complex relational reasoning with the information they remember... (read more)

PDF Abstract

Evaluation Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK COMPARE
Language Modelling WikiText-103 LSTM (RMC) Validation perplexity 30.8 # 14
Language Modelling WikiText-103 LSTM (RMC) Test perplexity 31.6 # 20