Trellis Networks for Sequence Modeling

ICLR 2019 Shaojie BaiJ. Zico KolterVladlen Koltun

We present trellis networks, a new architecture for sequence modeling. On the one hand, a trellis network is a temporal convolutional network with special structure, characterized by weight tying across depth and direct injection of the input into deep layers... (read more)

PDF Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT LEADERBOARD
Language Modelling Penn Treebank (Character Level) Trellis Network Bit per Character (BPC) 1.158 # 2
Number of params 13.4M # 1
Language Modelling Penn Treebank (Word Level) Trellis Network Test perplexity 54.19 # 15
Sequential Image Classification Sequential CIFAR-10 Trellis Network Unpermuted Accuracy 73.42% # 1
Language Modelling WikiText-103 Trellis Network Test perplexity 29.19 # 18