Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks

ICLR 2019 Yikang ShenShawn TanAlessandro SordoniAaron Courville

Natural language is hierarchically structured: smaller units (e.g., phrases) are nested within larger units (e.g., clauses). When a larger constituent ends, all of the smaller constituents that are nested within it must also be closed... (read more)

PDF Abstract ICLR 2019 PDF ICLR 2019 Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Constituency Grammar Induction PTB ON-LSTM Max F1 (WSJ) 49.4 # 7
Mean F1 (WSJ10) 65.1 # 2
Max F1 (WSJ10) 66.8 # 2
Mean F1 (WSJ) 47.7 # 7
Constituency Grammar Induction PTB ON-LSTM (tuned) Max F1 (WSJ) 50.0 # 5
Mean F1 (WSJ) 48.1 # 5

Methods used in the Paper