A Simple Method for Commonsense Reasoning

7 Jun 2018Trieu H. Trinh • Quoc V. Le

For example, it is difficult to use neural networks to tackle the Winograd Schema dataset~\cite{levesque2011winograd}. In this paper, we present a simple method for commonsense reasoning with neural networks, using unsupervised learning. On both Pronoun Disambiguation and Winograd Schema challenges, our models outperform previous state-of-the-art methods by a large margin, without using expensive annotated knowledge bases or hand-engineered features.

Full paper

Evaluation


Task Dataset Model Metric name Metric value Global rank Compare
Common Sense Reasoning Winograd Schema Challenge Word-LM-partial Score 62.6 # 2
Common Sense Reasoning Winograd Schema Challenge Char-LM-partial Score 57.9 # 3