Neural Belief Tracker: Data-Driven Dialogue State Tracking

One of the core components of modern spoken dialogue systems is the belief tracker, which estimates the user's goal at every step of the dialogue. However, most current approaches have difficulty scaling to larger, more complex dialogue domains. This is due to their dependency on either: a) Spoken Language Understanding models that require large amounts of annotated training data; or b) hand-crafted lexicons for capturing some of the linguistic variation in users' language. We propose a novel Neural Belief Tracking (NBT) framework which overcomes these problems by building on recent advances in representation learning. NBT models reason over pre-trained word vectors, learning to compose them into distributed representations of user utterances and dialogue context. Our evaluation on two datasets shows that this approach surpasses past limitations, matching the performance of state-of-the-art models which rely on hand-crafted semantic lexicons and outperforming them when such lexicons are not provided.

PDF Abstract ACL 2017 PDF ACL 2017 Abstract

Datasets


Introduced in the Paper:

Wizard-of-Oz

Used in the Paper:

Dialogue State Tracking Challenge
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Dialogue State Tracking Second dialogue state tracking challenge Neural belief tracker Request 96.5 # 2
Area 90 # 2
Food 84 # 2
Price 94 # 1
Joint 73.4 # 5
Dialogue State Tracking Wizard-of-Oz Neural belief tracker Request 96.5 # 5
Joint 84.4 # 9

Methods


No methods listed for this paper. Add relevant methods here