Amendable Generation for Dialogue State Tracking

In task-oriented dialogue systems, recent dialogue state tracking methods tend to perform one-pass generation of the dialogue state based on the previous dialogue state. The mistakes of these models made at the current turn are prone to be carried over to the next turn, causing error propagation. In this paper, we propose a novel Amendable Generation for Dialogue State Tracking (AG-DST), which contains a two-pass generation process: (1) generating a primitive dialogue state based on the dialogue of the current turn and the previous dialogue state, and (2) amending the primitive dialogue state from the first pass. With the additional amending generation pass, our model is tasked to learn more robust dialogue state tracking by amending the errors that still exist in the primitive dialogue state, which plays the role of reviser in the double-checking process and alleviates unnecessary error propagation. Experimental results show that AG-DST significantly outperforms previous works in two active DST datasets (MultiWOZ 2.2 and WOZ 2.0), achieving new state-of-the-art performances.

PDF Abstract EMNLP (NLP4ConvAI) 2021 PDF EMNLP (NLP4ConvAI) 2021 Abstract

Results from the Paper

Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Multi-domain Dialogue State Tracking MULTIWOZ 2.2 AG-DST Joint Acc 57.26 # 2
Dialogue State Tracking Wizard-of-Oz AG-DST Joint 91.37 # 1