MultiWOZ 2.1: A Consolidated Multi-Domain Dialogue Dataset with State Corrections and State Tracking Baselines

LREC 2020 Mihail EricRahul GoelShachi PaulAdarsh KumarAbhishek SethiPeter KuAnuj Kumar GoyalSanchit AgarwalShuyang GaoDilek Hakkani-Tur

MultiWOZ 2.0 (Budzianowski et al., 2018) is a recently released multi-domain dialogue dataset spanning 7 distinct domains and containing over 10,000 dialogues. Though immensely useful and one of the largest resources of its kind to-date, MultiWOZ 2.0 has a few shortcomings... (read more)

PDF Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT LEADERBOARD
Multi-domain Dialogue State Tracking MULTIWOZ 2.0 TRADE Joint Acc 48.6 # 5
Multi-domain Dialogue State Tracking MULTIWOZ 2.1 TRADE Joint Acc 45.6 # 4