Hierarchical Dialogue Understanding with Special Tokens and Turn-level Attention

Compared with standard text, understanding dialogue is more challenging for machines as the dynamic and unexpected semantic changes in each turn. To model such inconsistent semantics, we propose a simple but effective Hierarchical Dialogue Understanding model, HiDialog. Specifically, we first insert multiple special tokens into a dialogue and propose the turn-level attention to learn turn embeddings hierarchically. Then, a heterogeneous graph module is leveraged to polish the learned embeddings. We evaluate our model on various dialogue understanding tasks including dialogue relation extraction, dialogue emotion recognition, and dialogue act classification. Results show that our simple approach achieves state-of-the-art performance on all three tasks above. All our source code is publicly available at https://github.com/ShawX825/HiDialog.

PDF Abstract Tiny Papers 2023 PDF Tiny Papers 2023 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Dialog Relation Extraction DialogRE HiDialog F1c (v2) 68.2 # 2
F1 (v2) 77.1 # 1
Emotion Recognition in Conversation MELD HiDialog Weighted-F1 66.96 # 3

Methods


No methods listed for this paper. Add relevant methods here