Text-to-Text Pre-Training for Data-to-Text Tasks

21 May 2020Mihir Kale

We study the pre-train + fine-tune strategy for data-to-text tasks. Fine-tuning T5 achieves state-of-the-art results on the WebNLG, MultiWoz and ToTTo benchmarks... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT LEADERBOARD
Data-to-Text Generation ToTTo T5-3B BLEU 49.5 # 1
PARENT 58.4 # 1
Data-to-Text Generation WebNLG T5-Large BLEU 63.9 # 2
Data-to-Text Generation WebNLG T5-3B BLEU 62.8 # 3
Data-to-Text Generation WebNLG T5-Base BLEU 64.7 # 1
Data-to-Text Generation WebNLG T5-Small BLEU 62.6 # 4
Data-to-Text Generation WebNLG Full T5-Base BLEU 55.2 # 2
Data-to-Text Generation WebNLG Full T5-Large BLEU 57.1 # 1
Data-to-Text Generation WebNLG Full T5-3B BLEU 54.0 # 3
Data-to-Text Generation WebNLG Full T5-Small BLEU 52.0 # 6