DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
We present a large, tunable neural conversational response generation model, DialoGPT (dialogue generative pre-trained transformer). Trained on 147M conversation-like exchanges extracted from Reddit comment chains over a period spanning from 2005 through 2017, DialoGPT extends the Hugging Face PyTorch transformer to attain a performance close to human both in terms of automatic and human evaluation in single-turn dialogue settings... (read more)
PDFCode
Colab
Results from the Paper
Submit
results from this paper
to get state-of-the-art GitHub badges and help the
community compare results to other papers.
Residual Connection
BPE
Dense Connections
Label Smoothing
ReLU
Adam
Softmax
Dropout
Multi-Head Attention
Layer Normalization
Scaled Dot-Product Attention
Transformer