Text Generation
Text generation is the task of generating text with the goal of appearing indistinguishable to human-written text.
( Image credit: Adversarial Ranking for Language Generation )
Leaderboards
| TREND | DATASET | BEST METHOD | PAPER TITLE | PAPER | CODE | COMPARE |
|---|---|---|---|---|---|---|
|
||||||
|
||||||
|
||||||
|
||||||
|
||||||
|
||||||
|
||||||
|
Subtasks
Greatest papers with code
MaskGAN: Better Text Generation via Filling in the______
Additionally, these models are typically trained via maxi- mum likelihood and teacher forcing.
#3 best model for
Multivariate Time Series Imputation
on Basketball Players Movement
Language Models are Unsupervised Multitask Learners
Preprint 2019
• huggingface/pytorch-transformers
• 
Natural language processing tasks, such as question answering, machine translation, reading comprehension, and summarization, are typically approached with supervised learning on taskspecific datasets.
SOTA for Language Modelling on Text8 (using extra training data)
COMMON SENSE REASONING DOCUMENT SUMMARIZATION LANGUAGE MODELLING MACHINE TRANSLATION QUESTION ANSWERING READING COMPREHENSION TEXT GENERATION
HuggingFace's Transformers: State-of-the-art Natural Language Processing
In this paper, we present HuggingFace's Transformers library, a library for state-of-the-art NLP, making these developments available to the community by gathering state-of-the-art general-purpose pretrained models under a unified API together with an ecosystem of libraries, examples, tutorials and scripts targeting many downstream NLP tasks.
CTRL: A Conditional Transformer Language Model for Controllable Generation
Preprint 2019
• huggingface/transformers
•
Large-scale language models show promising text generation capabilities, but users cannot easily control particular aspects of the generated text.
Generating Sequences With Recurrent Neural Networks
This paper shows how Long Short-term Memory recurrent neural networks can be used to generate complex sequences with long-range structure, simply by predicting one data point at a time.
Neural Assistant: Joint Action Prediction, Response Generation, and Latent Knowledge Reasoning
In this paper, we develop Neural Assistant: a single neural network model that takes conversation history and an external knowledge source as input and jointly produces both text response and action to be taken by the system as output.
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
NAACL 2019
• facebookresearch/fairseq-py
•
fairseq is an open-source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text generation tasks.
Mixture Models for Diverse Machine Translation: Tricks of the Trade
• pytorch/fairseq
•
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models
• pytorch/fairseq
•
We observe that our method consistently outperforms BS and previously proposed techniques for diverse decoding from neural sequence models.
IMAGE CAPTIONING MACHINE TRANSLATION QUESTION GENERATION TEXT GENERATION TIME SERIES
Sequence-to-Sequence Learning as Beam-Search Optimization
EMNLP 2016
• facebookresearch/fairseq-py
•
In this work, we introduce a model and beam-search training scheme, based on the work of Daume III and Marcu (2005), that extends seq2seq to learn global sequence scores.
#17 best model for
Machine Translation
on IWSLT2015 German-English