Speech Synthesis
Speech synthesis is the task of generating speech from text.
Please note that the state-of-the-art tables here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.
State-of-the-art leaderboards
| Trend | Dataset | Best Method | Paper title | Paper | Code | Compare |
|---|---|---|---|---|---|---|
|
||||||
|
Greatest papers with code
Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis
NeurIPS 2018
• CorentinJ/Real-Time-Voice-Cloning
• 
Clone a voice in 5 seconds to generate arbitrary speech in real-time
SOTA for Text-To-Speech Synthesis on LJSpeech (using extra training data)
SPEAKER VERIFICATION SPEECH SYNTHESIS TEXT-TO-SPEECH SYNTHESIS TRANSFER LEARNING
Efficient Neural Audio Synthesis
ICML 2018
• CorentinJ/Real-Time-Voice-Cloning
•
The small number of weights in a Sparse WaveRNN makes it possible to sample high-fidelity audio on a mobile CPU in real time.
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions
• CorentinJ/Real-Time-Voice-Cloning
•
This paper describes Tacotron 2, a neural network architecture for speech synthesis directly from text.
Tacotron: Towards End-to-End Speech Synthesis
A text-to-speech synthesis system typically consists of multiple stages, such as a text analysis frontend, an acoustic model and an audio synthesis module.
#4 best model for
Speech Synthesis
on North American English
WaveGlow: A Flow-based Generative Network for Speech Synthesis
• NVIDIA/waveglow
•
In this paper we propose WaveGlow: a flow-based network capable of generating high quality speech from mel-spectrograms.
WaveNet: A Generative Model for Raw Audio
This paper introduces WaveNet, a deep neural network for generating raw audio waveforms.
SOTA for Speech Synthesis on Mandarin Chinese
Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning
ICLR 2018
• r9y9/deepvoice3_pytorch
•
We present Deep Voice 3, a fully-convolutional attention-based neural text-to-speech (TTS) system.
Mixed-Precision Training for NLP and Speech Recognition with OpenSeq2Seq
We present OpenSeq2Seq - a TensorFlow-based toolkit for training sequence-to-sequence models that features distributed and mixed-precision training.
Deep Voice: Real-time Neural Text-to-Speech
We present Deep Voice, a production-quality text-to-speech system constructed entirely from deep neural networks.
A Real-Time Wideband Neural Vocoder at 1.6 kb/s Using LPCNet
We demonstrate that LPCNet operating at 1. 6 kb/s achieves significantly higher quality than MELP and that uncompressed LPCNet can exceed the quality of a waveform codec operating at low bitrate.