Controllable speech synthesis by learning discrete phoneme-level prosodic representations

no code implementations • 29 Nov 2022 • Nikolaos Ellinas, Myrsini Christidou, Alexandra Vioni, June Sig Sung, Aimilios Chalamandaris, Pirros Tsiakoulis, Paris Mastorocostas

The final model enables fine-grained phoneme-level prosody control for all speakers contained in the training set, while maintaining the speaker identity.

Speech Synthesis

Investigating Content-Aware Neural Text-To-Speech MOS Prediction Using Prosodic and Linguistic Features

no code implementations • 1 Nov 2022 • Alexandra Vioni, Georgia Maniati, Nikolaos Ellinas, June Sig Sung, Inchul Hwang, Aimilios Chalamandaris, Pirros Tsiakoulis

In modern high-quality neural TTS systems, prosodic appropriateness with regard to the spoken content is a decisive factor for speech naturalness.

POS Self-Supervised Learning

SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesis

no code implementations • 6 Apr 2022 • Georgia Maniati, Alexandra Vioni, Nikolaos Ellinas, Karolos Nikitaras, Konstantinos Klapsas, June Sig Sung, Gunu Jho, Aimilios Chalamandaris, Pirros Tsiakoulis

In this work, we present the SOMOS dataset, the first large-scale mean opinion scores (MOS) dataset consisting of solely neural text-to-speech (TTS) samples.

Speech Synthesis Text-To-Speech Synthesis

Improved Prosodic Clustering for Multispeaker and Speaker-independent Phoneme-level Prosody Control

no code implementations • 19 Nov 2021 • Myrsini Christidou, Alexandra Vioni, Nikolaos Ellinas, Georgios Vamvoukakis, Konstantinos Markopoulos, Panos Kakoulidis, June Sig Sung, Hyoungmin Park, Aimilios Chalamandaris, Pirros Tsiakoulis

This paper presents a method for phoneme-level prosody control of F0 and duration on a multispeaker text-to-speech setup, which is based on prosodic clustering.

Data Augmentation

Prosodic Clustering for Phoneme-level Prosody Control in End-to-End Speech Synthesis

no code implementations • 19 Nov 2021 • Alexandra Vioni, Myrsini Christidou, Nikolaos Ellinas, Georgios Vamvoukakis, Panos Kakoulidis, TaeHoon Kim, June Sig Sung, Hyoungmin Park, Aimilios Chalamandaris, Pirros Tsiakoulis

This paper presents a method for controlling the prosody at the phoneme level in an autoregressive attention-based text-to-speech system.

Speech Synthesis

Rapping-Singing Voice Synthesis based on Phoneme-level Prosody Control

no code implementations • 17 Nov 2021 • Konstantinos Markopoulos, Nikolaos Ellinas, Alexandra Vioni, Myrsini Christidou, Panos Kakoulidis, Georgios Vamvoukakis, Georgia Maniati, June Sig Sung, Hyoungmin Park, Pirros Tsiakoulis, Aimilios Chalamandaris

In this paper, a text-to-rapping/singing system is introduced, which can be adapted to any speaker's voice.

Singing Voice Synthesis