Search Results for author: Alexandra Markó

Found 4 papers, 3 papers with code

Adaptation of Tacotron2-based Text-To-Speech for Articulatory-to-Acoustic Mapping using Ultrasound Tongue Imaging

1 code implementation26 Jul 2021 Csaba Zainkó, László Tóth, Amin Honarmandi Shandiz, Gábor Gosztolya, Alexandra Markó, Géza Németh, Tamás Gábor Csapó

In this paper, we experimented with transfer learning and adaptation of a Tacotron2 text-to-speech model to improve the final synthesis quality of ultrasound-based articulatory-to-acoustic mapping with a limited database.

Transfer Learning

Speech Synthesis from Text and Ultrasound Tongue Image-based Articulatory Input

1 code implementation5 Jul 2021 Tamás Gábor Csapó, László Tóth, Gábor Gosztolya, Alexandra Markó

Besides, we analyze the ultrasound tongue recordings of several speakers, and show that misalignments in the ultrasound transducer positioning can have a negative effect on the final synthesis performance.

Speech Synthesis Text-To-Speech Synthesis

Ultrasound-based Articulatory-to-Acoustic Mapping with WaveGlow Speech Synthesis

1 code implementation6 Aug 2020 Tamás Gábor Csapó, Csaba Zainkó, László Tóth, Gábor Gosztolya, Alexandra Markó

The training target is the 80-dimensional mel-spectrogram, which results in a finer detailed spectral representation than the previously used 25-dimensional Mel-Generalized Cepstrum.

Audio and Speech Processing Sound

Ultrasound-based Silent Speech Interface Built on a Continuous Vocoder

no code implementations24 Jun 2019 Tamás Gábor Csapó, Mohammed Salah Al-Radhi, Géza Németh, Gábor Gosztolya, Tamás Grósz, László Tóth, Alexandra Markó

Recently it was shown that within the Silent Speech Interface (SSI) field, the prediction of F0 is possible from Ultrasound Tongue Images (UTI) as the articulatory input, using Deep Neural Networks for articulatory-to-acoustic mapping.

Sound Audio and Speech Processing

Cannot find the paper you are looking for? You can Submit a new open access paper.