Search Results for author:
Found 19 papers, 1 papers with code
Evaluating Sampling-based Filler Insertion with Spontaneous TTS
Perceptual results show little difference between compared filler insertion models including with ground-truth, which may be due to the ambiguity of what is good filler insertion and a strong neural spontaneous TTS that produces natural speech irrespective of input.
Speech Data Augmentation for Improving Phoneme Transcriptions of Aphasic Speech Using Wav2Vec 2.0 for the PSST Challenge
As part of the PSST challenge, we explore how data augmentations, data sources, and model size affect phoneme transcription accuracy on speech produced by individuals with aphasia.
On the Use of Self-Supervised Speech Representations in Spontaneous Speech Synthesis
Prior work has shown that SSL is an effective intermediate representation in two-stage text-to-speech (TTS) for both read and spontaneous speech.
Automatic Evaluation of Turn-taking Cues in Conversational Speech Synthesis
Turn-taking is a fundamental aspect of human communication where speakers convey their intention to either hold, or yield, their turn through prosodic cues.
A Comparative Study of Self-Supervised Speech Representations in Read and Spontaneous TTS
Recent work has explored using self-supervised learning (SSL) speech representations such as wav2vec2. 0 as the representation medium in standard two-stage TTS, in place of conventionally used mel-spectrograms.
Prosody-controllable spontaneous TTS with neural HMMs
Spontaneous speech has many affective and pragmatic functions that are interesting and challenging to model in TTS.
Integrated Speech and Gesture Synthesis
Text-to-speech and co-speech gesture synthesis have until now been treated as separate areas by two different research communities, and applications merely stack the two technologies using a simple system-level pipeline.
Chinese Whispers: A Multimodal Dataset for Embodied Language Grounding
In this paper, we introduce a multimodal dataset in which subjects are instructing each other how to assemble IKEA furniture.
Augmented Prompt Selection for Evaluation of Spontaneous Speech Synthesis
Spontaneous speech is emergent and transient, whereas text read out loud is pre-planned.
Machine Learning and Social Robotics for Detecting Early Signs of Dementia
This paper presents the EACare project, an ambitious multi-disciplinary collaboration with the aim to develop an embodied system, capable of carrying out neuropsychological tests to detect early signs of dementia, e. g., due to Alzheimer's disease.
Hidden Resources ― Strategies to Acquire and Exploit Potential Spoken Language Resources in National Archives
In 2014, the Swedish government tasked a Swedish agency, The Swedish Post and Telecom Authority (PTS), with investigating how to best create and populate an infrastructure for spoken language resources (Ref N2014/2840/ITP).
