Search Results for author:
Found 19 papers, 10 papers with code
Requirements and Motivations of Low-Resource Speech Synthesis for Language Revitalization
This paper describes the motivation and development of speech synthesis systems for the purposes of language revitalization.
Revisiting Acoustic Similarity in Emotional Speech and Music via Self-Supervised Representations
In this work, we revisit the acoustic similarity between emotion speech and music, starting with an analysis of the layerwise behavior of SSL models for Speech Emotion Recognition (SER) and Music Emotion Recognition (MER).
Cross-lingual Speech Emotion Recognition: Humans vs. Self-Supervised Models
Utilizing Self-Supervised Learning (SSL) models for Speech Emotion Recognition (SER) has proven effective, yet limited research has explored cross-lingual scenarios.
Acquiring Pronunciation Knowledge from Transcribed Speech Audio via Multi-task Learning
Recent work has shown the feasibility and benefit of bootstrapping an integrated sequence-to-sequence (Seq2Seq) linguistic frontend from a traditional pipeline-based frontend for text-to-speech (TTS).
AccentBox: Towards High-Fidelity Zero-Shot Accent Generation
While recent Zero-Shot Text-to-Speech (ZS-TTS) models have achieved high naturalness and speaker similarity, they fall short in accent fidelity and control.
An Initial Investigation of Language Adaptation for TTS Systems under Low-resource Scenarios
Self-supervised learning (SSL) representations from massively multilingual models offer a promising solution for low-resource language speech tasks.
Multi-Modal Automatic Prosody Annotation with Contrastive Pretraining of SSWP
In expressive and controllable Text-to-Speech (TTS), explicit prosodic features significantly improve the naturalness and controllability of synthesised speech.
Predicting pairwise preferences between TTS audio stimuli using parallel ratings data and anti-symmetric twin neural networks
While previous work has focused on predicting listeners' ratings (mean opinion scores) of individual stimuli, we focus on the simpler task of predicting subjective preference given two speech stimuli for the same text.
Automatic audiovisual synchronisation for ultrasound tongue imaging
Our results demonstrate the strength of our approach and its ability to generalise to data from new domains.
Silent versus modal multi-speaker speech recognition from ultrasound and video
We observe that silent speech recognition from imaging data underperforms compared to modal speech recognition, likely due to a speaking-mode mismatch between training and testing.
Exploiting ultrasound tongue imaging for the automatic detection of speech articulation errors
For automatic velar fronting error detection, the best results are obtained when jointly using ultrasound and audio.
TaL: a synchronised multi-speaker corpus of ultrasound tongue imaging, audio, and lip videos
We present the Tongue and Lips corpus (TaL), a multi-speaker corpus of audio, ultrasound tongue imaging, and lip videos.
UltraSuite: A Repository of Ultrasound and Acoustic Data from Child Speech Therapy Sessions
In addition, it includes a set of annotations, some manual and some automatically produced, and software tools to process, transform and visualise the data.
Synchronising audio and ultrasound by learning cross-modal embeddings
Audiovisual synchronisation is the task of determining the time offset between speech audio and a video recording of the articulators.
Ultrasound tongue imaging for diarization and alignment of child speech therapy sessions
We investigate the automatic processing of child speech therapy sessions using ultrasound visual biofeedback, with a specific focus on complementing acoustic features with ultrasound images of the tongue for the tasks of speaker diarization and time-alignment of target words.
Speaker-independent classification of phonetic segments from raw ultrasound in child speech
Ultrasound tongue imaging (UTI) provides a convenient way to visualize the vocal tract during speech production.
Attentive Filtering Networks for Audio Replay Attack Detection
In this work, we propose our replay attacks detection system - Attentive Filtering Network, which is composed of an attention-based filtering mechanism that enhances feature representations in both the frequency and time domains, and a ResNet-based classifier.
A Multilinear Tongue Model Derived from Speech Related MRI Data of the Human Vocal Tract
We present a multilinear statistical model of the human tongue that captures anatomical and tongue pose related shape variations separately.
A statistical shape space model of the palate surface trained on 3D MRI scans of the vocal tract
The palate model is then tested using 3D MRI from another corpus and evaluated using a high-resolution optical scan.
