Search Results for author:
Found 10 papers, 3 papers with code
Automatic audiovisual synchronisation for ultrasound tongue imaging
Our results demonstrate the strength of our approach and its ability to generalise to data from new domains.
Silent versus modal multi-speaker speech recognition from ultrasound and video
We observe that silent speech recognition from imaging data underperforms compared to modal speech recognition, likely due to a speaking-mode mismatch between training and testing.
Exploiting ultrasound tongue imaging for the automatic detection of speech articulation errors
For automatic velar fronting error detection, the best results are obtained when jointly using ultrasound and audio.
TaL: a synchronised multi-speaker corpus of ultrasound tongue imaging, audio, and lip videos
We present the Tongue and Lips corpus (TaL), a multi-speaker corpus of audio, ultrasound tongue imaging, and lip videos.
Speaker-independent classification of phonetic segments from raw ultrasound in child speech
Ultrasound tongue imaging (UTI) provides a convenient way to visualize the vocal tract during speech production.
UltraSuite: A Repository of Ultrasound and Acoustic Data from Child Speech Therapy Sessions
In addition, it includes a set of annotations, some manual and some automatically produced, and software tools to process, transform and visualise the data.
Synchronising audio and ultrasound by learning cross-modal embeddings
Audiovisual synchronisation is the task of determining the time offset between speech audio and a video recording of the articulators.
Ultrasound tongue imaging for diarization and alignment of child speech therapy sessions
We investigate the automatic processing of child speech therapy sessions using ultrasound visual biofeedback, with a specific focus on complementing acoustic features with ultrasound images of the tongue for the tasks of speaker diarization and time-alignment of target words.
