no code implementations • 26 Dec 2024 • Jimmy Tobin, Katrin Tomanek, Subhashini Venugopalan
This study investigates the impact of integrating a dataset of disordered speech recordings ($\sim$1, 000 hours) into the fine-tuning of a near state-of-the-art ASR baseline system.
no code implementations • 25 Dec 2024 • Chirag Nagpal, Subhashini Venugopalan, Jimmy Tobin, Marilyn Ladewig, Katherine Heller, Katrin Tomanek
We introduce a large language model (LLM) capable of processing speech inputs and show that tuning it further with reinforcement learning on human preference (RLHF) enables it to adapt better to disordered speech than traditional fine-tuning.
no code implementations • 13 Sep 2024 • Pan-Pan Jiang, Jimmy Tobin, Katrin Tomanek, Robert L. MacDonald, Katie Seaver, Richard Cave, Marilyn Ladewig, Rus Heywood, Jordan R. Green
Project Euphonia, a Google initiative, is dedicated to improving automatic speech recognition (ASR) of disordered speech.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +2
no code implementations • 13 Mar 2023 • Subhashini Venugopalan, Jimmy Tobin, Samuel J. Yang, Katie Seaver, Richard J. N. Cave, Pan-Pan Jiang, Neil Zeghidour, Rus Heywood, Jordan Green, Michael P. Brenner
We developed dysarthric speech intelligibility classifiers on 551, 176 disordered speech samples contributed by a diverse set of 468 speakers, with a range of self-reported speaking disorders and rated for their overall intelligibility on a five-point scale.
no code implementations • 21 Sep 2022 • Jimmy Tobin, Qisheng Li, Subhashini Venugopalan, Katie Seaver, Richard Cave, Katrin Tomanek
BERTScore was found to be more correlated with human assessment of error type and assessment.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +2
no code implementations • 9 Oct 2021 • Jimmy Tobin, Katrin Tomanek
Word error rate (WER) thresholds were selected to determine Success Percentage (the percentage of personalized models reaching the target WER) in different application scenarios.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +1
no code implementations • 8 Jul 2021 • Subhashini Venugopalan, Joel Shor, Manoj Plakal, Jimmy Tobin, Katrin Tomanek, Jordan R. Green, Michael P. Brenner
Automatic classification of disordered speech can provide an objective tool for identifying the presence and severity of speech impairment.