Search Results for author: Jimmy Tobin

Found 7 papers, 0 papers with code

Towards a Single ASR Model That Generalizes to Disordered Speech

no code implementations26 Dec 2024 Jimmy Tobin, Katrin Tomanek, Subhashini Venugopalan

This study investigates the impact of integrating a dataset of disordered speech recordings ($\sim$1, 000 hours) into the fine-tuning of a near state-of-the-art ASR baseline system.

Fairness speech-recognition +1

Speech Recognition With LLMs Adapted to Disordered Speech Using Reinforcement Learning

no code implementations25 Dec 2024 Chirag Nagpal, Subhashini Venugopalan, Jimmy Tobin, Marilyn Ladewig, Katherine Heller, Katrin Tomanek

We introduce a large language model (LLM) capable of processing speech inputs and show that tuning it further with reinforcement learning on human preference (RLHF) enables it to adapt better to disordered speech than traditional fine-tuning.

Language Modeling Language Modelling +5

Speech Intelligibility Classifiers from 550k Disordered Speech Samples

no code implementations13 Mar 2023 Subhashini Venugopalan, Jimmy Tobin, Samuel J. Yang, Katie Seaver, Richard J. N. Cave, Pan-Pan Jiang, Neil Zeghidour, Rus Heywood, Jordan Green, Michael P. Brenner

We developed dysarthric speech intelligibility classifiers on 551, 176 disordered speech samples contributed by a diverse set of 468 speakers, with a range of self-reported speaking disorders and rated for their overall intelligibility on a five-point scale.

Personalized Automatic Speech Recognition Trained on Small Disordered Speech Datasets

no code implementations9 Oct 2021 Jimmy Tobin, Katrin Tomanek

Word error rate (WER) thresholds were selected to determine Success Percentage (the percentage of personalized models reaching the target WER) in different application scenarios.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

Cannot find the paper you are looking for? You can Submit a new open access paper.