Search Results for author:
Found 16 papers, 2 papers with code
Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models
Large Language Models (LLMs) based on Mixture-of-Experts (MoE) architecture are showing promising performance on various tasks.
Towards ASR Robust Spoken Language Understanding Through In-Context Learning With Word Confusion Networks
In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text.
Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue
Specifically, our framework serializes tasks in the order of current paralinguistic attribute prediction, response paralinguistic attribute prediction, and response text generation with autoregressive conditioning.
Perseus: Removing Energy Bloat from Large Model Training
Training large AI models on numerous GPUs consumes a massive amount of energy.
Discriminative Speech Recognition Rescoring with Pre-trained Language Models
In this study, we propose and explore several discriminative fine-tuning schemes for pre-trained LMs.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting
We explore the ability of large language models (LLMs) to act as speech recognition post-processors that perform rescoring and error correction.
Ranked #3 on
Speech Recognition
on WSJ eval92
(using extra training data)
Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition
We propose a neural language modeling system based on low-rank adaptation (LoRA) for speech recognition output rescoring.
Personalization for BERT-based Discriminative Speech Recognition Rescoring
On a test set with personalized named entities, we show that each of these approaches improves word error rate by over 10%, against a neural rescoring baseline.
Scaling Laws for Discriminative Speech Recognition Rescoring Models
We study whether this scaling property is also applicable to second-pass rescoring, which is an important component of speech recognition systems.
Distillation Strategies for Discriminative Speech Recognition Rescoring
We also show that the proposed distillation can reduce the WER gap between the student and the teacher by 62% upto 100%.
Mitigating Closed-model Adversarial Examples with Bayesian Neural Modeling for Enhanced End-to-End Speech Recognition
In this work, we aim to enhance the system robustness of end-to-end automatic speech recognition (ASR) against adversarially-noisy speech examples.
RescoreBERT: Discriminative Speech Recognition Rescoring with BERT
Specifically, training a bidirectional model like BERT on a discriminative objective such as minimum WER (MWER) has not been explored.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+4
Personalization Strategies for End-to-End Speech Recognition Systems
We also describe a novel second-pass de-biasing approach: used in conjunction with a first-pass shallow fusion that optimizes on oracle WER, we can achieve an additional 14% improvement on personalized content recognition, and even improve accuracy for the general use case by up to 2. 5%.
Domain-aware Neural Language Models for Speech Recognition
As voice assistants become more ubiquitous, they are increasingly expected to support and perform well on a wide variety of use-cases across different domains.
Improving accuracy of rare words for RNN-Transducer through unigram shallow fusion
We show that this simple method can improve performance on rare words by 3. 7% WER relative without degradation on general test set, and the improvement from USF is additive to any additional language model based rescoring.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Multi-task Language Modeling for Improving Speech Recognition of Rare Words
We show that our rescoring model trained with these additional tasks outperforms the baseline rescoring model, trained with only the language modeling task, by 1. 4% on a general test and by 2. 6% on a rare word test set in terms of word-error-rate relative (WERR).
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
