Search Results for author:
Found 27 papers, 1 papers with code
Towards Selection of Text-to-speech Data to Augment ASR Training
This paper presents a method for selecting appropriate synthetic speech samples from a given large text-to-speech (TTS) dataset as supplementary training data for an automatic speech recognition (ASR) model.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Multi-Head State Space Model for Speech Recognition
State space models (SSMs) have recently shown promising results on small-scale sequence and language modelling tasks, rivalling and outperforming many attention-based approaches.
Improving Fast-slow Encoder based Transducer with Streaming Deliberation
Experiments on Librispeech and in-house data show relative WER reductions (WERRs) from 3% to 5% with a slight increase in model size and negligible extra token emission latency compared with fast-slow encoder based transducer.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Massively Multilingual ASR on 70 Languages: Tokenization, Architecture, and Generalization Capabilities
Later, we use our optimal tokenization strategy to train multiple embedding and output model to further improve our result.
Factorized Blank Thresholding for Improved Runtime Efficiency of Neural Transducers
We show how factoring the RNN-T's output distribution can significantly reduce the computation cost and power consumption for on-device ASR inference with no loss in accuracy.
Joint Audio/Text Training for Transformer Rescorer of Streaming Speech Recognition
In this work, we present our Joint Audio/Text training method for Transformer Rescorer, to leverage unpaired text-only data which is relatively cheaper than paired audio-text data.
Anchored Speech Recognition with Neural Transducers
In this paper, we investigate anchored speech recognition to make neural transducers robust to background speech.
Learning ASR pathways: A sparse multilingual ASR model
Neural network pruning compresses automatic speech recognition (ASR) models effectively.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
Learning a Dual-Mode Speech Recognition Model via Self-Pruning
There is growing interest in unifying the streaming and full-context automatic speech recognition (ASR) networks into a single end-to-end ASR model to simplify the model training and deployment for both use cases.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Deliberation Model for On-Device Spoken Language Understanding
We propose a novel deliberation-based approach to end-to-end (E2E) spoken language understanding (SLU), where a streaming automatic speech recognition (ASR) model produces the first-pass hypothesis and a second-pass natural language understanding (NLU) component generates the semantic parse by conditioning on both ASR's text and audio embeddings.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
Federated Domain Adaptation for ASR with Full Self-Supervision
Cross-device federated learning (FL) protects user privacy by collaboratively training a model on user devices, therefore eliminating the need for collecting, storing, and manually labeling user data.
Streaming parallel transducer beam search with fast-slow cascaded encoders
Streaming ASR with strict latency constraints is required in many speech recognition applications.
Neural-FST Class Language Model for End-to-End Speech Recognition
We propose Neural-FST Class Language Model (NFCLM) for end-to-end speech recognition, a novel method that combines neural network language models (NNLMs) and finite state transducers (FSTs) in a mathematically consistent framework.
Scaling ASR Improves Zero and Few Shot Learning
With 4. 5 million hours of English speech from 10 different sources across 120 countries and models of up to 10 billion parameters, we explore the frontiers of scale for automatic speech recognition.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Omni-sparsity DNN: Fast Sparsity Optimization for On-Device Streaming E2E ASR via Supernet
From wearables to powerful smart devices, modern automatic speech recognition (ASR) models run on a variety of edge devices with different computational budgets.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Evaluating User Perception of Speech Recognition System Quality with Semantic Distance Metric
Measuring automatic speech recognition (ASR) system quality is critical for creating user-satisfying voice-driven applications.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
Streaming Transformer Transducer Based Speech Recognition Using Non-Causal Convolution
This paper improves the streaming transformer transducer for speech recognition by using non-causal convolution.
Transferring Voice Knowledge for Acoustic Event Detection: An Empirical Study
Detection of common events and scenes from audio is useful for extracting and understanding human contexts in daily life.
Noisy Training Improves E2E ASR for the Edge
We apply noisy training to improve both dense and sparse state-of-the-art Emformer models and observe consistent WER reduction.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Collaborative Training of Acoustic Encoders for Speech Recognition
On-device speech recognition requires training models of different sizes for deploying on devices with various computational budgets.
Dissecting User-Perceived Latency of On-Device E2E Speech Recognition
As speech-enabled devices such as smartphones and smart speakers become increasingly ubiquitous, there is growing interest in building automatic speech recognition (ASR) systems that can run directly on-device; end-to-end (E2E) speech recognition models such as recurrent neural network transducers and their variants have recently emerged as prime candidates for this task.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Flexi-Transducer: Optimizing Latency, Accuracy and Compute forMulti-Domain On-Device Scenarios
In order to achieve flexible and better accuracy and latency trade-offs, the following techniques are used.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding
We define SemDist as the distance between a reference and hypothesis pair in a sentence-level embedding space.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+13
Dynamic Encoder Transducer: A Flexible Solution For Trading Off Accuracy For Latency
DET gets similar accuracy as a baseline model with better latency on a large in-house data set by assigning a lightweight encoder for the beginning part of one utterance and a full-size encoder for the rest.
Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusion
How to leverage dynamic contextual information in end-to-end speech recognition has remained an active research area.
SapAugment: Learning A Sample Adaptive Policy for Data Augmentation
Our policy adapts the augmentation parameters based on the training loss of the data samples.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Bandwidth Embeddings for Mixed-bandwidth Speech Recognition
In this paper, we tackle the problem of handling narrowband and wideband speech by building a single acoustic model (AM), also called mixed bandwidth AM.
