Enhancing Multilingual Speech Recognition through Language Prompt Tuning and Frame-Level Language Adapter

no code implementations • 18 Sep 2023 • Song Li, Yongbin You, Xuezhi Wang, Ke Ding, Guanglu Wan

To further expand the applications of multilingual artificial intelligence assistants and facilitate international communication, it is essential to enhance the performance of multilingual speech recognition, which is a crucial component of speech interaction.

speech-recognition Speech Recognition

Dynamic latency speech recognition with asynchronous revision

no code implementations • 3 Nov 2020 • Mingkun Huang, Meng Cai, Jun Zhang, Yang Zhang, Yongbin You, Yi He, Zejun Ma

In this work we propose an inference technique, asynchronous revision, to unify streaming and non-streaming speech recognition models.

speech-recognition Speech Recognition

Improving RNN transducer with normalized jointer network

no code implementations • 3 Nov 2020 • Mingkun Huang, Jun Zhang, Meng Cai, Yang Zhang, Jiali Yao, Yongbin You, Yi He, Zejun Ma

In this work, we analyze the cause of the huge gradient variance in RNN-T training and proposed a new \textit{normalized jointer network} to overcome it.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2