Ideal-LLM: Integrating Dual Encoders and Language-Adapted LLM for Multilingual Speech-to-Text

no code implementations • 17 Sep 2024 • Hongfei Xue, Wei Ren, Xuelong Geng, Kun Wei, Longhao Li, Qijie Shao, Linju Yang, Kai Diao, Lei Xie

Integrating audio encoders with LLMs through connectors has enabled these models to process and comprehend audio modalities, significantly enhancing speech-to-text tasks, including automatic speech recognition (ASR) and automatic speech translation (AST).

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Unveiling the Potential of LLM-Based ASR on Chinese Open-Source Datasets

no code implementations • 3 May 2024 • Xuelong Geng, Tianyi Xu, Kun Wei, Bingshen Mu, Hongfei Xue, He Wang, Yangze Li, Pengcheng Guo, Yuhang Dai, Longhao Li, Mingchen Shao, Lei Xie

Building upon this momentum, our research delves into an in-depth examination of this paradigm on a large open-source Chinese dataset.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1