Enhancing the Unified Streaming and Non-streaming Model with Contrastive Learning

no code implementations • 1 Jun 2023 • Yuting Yang, Yuke Li, Binbin Du

Specifically, the top-layer hidden representation at the same frame of the streaming and non-streaming modes are regarded as a positive pair, encouraging the representation of the streaming mode close to its non-streaming counterpart.

Contrastive Learning speech-recognition +1

The System Description of dun_oscar team for The ICPR MSR Challenge

no code implementations • 13 Mar 2023 • Binbin Du, Rui Deng, Yingxin Zhang

In task3, we employ the ASR system to improve the visual system, some false subtitles can be corrected by a fusion module.

Optical Character Recognition (OCR)

Improving CTC-based ASR Models with Gated Interlayer Collaboration

no code implementations • 25 May 2022 • Yuting Yang, Yuke Li, Binbin Du

The CTC-based automatic speech recognition (ASR) models without the external language model usually lack the capacity to model conditional dependencies and textual interactions.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Multi-Level Modeling Units for End-to-End Mandarin Speech Recognition

no code implementations • 24 May 2022 • Yuting Yang, Binbin Du, Yuke Li

Thus only considering the writing of Chinese characters as modeling units is insufficient to capture speech features.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

BBS-KWS:The Mandarin Keyword Spotting System Won the Video Keyword Wakeup Challenge

no code implementations • 3 Dec 2021 • Yuting Yang, Binbin Du, Yingxin Zhang, Wenxuan Wang, Yuke Li

We propose a mandarin keyword spotting system (KWS) with several novel and effective improvements, including a big backbone (B) model, a keyword biasing (B) mechanism and the introduction of syllable modeling units (S).

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2