Simultaneous Speech-to-Text Translation
3 papers with code • 0 benchmarks • 0 datasets
Simultaneous Speech-to-Text translation aims to translate concurrently with the source speech. It is crucial since it enables real-time interpretation of conversations, lectures and talks.
Benchmarks
These leaderboards are used to track progress in Simultaneous Speech-to-Text Translation
Most implemented papers
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit
espnet/espnet
•
•
ESPnet-ST-v2 is a revamp of the open-source ESPnet-ST toolkit necessitated by the broadening interests of the spoken language translation community.
LeaPformer: Enabling Linear Transformers for Autoregressive and Simultaneous Tasks via Learned Proportions
A promising approach to preserving model performance in linearized transformers is to employ position-based re-weighting functions.
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning
Simultaneous speech-to-speech translation (Simul-S2ST, a. k. a streaming speech translation) outputs target speech while receiving streaming speech inputs, which is critical for real-time communication.
