Europarl-ASR: A Large Corpus of Parliamentary Debates for Streaming ASR Benchmarking and Speech Data Filtering/Verbatimization
We introduce Europarl-ASR, a large speech and text corpus of parliamentary debates including 1 300 hours of transcribed speeches and 70 million tokens of text in English extracted from European Parliament sessions. The training set is labelled with the Parliament’s non-fully-verbatim official transcripts, time-aligned. As verbatimness is critical for acoustic model training, we also provide automatically noise-filtered and automatically verbatimized transcripts of all speeches based on speech data filtering and verbatimization techniques. Additionally, 18 hours of transcribed speeches were manually verbatimized to build reliable speaker-dependent and speaker-independent development/test sets for streaming ASR benchmarking. The availability of manual non-verbatim and verbatim transcripts for dev/test speeches makes this corpus useful for the assessment of automatic filtering and verbatimization techniques. This paper describes the corpus and its creation, and provides off-line and streaming ASR baselines for both the speaker-dependent and speaker-independent tasks using the three training transcription sets. The corpus is publicly released under an open licence.
PDF Abstract
Datasets
Results from the Paper
| Task | Dataset | Model | Metric Name | Metric Value | Global Rank | Benchmark |
|---|---|---|---|---|---|---|
| Speech Recognition | Europarl-ASR EN Guest-test | mllp_2021_streaming_verb | WER | 7.3 | # 3 | |
| Speech Recognition | Europarl-ASR EN Guest-test | mllp_2021_offline_verb | WER | 7.0 | # 2 | |
| Speech Recognition | Europarl-ASR EN MEP-test | mllp_2021_streaming_filt | WER | 7.9 | # 2 | |
| Speech Recognition | Europarl-ASR EN MEP-test | mllp_2021_offline_filt | WER | 7.8 | # 1 |
