Timers and Such: A Practical Benchmark for Spoken Language Understanding with Numbers

4 Apr 2021  ·  Loren Lugosch, Piyush Papreja, Mirco Ravanelli, Abdelwahab Heba, Titouan Parcollet ·

This paper introduces Timers and Such, a new open source dataset of spoken English commands for common voice control use cases involving numbers. We describe the gap in existing spoken language understanding datasets that Timers and Such fills, the design and creation of the dataset, and experiments with a number of ASR-based and end-to-end baseline models, the code for which has been made available as part of the SpeechBrain toolkit.

PDF Abstract

Results from the Paper


Ranked #4 on Spoken Language Understanding on Timers and Such (using extra training data)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Spoken Language Understanding Timers and Such Baseline Accuracy (%) 81.6 # 3

Methods


No methods listed for this paper. Add relevant methods here