Predicting Ratings of Real Dialogue Participants from Artificial Data and Ratings of Human Dialogue Observers

no code implementations • LREC 2020 • Kallirroi Georgila, Carla Gordon, Volodymyr Yanov, David Traum

We applied all these dialogue evaluation functions to a held-out portion of our WOz dialogues, and we report results on the predictive power of these different types of dialogue evaluation functions.

Dialogue Evaluation

Evaluation of Off-the-shelf Speech Recognizers Across Diverse Dialogue Domains

no code implementations • LREC 2020 • Kallirroi Georgila, Anton Leuski, Volodymyr Yanov, David Traum

We evaluate several publicly available off-the-shelf (commercial and research) automatic speech recognition (ASR) systems across diverse dialogue domains (in US-English).

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1