no code implementations • LREC 2022 • Divya Tadimeti, Kallirroi Georgila, David Traum
We evaluate several publicly available off-the-shelf (commercial and research) automatic speech recognition (ASR) systems on dialogue agent-directed English speech from speakers with General American vs. non-American accents.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
no code implementations • LREC 2022 • Deepthi Karkada, Ramesh Manuvinakurike, Maike Paetzel-Prüsmann, Kallirroi Georgila
In this work, we study entrainment of users playing a creative reference resolution game with an autonomous dialogue system.
no code implementations • 18 Mar 2022 • Shikib Mehri, Jinho Choi, Luis Fernando D'Haro, Jan Deriu, Maxine Eskenazi, Milica Gasic, Kallirroi Georgila, Dilek Hakkani-Tur, Zekang Li, Verena Rieser, Samira Shaikh, David Traum, Yi-Ting Yeh, Zhou Yu, Yizhe Zhang, Chen Zhang
This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog.
no code implementations • LREC 2020 • Kallirroi Georgila, Anton Leuski, Volodymyr Yanov, David Traum
We evaluate several publicly available off-the-shelf (commercial and research) automatic speech recognition (ASR) systems across diverse dialogue domains (in US-English).
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
no code implementations • LREC 2020 • Kallirroi Georgila, Carla Gordon, Volodymyr Yanov, David Traum
We applied all these dialogue evaluation functions to a held-out portion of our WOz dialogues, and we report results on the predictive power of these different types of dialogue evaluation functions.
no code implementations • COLING 2018 • Ramesh Manuvinakurike, Sumanth Bharadwaj, Kallirroi Georgila
In this study we collect and annotate human-human role-play dialogues in the domain of weight management.
no code implementations • COLING 2018 • Deepthi Karkada, Ramesh Manuvinakurike, Kallirroi Georgila
We introduce a dataset containing human-authored descriptions of target locations in an "end-of-trip in a taxi ride" scenario.
no code implementations • WS 2018 • Ramesh Manuvinakurike, Trung Bui, Walter Chang, Kallirroi Georgila
We present {``}conversational image editing{''}, a novel real-world application domain combining dialogue, visual information, and the use of computer vision.
no code implementations • WS 2017 • Ramesh Manuvinakurike, David DeVault, Kallirroi Georgila
We apply Reinforcement Learning (RL) to the problem of incremental dialogue policy learning in the context of a fast-paced dialogue game.
no code implementations • LREC 2012 • Kallirroi Georgila, Alan Black, Kenji Sagae, David Traum
To determine the best trade-off between performance and cost, we perform a systematic evaluation of human and synthesized voices with regard to naturalness, conversational aspect, and likability.