no code implementations • SIGDIAL (ACL) 2020 • Sarah E. Finch, Jinho D. Choi
As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing.
no code implementations • 10 Sep 2020 • Sarah E. Finch, James D. Finch, Ali Ahmadvand, Ingyu, Choi, Xiangjue Dong, Ruixiang Qi, Harshita Sahijwani, Sergey Volokhin, Zihan Wang, ZiHao Wang, Jinho D. Choi
Inspired by studies on the overwhelming presence of experience-sharing in human-human conversations, Emora, the social chatbot developed by Emory University, aims to bring such experience-focused interaction to the current field of conversational AI.
no code implementations • EMNLP (NLP4ConvAI) 2021 • James D. Finch, Sarah E. Finch, Jinho D. Choi
Improving user experience of a dialogue system often requires intensive developer effort to read conversation logs, run statistical analyses, and intuit the relative importance of system shortcomings.
no code implementations • 31 Oct 2021 • Sarah E. Finch, James D. Finch, Daniil Huryn, William Hutsell, Xiaoyuan Huang, Han He, Jinho D. Choi
In the third and final stage, our bot selects a small subset of predicates and translates them into an English response.
3 code implementations • 18 Dec 2022 • Sarah E. Finch, James D. Finch, Jinho D. Choi
Our method is used to evaluate four state-of-the-art open-domain dialogue systems and compared with existing approaches.
1 code implementation • 12 Sep 2023 • Sarah E. Finch, Ellie S. Paek, Jinho D. Choi
Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses.
no code implementations • 14 Sep 2023 • Sarah E. Finch, James D. Finch, Jinho D. Choi
Human evaluation has been widely accepted as the standard for evaluating chat-oriented dialogue systems.
1 code implementation • 27 Jan 2024 • Sarah E. Finch, Jinho D. Choi
Mastering commonsense understanding and reasoning is a pivotal skill essential for conducting engaging conversations.