Search Results for author: Sarah E. Finch

Found 8 papers, 3 papers with code

Towards Unified Dialogue System Evaluation: A Comprehensive Analysis of Current Evaluation Protocols

no code implementations SIGDIAL (ACL) 2020 Sarah E. Finch, Jinho D. Choi

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing.

Dialogue Management Management

Emora: An Inquisitive Social Chatbot Who Cares For You

no code implementations10 Sep 2020 Sarah E. Finch, James D. Finch, Ali Ahmadvand, Ingyu, Choi, Xiangjue Dong, Ruixiang Qi, Harshita Sahijwani, Sergey Volokhin, Zihan Wang, ZiHao Wang, Jinho D. Choi

Inspired by studies on the overwhelming presence of experience-sharing in human-human conversations, Emora, the social chatbot developed by Emory University, aims to bring such experience-focused interaction to the current field of conversational AI.

Chatbot intent-classification +1

What Went Wrong? Explaining Overall Dialogue Quality through Utterance-Level Impacts

no code implementations EMNLP (NLP4ConvAI) 2021 James D. Finch, Sarah E. Finch, Jinho D. Choi

Improving user experience of a dialogue system often requires intensive developer effort to read conversation logs, run statistical analyses, and intuit the relative importance of system shortcomings.

Chatbot Weakly-supervised Learning

Don't Forget Your ABC's: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems

3 code implementations18 Dec 2022 Sarah E. Finch, James D. Finch, Jinho D. Choi

Our method is used to evaluate four state-of-the-art open-domain dialogue systems and compared with existing approaches.

Chatbot Dialogue Evaluation

Leveraging Large Language Models for Automated Dialogue Analysis

1 code implementation12 Sep 2023 Sarah E. Finch, Ellie S. Paek, Jinho D. Choi

Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses.

General Knowledge Language Modelling +1

Exploring the Impact of Human Evaluator Group on Chat-Oriented Dialogue Evaluation

no code implementations14 Sep 2023 Sarah E. Finch, James D. Finch, Jinho D. Choi

Human evaluation has been widely accepted as the standard for evaluating chat-oriented dialogue systems.

Chatbot Dialogue Evaluation

ConvoSense: Overcoming Monotonous Commonsense Inferences for Conversational AI

1 code implementation27 Jan 2024 Sarah E. Finch, Jinho D. Choi

Mastering commonsense understanding and reasoning is a pivotal skill essential for conducting engaging conversations.

Cannot find the paper you are looking for? You can Submit a new open access paper.