Search Results for author: Ziang Xiao

Found 10 papers, 3 papers with code

Generative Echo Chamber? Effects of LLM-Powered Search Systems on Diverse Information Seeking

no code implementations8 Feb 2024 Nikhil Sharma, Q. Vera Liao, Ziang Xiao

Large language models (LLMs) powered conversational search systems have already been used by hundreds of millions of people, and are believed to bring many benefits over conventional search.

Conversational Search

Rethinking Model Evaluation as Narrowing the Socio-Technical Gap

no code implementations1 Jun 2023 Q. Vera Liao, Ziang Xiao

The recent development of generative and large language models (LLMs) poses new challenges for model evaluation that the research community and industry are grappling with.

Explainable Artificial Intelligence (XAI) nlg evaluation +1

Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory

1 code implementation24 May 2023 Ziang Xiao, Susu Zhang, Vivian Lai, Q. Vera Liao

We address a fundamental challenge in Natural Language Generation (NLG) model evaluation -- the design and evaluation of evaluation metrics.

nlg evaluation Text Generation +1

ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games

1 code implementation24 May 2023 Ruoyao Wang, Graham Todd, Eric Yuan, Ziang Xiao, Marc-Alexandre Côté, Peter Jansen

In this work, we investigate the capacity of language models to generate explicit, interpretable, and interactive world models of scientific and common-sense reasoning tasks.

Code Generation Common Sense Reasoning +2

Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Coding

no code implementations17 Apr 2023 Ziang Xiao, Xingdi Yuan, Q. Vera Liao, Rania Abdelghani, Pierre-Yves Oudeyer

In this study, we explored the use of large language models (LLMs) in supporting deductive coding, a major category of qualitative analysis where researchers use pre-determined codebooks to label the data into a fixed set of codes.

Inform the uninformed: Improving Online Informed Consent Reading with an AI-Powered Chatbot

no code implementations2 Feb 2023 Ziang Xiao, Tiffany Wenting Li, Karrie Karahalios, Hari Sundaram

By comparing the chatbot with form-based interaction, we found the chatbot improved consent form reading, promoted participants' feelings of agency, and closed the power gap between the participant and the researcher.

Chatbot Ethics

What should I Ask: A Knowledge-driven Approach for Follow-up Questions Generation in Conversational Surveys

no code implementations23 May 2022 Yubin Ge, Ziang Xiao, Jana Diesner, Heng Ji, Karrie Karahalios, Hari Sundaram

We constructed a new human-annotated dataset of human-written follow-up questions with dialogue history and labeled knowledge in the context of conversational surveys.

Question Generation Question-Generation

Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys with Open-ended Questions

no code implementations25 May 2019 Ziang Xiao, Michelle X. Zhou, Q. Vera Liao, Gloria Mark, Changyan Chi, Wenxi Chen, Huahai Yang

The rise of increasingly more powerful chatbots offers a new way to collect information through conversational surveys, where a chatbot asks open-ended questions, interprets a user's free-text responses, and probes answers whenever needed.

Chatbot Informativeness +1

Cannot find the paper you are looking for? You can Submit a new open access paper.