1 code implementation • 9 Nov 2023 • Shuyi Xie, Wenlin Yao, Yong Dai, Shaobo Wang, Donlin Zhou, Lifeng Jin, Xinhua Feng, Pengzhi Wei, Yujie Lin, Zhichao Hu, Dong Yu, Zhengyou Zhang, Jing Nie, Yuhong Liu
We construct a hierarchical task tree encompassing 7 major areas covering over 200 categories and over 800 tasks, which covers diverse capabilities such as question answering, reasoning, multiturn dialogue, and text generation, to evaluate LLMs in a comprehensive and in-depth manner.
no code implementations • WS 2018 • Zhichao Hu, Jean Fox Tree, Marilyn Walker
Previous work has shown that conversants adapt to many aspects of their partners{'} language.
no code implementations • 4 Sep 2017 • Zhichao Hu, Marilyn A. Walker, Michael Neff, Jean E. Fox Tree
Our results show that subjects are able to perceive the intended variation in extraversion between different virtual agents, independently of the story they are telling and the gender of the agent.
no code implementations • WS 2017 • Zhichao Hu, Marilyn A. Walker
To understand narrative, humans draw inferences about the underlying relations between narrative events.
no code implementations • WS 2017 • Zhichao Hu, Elahe Rahimtoroghi, Marilyn A. Walker
Human understanding of narrative is mainly driven by reasoning about causal relations between events and thus recognizing them is a key capability for computational models of language understanding.
no code implementations • EMNLP 2013 • Zhichao Hu, Elahe Rahimtoroghi, Larissa Munishkina, Reid Swanson, Marilyn A. Walker
Human engagement in narrative is partially driven by reasoning about discourse relations between narrative events, and the expectations about what is likely to happen next that results from such reasoning.
no code implementations • LREC 2016 • Zhichao Hu, Michelle Dick, Chung-Ning Chang, Kevin Bowden, Michael Neff, Jean Fox Tree, Marilyn Walker
This paper presents a new corpus, the Story Dialogue with Gestures (SDG) corpus, consisting of 50 personal narratives regenerated as dialogues, complete with annotations of gesture placement and accompanying gesture forms.