Search Results for author: Zhichao Hu

Found 8 papers, 1 papers with code

TencentLLMEval: A Hierarchical Evaluation of Real-World Capabilities for Human-Aligned LLMs

1 code implementation9 Nov 2023 Shuyi Xie, Wenlin Yao, Yong Dai, Shaobo Wang, Donlin Zhou, Lifeng Jin, Xinhua Feng, Pengzhi Wei, Yujie Lin, Zhichao Hu, Dong Yu, Zhengyou Zhang, Jing Nie, Yuhong Liu

We construct a hierarchical task tree encompassing 7 major areas covering over 200 categories and over 800 tasks, which covers diverse capabilities such as question answering, reasoning, multiturn dialogue, and text generation, to evaluate LLMs in a comprehensive and in-depth manner.

Benchmarking Question Answering +1

Storytelling Agents with Personality and Adaptivity

no code implementations4 Sep 2017 Zhichao Hu, Marilyn A. Walker, Michael Neff, Jean E. Fox Tree

Our results show that subjects are able to perceive the intended variation in extraversion between different virtual agents, independently of the story they are telling and the gender of the agent.

Inferring Narrative Causality between Event Pairs in Films

no code implementations WS 2017 Zhichao Hu, Marilyn A. Walker

To understand narrative, humans draw inferences about the underlying relations between narrative events.

Relation

Inference of Fine-Grained Event Causality from Blogs and Films

no code implementations WS 2017 Zhichao Hu, Elahe Rahimtoroghi, Marilyn A. Walker

Human understanding of narrative is mainly driven by reasoning about causal relations between events and thus recognizing them is a key capability for computational models of language understanding.

Unsupervised Induction of Contingent Event Pairs from Film Scenes

no code implementations EMNLP 2013 Zhichao Hu, Elahe Rahimtoroghi, Larissa Munishkina, Reid Swanson, Marilyn A. Walker

Human engagement in narrative is partially driven by reasoning about discourse relations between narrative events, and the expectations about what is likely to happen next that results from such reasoning.

Common Sense Reasoning

A Corpus of Gesture-Annotated Dialogues for Monologue-to-Dialogue Generation from Personal Narratives

no code implementations LREC 2016 Zhichao Hu, Michelle Dick, Chung-Ning Chang, Kevin Bowden, Michael Neff, Jean Fox Tree, Marilyn Walker

This paper presents a new corpus, the Story Dialogue with Gestures (SDG) corpus, consisting of 50 personal narratives regenerated as dialogues, complete with annotations of gesture placement and accompanying gesture forms.

Dialogue Generation

Cannot find the paper you are looking for? You can Submit a new open access paper.