Search Results for author: Xiaomeng Ma

Found 4 papers, 2 papers with code

ToMChallenges: A Principle-Guided Dataset and Diverse Evaluation Tasks for Exploring Theory of Mind

no code implementations24 May 2023 Xiaomeng Ma, Lingyu Gao, Qihui Xu

In addition, our paper wants to raise awareness in evaluating the ToM in LLMs and we want to invite more discussion on how to design the prompts and tasks for ToM tasks that can better assess the LLMs' ability.

Multiple-choice Question Answering

Evaluating Transformer Models and Human Behaviors on Chinese Character Naming

1 code implementation22 Mar 2023 Xiaomeng Ma, Lingyu Gao

These results suggested that the transformer models can well capture human's character naming behavior.

How do we get there? Evaluating transformer neural networks as cognitive models for English past tense inflection

1 code implementation17 Oct 2022 Xiaomeng Ma, Lingyu Gao

The different behaviors on the regulars and irregulars suggest that the models have some degree of symbolic learning on the regularity of the verbs.

Cannot find the paper you are looking for? You can Submit a new open access paper.