Search Results for author: Yuling Gu

Found 11 papers, 4 papers with code

Digital Socrates: Evaluating LLMs through Explanation Critiques

no code implementations16 Nov 2023 Yuling Gu, Oyvind Tafjord, Peter Clark

While LLMs can provide reasoned explanations along with their answers, the nature and quality of those explanations are still poorly understood.

What Makes it Ok to Set a Fire? Iterative Self-distillation of Contexts and Rationales for Disambiguating Defeasible Social and Moral Situations

no code implementations24 Oct 2023 Kavel Rao, Liwei Jiang, Valentina Pyatkin, Yuling Gu, Niket Tandon, Nouha Dziri, Faeze Brahman, Yejin Choi

From this model we distill a high-quality dataset, \delta-Rules-of-Thumb, of 1. 2M entries of contextualizations and rationales for 115K defeasible moral actions rated highly by human annotators 85. 9% to 99. 8% of the time.

Imitation Learning

Measure More, Question More: Experimental Studies on Transformer-based Language Models and Complement Coercion

no code implementations20 Dec 2022 Yuling Gu

Transformer-based language models have shown strong performance on an array of natural language understanding tasks.

Natural Language Understanding Sentence

Do language models have coherent mental models of everyday things?

1 code implementation20 Dec 2022 Yuling Gu, Bhavana Dalvi Mishra, Peter Clark

Using these questions as probes, we observe that state-of-the-art pre-trained language models (LMs) like GPT-3 and Macaw have fragments of knowledge about these everyday things, but do not have fully coherent "parts mental models" (54-59% accurate, 19-43% conditional constraint violation).

One Venue, Two Conferences: The Separation of Chinese and American Citation Networks

no code implementations17 Nov 2022 Bingchen Zhao, Yuling Gu, Jessica Zosa Forde, Naomi Saphra

At NeurIPS, American and Chinese institutions cite papers from each other's regions substantially less than they cite endogamously.

Just-DREAM-about-it: Figurative Language Understanding with DREAM-FLUTE

1 code implementation28 Oct 2022 Yuling Gu, Yao Fu, Valentina Pyatkin, Ian Magnusson, Bhavana Dalvi Mishra, Peter Clark

We hypothesize that to perform this task well, the reader needs to mentally elaborate the scene being described to identify a sensible meaning of the language.

Large-Scale Acoustic Characterization of Singaporean Children's English Pronunciation

no code implementations18 Feb 2022 Yuling Gu, Nancy F. Chen

In tense and lax vowel pairs, we also consistently observe that the distinction is less conspicuous for Singaporean children compared to the other speaker groups.

DREAM: Improving Situational QA by First Elaborating the Situation

1 code implementation NAACL 2022 Yuling Gu, Bhavana Dalvi Mishra, Peter Clark

To test this conjecture, we train a new model, DREAM, to answer questions that elaborate the scenes that situated questions are about, and then provide those elaborations as additional context to a question-answering (QA) model.

Question Answering

Acoustic Characterization of Singaporean Children's English: Comparisons to American and British Counterparts

no code implementations WS 2019 Yuling Gu, Nancy Chen

We investigate English pronunciation patterns in Singaporean children in relation to their American and British counterparts by conducting archetypal analysis on selected vowel pairs.

Position

Cannot find the paper you are looking for? You can Submit a new open access paper.