Search Results for author: Caleb Ziems

Found 19 papers, 12 papers with code

CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies

1 code implementation23 Apr 2024 Weiyan Shi, Ryan Li, Yutong Zhang, Caleb Ziems, Chunhua yu, Raya Horesh, Rogério Abreu de Paula, Diyi Yang

To enhance language models' cultural awareness, we design a generalizable pipeline to construct cultural knowledge bases from different online communities on a massive scale.

Social Skill Training with Large Language Models

no code implementations5 Apr 2024 Diyi Yang, Caleb Ziems, William Held, Omar Shaikh, Michael S. Bernstein, John Mitchell

People rely on social skills like conflict resolution to communicate effectively and to thrive in both work and personal life.

Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future

no code implementations28 Feb 2024 Minzhi Li, Weiyan Shi, Caleb Ziems, Diyi Yang

As Natural Language Processing (NLP) systems become increasingly integrated into human social life, these technologies will need to increasingly rely on social intelligence.

Impressions: Understanding Visual Semiotics and Aesthetic Impact

no code implementations27 Oct 2023 Julia Kruk, Caleb Ziems, Diyi Yang

We present Impressions, a novel dataset through which to investigate the semiotics of images, and how specific visual features and design choices can elicit specific emotions, thoughts and beliefs.

Image Captioning

CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation

1 code implementation24 Oct 2023 Minzhi Li, Taiwei Shi, Caleb Ziems, Min-Yen Kan, Nancy F. Chen, Zhengyuan Liu, Diyi Yang

Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance.

text annotation

Modeling Cross-Cultural Pragmatic Inference with Codenames Duet

1 code implementation4 Jun 2023 Omar Shaikh, Caleb Ziems, William Held, Aryan J. Pariani, Fred Morstatter, Diyi Yang

Prior work uses simple reference games to test models of pragmatic reasoning, often with unidentified speakers and listeners.

TADA: Task-Agnostic Dialect Adapters for English

1 code implementation26 May 2023 Will Held, Caleb Ziems, Diyi Yang

Large Language Models, the dominant starting point for Natural Language Processing (NLP) applications, fail at a higher rate for speakers of English dialects other than Standard American English (SAE).

Data Augmentation

Can Large Language Models Transform Computational Social Science?

1 code implementation12 Apr 2023 Caleb Ziems, William Held, Omar Shaikh, Jiaao Chen, Zhehao Zhang, Diyi Yang

We conclude that the performance of today's LLMs can augment the CSS research pipeline in two ways: (1) serving as zero-shot data annotators on human annotation teams, and (2) bootstrapping challenging creative generation tasks (e. g., explaining the underlying attributes of a text).

Persuasiveness

VALUE: Understanding Dialect Disparity in NLU

1 code implementation ACL 2022 Caleb Ziems, Jiaao Chen, Camille Harris, Jessica Anderson, Diyi Yang

To understand disparities in current models and to facilitate more dialect-competent NLU systems, we introduce the VernAcular Language Understanding Evaluation (VALUE) benchmark, a challenging variant of GLUE that we created with a set of lexical and morphosyntactic transformation rules.

Linguistic Acceptability Natural Language Understanding

The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems

2 code implementations ACL 2022 Caleb Ziems, Jane A. Yu, Yi-Chia Wang, Alon Halevy, Diyi Yang

In this work, we introduce a new resource, not to authoritatively resolve moral ambiguities, but instead to facilitate systematic understanding of the intuitions, values and moral judgments reflected in the utterances of dialogue systems.

Attribute Benchmarking

Inducing Positive Perspectives with Text Reframing

1 code implementation ACL 2022 Caleb Ziems, Minzhi Li, Anthony Zhang, Diyi Yang

Sentiment transfer is one popular example of a text style transfer task, where the goal is to reverse the sentiment polarity of a text.

Sentence Style Transfer +1

Quantifying the Impact of Human Capital, Job History, and Language Factors on Job Seniority with a Large-scale Analysis of Resumes

no code implementations15 Jun 2021 Austin P Wright, Caleb Ziems, Haekyu Park, Jon Saad-Falcon, Duen Horng Chau, Diyi Yang, Maria Tomprou

As job markets worldwide have become more competitive and applicant selection criteria have become more opaque, and different (and sometimes contradictory) information and advice is available for job seekers wishing to progress in their careers, it has never been more difficult to determine which factors in a r\'esum\'e most effectively help career progression.

Racism is a Virus: Anti-Asian Hate and Counterspeech in Social Media during the COVID-19 Crisis

1 code implementation25 May 2020 Bing He, Caleb Ziems, Sandeep Soni, Naren Ramakrishnan, Diyi Yang, Srijan Kumar

The spread of COVID-19 has sparked racism and hate on social media targeted towards Asian communities.

Ten-year Survival Prediction for Breast Cancer Patients

no code implementations2 Nov 2019 Changmao Li, Han He, Yunze Hao, Caleb Ziems

This report assesses different machine learning approaches to 10-year survival prediction of breast cancer patients.

BIG-bench Machine Learning Survival Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.