Search Results for author: Ashima Suvarna

Found 7 papers, 1 papers with code

PhonologyBench: Evaluating Phonological Skills of Large Language Models

no code implementations3 Apr 2024 Ashima Suvarna, Harshita Khandelwal, Nanyun Peng

To this end, we present PhonologyBench, a novel benchmark consisting of three diagnostic tasks designed to explicitly test the phonological skills of LLMs in English: grapheme-to-phoneme conversion, syllable counting, and rhyme word generation.

Language Modelling Large Language Model

Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimization

1 code implementation31 Mar 2024 Hritik Bansal, Ashima Suvarna, Gantavya Bhatt, Nanyun Peng, Kai-Wei Chang, Aditya Grover

A common technique for aligning large language models (LLMs) relies on acquiring human preferences by comparing multiple generations conditioned on a fixed context.

Improving Event Definition Following For Zero-Shot Event Detection

no code implementations5 Mar 2024 Zefan Cai, Po-Nien Kung, Ashima Suvarna, Mingyu Derek Ma, Hritik Bansal, Baobao Chang, P. Jeffrey Brantingham, Wei Wang, Nanyun Peng

We hypothesize that a diverse set of event types and definitions are the key for models to learn to follow event definitions while existing event extraction datasets focus on annotating many high-quality examples for a few event types.

Event Detection Event Extraction

\#NotAWhore! A Computational Linguistic Perspective of Rape Culture and Victimization on Social Media

no code implementations ACL 2020 Ashima Suvarna, Grusha Bhalla

The recent surge in online forums and movements supporting sexual assault survivors has led to the emergence of a {`}virtual bubble{'} where survivors can recount their stories.

Cultural Vocal Bursts Intensity Prediction Transfer Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.