Search Results for author: Joseph Gatto

Found 12 papers, 1 papers with code

Do LLMs Find Human Answers To Fact-Driven Questions Perplexing? A Case Study on Reddit

no code implementations1 Apr 2024 Parker Seegmiller, Joseph Gatto, Omar Sharif, Madhusudan Basak, Sarah Masud Preum

Large language models (LLMs) have been shown to be proficient in correctly answering questions in the context of online discourse.

Mad Libs Are All You Need: Augmenting Cross-Domain Document-Level Event Argument Data

no code implementations5 Mar 2024 Joseph Gatto, Parker Seegmiller, Omar Sharif, Sarah M. Preum

Our approach leverages the intuition that Mad Libs, which are categorically masked documents used as a part of a popular game, can be generated and solved by LLMs to produce data for DocEAE.

Data Augmentation Event Argument Extraction

Scope of Large Language Models for Mining Emerging Opinions in Online Health Discourse

no code implementations5 Mar 2024 Joseph Gatto, Madhusudan Basak, Yash Srivastava, Philip Bohlman, Sarah M. Preum

We detail (i) a method of claim identification -- the task of identifying if a post title contains a claim and (ii) an opinion mining-driven evaluation framework for stance detection using LLMs.

Opinion Mining Zero-Shot Stance Detection

Chain-of-Thought Embeddings for Stance Detection on Social Media

1 code implementation30 Oct 2023 Joseph Gatto, Omar Sharif, Sarah Masud Preum

Chain-of-Thought (COT) prompting has recently been shown to improve performance on stance detection tasks -- alleviating some of these issues.

Stance Detection

Not Enough Labeled Data? Just Add Semantics: A Data-Efficient Method for Inferring Online Health Texts

no code implementations18 Sep 2023 Joseph Gatto, Sarah M. Preum

Our error analysis shows that AMR-infused language models perform better on complex texts and generally show less predictive variance in the presence of changing complexity.

Sentence text-classification +1

Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similarity

no code implementations12 Sep 2023 Joseph Gatto, Omar Sharif, Parker Seegmiller, Philip Bohlman, Sarah Masud Preum

Additionally, we show generative LLMs significantly outperform existing encoder-based STS models when characterizing the semantic similarity between two texts with complex semantic relationships dependent on world knowledge.

Memorization Semantic Similarity +4

Theme-driven Keyphrase Extraction to Analyze Social Media Discourse

no code implementations27 Jan 2023 William Romano, Omar Sharif, Madhusudan Basak, Joseph Gatto, Sarah Preum

Lastly, we found that a large language model (ChatGPT) outperforms unsupervised keyphrase extraction models, and we evaluate its efficacy in this task.

Keyphrase Extraction Language Modelling +1

Single Sample Feature Importance: An Interpretable Algorithm for Low-Level Feature Analysis

no code implementations27 Nov 2019 Joseph Gatto, Ravi Lanka, Yumi Iwashita, Adrian Stoica

Have you ever wondered how your feature space is impacting the prediction of a specific sample in your dataset?

Feature Importance

Cannot find the paper you are looking for? You can Submit a new open access paper.