Search Results for author: Joseph Gatto

Found 17 papers, 3 papers with code

Follow-up Question Generation For Enhanced Patient-Provider Conversations

no code implementations21 Mar 2025 Joseph Gatto, Parker Seegmiller, Timothy Burdick, Inas S. Khayal, Sarah DeLozier, Sarah M. Preum

These two challenges occur frequently in medical dialogue as a doctor asks questions based not only on patient utterances but also their prior EHR data and current diagnostic hypotheses.

Diagnostic Question Generation +1

REGen: A Reliable Evaluation Framework for Generative Event Argument Extraction

no code implementations24 Feb 2025 Omar Sharif, Joseph Gatto, Madhusudan Basak, Sarah M. Preum

To bridge this gap, we introduce Reliable Evaluation framework for Generative event argument extraction (REGen), a framework that better aligns with human judgment.

Event Argument Extraction valid

In-Context Learning for Preserving Patient Privacy: A Framework for Synthesizing Realistic Patient Portal Messages

1 code implementation10 Nov 2024 Joseph Gatto, Parker Seegmiller, Timothy E. Burdick, Sarah Masud Preum

We believe this work provides a path forward for (i) the release of large-scale synthetic patient message datasets that are stylistically similar to ground-truth samples and (ii) HIPAA-friendly data generation which requires minimal human de-identification efforts.

De-identification In-Context Learning +2

Explicit, Implicit, and Scattered: Revisiting Event Extraction to Capture Complex Arguments

no code implementations4 Oct 2024 Omar Sharif, Joseph Gatto, Madhusudan Basak, Sarah M. Preum

First, implicit arguments are event arguments which are not explicitly mentioned in the text, but can be inferred through context.

Event Extraction Text Generation

Depth $F_1$: Improving Evaluation of Cross-Domain Text Classification by Measuring Semantic Generalizability

1 code implementation20 Jun 2024 Parker Seegmiller, Joseph Gatto, Sarah Masud Preum

Recent evaluations of cross-domain text classification models aim to measure the ability of a model to obtain domain-invariant performance in a target domain given labeled samples in a source domain.

Cross-Domain Text Classification text-classification +1

Do LLMs Find Human Answers To Fact-Driven Questions Perplexing? A Case Study on Reddit

no code implementations1 Apr 2024 Parker Seegmiller, Joseph Gatto, Omar Sharif, Madhusudan Basak, Sarah Masud Preum

Large language models (LLMs) have been shown to be proficient in correctly answering questions in the context of online discourse.

Scope of Large Language Models for Mining Emerging Opinions in Online Health Discourse

no code implementations5 Mar 2024 Joseph Gatto, Madhusudan Basak, Yash Srivastava, Philip Bohlman, Sarah M. Preum

We detail (i) a method of claim identification -- the task of identifying if a post title contains a claim and (ii) an opinion mining-driven evaluation framework for stance detection using LLMs.

Opinion Mining Zero-Shot Stance Detection

Chain-of-Thought Embeddings for Stance Detection on Social Media

1 code implementation30 Oct 2023 Joseph Gatto, Omar Sharif, Sarah Masud Preum

Chain-of-Thought (COT) prompting has recently been shown to improve performance on stance detection tasks -- alleviating some of these issues.

Stance Detection

Not Enough Labeled Data? Just Add Semantics: A Data-Efficient Method for Inferring Online Health Texts

no code implementations18 Sep 2023 Joseph Gatto, Sarah M. Preum

Our error analysis shows that AMR-infused language models perform better on complex texts and generally show less predictive variance in the presence of changing complexity.

Abstract Meaning Representation Sentence +2

Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similarity

no code implementations12 Sep 2023 Joseph Gatto, Omar Sharif, Parker Seegmiller, Philip Bohlman, Sarah Masud Preum

Additionally, we show generative LLMs significantly outperform existing encoder-based STS models when characterizing the semantic similarity between two texts with complex semantic relationships dependent on world knowledge.

Memorization Semantic Similarity +4

Theme-driven Keyphrase Extraction to Analyze Social Media Discourse

no code implementations27 Jan 2023 William Romano, Omar Sharif, Madhusudan Basak, Joseph Gatto, Sarah Preum

Lastly, we found that a large language model (ChatGPT) outperforms unsupervised keyphrase extraction models, and we evaluate its efficacy in this task.

Keyphrase Extraction Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.