Search Results for author: Hayden Helm

Found 7 papers, 1 papers with code

Investigating social alignment via mirroring in a system of interacting language models

no code implementations7 Dec 2024 Harvey McGuinness, Tianyu Wang, Carey E. Priebe, Hayden Helm

In this paper, we introduce a simple computational framework that enables studying the effect of mirroring behavior on alignment in multi-agent systems.

Sociology

Embedding-based statistical inference on generative models

no code implementations1 Oct 2024 Hayden Helm, Aranyak Acharyya, Brandon Duderstadt, Youngser Park, Carey E. Priebe

We demonstrate that using the perspective space as the basis of a notion of "similar" is effective for multiple model-level inference tasks.

In-Context Learning parameter-efficient fine-tuning

Tracking the perspectives of interacting language models

no code implementations17 Jun 2024 Hayden Helm, Brandon Duderstadt, Youngser Park, Carey E. Priebe

Large language models (LLMs) are capable of producing high quality information at unprecedented rates.

Retrieval

MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering

no code implementations3 Jun 2024 Robert Osazuwa Ness, Katie Matton, Hayden Helm, Sheng Zhang, Junaid Bajwa, Carey E. Priebe, Eric Horvitz

Medical question-answering benchmarks rely on assumptions consistent with quantifying LLM performance but that may not hold in the open world of the clinic.

MedQA Question Answering

A Statistical Turing Test for Generative Models

no code implementations16 Sep 2023 Hayden Helm, Carey E. Priebe, Weiwei Yang

Implicit in these efforts is an assumption that the generation properties of a human are different from that of the machine.

Random Forests for Adaptive Nearest Neighbor Estimation of Information-Theoretic Quantities

1 code implementation30 Jun 2019 Ronan Perry, Ronak Mehta, Richard Guo, Eva Yezerets, Jesús Arroyo, Mike Powell, Hayden Helm, Cencheng Shen, Joshua T. Vogelstein

Information-theoretic quantities, such as conditional entropy and mutual information, are critical data summaries for quantifying uncertainty.

Cannot find the paper you are looking for? You can Submit a new open access paper.