Search Results for author: Linda Petzold

Found 29 papers, 12 papers with code

Quokka: An Open-source Large Language Model ChatBot for Material Science

1 code implementation2 Jan 2024 Xianjun Yang, Stephen D. Wilson, Linda Petzold

This paper presents the development of a specialized chatbot for materials science, leveraging the Llama-2 language model, and continuing pre-training on the expansive research articles in the materials science domain from the S2ORC dataset.

Chatbot Language Modelling +1

A Survey on Detection of LLMs-Generated Content

1 code implementation24 Oct 2023 Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng

The burgeoning capabilities of advanced large language models (LLMs) such as ChatGPT have led to an increase in synthetic content generation with implications across a variety of sectors, including media, cybersecurity, public discourse, and education.

Zero-Shot Detection of Machine-Generated Codes

1 code implementation8 Oct 2023 Xianjun Yang, Kexun Zhang, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng

We then modify the previous zero-shot text detection method, DetectGPT (Mitchell et al., 2023) by utilizing a surrogate white-box model to estimate the probability of the rightmost tokens, allowing us to identify code snippets generated by language models.

Language Modelling Text Detection

Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models

no code implementations4 Oct 2023 Xianjun Yang, Xiao Wang, Qi Zhang, Linda Petzold, William Yang Wang, Xun Zhao, Dahua Lin

This study serves as a clarion call for a collective effort to overhaul and fortify the safety of open-source LLMs against malicious attackers.

Bayesian polynomial neural networks and polynomial neural ordinary differential equations

no code implementations17 Aug 2023 Colby Fronk, Jaewoong Yun, Prashant Singh, Linda Petzold

Symbolic regression with polynomial neural networks and polynomial neural ordinary differential equations (ODEs) are two recent and powerful approaches for equation recovery of many science and engineering problems.

Bayesian Inference Symbolic Regression +1

DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Text

1 code implementation27 May 2023 Xianjun Yang, Wei Cheng, Yue Wu, Linda Petzold, William Yang Wang, Haifeng Chen

However, this progress also presents a significant challenge in detecting the origin of a given text, and current research on detection methods lags behind the rapid evolution of LLMs.

Are Large Language Models Ready for Healthcare? A Comparative Study on Clinical Language Understanding

1 code implementation9 Apr 2023 Yuqing Wang, Yun Zhao, Linda Petzold

In this study, we conduct a comprehensive evaluation of state-of-the-art LLMs, namely GPT-3. 5, GPT-4, and Bard, within the realm of clinical language understanding tasks.

Document Classification named-entity-recognition +6

Dynamic Prompting: A Unified Framework for Prompt Tuning

1 code implementation6 Mar 2023 Xianjun Yang, Wei Cheng, Xujiang Zhao, Wenchao Yu, Linda Petzold, Haifeng Chen

Experimental results underscore the significant performance improvement achieved by dynamic prompt tuning across a wide range of tasks, including NLP tasks, vision recognition tasks, and vision-language tasks.

Position

MatKB: Semantic Search for Polycrystalline Materials Synthesis Procedures

1 code implementation11 Feb 2023 Xianjun Yang, Stephen Wilson, Linda Petzold

In this paper, we present a novel approach to knowledge extraction and retrieval using Natural Language Processing (NLP) techniques for material science.

Document Classification Retrieval

OASum: Large-Scale Open Domain Aspect-based Summarization

1 code implementation19 Dec 2022 Xianjun Yang, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang, Xiaoman Pan, Linda Petzold, Dong Yu

Specifically, zero/few-shot and fine-tuning results show that the model pre-trained on our corpus demonstrates a strong aspect or query-focused generation ability compared with the backbone model.

PcMSP: A Dataset for Scientific Action Graphs Extraction from Polycrystalline Materials Synthesis Procedure Text

1 code implementation22 Oct 2022 Xianjun Yang, Ya Zhuo, Julia Zuo, Xinlu Zhang, Stephen Wilson, Linda Petzold

Scientific action graphs extraction from materials synthesis procedures is important for reproducible research, machine automation, and material prediction.

Named Entity Recognition Named Entity Recognition (NER) +3

Improving Medical Predictions by Irregular Multimodal Electronic Health Records Modeling

1 code implementation18 Oct 2022 Xinlu Zhang, Shiyang Li, Zhiyu Chen, Xifeng Yan, Linda Petzold

Our method first addresses irregularity in each single modality by (1) modeling irregular time series by dynamically incorporating hand-crafted imputation embeddings into learned interpolation embeddings via a gating mechanism, and (2) casting a series of clinical note representations as multivariate irregular time series and tackling irregularity via a time attention mechanism.

Imputation Irregular Time Series +2

VREN: Volleyball Rally Dataset with Expression Notation Language

no code implementations28 Sep 2022 Haotian Xia, Rhys Tracy, Yun Zhao, Erwan Fraisse, Yuan-Fang Wang, Linda Petzold

The second goal is to introduce a volleyball descriptive language to fully describe the rally processes in the games and apply the language to our dataset.

Decision Making Descriptive +1

Few-Shot Document-Level Event Argument Extraction

1 code implementation6 Sep 2022 Xianjun Yang, Yujie Lu, Linda Petzold

To fill this gap, we present FewDocAE, a Few-Shot Document-Level Event Argument Extraction benchmark, based on the existing document-level event extraction dataset.

Document-level Event Extraction Event Argument Extraction +2

Interpretable Polynomial Neural Ordinary Differential Equations

no code implementations9 Aug 2022 Colby Fronk, Linda Petzold

Neural networks have the ability to serve as universal function approximators, but they are not interpretable and don't generalize well outside of their training region.

regression Symbolic Regression

Predicting the Need for Blood Transfusion in Intensive Care Units with Reinforcement Learning

no code implementations26 Jun 2022 Yuqing Wang, Yun Zhao, Linda Petzold

As critically ill patients frequently develop anemia or coagulopathy, transfusion of blood products is a frequent intervention in the Intensive Care Units (ICU).

Decision Making Q-Learning +3

Enhancing Transformer Efficiency for Multivariate Time Series Classification

no code implementations28 Mar 2022 Yuqing Wang, Yun Zhao, Linda Petzold

Most current multivariate time series (MTS) classification algorithms focus on improving the predictive accuracy.

Classification Time Series +2

Integrating Physiological Time Series and Clinical Notes with Transformer for Early Prediction of Sepsis

no code implementations28 Mar 2022 Yuqing Wang, Yun Zhao, Rachael Callcut, Linda Petzold

In this paper, we propose a multimodal Transformer model for early sepsis prediction, using the physiological time series data and clinical notes for each patient within $36$ hours of ICU admission.

Time Series Time Series Analysis

Empirical Quantitative Analysis of COVID-19 Forecasting Models

no code implementations1 Oct 2021 Yun Zhao, Yuqing Wang, Junfeng Liu, Haotian Xia, Zhenni Xu, Qinghang Hong, Zhiyang Zhou, Linda Petzold

In this paper, we perform quantitative analysis of COVID-19 forecasting of confirmed cases and deaths across different regions in the United States with different forecasting horizons, and evaluate the relative impacts of the following three dimensions on the predictive performance (improvement and variation) through different evaluation metrics: model selection, hyperparameter tuning, and the length of time series required for training.

Model Selection Time Series +1

Multiple Organ Failure Prediction with Classifier-Guided Generative Adversarial Imputation Networks

no code implementations22 Jun 2021 Xinlu Zhang, Yun Zhao, Rachael Callcut, Linda Petzold

Multiple organ failure (MOF) is a severe syndrome with a high mortality rate among Intensive Care Unit (ICU) patients.

Imputation

BERTSurv: BERT-Based Survival Models for Predicting Outcomes of Trauma Patients

no code implementations19 Mar 2021 Yun Zhao, Qinghang Hong, Xinlu Zhang, Yu Deng, Yuqing Wang, Linda Petzold

However, there is a lack of deep learning methods that can model the relationship between measurements, clinical notes and mortality outcomes.

Mortality Prediction Survival Analysis

Robust and integrative Bayesian neural networks for likelihood-free parameter inference

no code implementations12 Feb 2021 Fredrik Wrede, Robin Eriksson, Richard Jiang, Linda Petzold, Stefan Engblom, Andreas Hellander, Prashant Singh

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference.

Density Estimation

Model Optimization for Deep Space Exploration via Simulators and Deep Learning

no code implementations28 Dec 2020 James Bird, Kellan Colburn, Linda Petzold, Philip Lubin

Machine learning, and eventually true artificial intelligence techniques, are extremely important advancements in astrophysics and astronomy.

Astronomy Model Optimization

How Much Does It Hurt: A Deep Learning Framework for Chronic Pain Score Assessment

no code implementations22 Sep 2020 Yun Zhao, Franklin Ly, Qinghang Hong, Zhuowei Cheng, Tyler Santander, Henry T. Yang, Paul K. Hansma, Linda Petzold

Chronic pain is defined as pain that lasts or recurs for more than 3 to 6 months, often long after the injury or illness that initially caused the pain has healed.

Advances in Deep Space Exploration via Simulators & Deep Learning

no code implementations10 Feb 2020 James Bird, Linda Petzold, Philip Lubin, Julia Deacon

The StarLight program conceptualizes fast interstellar travel via small wafer satellites (wafersats) that are propelled by directed energy.

Navigate object-detection +1

A Deep Learning Framework for Classification of in vitro Multi-Electrode Array Recordings

no code implementations5 Jun 2019 Yun Zhao, Elmer Guzman, Morgane Audouard, Zhuowei Cheng, PaulK. Hansma, Kenneth S. Kosik, Linda Petzold

In this paper, we address the problem of classifying in vitro MEA recordings of mouse and human neuronal cultures from different genotypes, where there is no easy way to directly utilize raw sequences as inputs to train an end-to-end classification model.

Cultural Vocal Bursts Intensity Prediction General Classification

Selecting the Metric in Hamiltonian Monte Carlo

1 code implementation28 May 2019 Ben Bales, Arya Pourzanjani, Aki Vehtari, Linda Petzold

We present a selection criterion for the Euclidean metric adapted during warmup in a Hamiltonian Monte Carlo sampler that makes it possible for a sampler to automatically pick the metric based on the model and the availability of warmup draws.

Computation Methodology

Cannot find the paper you are looking for? You can Submit a new open access paper.