Search Results for author:
Found 84 papers, 54 papers with code
LabTOP: A Unified Model for Lab Test Outcome Prediction on Electronic Health Records
Lab tests are fundamental for diagnosing diseases and monitoring patient conditions.
R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs
To address this, We introduce R2-KG, a plug-and-play, dual-agent framework that separates reasoning into two roles: an Operator (a low-capacity LLM) that gathers evidence and a Supervisor (a high-capacity LLM) that makes final judgments.
Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning
In response, we present Language model Ensemble with Monte Carlo Tree Search (LE-MCTS), a novel framework for process-level ensembling of language models.
Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling
Predicting future international events from textual information, such as news articles, has tremendous potential for applications in global policy, strategic decision-making, and geopolitics.
Single Ground Truth Is Not Enough: Add Linguistic Variability to Aspect-based Sentiment Analysis Evaluation
Aspect-based sentiment analysis (ABSA) is the challenging task of extracting sentiment along with its corresponding aspects and opinions from human language.
Aspect-Based Sentiment Analysis
Aspect-Based Sentiment Analysis (ABSA)
+2
Towards Predicting Temporal Changes in a Patient's Chest X-ray Images based on Electronic Health Records
Chest X-ray imaging (CXR) is an important diagnostic tool used in hospitals to assess patient conditions and monitor changes over time.
Time is Not Enough: Time-Frequency based Explanation for Time-Series Black-Box Models
We conduct extensive experiments in the generated synthetic dataset and various UCR Time-Series datasets to first compare the explanation performance of FIA and other existing perturbation-based XAI methods in both time-domain and time-frequency domain, and then show the superiority of our FIA in the time-frequency domain with the SpectralX framework.
EHRCon: Dataset for Checking Consistency between Unstructured Notes and Structured Tables in Electronic Health Records
To address this, we developed EHRCon, a new dataset and task specifically designed to ensure data consistency between structured tables and unstructured notes in EHRs.
DialSim: A Real-Time Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agents
Recent advancements in Large Language Models (LLMs) have significantly enhanced the capabilities of conversational agents, making them applicable to various fields (e. g., education).
EHR-SeqSQL : A Sequential Text-to-SQL Dataset For Interactively Exploring Electronic Health Records
In this paper, we introduce EHR-SeqSQL, a novel sequential text-to-SQL dataset for Electronic Health Record (EHR) databases.
Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health Records
In this paper, we describe the task of reliable text-to-SQL modeling, the dataset, and the methods and results of the participants.
Towards Unbiased Evaluation of Detecting Unanswerable Questions in EHRSQL
Incorporating unanswerable questions into EHR QA systems is crucial for testing the trustworthiness of a system, as providing non-existent responses can mislead doctors in their diagnoses.
EHRFL: Federated Learning Framework for Institution-Specific Model Construction using Electronic Health Records
The increasing volume of electronic health records (EHRs) across healthcare institutions presents the opportunity to enhance model accuracy and robustness in clinical prediction tasks.
TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoring
To enable wider deployment, it is crucial to address these challenges in model design and enhance model evaluation to build trust in the model's output.
Recent Advances, Applications, and Open Challenges in Machine Learning for Health: Reflections from Research Roundtables at ML4H 2023 Symposium
The organization of the research roundtables at the conference involved 17 Senior Chairs and 19 Junior Chairs across 11 tables.
KorMedMCQA: Multi-Choice Question Answering Benchmark for Korean Healthcare Professional Licensing Examinations
We present KorMedMCQA, the first Korean Medical Multiple-Choice Question Answering benchmark, derived from professional healthcare licensing examinations conducted in Korea between 2012 and 2024.
EHRNoteQA: An LLM Benchmark for Real-World Clinical Practice Using Discharge Summaries
Furthermore, to validate EHRNoteQA as a reliable proxy for expert evaluations in clinical practice, we measure the correlation between the LLM performance on EHRNoteQA, and the LLM performance manually evaluated by clinicians.
Multimodal Transformer With a Low-Computational-Cost Guarantee
Transformer-based models have significantly improved performance across a range of multimodal understanding tasks, such as visual question answering and action recognition.
KorNAT: LLM Alignment Benchmark for Korean Social Values and Common Knowledge
For the common knowledge dataset, we constructed samples based on Korean textbooks and GED reference materials.
Self-Supervised Contrastive Learning for Long-term Forecasting
To this end, our contrastive loss incorporates global autocorrelation held in the whole time series, which facilitates the construction of positive and negative pairs in a self-supervised manner.
Ranked #1 on
Time Series Forecasting
on ETTh1 (720) Univariate
Learning under Label Noise through Few-Shot Human-in-the-Loop Refinement
We show that FHLR achieves significantly better performance when learning from noisy labels and achieves state-of-the-art by a large margin, with up to 19% accuracy improvement under symmetric and asymmetric noise.
General-Purpose Retrieval-Enhanced Medical Prediction Model Using Near-Infinite History
This allows for an unrestricted input size, eliminating the need for manual event selection.
EHRXQA: A Multi-Modal Question Answering Dataset for Electronic Health Records with Chest X-ray Images
To develop our dataset, we first construct two uni-modal resources: 1) The MIMIC-CXR-VQA dataset, our newly created medical visual question answering (VQA) benchmark, specifically designed to augment the imaging modality in EHR QA, and 2) EHRSQL (MIMIC-IV), a refashioned version of a previously established table-based EHR QA dataset.
KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Models
While large language models (LLMs) have made considerable advancements in understanding and generating unstructured text, their application in structured data remains underexplored.
Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notes
The development of large language models tailored for handling patients' clinical notes is often hindered by the limited accessibility and usability of these notes due to strict privacy regulations.
VisAlign: Dataset for Measuring the Degree of Alignment between AI and Humans in Visual Perception
In this paper, we focus on the models' visual perception alignment with humans, further referred to as AI-human visual alignment.
ECG-QA: A Comprehensive Question Answering Dataset Combined With Electrocardiogram
As a result, our dataset includes diverse ECG interpretation questions, including those that require a comparative analysis of two different ECGs.
Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Table
Despite recent interest in open domain question answering (ODQA) over tables, many studies still rely on datasets that are not truly optimal for the task with respect to utilizing structural nature of table.
FactKG: Fact Verification via Reasoning on Knowledge Graphs
KGs can be a valuable knowledge source in fact verification due to their reliability and broad applicability.
Learning Missing Modal Electronic Health Records with Unified Multi-modal Data Embedding and Modality-Aware Attention
Electronic Health Record (EHR) provides abundant information through various modalities.
Rediscovery of CNN's Versatility for Text-based Encoding of Raw Electronic Health Records
Making the most use of abundant information in electronic health records (EHR) is rapidly becoming an important topic in the medical domain.
Perspective Projection-Based 3D CT Reconstruction from Biplanar X-rays
X-ray computed tomography (CT) is one of the most common imaging techniques used to diagnose various diseases in the medical field.
Text-to-ECG: 12-Lead Electrocardiogram Synthesis conditioned on Clinical Text Reports
We compare the performance of our model with other representative models in text-to-speech and text-to-image.
Deep Imbalanced Time-series Forecasting via Local Discrepancy Density
Based on our findings, we propose a reweighting framework that down-weights the losses incurred by abrupt changes and up-weights those by normal states.
Vision-Language Generative Model for View-Specific Chest X-ray Generation
Synthetic medical data generation has opened up new possibilities in the healthcare domain, offering a powerful tool for simulating clinical scenarios, enhancing diagnostic and treatment quality, gaining granular medical knowledge, and accelerating the development of unbiased algorithms.
EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Records
We then manually linked these questions to two open-source EHR databases, MIMIC-III and eICU, and included various time expressions and held-out unanswerable questions in the dataset, which were also collected from the poll.
Significantly improving zero-shot X-ray pathology classification via fine-tuning pre-trained image-text encoders
Deep neural networks are increasingly used in medical imaging for tasks such as pathological classification, but they face challenges due to the scarcity of high-quality, expert-labeled training data.
UniHPF : Universal Healthcare Predictive Framework with Zero Domain Knowledge
Despite the abundance of Electronic Healthcare Records (EHR), its heterogeneity restricts the utilization of medical data in building predictive models.
Universal EHR Federated Learning Framework
Federated learning (FL) is the most practical multi-source learning method for electronic healthcare records (EHR).
Self-Supervised Predictive Coding with Multimodal Fusion for Patient Deterioration Prediction in Fine-grained Time Resolution
Accurate time prediction of patients' critical events is crucial in urgent scenarios where timely decision-making is important.
Specializing Multi-domain NMT via Penalizing Low Mutual Information
Multi-domain Neural Machine Translation (NMT) trains a single model with multiple domains.
Do Language Models Understand Measurements?
Recent success of pre-trained language models (PLMs) has stimulated interest in their ability to understand and work with numbers.
Correlation between Alignment-Uniformity and Performance of Dense Contrastive Representations
Recently, dense contrastive learning has shown superior performance on dense prediction tasks compared to instance-level contrastive learning.
Reweighting Strategy based on Synthetic Data Identification for Sentence Similarity
To analyze this, we first train a classifier that identifies machine-written sentences, and observe that the linguistic features of the sentences identified as written by a machine are significantly different from those of human-written sentences.
Automatic Detection of Noisy Electrocardiogram Signals without Explicit Noise Labels
Automatic deep learning-based examination of ECG signals can lead to inaccurate diagnosis, and manual analysis involves rejection of noisy ECG samples by clinicians, which might cost extra time.
Task Agnostic and Post-hoc Unseen Distribution Detection
Despite the recent advances in out-of-distribution(OOD) detection, anomaly detection, and uncertainty estimation tasks, there do not exist a task-agnostic and post-hoc approach.
GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learning
To address this challenge, we propose General Healthcare Predictive Framework (GenHPF), which is applicable to any EHR with minimal preprocessing for multiple prediction tasks.
Towards the Practical Utility of Federated Learning in the Medical Domain
We evaluate six FL algorithms designed for addressing data heterogeneity among clients, and a hybrid algorithm combining the strengths of two representative FL algorithms.
Revisiting the Importance of Amplifying Bias for Debiasing
$f_B$ is trained to focus on bias-aligned samples (i. e., overfitted to the bias) while $f_D$ is mainly trained with bias-conflicting samples by concentrating on samples which $f_B$ fails to learn, leading $f_D$ to be less susceptible to the dataset bias.
Unconditional Image-Text Pair Generation with Multimodal Cross Quantizer
To learn a multimodal semantic correlation in a quantized space, we combine VQ-VAE with a Transformer encoder and apply an input masking strategy.
Graph-Text Multi-Modal Pre-training for Medical Representation Learning
MedGTX uses a novel graph encoder to exploit the graphical nature of structured EHR data, and a text encoder to handle unstructured text, and a cross-modal encoder to learn a joint representation space.
Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogram
In this work, we propose an ECG pre-training method that learns both local and global contextual representations for better generalizability and performance on downstream tasks.
Uncertainty-Aware Text-to-Program for Question Answering on Structured Electronic Health Records
In addition, for a reliable EHR-QA model, we apply the uncertainty decomposition method to measure the ambiguity in the input question.
Real-Time Seizure Detection using EEG: A Comprehensive Comparison of Recent Approaches under a Realistic Setting
Electroencephalogram (EEG) is an important diagnostic test that physicians use to record brain activity and detect seizures by monitoring the signals.
Ranked #1 on
Seizure Detection
on TUH EEG Seizure Corpus
Continuous-Time Video Generation via Learning Motion Dynamics with Neural ODE
In order to perform unconditional video generation, we must learn the distribution of the real-world videos.
Exploration into Translation-Equivariant Image Quantization
This is an exploratory study that discovers the current image quantization (vector quantization) do not satisfy translation equivariance in the quantized space due to aliasing.
Question Answering for Complex Electronic Health Records Database using Unified Encoder-Decoder Architecture
An intelligent machine that can answer human questions based on electronic health records (EHR-QA) has a great practical value, such as supporting clinical decisions, managing hospital administration, and medical chatbots.
Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embedding
EHR systems lack a unified code system forrepresenting medical concepts, which acts asa barrier for the deployment of deep learningmodels in large scale to multiple clinics and hos-pitals.
Conditional Generation of Periodic Signals with Fourier-Based Decoder
Periodic signals play an important role in daily lives.
Natural Attribute-based Shift Detection
Despite the impressive performance of deep networks in vision, language, and healthcare, unpredictable behaviors on samples from the distribution different than the training distribution cause severe problems in deployment.
Decoupled Kernel Neural Processes: Neural Network-Parameterized Stochastic Processes using Explicit Data-driven Kernel
To address this, we introduce a new neural stochastic processes, Decoupled Kernel Neural Processes (DKNPs), which explicitly learn a separate mean and kernel function to directly model the covariance between output variables in a data-driven manner.
Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embedding
To overcome this problem, we introduce Description-based Embedding, DescEmb, a code-agnostic description-based representation learning framework for predictive modeling on EHR.
Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training
Recently a number of studies demonstrated impressive performance on diverse vision-language multi-modal tasks such as image captioning and visual question answering by extending the BERT architecture with multi-modal pre-training objectives.
Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Prediction
Accurate terminology translation is crucial for ensuring the practicality and reliability of neural machine translation (NMT) systems.
A System for Automated Open-Source Threat Intelligence Gathering and Management
SecurityKG collects OSCTI reports from various sources, uses a combination of AI and NLP techniques to extract high-fidelity knowledge about threat behaviors, and constructs a security knowledge graph.
Evaluation of Out-of-Distribution Detection Performance of Self-Supervised Learning in a Controllable Environment
We evaluate the out-of-distribution (OOD) detection performance of self-supervised learning (SSL) techniques with a new evaluation framework.
Out-of-Distribution Detection
Out of Distribution (OOD) Detection
+1
Knowledge Graph-based Question Answering with Electronic Health Records
Question Answering (QA) is a widely-used framework for developing and evaluating an intelligent machine.
Vid-ODE: Continuous-Time Video Generation with Neural Ordinary Differential Equation
Video generation models often operate under the assumption of fixed frame rates, which leads to suboptimal performance when it comes to handling flexible frame rates (e. g., increasing the frame rate of the more dynamic portion of the video as well as handling missing video frames).
Neural Ordinary Differential Equations for Intervention Modeling
By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics in the continuous time domain.
Learning the Graphical Structure of Electronic Health Records with Graph Convolutional Transformer
A recent study showed that using the graphical structure underlying EHR data (e. g. relationship between diagnoses and treatments) improves the performance of prediction tasks such as heart failure prediction.
Analyzing the Role of Model Uncertainty for Electronic Health Records
We further show that RNNs with only Bayesian embeddings can be a more efficient way to capture model uncertainty compared to ensembles, and we analyze how model uncertainty is impacted across individual input features and patient subgroups.
Clinical Concept Extraction for Document-Level Coding
The text of clinical notes can be a valuable source of patient information and clinical assessments.
MiME: Multilevel Medical Embedding of Electronic Health Records for Predictive Healthcare
Deep learning models exhibit state-of-the-art performance for many predictive healthcare tasks using electronic health records (EHR) data, but these models typically require training data volume that exceeds the capacity of most healthcare systems.
RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Records
Therefore, our design study aims to provide a visual analytics solution to increase interpretability and interactivity of RNNs via a joint effort of medical experts, artificial intelligence scientists, and visual analytics researchers.
Compositional Obverter Communication Learning From Raw Visual Input
Previously, it has been shown that neural network agents can learn to communicate in a highly structured, possibly compositional language based on disentangled input (e. g. hand- engineered features).
MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks
We present MorphNet, an approach to automate the design of neural network structures.
Generating Multi-label Discrete Patient Records using Generative Adversarial Networks
Access to electronic health record (EHR) data has motivated computational advances in medical research.
Causal Regularization
In application domains such as healthcare, we want accurate predictive models that are also causally interpretable.
GRAM: Graph-based Attention Model for Healthcare Representation Learning
-Interpretation:The representations learned by deep learning methods should align with medical knowledge.
RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism
RETAIN was tested on a large health system EHR dataset with 14 million visits completed by 263K patients over an 8 year period and demonstrated predictive accuracy and computational scalability comparable to state-of-the-art methods such as RNN, and ease of interpretability comparable to traditional models.
Ranked #2 on
Disease Trajectory Forecasting
on UK CF trust
Multi-layer Representation Learning for Medical Concepts
Learning efficient representations for concepts has been proven to be an important basis for many applications such as machine translation or document classification.
Medical Concept Representation Learning from Electronic Health Records and its Application on Heart Failure Prediction
Objective: To transform heterogeneous clinical data from electronic health records into clinically meaningful constructed features using data driven method that rely, in part, on temporal relations among data.
Doctor AI: Predicting Clinical Events via Recurrent Neural Networks
Leveraging large historical data in electronic health record (EHR), we developed Doctor AI, a generic predictive model that covers observed medical conditions and medication uses.
