Search Results for author:
Found 41 papers, 22 papers with code
Distance Metric Learning with Joint Representation Diversification
Distance metric learning (DML) is to learn a representation space equipped with a metric, such that examples from the same class are closer than examples from different classes with respect to the metric.
LearNAT: Learning NL2SQL with AST-guided Task Decomposition for Large Language Models
Inspired by the application of reinforcement learning in mathematical problem-solving to encourage step-by-step reasoning in LLMs, we propose LearNAT (Learning NL2SQL with AST-guided Task Decomposition), a novel framework that improves the performance of open-source LLMs on complex NL2SQL tasks through task decomposition and reinforcement learning.
GeoEdit: Geometric Knowledge Editing for Large Language Models
For the remaining neurons, we integrate both old and new knowledge for aligned directions and apply a "forget-then-learn" editing strategy for opposite directions.
Recurrent Knowledge Identification and Fusion for Language Model Continual Learning
Continual learning (CL) is crucial for deploying large language models (LLMs) in dynamic real-world environments without costly retraining.
DRESSing Up LLM: Efficient Stylized Question-Answering via Style Subspace Editing
Our approach leverages the over-parameterized nature of LLMs to disentangle a style-relevant subspace within the model's representation space to conduct representation editing, ensuring a minimal impact on the original semantics.
Enhancing Topic Interpretability for Neural Topic Modeling through Topic-wise Contrastive Learning
Data mining and knowledge discovery are essential aspects of extracting valuable insights from vast datasets.
RAGraph: A General Retrieval-Augmented Graph Learning Framework
Graph Neural Networks (GNNs) have become essential in interpreting relational data across various domains, yet, they often struggle to generalize to unseen graph data that differs markedly from training instances.
Parenting: Optimizing Knowledge Selection of Retrieval-Augmented Language Models with Parameter Decoupling and Tailored Tuning
Retrieval-Augmented Generation (RAG) offers an effective solution to the issues faced by Large Language Models (LLMs) in hallucination generation and knowledge obsolescence by incorporating externally retrieved knowledge.
3DS: Decomposed Difficulty Data Selection's Case Study on LLM Medical Domain Adaptation
To address this, we propose a two-stage model-centric data selection framework, Decomposed Difficulty Data Selection (3DS), which aligns data with the model's knowledge distribution for optimized adaptation.
TPO: Aligning Large Language Models with Multi-branch & Multi-step Preference Trees
In the domain of complex reasoning tasks, such as mathematical reasoning, recent advancements have proposed the use of Direct Preference Optimization (DPO) to suppress output of dispreferred responses, thereby enhancing the long-chain reasoning capabilities of large language models (LLMs).
ColaCare: Enhancing Electronic Health Record Modeling through Large Language Model-Driven Multi-Agent Collaboration
We introduce ColaCare, a framework that enhances Electronic Health Record (EHR) modeling through multi-agent collaboration driven by Large Language Models (LLMs).
IntelliCare: Improving Healthcare Analysis with Variance-Controlled Patient-Level Knowledge from Large Language Models
While pioneering deep learning methods have made great strides in analyzing electronic health record (EHR) data, they often struggle to fully capture the semantics of diverse medical codes from limited data.
TC-RAG:Turing-Complete RAG's Case study on Medical LLM Systems
In the pursuit of enhancing domain-specific Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) emerges as a promising solution to mitigate issues such as hallucinations, outdated knowledge, and limited expertise in highly specialized queries.
KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Models
Simultaneously, we proposed a rewriting strategy and data ratio optimization strategy to address preference imbalances.
Is larger always better? Evaluating and prompting large language models for non-generative medical tasks
The use of Large Language Models (LLMs) in medicine is growing, but their ability to handle both structured Electronic Health Record (EHR) data and unstructured clinical notes is not well-studied.
SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status Prediction
To tackle this problem, we propose SMART, a Self-Supervised Missing-Aware RepresenTation Learning approach for patient health status prediction, which encodes missing information via elaborated attentions and learns to impute missing values through a novel self-supervised pre-training approach that reconstructs missing data representations in the latent space.
LoRA Dropout as a Sparsity Regularizer for Overfitting Control
We then demonstrate the theoretical mechanism of our LoRA Dropout mechanism from the perspective of sparsity regularization by providing a generalization error bound under this framework.
LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation
This highlights the potential of Mamba in facilitating model lightweighting.
Learnable Prompt as Pseudo-Imputation: Reassessing the Necessity of Traditional EHR Data Imputation in Downstream Clinical Prediction
PAI no longer introduces any imputed data but constructs a learnable prompt to model the implicit preferences of the downstream model for missing values, resulting in a significant performance improvement for all EHR analysis models.
Infinite-Horizon Graph Filters: Leveraging Power Series to Enhance Sparse Information Aggregation
Graph Neural Networks (GNNs) have shown considerable effectiveness in a variety of graph learning tasks, particularly those based on the message-passing approach in recent years.
Imputation with Inter-Series Information from Prototypes for Irregular Sampled Time Series
To bridge this gap, we propose PRIME, a Prototype Recurrent Imputation ModEl, which integrates both intra-series and inter-series information for imputing missing values in irregularly sampled time series.
Learning the Dynamic Correlations and Mitigating Noise by Hierarchical Convolution for Long-term Sequence Forecasting
In particular, a hierarchical convolution structure is introduced to extract the information from the series at various scales.
HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responses
In this paper, we investigate the retrieval-augmented generation (RAG) based on Knowledge Graphs (KGs) to improve the accuracy and reliability of Large Language Models (LLMs).
Predict and Interpret Health Risk using EHR through Typical Patients
Predicting health risks from electronic health records (EHR) is a topic of recent interest.
Domain-invariant Clinical Representation Learning by Bridging Data Distribution Shift across EMR Datasets
Due to the limited information about emerging diseases, symptoms are hard to be noticed and recognized, so that the window for clinical intervention could be ignored.
A ModelOps-based Framework for Intelligent Medical Knowledge Extraction
Extracting medical knowledge from healthcare texts enhances downstream tasks like medical knowledge graph construction and clinical decision-making.
Fused Gromov-Wasserstein Graph Mixup for Graph-level Classifications
To solve this problem, we propose a novel graph mixup algorithm called FGWMixup, which seeks a midpoint of source graphs in the Fused Gromov-Wasserstein (FGW) metric space.
Mortality Prediction with Adaptive Feature Importance Recalibration for Peritoneal Dialysis Patients: a deep-learning-based study on a real-world longitudinal follow-up dataset
Here, our objective is to develop a deep learning model for a real-time, individualized, and interpretable mortality prediction model - AICare.
M$^3$Care: Learning with Missing Modalities in Multimodal Healthcare Data
M3Care is an end-to-end model compensating the missing information of the patients with missing modalities to perform clinical analysis.
Domain Generalization through the Lens of Angular Invariance
Based on the proposed term of invariance, we propose a novel deep DG method called Angular Invariance Domain Generalization Network (AIDGN).
A Comprehensive Benchmark for COVID-19 Predictive Modeling Using Electronic Health Records in Intensive Care
Many deep learning models have been proposed to conduct clinical predictive tasks such as mortality prediction for COVID-19 patients in intensive care units using Electronic Health Record (EHR) data.
MedFACT: Modeling Medical Feature Correlations in Patient Health Representation Learning via Feature Clustering
Thus, to address the issues, we expect to group up strongly correlated features and learn feature correlations in a group-wise manner to reduce the learning complexity without losing generality.
SpotTune: Leveraging Transient Resources for Cost-efficient Hyper-parameter Tuning in the Public Cloud
Hyper-parameter tuning (HPT) is crucial for many machine learning (ML) algorithms.
CovidCare: Transferring Knowledge from Existing EMR to Emerging Epidemic for Interpretable Prognosis
Due to the characteristics of COVID-19, the epidemic develops rapidly and overwhelms health service systems worldwide.
StageNet: Stage-Aware Neural Networks for Health Risk Prediction
Compared to the best baseline model, StageNet achieves up to 12% higher AUPRC for risk prediction task on two real-world patient datasets.
ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Context
Predicting the patient's clinical outcome from the historical electronic medical records (EMR) is a fundamental research problem in medical informatics.
AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibration
It also models the correlation between clinical features to enhance the ones which strongly indicate the health status and thus can maintain a state-of-the-art performance in terms of prediction accuracy while providing qualitative interpretability.
MUSEFood: Multi-sensor-based Food Volume Estimation on Smartphones
Furthermore, MUSEFood uses the microphone and the speaker to accurately measure the vertical distance from the camera to the food in a noisy environment, thus scaling the size of food in the image to its actual size.
Multi-Label Robust Factorization Autoencoder and its Application in Predicting Drug-Drug Interactions
However, the shallow models leveraging bilinear forms suffer from limitations on capturing complicated nonlinear interactions between drug pairs.
Cell Selection with Deep Reinforcement Learning in Sparse Mobile Crowdsensing
Since the sensed data from different cells (sub-areas) of the target sensing area will probably lead to diverse levels of inference data quality, cell selection (i. e., choose which cells of the target area to collect sensed data from participants) is a critical issue that will impact the total amount of data that requires to be collected (i. e., data collection costs) for ensuring a certain level of quality.
Motif-based Rule Discovery for Predicting Real-valued Time Series
Time series prediction is of great significance in many applications and has attracted extensive attention from the data mining community.
