Search Results for author: Hejie Cui

Found 28 papers, 18 papers with code

Biomedical Visual Instruction Tuning with Clinician Preference Alignment

1 code implementation19 Jun 2024 Hejie Cui, Lingjun Mao, Xin Liang, Jieyu Zhang, Hui Ren, Quanzheng Li, Xiang Li, Carl Yang

In this work, we propose a data-centric framework, Biomedical Visual Instruction Tuning with Clinician Preference Alignment (BioMed-VITAL), that incorporates clinician preferences into both stages of generating and selecting instruction data for tuning biomedical multimodal foundation models.

Instruction Following Visual Question Answering (VQA)

TACCO: Task-guided Co-clustering of Clinical Concepts and Patient Visits for Disease Subtyping based on EHR Data

1 code implementation14 Jun 2024 Ziyang Zhang, Hejie Cui, ran Xu, Yuzhang Xie, Joyce C. Ho, Carl Yang

In this work, we introduce TACCO, a novel framework that jointly discovers clusters of clinical concepts and patient visits based on a hypergraph modeling of EHR data.

Clustering Phenotype classification

Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM

no code implementations19 Feb 2024 Hejie Cui, Xinyu Fang, ran Xu, Xuan Kan, Joyce C. Ho, Carl Yang

While there has been a lot of research on representation learning of structured EHR data, the fusion of different types of EHR data (multimodal fusion) is not well studied.

Decision Making Representation Learning

Microstructures and Accuracy of Graph Recall by Large Language Models

1 code implementation19 Feb 2024 Yanbang Wang, Hejie Cui, Jon Kleinberg

Moreover, we find that more advanced LLMs have a striking dependence on the domain that a real-world graph comes from -- by yielding the best recall accuracy when the graph is narrated in a language style consistent with its original domain.

Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models

1 code implementation1 Nov 2023 ran Xu, Hejie Cui, Yue Yu, Xuan Kan, Wenqi Shi, Yuchen Zhuang, Wei Jin, Joyce Ho, Carl Yang

Clinical natural language processing requires methods that can address domain-specific challenges, such as complex medical terminology and clinical contexts.

Clinical Knowledge Diversity +2

Dynamic Brain Transformer with Multi-level Attention for Functional Brain Network Analysis

1 code implementation5 Sep 2023 Xuan Kan, Antonio Aodong Chen Gu, Hejie Cui, Ying Guo, Carl Yang

However, the conventional approach involving static brain network analysis offers limited potential in capturing the dynamism of brain function.

R-Mixup: Riemannian Mixup for Biological Networks

no code implementations5 Jun 2023 Xuan Kan, Zimu Li, Hejie Cui, Yue Yu, ran Xu, Shaojun Yu, Zilong Zhang, Ying Guo, Carl Yang

Biological networks are commonly used in biomedical and healthcare domains to effectively model the structure of complex biological systems with interactions linking biological entities.

Data Augmentation

PTGB: Pre-Train Graph Neural Networks for Brain Network Analysis

1 code implementation20 May 2023 Yi Yang, Hejie Cui, Carl Yang

The human brain is the central hub of the neurobiological system, controlling behavior and cognition in complex ways.

Transfer Learning Unsupervised Pre-training

Transformer-Based Hierarchical Clustering for Brain Network Analysis

1 code implementation6 May 2023 Wei Dai, Hejie Cui, Xuan Kan, Ying Guo, Sanne van Rooij, Carl Yang

Brain networks, graphical models such as those constructed from MRI, have been widely used in pathological prediction and analysis of brain functions.

Clustering

Neighborhood-Regularized Self-Training for Learning with Few Labels

1 code implementation10 Jan 2023 ran Xu, Yue Yu, Hejie Cui, Xuan Kan, Yanqiao Zhu, Joyce Ho, Chao Zhang, Carl Yang

Our further analysis demonstrates that our proposed data selection strategy reduces the noise of pseudo labels by 36. 8% and saves 57. 3% of the time when compared with the best baseline.

Learning Task-Aware Effective Brain Connectivity for fMRI Analysis with Graph Neural Networks

1 code implementation1 Nov 2022 Yue Yu, Xuan Kan, Hejie Cui, ran Xu, Yujia Zheng, Xiangchen Song, Yanqiao Zhu, Kun Zhang, Razieh Nabi, Ying Guo, Chao Zhang, Carl Yang

To better adapt GNNs for fMRI analysis, we propose TBDS, an end-to-end framework based on \underline{T}ask-aware \underline{B}rain connectivity \underline{D}AG (short for Directed Acyclic Graph) \underline{S}tructure generation for fMRI analysis.

Time Series Time Series Analysis

Brain Network Transformer

2 code implementations13 Oct 2022 Xuan Kan, Wei Dai, Hejie Cui, Zilong Zhang, Ying Guo, Carl Yang

Human brains are commonly modeled as networks of Regions of Interest (ROIs) and their connections for the understanding of brain functions and mental disorders.

Clustering

Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis

1 code implementation30 Jun 2022 Hejie Cui, Wei Dai, Yanqiao Zhu, Xiaoxiao Li, Lifang He, Carl Yang

Mapping the connections of the human brain as a network is one of the most pervasive paradigms in neuroscience.

Disease Prediction

Data-Efficient Brain Connectome Analysis via Multi-Task Meta-Learning

1 code implementation9 Jun 2022 Yi Yang, Yanqiao Zhu, Hejie Cui, Xuan Kan, Lifang He, Ying Guo, Carl Yang

Specifically, we propose to meta-train the model on datasets of large sample sizes and transfer the knowledge to small datasets.

Meta-Learning

FBNETGEN: Task-aware GNN-based fMRI Analysis via Functional Brain Network Generation

1 code implementation25 May 2022 Xuan Kan, Hejie Cui, Joshua Lukemire, Ying Guo, Carl Yang

In particular, we formulate (1) prominent region of interest (ROI) features extraction, (2) brain networks generation, and (3) clinical predictions with GNNs, in an end-to-end trainable model under the guidance of particular prediction tasks.

Graph Neural Network Time Series +1

How Can Graph Neural Networks Help Document Retrieval: A Case Study on CORD19 with Concept Map Generation

1 code implementation12 Jan 2022 Hejie Cui, Jiaying Lu, Yao Ge, Carl Yang

Graph neural networks (GNNs), as a group of powerful tools for representation learning on irregular data, have manifested superiority in various downstream tasks.

Representation Learning Retrieval

Structure-Aware Hard Negative Mining for Heterogeneous Graph Contrastive Learning

no code implementations31 Aug 2021 Yanqiao Zhu, Yichen Xu, Hejie Cui, Carl Yang, Qiang Liu, Shu Wu

Recently, heterogeneous Graph Neural Networks (GNNs) have become a de facto model for analyzing HGs, while most of them rely on a relative large number of labeled data.

Contrastive Learning

Effective and Interpretable fMRI Analysis via Functional Brain Network Generation

no code implementations23 Jul 2021 Xuan Kan, Hejie Cui, Ying Guo, Carl Yang

Recent studies in neuroscience show great potential of functional brain networks constructed from fMRI data for popularity modeling and clinical predictions.

Zero-Shot Scene Graph Relation Prediction through Commonsense Knowledge Integration

1 code implementation11 Jul 2021 Xuan Kan, Hejie Cui, Carl Yang

Relation prediction among entities in images is an important step in scene graph generation (SGG), which further impacts various visual understanding and reasoning tasks.

Graph Generation Graph Mining +3

Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis

no code implementations7 Jul 2021 Yanqiao Zhu, Hejie Cui, Lifang He, Lichao Sun, Carl Yang

Multimodal brain networks characterize complex connectivities among different brain regions from both structural and functional aspects and provide a new means for mental disease analysis.

Contrastive Learning

On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphs

2 code implementations3 Jul 2021 Hejie Cui, Zijie Lu, Pan Li, Carl Yang

Graph neural networks (GNNs) have been widely used in various graph-related problems such as node classification and graph classification, where superior performance is mainly established when natural node features are available.

Graph Classification Node Classification

Pulmonary Vessel Segmentation based on Orthogonal Fused U-Net++ of Chest CT Images

no code implementations3 Jul 2021 Hejie Cui, Xinglong Liu, Ning Huang

Pulmonary vessel segmentation is important for clinical diagnosis of pulmonary diseases, while is also challenging due to the complicated structure.

Segmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.