1 code implementation • 19 Jun 2024 • Hejie Cui, Lingjun Mao, Xin Liang, Jieyu Zhang, Hui Ren, Quanzheng Li, Xiang Li, Carl Yang
In this work, we propose a data-centric framework, Biomedical Visual Instruction Tuning with Clinician Preference Alignment (BioMed-VITAL), that incorporates clinician preferences into both stages of generating and selecting instruction data for tuning biomedical multimodal foundation models.
1 code implementation • 14 Jun 2024 • Ziyang Zhang, Hejie Cui, ran Xu, Yuzhang Xie, Joyce C. Ho, Carl Yang
In this work, we introduce TACCO, a novel framework that jointly discovers clusters of clinical concepts and patient visits based on a hypergraph modeling of EHR data.
no code implementations • 19 Mar 2024 • Hejie Cui, Zhuocheng Shen, Jieyu Zhang, Hui Shao, Lianhui Qin, Joyce C. Ho, Carl Yang
Electronic health records (EHRs) contain valuable patient data for health-related prediction tasks, such as disease prediction.
no code implementations • 19 Feb 2024 • Hejie Cui, Xinyu Fang, ran Xu, Xuan Kan, Joyce C. Ho, Carl Yang
While there has been a lot of research on representation learning of structured EHR data, the fusion of different types of EHR data (multimodal fusion) is not well studied.
1 code implementation • 19 Feb 2024 • Yanbang Wang, Hejie Cui, Jon Kleinberg
Moreover, we find that more advanced LLMs have a striking dependence on the domain that a real-world graph comes from -- by yielding the best recall accuracy when the graph is narrated in a language style consistent with its original domain.
1 code implementation • 1 Nov 2023 • ran Xu, Hejie Cui, Yue Yu, Xuan Kan, Wenqi Shi, Yuchen Zhuang, Wei Jin, Joyce Ho, Carl Yang
Clinical natural language processing requires methods that can address domain-specific challenges, such as complex medical terminology and clinical contexts.
1 code implementation • 5 Sep 2023 • Xuan Kan, Antonio Aodong Chen Gu, Hejie Cui, Ying Guo, Carl Yang
However, the conventional approach involving static brain network analysis offers limited potential in capturing the dynamism of brain function.
no code implementations • 7 Jun 2023 • Carl Yang, Hejie Cui, Jiaying Lu, Shiyu Wang, ran Xu, Wenjing Ma, Yue Yu, Shaojun Yu, Xuan Kan, Chen Ling, Tianfan Fu, Liang Zhao, Joyce Ho, Fei Wang
This work aims to serve as a valuable resource for understanding the potential and opportunities of HKG in health research.
no code implementations • 5 Jun 2023 • Xuan Kan, Zimu Li, Hejie Cui, Yue Yu, ran Xu, Shaojun Yu, Zilong Zhang, Ying Guo, Carl Yang
Biological networks are commonly used in biomedical and healthcare domains to effectively model the structure of complex biological systems with interactions linking biological entities.
no code implementations • 1 Jun 2023 • Hejie Cui, Rongmei Lin, Nasser Zalmout, Chenwei Zhang, Jingbo Shang, Carl Yang, Xian Li
Information extraction, e. g., attribute value extraction, has been extensively studied and formulated based only on text.
no code implementations • 30 May 2023 • Chen Ling, Xujiang Zhao, Jiaying Lu, Chengyuan Deng, Can Zheng, Junxiang Wang, Tanmoy Chowdhury, Yun Li, Hejie Cui, Xuchao Zhang, Tianjiao Zhao, Amit Panalkar, Dhagash Mehta, Stefano Pasquali, Wei Cheng, Haoyu Wang, Yanchi Liu, Zhengzhang Chen, Haifeng Chen, Chris White, Quanquan Gu, Jian Pei, Carl Yang, Liang Zhao
In this article, we present a comprehensive survey on domain specification techniques for large language models, an emerging direction critical for large language model applications.
1 code implementation • 20 May 2023 • Yi Yang, Hejie Cui, Carl Yang
The human brain is the central hub of the neurobiological system, controlling behavior and cognition in complex ways.
1 code implementation • 6 May 2023 • Wei Dai, Hejie Cui, Xuan Kan, Ying Guo, Sanne van Rooij, Carl Yang
Brain networks, graphical models such as those constructed from MRI, have been widely used in pathological prediction and analysis of brain functions.
1 code implementation • 10 Jan 2023 • ran Xu, Yue Yu, Hejie Cui, Xuan Kan, Yanqiao Zhu, Joyce Ho, Chao Zhang, Carl Yang
Our further analysis demonstrates that our proposed data selection strategy reduces the noise of pseudo labels by 36. 8% and saves 57. 3% of the time when compared with the best baseline.
1 code implementation • 1 Nov 2022 • Yue Yu, Xuan Kan, Hejie Cui, ran Xu, Yujia Zheng, Xiangchen Song, Yanqiao Zhu, Kun Zhang, Razieh Nabi, Ying Guo, Chao Zhang, Carl Yang
To better adapt GNNs for fMRI analysis, we propose TBDS, an end-to-end framework based on \underline{T}ask-aware \underline{B}rain connectivity \underline{D}AG (short for Directed Acyclic Graph) \underline{S}tructure generation for fMRI analysis.
2 code implementations • 13 Oct 2022 • Xuan Kan, Wei Dai, Hejie Cui, Zilong Zhang, Ying Guo, Carl Yang
Human brains are commonly modeled as networks of Regions of Interest (ROIs) and their connections for the understanding of brain functions and mental disorders.
1 code implementation • 30 Jun 2022 • Hejie Cui, Wei Dai, Yanqiao Zhu, Xiaoxiao Li, Lifang He, Carl Yang
Mapping the connections of the human brain as a network is one of the most pervasive paradigms in neuroscience.
1 code implementation • 9 Jun 2022 • Yi Yang, Yanqiao Zhu, Hejie Cui, Xuan Kan, Lifang He, Ying Guo, Carl Yang
Specifically, we propose to meta-train the model on datasets of large sample sizes and transfer the knowledge to small datasets.
1 code implementation • 25 May 2022 • Xuan Kan, Hejie Cui, Joshua Lukemire, Ying Guo, Carl Yang
In particular, we formulate (1) prominent region of interest (ROI) features extraction, (2) brain networks generation, and (3) clinical predictions with GNNs, in an end-to-end trainable model under the guidance of particular prediction tasks.
1 code implementation • 17 Mar 2022 • Hejie Cui, Wei Dai, Yanqiao Zhu, Xuan Kan, Antonio Aodong Chen Gu, Joshua Lukemire, Liang Zhan, Lifang He, Ying Guo, Carl Yang
To bridge this gap, we present BrainGB, a benchmark for brain network analysis with GNNs.
1 code implementation • 12 Jan 2022 • Hejie Cui, Jiaying Lu, Yao Ge, Carl Yang
Graph neural networks (GNNs), as a group of powerful tools for representation learning on irregular data, have manifested superiority in various downstream tasks.
no code implementations • 31 Aug 2021 • Yanqiao Zhu, Yichen Xu, Hejie Cui, Carl Yang, Qiang Liu, Shu Wu
Recently, heterogeneous Graph Neural Networks (GNNs) have become a de facto model for analyzing HGs, while most of them rely on a relative large number of labeled data.
no code implementations • 23 Jul 2021 • Xuan Kan, Hejie Cui, Ying Guo, Carl Yang
Recent studies in neuroscience show great potential of functional brain networks constructed from fMRI data for popularity modeling and clinical predictions.
1 code implementation • 11 Jul 2021 • Hejie Cui, Wei Dai, Yanqiao Zhu, Xiaoxiao Li, Lifang He, Carl Yang
Interpretable brain network models for disease prediction are of great value for the advancement of neuroscience.
1 code implementation • 11 Jul 2021 • Xuan Kan, Hejie Cui, Carl Yang
Relation prediction among entities in images is an important step in scene graph generation (SGG), which further impacts various visual understanding and reasoning tasks.
no code implementations • 7 Jul 2021 • Yanqiao Zhu, Hejie Cui, Lifang He, Lichao Sun, Carl Yang
Multimodal brain networks characterize complex connectivities among different brain regions from both structural and functional aspects and provide a new means for mental disease analysis.
2 code implementations • 3 Jul 2021 • Hejie Cui, Zijie Lu, Pan Li, Carl Yang
Graph neural networks (GNNs) have been widely used in various graph-related problems such as node classification and graph classification, where superior performance is mainly established when natural node features are available.
no code implementations • 3 Jul 2021 • Hejie Cui, Xinglong Liu, Ning Huang
Pulmonary vessel segmentation is important for clinical diagnosis of pulmonary diseases, while is also challenging due to the complicated structure.