no code implementations • EMNLP 2021 • Kewei Cheng, Ziqing Yang, Ming Zhang, Yizhou Sun
Knowledge graph inference has been studied extensively due to its wide applications.
no code implementations • ICML 2020 • Ting Chen, Lala Li, Yizhou Sun
Embedding layers are commonly used to map discrete symbols into continuous embedding vectors that reflect their semantic meanings.
no code implementations • 20 Dec 2024 • Yanna Ding, Zijie Huang, Xiao Shou, Yihang Guo, Yizhou Sun, Jianxi Gao
Learning curve extrapolation predicts neural network performance from early training epochs and has been applied to accelerate AutoML, facilitating hyperparameter tuning and neural architecture search.
no code implementations • 10 Dec 2024 • Zongyu Lin, Wei Liu, Chen Chen, Jiasen Lu, Wenze Hu, Tsu-Jui Fu, Jesse Allardice, Zhengfeng Lai, Liangchen Song, BoWen Zhang, Cha Chen, Yiran Fei, Yifan Jiang, Lezhi Li, Yizhou Sun, Kai-Wei Chang, Yinfei Yang
The field of video generation has made remarkable advancements, yet there remains a pressing need for a clear, systematic recipe that can guide the development of robust and scalable models.
no code implementations • 3 Dec 2024 • Derek Xu, Tong Xie, Botao Xia, Haoyu Li, Yunsheng Bai, Yizhou Sun, Wei Wang
This work focuses on the few-shot examples present in most code generation prompts, offering a systematic study on whether few-shot examples improve LLM's coding capabilities, which few-shot examples have the largest impact, and how to select impactful examples.
1 code implementation • 24 Nov 2024 • Arvind Murari Vepa, Zukang Yang, Andrew Choi, Jungseock Joo, Fabien Scalzo, Yizhou Sun
While weakly-supervised methods have been explored to reduce annotation burden, the fusion of AL with weak supervision remains unexplored, despite its potential to significantly reduce annotation costs.
1 code implementation • 7 Nov 2024 • Roshni G. Iyer, Yewen Wang, Wei Wang, Yizhou Sun
We call this model Non-Euclidean Mixture Model, i. e., NMM.
no code implementations • 3 Nov 2024 • Fang Sun, Zijie Huang, Haixin Wang, Yadi Cao, Xiao Luo, Wei Wang, Yizhou Sun
Molecular dynamics simulations are crucial for understanding complex physical, chemical, and biological processes at the atomic level.
1 code implementation • 25 Oct 2024 • Weikai Li, Ding Wang, Zijian Ding, Atefeh Sohrabizadeh, Zongyue Qin, Jason Cong, Yizhou Sun
We propose a more domain-generalizable model structure: a two-level hierarchical Mixture of Experts (MoE), that can be flexibly adapted to any GNN model.
no code implementations • 9 Oct 2024 • Haining Yu, Yizhou Sun
When used in observational sampling, $\hat{Q}$ is unbiased and asymptotically selects the model with the smallest MSE.
1 code implementation • 8 Oct 2024 • Zijie Huang, Wanjia Zhao, Jingdong Gao, Ziniu Hu, Xiao Luo, Yadi Cao, Yuanzhou Chen, Yizhou Sun, Wei Wang
While TRS is a domain-specific physical prior, we present the first theoretical proof that TRS loss can universally improve modeling accuracy by minimizing higher-order Taylor terms in ODE integration, which is numerically beneficial to various systems regardless of their properties, even for irreversible systems.
no code implementations • 25 Sep 2024 • Zongyue Qin, Zifan He, Neha Prakriya, Jason Cong, Yizhou Sun
Specifically, we first introduce a novel draft and verification scheme that generates multiple sequences following the large model's distribution based on beam sampling trajectories from the small model.
no code implementations • 20 Sep 2024 • Yunsheng Bai, Atefeh Sohrabizadeh, Zijian Ding, Rongjian Liang, Weikai Li, Ding Wang, Haoxing Ren, Yizhou Sun, Jason Cong
HLS relies on pragmas, which are directives inserted into the source code to guide the synthesis process, and pragmas have various settings and values that significantly impact the resulting hardware design.
no code implementations • 4 Sep 2024 • Zhicheng Ren, Zhiping Xiao, Yizhou Sun
Our work paves the way for more explainable, reliable, and effective social media user embedding which allows for better personalized content delivery.
1 code implementation • 22 Aug 2024 • Haixin Wang, Yadi Cao, Zijie Huang, Yuxuan Liu, Peiyan Hu, Xiao Luo, Zezheng Song, Wanjia Zhao, Jilin Liu, Jinan Sun, Shikun Zhang, Long Wei, Yue Wang, Tailin Wu, Zhi-Ming Ma, Yizhou Sun
This paper explores the recent advancements in enhancing Computational Fluid Dynamics (CFD) tasks through Machine Learning (ML) techniques.
no code implementations • 16 Aug 2024 • Zijian Ding, Atefeh Sohrabizadeh, Weikai Li, Zongyue Qin, Yizhou Sun, Jason Cong
There have been several recent works proposed to utilize model-based optimization methods to improve the productivity of using high-level synthesis (HLS) to design domain-specific architectures.
no code implementations • 12 Aug 2024 • Marco Maurizi, Derek Xu, Yu-Tong Wang, Desheng Yao, David Hahn, Mourad Oudich, Anish Satpati, Mathieu Bauchy, Wei Wang, Yizhou Sun, Yun Jing, Xiaoyu Rayne Zheng
Material responses to static and dynamic stimuli, represented as nonlinear curves, are design targets for engineering functionalities like structural support, impact protection, and acoustic and photonic bandgaps.
no code implementations • 31 Jul 2024 • Kewei Cheng, Jingfeng Yang, Haoming Jiang, Zhengyang Wang, Binxuan Huang, Ruirui Li, Shiyang Li, Zheng Li, Yifan Gao, Xian Li, Bing Yin, Yizhou Sun
To investigate into the true inductive reasoning capabilities of LLMs, we propose a novel framework, SolverLearner.
no code implementations • 21 Jul 2024 • Zongyue Qin, Chen Luo, Zhengyang Wang, Haoming Jiang, Yizhou Sun
This precise, up-to-date, and private information is typically stored in relational databases.
no code implementations • 12 Jul 2024 • Zongyue Qin, Ziniu Hu, Zifan He, Neha Prakriya, Jason Cong, Yizhou Sun
We consider multi-token joint decoding (MTJD), which generates multiple tokens from their joint distribution at each iteration, theoretically reducing perplexity and enhancing task performance.
no code implementations • 15 Jun 2024 • Haike Xu, Zongyu Lin, Yizhou Sun, Kai-Wei Chang, Piotr Indyk
Our experiments demonstrate the efficacy of our approach not only in contradiction retrieval with more than 30% accuracy improvements on MSMARCO and HotpotQA across different model architectures but also in applications such as cleaning corrupted corpora to restore high-quality QA retrieval.
1 code implementation • 13 Jun 2024 • Zimin Zhang, Qianli Wu, Botao Xia, Fang Sun, Ziniu Hu, Yizhou Sun, Shichang Zhang
Artificial intelligence (AI) is transforming scientific research, with explainable AI methods like concept-based models (CMs) showing promise for new discoveries.
no code implementations • 13 Jun 2024 • Shichang Zhang, Da Zheng, Jiani Zhang, Qi Zhu, Xiang Song, Soji Adeshina, Christos Faloutsos, George Karypis, Yizhou Sun
Large Language Models (LLMs), noted for their superior text understanding abilities, offer a solution for processing the text in graphs but face integration challenges due to their limitation for encoding graph structures and their computational complexities when dealing with extensive text in large neighborhoods of interconnected nodes.
no code implementations • 13 Jun 2024 • Zongyue Qin, Yunsheng Bai, Atefeh Sohrabizadeh, Zijian Ding, Ziniu Hu, Yizhou Sun, Jason Cong
Thus, it is desirable to automate such decisions with the help of machine learning for predicting the quality of HLS designs, requiring a deeper understanding of the program that consists of original code and pragmas.
no code implementations • 5 Jun 2024 • Hritik Bansal, Zongyu Lin, Tianyi Xie, Zeshun Zong, Michal Yarom, Yonatan Bitton, Chenfanfu Jiang, Yizhou Sun, Kai-Wei Chang, Aditya Grover
Recent advances in internet-scale video data pretraining have led to the development of text-to-video generative models that can create high-quality videos across a broad range of visual concepts, synthesize realistic motions and render complex objects.
1 code implementation • 9 May 2024 • Zifan He, Zongyue Qin, Neha Prakriya, Yizhou Sun, Jason Cong
With an additional 0. 5% - 2% of parameters, HMT can easily plug in and augment future LLMs to handle long context effectively.
no code implementations • 30 Apr 2024 • Kaiqiao Han, Yi Yang, Zijie Huang, Xuan Kan, Yang Yang, Ying Guo, Lifang He, Liang Zhan, Yizhou Sun, Wei Wang, Carl Yang
Brain network analysis is vital for understanding the neural interactions regarding brain structures and functions, and identifying potential biomarkers for clinical phenotypes.
no code implementations • 28 Apr 2024 • Qi Zhu, Da Zheng, Xiang Song, Shichang Zhang, Bowen Jin, Yizhou Sun, George Karypis
Inspired by this, we introduce Graph-aware Parameter-Efficient Fine-Tuning - GPEFT, a novel approach for efficient graph representation learning with LLMs on text-rich graphs.
1 code implementation • 14 Apr 2024 • Roshni G. Iyer, Wei Wang, Yizhou Sun
BR-GCN models use bi-level attention to learn node embeddings through (1) node-level attention, and (2) relation-level attention.
1 code implementation • 4 Apr 2024 • Arjun Subramonian, Jian Kang, Yizhou Sun
Throughout our analysis, we connect our findings to previously-proposed hypotheses for the origins of degree bias, supporting and unifying some while drawing doubt to others.
1 code implementation • 13 Mar 2024 • Weikai Li, Zhiping Xiao, Xiao Luo, Yizhou Sun
We propose a new method of evaluating node influence, which measures the prediction change of a trained GNN model caused by removing a node.
no code implementations • 29 Feb 2024 • Zijie Huang, Jeehyun Hwang, Junkai Zhang, Jinwoo Baik, Weitong Zhang, Dominik Wodarz, Yizhou Sun, Quanquan Gu, Wei Wang
Real-world multi-agent systems are often dynamic and continuous, where the agents co-evolve and undergo changes in their trajectories and interactions over time.
no code implementations • 21 Feb 2024 • Hengchuang Yin, Zhonghui Gu, Fanhao Wang, Yiparemu Abuduhaibaier, Yanqiao Zhu, Xinming Tu, Xian-Sheng Hua, Xiao Luo, Yizhou Sun
Large language models (LLMs) such as ChatGPT have gained considerable interest across diverse research communities.
no code implementations • 20 Feb 2024 • Kewei Cheng, Nesreen K. Ahmed, Theodore Willke, Yizhou Sun
Our experiments show that this framework significantly enhances the reasoning capabilities of LLMs, enabling them to excel in a broader spectrum of natural language scenarios.
1 code implementation • 8 Dec 2023 • Haoyu Li, Shichang Zhang, Longwen Tang, Mathieu Bauchy, Yizhou Sun
Metallic Glasses (MGs) are widely used materials that are stronger than steel while being shapeable as plastic.
no code implementations • 11 Nov 2023 • Xiao Luo, Yiyang Gu, Huiyu Jiang, Hang Zhou, Jinsheng Huang, Wei Ju, Zhiping Xiao, Ming Zhang, Yizhou Sun
In this paper, we propose a new approach named Prototypical Graph ODE (PGODE) to address the problem.
1 code implementation • 10 Oct 2023 • Zijie Huang, Wanjia Zhao, Jingdong Gao, Ziniu Hu, Xiao Luo, Yadi Cao, Yuanzhou Chen, Yizhou Sun, Wei Wang
Learning complex multi-agent system dynamics from data is crucial across many domains, such as in physical simulations and material modeling.
no code implementations • 7 Oct 2023 • Song Jiang, Zahra Shakeri, Aaron Chan, Maziar Sanjabi, Hamed Firooz, Yinglong Xia, Bugra Akyildiz, Yizhou Sun, Jinchao Li, Qifan Wang, Asli Celikyilmaz
Breakdown analysis further highlights RESPROMPT particularly excels in complex multi-step reasoning: for questions demanding at least five reasoning steps, RESPROMPT outperforms the best CoT based benchmarks by a remarkable average improvement of 21. 1% on LLaMA-65B and 14. 3% on LLaMA2-70B.
1 code implementation • 29 Sep 2023 • Arjun Subramonian, Levent Sagun, Yizhou Sun
We further bridge GCN's preferential attachment bias with unfairness in link prediction and propose a new within-group fairness metric.
1 code implementation • 29 Sep 2023 • Yanqiao Zhu, Jeehyun Hwang, Keir Adams, Zhen Liu, Bozhao Nan, Brock Stenfors, Yuanqi Du, Jatin Chauhan, Olaf Wiest, Olexandr Isayev, Connor W. Coley, Yizhou Sun, Wei Wang
Molecular Representation Learning (MRL) has proven impactful in numerous biochemical applications such as drug discovery and enzyme design.
no code implementations • 15 Sep 2023 • Derek Xu, Yizhou Sun, Wei Wang
Invariance describes transformations that do not alter data's underlying semantics.
1 code implementation • 20 Jul 2023 • Xiaoxuan Wang, Ziniu Hu, Pan Lu, Yanqiao Zhu, Jieyu Zhang, Satyen Subramaniam, Arjun R. Loomba, Shichang Zhang, Yizhou Sun, Wei Wang
Most of the existing Large Language Model (LLM) benchmarks on scientific problem reasoning focus on problems grounded in high-school subjects and are confined to elementary algebraic operations.
1 code implementation • NeurIPS 2023 • Wei Jin, Haitao Mao, Zheng Li, Haoming Jiang, Chen Luo, Hongzhi Wen, Haoyu Han, Hanqing Lu, Zhengyang Wang, Ruirui Li, Zhen Li, Monica Xiao Cheng, Rahul Goutam, Haiyang Zhang, Karthik Subbian, Suhang Wang, Yizhou Sun, Jiliang Tang, Bing Yin, Xianfeng Tang
To test the potential of the dataset, we introduce three tasks in this work: (1) next-product recommendation, (2) next-product recommendation with domain shifts, and (3) next-product title generation.
1 code implementation • 11 Jul 2023 • Arjun Subramonian, Adina Williams, Maximilian Nickel, Yizhou Sun, Levent Sagun
The expressive power of graph neural networks is usually measured by comparing how many pairs of graphs or nodes an architecture can possibly distinguish as non-isomorphic to those distinguishable by the $k$-dimensional Weisfeiler-Leman ($k$-WL) test.
no code implementations • 10 Jul 2023 • Zijie Huang, Yizhou Sun, Wei Wang
In practice, however, we might observe multiple systems that are generated across different environments, which differ in latent exogenous factors such as temperature and gravity.
1 code implementation • 8 Jul 2023 • Shixuan Liu, Changjun Fan, Kewei Cheng, Yunfei Wang, Peng Cui, Yizhou Sun, Zhong Liu
Heterogeneous Information Networks (HINs) are information networks with multiple types of nodes and edges.
no code implementations • 4 Jul 2023 • Zijie Huang, Daheng Wang, Binxuan Huang, Chenwei Zhang, Jingbo Shang, Yan Liang, Zhengyang Wang, Xian Li, Christos Faloutsos, Yizhou Sun, Wei Wang
We propose Concept2Box, a novel approach that jointly embeds the two views of a KG using dual geometric representations.
no code implementations • 25 Jun 2023 • Shengming Zhang, Yizhou Sun
Drug-target interaction (DTI) prediction, which aims at predicting whether a drug will be bounded to a target, have received wide attention recently, with the goal to automate and accelerate the costly process of drug design.
no code implementations • 24 Jun 2023 • Shichang Zhang, Atefeh Sohrabizadeh, Cheng Wan, Zijie Huang, Ziniu Hu, Yewen Wang, Yingyan, Lin, Jason Cong, Yizhou Sun
Graph neural networks (GNNs) are emerging for machine learning research on graph-structured data.
no code implementations • 20 Jun 2023 • Song Jiang, Zijie Huang, Xiao Luo, Yizhou Sun
We model a multi-agent dynamical system as a graph and propose CounterFactual GraphODE (CF-GODE), a causal model that estimates continuous-time counterfactual outcomes in the presence of inter-dependencies between units.
no code implementations • 18 May 2023 • Yunsheng Bai, Atefeh Sohrabizadeh, Zongyue Qin, Ziniu Hu, Yizhou Sun, Jason Cong
In addition, these programs can be compiled and converted into a control data flow graph (CDFG), and the compiler also provides fine-grained alignment between the code tokens and the CDFG nodes.
1 code implementation • 23 Apr 2023 • Roshni G. Iyer, Wei Wang, Yizhou Sun
Recent graph neural networks (GNNs) with the attention mechanism have historically been limited to small-scale homogeneous graphs (HoGs).
1 code implementation • 7 Mar 2023 • Kewei Cheng, Nesreen K. Ahmed, Yizhou Sun
NCRL detects the best compositional structure of a rule body, and breaks it into small compositions in order to infer the rule head.
1 code implementation • 24 Feb 2023 • Shichang Zhang, Jiani Zhang, Xiang Song, Soji Adeshina, Da Zheng, Christos Faloutsos, Yizhou Sun
However, GNN explanation for link prediction (LP) is lacking in the literature.
1 code implementation • CVPR 2023 • Ziniu Hu, Ahmet Iscen, Chen Sun, ZiRui Wang, Kai-Wei Chang, Yizhou Sun, Cordelia Schmid, David A. Ross, Alireza Fathi
REVEAL consists of four key components: the memory, the encoder, the retriever and the generator.
Ranked #9 on Visual Question Answering (VQA) on OK-VQA
1 code implementation • 5 Dec 2022 • Zhicheng Ren, Yifu Yuan, Yuxin Wu, Xiaxuan Gao, Yewen Wang, Yizhou Sun
The existing Active Graph Embedding framework proposes to use centrality score, density score, and entropy score to evaluate the value of unlabeled nodes, and it has been shown to be capable of bringing some improvement to the node classification tasks of Graph Convolutional Networks.
no code implementations • 5 Dec 2022 • Danfeng Guo, Zijie Huang, Junheng Hao, Yizhou Sun, Wei Wang, Demetri Terzopoulos
Hence, those models are unable to predict further future.
no code implementations • 24 Nov 2022 • Yiqiao Jin, Xiting Wang, Yaru Hao, Yizhou Sun, Xing Xie
In this paper, we move towards combining large parametric models with non-parametric prototypical networks.
no code implementations • 15 Nov 2022 • Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Akshat Shrivastava, Shang-Wen Li, Liang-Hsuan Tseng, Alexei Baevski, Guan-Ting Lin, Hung-Yi Lee, Yizhou Sun, Wei Wang
Recent studies find existing self-supervised speech encoders contain primarily acoustic rather than semantic information.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +11
no code implementations • 15 Nov 2022 • Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, ZiYi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
Answering open-domain questions requires world knowledge about in-context entities.
no code implementations • 16 Oct 2022 • Ang Li, Song Jiang, Yizhou Sun, Judea Pearl
This paper deals with the problem of learning the probabilities of causation of subpopulations given finite population data.
no code implementations • 15 Oct 2022 • Ang Li, Song Jiang, Yizhou Sun, Judea Pearl
In this paper, we present a machine learning framework that uses the bounds of the benefit function that are estimable from the finite population data to learn the bounds of the benefit function for each cell of characteristics.
1 code implementation • 15 Oct 2022 • Yiqiao Jin, Yunsheng Bai, Yanqiao Zhu, Yizhou Sun, Wei Wang
In this paper, we formulate the novel problem of code recommendation, whose purpose is to predict the future contribution behaviors of developers given their interaction history, the semantic features of source code, and the hierarchical file structures of projects.
1 code implementation • 19 Sep 2022 • Roshni G. Iyer, Yunsheng Bai, Wei Wang, Yizhou Sun
For works that seek to put both views of the KG together, the instance and ontology views are assumed to belong to the same geometric space, such as all nodes embedded in the same Euclidean space or non-Euclidean product space, an assumption no longer reasonable for two-view KGs where different portions of the graph exhibit different structures.
1 code implementation • 16 Sep 2022 • Zhiping Xiao, Jeffrey Zhu, Yining Wang, Pei Zhou, Wen Hong Lam, Mason A. Porter, Yizhou Sun
We examine a variety of applications and we thereby demonstrate the effectiveness of our PEM model.
no code implementations • 21 Jul 2022 • Yunsheng Bai, Derek Xu, Yizhou Sun, Wei Wang
In this paper, we propose NSUBS with two innovations to tackle the challenges: (1) A novel encoder-decoder neural network architecture to dynamically compute the matching information between the query and the target graphs at each search state; (2) A novel look-ahead loss function for training the policy network.
no code implementations • 6 Jun 2022 • Hongwei Wang, Zixuan Zhang, Sha Li, Jiawei Han, Yizhou Sun, Hanghang Tong, Joseph P. Olive, Heng Ji
Existing link prediction or graph completion methods have difficulty dealing with event graphs because they are usually designed for a single large graph such as a social network or a knowledge graph, rather than multiple small dynamic event graphs.
no code implementations • 19 May 2022 • Ziniu Hu, Zhe Zhao, Xinyang Yi, Tiansheng Yao, Lichan Hong, Yizhou Sun, Ed H. Chi
First, the risk of having non-causal knowledge is higher, as the shared MTL model needs to encode all knowledge from different tasks, and causal knowledge for one task could be potentially spurious to the other.
1 code implementation • ACL 2022 • Zijie Huang, Zheng Li, Haoming Jiang, Tianyu Cao, Hanqing Lu, Bing Yin, Karthik Subbian, Yizhou Sun, Wei Wang
In this paper, we explore multilingual KG completion, which leverages limited seed alignment as a bridge, to embrace the collective knowledge from multiple languages.
Ranked #3 on Knowledge Graph Completion on DPB-5L (French)
no code implementations • 16 Feb 2022 • Roshni G. Iyer, Thuy Vu, Alessandro Moschitti, Yizhou Sun
This research studies graph-based approaches for Answer Sentence Selection (AS2), an essential component for retrieval-based Question Answering (QA) systems.
1 code implementation • 28 Jan 2022 • Shichang Zhang, Yozen Liu, Neil Shah, Yizhou Sun
Explaining machine learning models is an important and increasingly popular area of research interest.
no code implementations • 11 Jan 2022 • Chunheng Jiang, Tejaswini Pedapati, Pin-Yu Chen, Yizhou Sun, Jianxi Gao
To this end, we construct a network mapping $\phi$, converting a neural network $G_A$ to a directed line graph $G_B$ that is defined on those edges in $G_A$.
no code implementations • 17 Nov 2021 • Atefeh Sohrabizadeh, Yunsheng Bai, Yizhou Sun, Jason Cong
High-level synthesis (HLS) has freed the computer architects from developing their designs in a very low-level language and needing to exactly specify how the data should be transferred in register-level.
1 code implementation • ICLR 2022 • Shichang Zhang, Yozen Liu, Yizhou Sun, Neil Shah
Conversely, multi-layer perceptrons (MLPs) have no graph dependency and infer much faster than GNNs, even though they are less accurate than GNNs for node classification in general.
Ranked #5 on Node Classification on AMZ Computers
no code implementations • 9 Oct 2021 • Bernard Koch, Tim Sainburg, Pablo Geraldo, Song Jiang, Yizhou Sun, Jacob Gates Foster
This review systematizes the emerging literature for causal inference using deep neural networks under the potential outcomes framework.
no code implementations • Findings (EMNLP) 2021 • Ziniu Hu, Yizhou Sun, Kai-Wei Chang
Answering complex open-domain questions requires understanding the latent relations between involving entities.
1 code implementation • 13 Sep 2021 • Yiqiao Jin, Xiting Wang, Ruichao Yang, Yizhou Sun, Wei Wang, Hao Liao, Xing Xie
The detection of fake news often requires sophisticated reasoning skills, such as logically combining information by considering word-level subtle clues.
1 code implementation • ACM SIGKDD Conference on Knowledge Discovery & Data Mining 2021 • Zijie Huang, Yizhou Sun, Wei Wang
On one hand, features of objects change over time, influenced by the linked objects in the interaction graph.
2 code implementations • 5 Aug 2021 • Xuelu Chen, Ziniu Hu, Yizhou Sun
Answering complex First-Order Logical (FOL) queries on large-scale incomplete knowledge graphs (KGs) is an important yet challenging task.
no code implementations • 23 Jun 2021 • Yichao Zhou, Chelsea Ju, J. Harry Caufield, Kevin Shih, Calvin Chen, Yizhou Sun, Kai-Wei Chang, Peipei Ping, Wei Wang
To facilitate various downstream applications using clinical case reports (CCRs), we pre-train two deep contextualized language models, Clinical Embeddings from Language Model (C-ELMo) and Clinical Contextual String Embeddings (C-Flair) using the clinical-related corpus from the PubMed Central.
1 code implementation • 15 Mar 2021 • Junheng Hao, Muhao Chen, Wenchao Yu, Yizhou Sun, Wei Wang
The cross-view association model is learned to bridge the embeddings of ontological concepts and their corresponding instance-view entities.
1 code implementation • 7 Mar 2021 • Junheng Hao, Chelsea Ju, Muhao Chen, Yizhou Sun, Carlo Zaniolo, Wei Wang
Leveraging a wide-range of biological knowledge, such as gene ontology and protein-protein interaction (PPI) networks from other closely related species presents a vital approach to infer the molecular impact of a new species.
no code implementations • 28 Feb 2021 • Yichao Zhou, Wei-Ting Chen, BoWen Zhang, David Lee, J. Harry Caufield, Kai-Wei Chang, Yizhou Sun, Peipei Ping, Wei Wang
Clinical case reports are written descriptions of the unique aspects of a particular clinical case, playing an essential role in sharing clinical experiences about atypical disease phenotypes and new therapies.
no code implementations • 1 Jan 2021 • Yunsheng Bai, Derek Qiang Xu, Yizhou Sun, Wei Wang
Detecting the Maximum Common Subgraph (MCS) between two input graphs is fundamental for applications in biomedical analysis, malware detection, cloud computing, etc.
no code implementations • 1 Jan 2021 • Yewen Wang, Jian Tang, Yizhou Sun, Guy Wolf
We empirically analyse our proposed DGL-GNN model, and demonstrate its effectiveness and superior efficiency through a range of experiments.
no code implementations • 23 Dec 2020 • Shichang Zhang, Ziniu Hu, Arjun Subramonian, Yizhou Sun
Our framework MotIf-driven Contrastive leaRning Of Graph representations (MICRO-Graph) can: 1) use GNNs to extract motifs from large graph datasets; 2) leverage learned motifs to sample informative subgraphs for contrastive learning of GNN.
no code implementations • 18 Dec 2020 • Xiang Li, Danhao Ding, Ben Kao, Yizhou Sun, Nikos Mamoulis
A heterogeneous information network (HIN) has as vertices objects of different types and as edges the relations between objects, which are also of various types.
2 code implementations • 16 Dec 2020 • Yichao Zhou, Yu Yan, Rujun Han, J. Harry Caufield, Kai-Wei Chang, Yizhou Sun, Peipei Ping, Wei Wang
There has been a steady need in the medical community to precisely extract the temporal relations between clinical events.
no code implementations • 12 Dec 2020 • Jiarong Xu, Yizhou Sun, Xin Jiang, Yanhao Wang, Yang Yang, Chunping Wang, Jiangang Lu
To bridge the gap between theoretical graph attacks and real-world scenarios, in this work, we propose a novel and more realistic setting: strict black-box graph attack, in which the attacker has no knowledge about the victim model at all and is not allowed to send any queries.
no code implementations • 4 Dec 2020 • Jiarong Xu, Yang Yang, Junru Chen, Chunping Wang, Xin Jiang, Jiangang Lu, Yizhou Sun
Additionally, we explore a provable connection between the robustness of the unsupervised graph encoder and that of models on downstream tasks.
1 code implementation • NeurIPS 2020 • Zijie Huang, Yizhou Sun, Wei Wang
In this paper, we propose to learn system dynamics from irregularly-sampled partial observations with underlying graph structure for the first time.
no code implementations • 12 Oct 2020 • Ziheng Duan, Haoyan Xu, Yueyang Wang, Yida Huang, Anni Ren, Zhongbin Xu, Yizhou Sun, Wei Wang
Then we combine GNNs and our proposed variational graph pooling layers for joint graph representation learning and graph coarsening, after which the graph is progressively coarsened to one node.
1 code implementation • Findings of the Association for Computational Linguistics 2020 • Xuelu Chen, Muhao Chen, Changjun Fan, Ankith Uppunda, Yizhou Sun, Carlo Zaniolo
Predicting missing facts in a knowledge graph (KG) is a crucial task in knowledge base construction and reasoning, and it has been the subject of much research in recent works using KG embeddings.
Ranked #2 on Knowledge Graph Completion on DPB-5L (French)
2 code implementations • 27 Jun 2020 • Ziniu Hu, Yuxiao Dong, Kuansan Wang, Kai-Wei Chang, Yizhou Sun
Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data.
no code implementations • 11 Jun 2020 • Yunsheng Bai, Ken Gu, Yizhou Sun, Wei Wang
We introduce Bi-GNN for modeling biological link prediction tasks such as drug-drug interaction (DDI) and protein-protein interaction (PPI).
1 code implementation • 2 Jun 2020 • Zhiping Xiao, Weiping Song, Haoyan Xu, Zhicheng Ren, Yizhou Sun
However, the incompleteness of the labels and the features in social network datasets is tricky, not to mention the enormous data size and the heterogeneousity.
no code implementations • NeurIPS Workshop CAP 2020 • Roshni G. Iyer, Yizhou Sun, Wei Wang, Justin Gottschlich
To continue to advance this research, we present the program-derived semantics graph, a new graphical structure to capture semantics of code.
1 code implementation • 1 Apr 2020 • Carl Yang, Yuxin Xiao, Yu Zhang, Yizhou Sun, Jiawei Han
Since there has already been a broad body of HNE algorithms, as the first contribution of this work, we provide a generic paradigm for the systematic categorization and analysis over the merits of various existing HNE algorithms.
4 code implementations • 3 Mar 2020 • Ziniu Hu, Yuxiao Dong, Kuansan Wang, Yizhou Sun
Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data.
Ranked #4 on Heterogeneous Node Classification on OAG-Venue
no code implementations • 8 Feb 2020 • Yunsheng Bai, Derek Xu, Yizhou Sun, Wei Wang
However, MCS computation is NP-hard, and state-of-the-art MCS solvers rely on heuristic search algorithms which in practice cannot find good solution for large graph pairs given a limited computation budget.
1 code implementation • NeurIPS 2019 • Difan Zou, Ziniu Hu, Yewen Wang, Song Jiang, Yizhou Sun, Quanquan Gu
Original full-batch GCN training requires calculating the representation of all the nodes in the graph per GCN layer, which brings in high computation and memory costs.
no code implementations • 25 Sep 2019 • Yunsheng Bai, Derek Xu, Ken Gu, Xueqing Wu, Agustin Marinovic, Christopher Ro, Yizhou Sun, Wei Wang
Maximum Common Subgraph (MCS) is defined as the largest subgraph that is commonly present in both graphs of a graph pair.
no code implementations • 25 Sep 2019 • Xin Jiang*, Kewei Cheng*, Song Jiang*, Yizhou Sun
Despite the impressive success of graph convolutional networks (GCNs) on numerous applications, training on large-scale sparse networks remains challenging.
no code implementations • 25 Sep 2019 • Kewei Cheng, Yikai Zhu, Ming Zhang, Yizhou Sun
Knowledge graph has gained increasing attention in recent years for its successful applications of numerous tasks.
no code implementations • 25 Sep 2019 • Haonan Wang, Zhenbang Wu, Ziniu Hu, Yizhou Sun
Besides, the understanding of relationships among tasks has been ignored by most of the current methods.
no code implementations • 25 Sep 2019 • Ting Chen, Lala Li, Yizhou Sun
Embedding layers are commonly used to map discrete symbols into continuous embedding vectors that reflect their semantic meanings.
no code implementations • 25 Sep 2019 • Yewen Wang, Ziniu Hu, Yusong Ye, Yizhou Sun
However, there still lacks in-depth analysis on (1) Whether there exists a best filter that can perform best on all graph data; (2) Which graph properties will influence the optimal choice of graph filter; (3) How to design appropriate filter adaptive to the graph data.
2 code implementations • 26 Aug 2019 • Ting Chen, Lala Li, Yizhou Sun
Embedding layers are commonly used to map discrete symbols into continuous embedding vectors that reflect their semantic meanings.
1 code implementation • ACL 2019 • Ziniu Hu, Ting Chen, Kai-Wei Chang, Yizhou Sun
Existing approaches for learning word embeddings often assume there are sufficient occurrences for each word in the corpus, such that the representation of words can be accurately estimated from their contexts.
no code implementations • 31 May 2019 • Ziniu Hu, Changjun Fan, Ting Chen, Kai-Wei Chang, Yizhou Sun
With the proposed pre-training procedure, the generic structural information is learned and preserved, thus the pre-trained GNN requires less amount of labeled data and fewer domain-specific features to achieve high performance on different downstream tasks.
1 code implementation • 24 May 2019 • Changjun Fan, Li Zeng, Yuhui Ding, Muhao Chen, Yizhou Sun, Zhong Liu
By training on small-scale networks, the learned model is capable of assigning relative BC scores to nodes for any unseen networks, and thus identifying the highly-ranked nodes.
1 code implementation • 11 May 2019 • Ting Chen, Song Bian, Yizhou Sun
In this work, we propose a dissection of GNNs on graph classification into two parts: 1) the graph filtering, where graph-based neighbor aggregations are performed, and 2) the set function, where a set of hidden node features are composed for prediction.
Ranked #1 on Graph Classification on RE-M12K
1 code implementation • 30 Apr 2019 • Rui Feng, Yang Yang, Yuehan Lyu, Chenhao Tan, Yizhou Sun, Chunping Wang
Fairness has become a central issue for our research community as classification algorithms are adopted in societally critical domains such as recidivism prediction and loan approval.
1 code implementation • 1 Apr 2019 • Yunsheng Bai, Hao Ding, Yang Qiao, Agustin Marinovic, Ken Gu, Ting Chen, Yizhou Sun, Wei Wang
We introduce a novel approach to graph-level representation learning, which is to embed an entire graph into a vector space where the embeddings of two graphs preserve their graph-graph proximity.
Ranked #1 on Graph Classification on Web
1 code implementation • 26 Nov 2018 • Xuelu Chen, Muhao Chen, Weijia Shi, Yizhou Sun, Carlo Zaniolo
However, there are many KGs that model uncertain knowledge, which typically model the inherent uncertainty of relations facts with a confidence score, and embedding such uncertain knowledge represents an unresolved challenge.
1 code implementation • 23 Oct 2018 • Yunsheng Bai, Hao Ding, Yizhou Sun, Wei Wang
We introduce GSimCNN (Graph Similarity Computation via Convolutional Neural Networks) for predicting the similarity score between two graphs.
1 code implementation • 10 Sep 2018 • Yunsheng Bai, Hao Ding, Yizhou Sun, Wei Wang
Since computing the exact distance/similarity between two graphs is typically NP-hard, a series of approximate methods have been proposed with a trade-off between accuracy and speed.
3 code implementations • WSDM '19 Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining 2019 • Yunsheng Bai, Hao Ding, Song Bian, Ting Chen, Yizhou Sun, Wei Wang
Our model achieves better generalization on unseen graphs, and in the worst case runs in quadratic time with respect to the number of nodes in two graphs.
Ranked #1 on Graph Similarity on IMDb
no code implementations • 26 Jun 2018 • Zhengxing Chen, Truong-Huy D Nguyen, Yuyu Xu, Chris Amato, Seth Cooper, Yizhou Sun, Magy Seif El-Nasr
The selection of heroes, also known as pick or draft, takes place before the match starts and alternates between the two teams until each player has selected one hero.
1 code implementation • 26 Jun 2018 • Zhengxing Chen, Chris Amato, Truong-Huy Nguyen, Seth Cooper, Yizhou Sun, Magy Seif El-Nasr
Deck building is a crucial component in playing Collectible Card Games (CCGs).
1 code implementation • ICML 2018 • Ting Chen, Martin Renqiang Min, Yizhou Sun
Conventional embedding methods directly associate each symbol with a continuous embedding vector, which is equivalent to applying a linear transformation based on a "one-hot" encoding of the discrete symbols.
no code implementations • 22 Apr 2018 • Anahita Hosseini, Ting Chen, Wenjun Wu, Yizhou Sun, Majid Sarrafzadeh
To the best of our knowledge, this is the first study to use Heterogeneous Information Network for modeling clinical data and disease diagnosis.
no code implementations • 8 Nov 2017 • Ting Chen, Martin Renqiang Min, Yizhou Sun
Conventional embedding methods directly associate each symbol with a continuous embedding vector, which is equivalent to applying linear transformation based on "one-hot" encoding of the discrete symbols.
no code implementations • 23 Jun 2017 • Ting Chen, Yizhou Sun, Yue Shi, Liangjie Hong
In this paper, we propose a general neural network-based recommendation framework, which subsumes several existing state-of-the-art recommendation algorithms, and address the efficiency issue by investigating sampling strategies in the stochastic gradient descent training for the framework.
no code implementations • 4 Jun 2017 • Ting Chen, Liangjie Hong, Yue Shi, Yizhou Sun
While latent factors of items can be learned effectively from user interaction data, in many cases, such data is not available, especially for newly emerged items.
no code implementations • 24 Dec 2016 • Yupeng Gu, Ting Chen, Yizhou Sun, Bingyu Wang
The problem of ideology detection is to study the latent (political) placement for people, which is traditionally studied on politicians according to their voting behaviors.
Social and Information Networks
1 code implementation • 8 Dec 2016 • Ting Chen, Yizhou Sun
To address the challenges, we propose a task-guided and path-augmented heterogeneous network embedding model.
no code implementations • 26 Aug 2016 • Ting Chen, Lu-An Tang, Yizhou Sun, Zhengzhang Chen, Kai Zhang
Anomaly detection plays an important role in modern data-driven security applications, such as detecting suspicious access to a socket from a process.
no code implementations • NeurIPS 2009 • Jing Gao, Feng Liang, Wei Fan, Yizhou Sun, Jiawei Han
First, we can boost the diversity of classification ensemble by incorporating multiple clustering outputs, each of which provides grouping constraints for the joint label predictions of a set of related objects.