no code implementations • 8 May 2025 • Yanbo Wang, Xiyuan Wang, Quan Gan, Minjie Wang, Qibin Yang, David Wipf, Muhan Zhang
We introduce Griffin, the first foundation model attemptation designed specifically for Relational Databases (RDBs).
1 code implementation • 15 Apr 2025 • Laixin Xie, Ying Zhang, Xiyuan Wang, Shiyi Liu, Shenghan Gao, Xingxing Xing, Wei Wan, Haipeng Zhang, Quan Li
Influence Maximization (IM) in temporal graphs focuses on identifying influential "seeds" that are pivotal for maximizing network expansion.
no code implementations • 20 Feb 2025 • Yansheng Mao, Yufei Xu, Jiaqi Li, Fanxu Meng, Haotong Yang, Zilong Zheng, Xiyuan Wang, Muhan Zhang
This paper presents Long Input Fine-Tuning (LIFT), a novel framework for long-context modeling that can improve the long-context performance of arbitrary (short-context) LLMs by dynamically adapting model parameters based on the long input.
no code implementations • 4 Feb 2025 • Xiyuan Wang, Muhan Zhang
Recent advances in Graph Neural Networks (GNNs) have explored the potential of random noise as an input feature to enhance expressivity across diverse tasks.
no code implementations • 4 Feb 2025 • Xiyuan Wang, Yewei Liu, Lexi Pang, Siwei Chen, Muhan Zhang
Diffusion models have gained popularity in graph generation tasks; however, the extent of their expressivity concerning the graph distributions they can learn is not fully understood.
no code implementations • 24 Dec 2024 • Qian Tao, Xiyuan Wang, Muhan Zhang, Shuxian Hu, Wenyuan Yu, Jingren Zhou
Many recent studies have proposed the use of graph convolution methods over the numerous subgraphs of each graph, a concept known as subgraph graph neural networks (subgraph GNNs), to enhance GNNs' ability to distinguish non-isomorphic graphs.
no code implementations • 16 Dec 2024 • Yutong Xie, Yiyao Liu, Zhuang Ma, Lin Shi, Xiyuan Wang, Walter Yuan, Matthew O. Jackson, Qiaozhu Mei
The deployment of large language models (LLMs) in diverse applications requires a thorough understanding of their decision-making strategies and behavioral patterns.
no code implementations • 8 Dec 2024 • Haotong Yang, Xiyuan Wang, Qian Tao, Shuxian Hu, Zhouchen Lin, Muhan Zhang
Recent research on integrating Large Language Models (LLMs) with Graph Neural Networks (GNNs) typically follows two approaches: LLM-centered models, which convert graph data into tokens for LLM processing, and GNN-centered models, which use LLMs to encode text features into node and edge representations for GNN input.
2 code implementations • 6 Nov 2024 • Weishuo Ma, Yanbo Wang, Xiyuan Wang, Muhan Zhang
Various graph neural networks (GNNs) with advanced training techniques and model designs have been proposed for link prediction tasks.
Ranked #1 on
Link Property Prediction
on ogbl-ppa
no code implementations • 13 Oct 2024 • Junru Zhou, Cai Zhou, Xiyuan Wang, Pan Li, Muhan Zhang
Graph neural networks (GNNs) have achieved remarkable success in a variety of machine learning tasks over graph data.
no code implementations • 4 Oct 2024 • Zian Li, Cai Zhou, Xiyuan Wang, Xingang Peng, Muhan Zhang
Compared to directly generating a molecule, the relatively easy-to-generate representation in the first-stage guides the second-stage generation to reach a high-quality molecule in a more goal-oriented and much faster way.
1 code implementation • 12 Jun 2024 • Xiaohui Zhang, Yanbo Wang, Xiyuan Wang, Muhan Zhang
However, such methods focus on learning individual node representations, but overlook the pairwise representation learning nature of link prediction and fail to capture the important pairwise features of links such as common neighbors (CN).
1 code implementation • 5 May 2024 • Xiyuan Wang, Pan Li, Muhan Zhang
In contrast, this paper introduces a novel graph-to-set conversion method that bijectively transforms interconnected nodes into a set of independent points and then uses a set encoder to learn the graph representation.
1 code implementation • 7 Feb 2024 • Zian Li, Xiyuan Wang, Shijia Kang, Muhan Zhang
We then show that GeoNGNN, the geometric counterpart of one of the simplest subgraph graph neural networks (subgraph GNNs), can effectively break these corner cases' symmetry and thus achieve E(3)-completeness.
1 code implementation • 4 Feb 2024 • Cai Zhou, Xiyuan Wang, Muhan Zhang
Leveraging LGD and the ``all tasks as generation'' formulation, our framework is capable of solving graph tasks of various levels and types.
1 code implementation • 28 Nov 2023 • Xiyuan Wang, Muhan Zhang
We introduce PyTorch Geometric High Order (PyGHO), a library for High Order Graph Neural Networks (HOGNNs) that extends PyTorch Geometric (PyG).
1 code implementation • NeurIPS 2023 • Cai Zhou, Xiyuan Wang, Muhan Zhang
Second, on $1$-simplices or edge level, we bridge edge-level random walk and Hodge $1$-Laplacians and design corresponding edge PE respectively.
1 code implementation • NeurIPS 2023 • Junru Zhou, Jiarui Feng, Xiyuan Wang, Muhan Zhang
Many of the proposed GNN models with provable cycle counting power are based on subgraph GNNs, i. e., extracting a bag of subgraphs from the input graph, generating representations for each subgraph, and using them to augment the representation of the input graph.
no code implementations • 24 May 2023 • Xiyuan Wang, Fangyuan Wang, Bo Xu, Liang Xu, Jing Xiao
Typically, the Time-Delay Neural Network (TDNN) and Transformer can serve as a backbone for Speaker Verification (SV).
1 code implementation • 8 May 2023 • Cai Zhou, Xiyuan Wang, Muhan Zhang
Relational pooling is a framework for building more expressive and permutation-invariant graph neural networks.
no code implementations • 20 Apr 2023 • Xiyuan Wang, Pan Li, Muhan Zhang
When we want to learn a node-set representation involving multiple nodes, a common practice in previous works is to directly aggregate the single-node representations obtained by a GNN.
2 code implementations • NeurIPS 2023 • Zian Li, Xiyuan Wang, Yinan Huang, Muhan Zhang
In this work, we first construct families of novel and symmetric geometric graphs that Vanilla DisGNN cannot distinguish even when considering all-pair distances, which greatly expands the existing counterexample families.
1 code implementation • 2 Feb 2023 • Xiyuan Wang, Haotong Yang, Muhan Zhang
In this work, we propose a novel link prediction model and further boost it by studying graph incompleteness.
Ranked #1 on
Link Property Prediction
on ogbl-ddi
1 code implementation • 1 Aug 2022 • Xiyuan Wang, Muhan Zhang
Projected onto a frame, equivariant features like 3D coordinates are converted to invariant features, so that we can capture geometric information with these projections and decouple the symmetry requirement from GNN design.
1 code implementation • 20 Jun 2022 • Yang Hu, Xiyuan Wang, Zhouchen Lin, Pan Li, Muhan Zhang
As pointed out by previous works, this two-step procedure results in low discriminating power, as 1-WL-GNNs by nature learn node-level representations instead of link-level.
2 code implementations • 23 May 2022 • Xiyuan Wang, Muhan Zhang
We also establish a connection between the expressive power of spectral GNNs and Graph Isomorphism (GI) testing, the latter of which is often used to characterize spatial GNNs' expressive power.
no code implementations • ICLR 2022 • Xiyuan Wang, Muhan Zhang
And training a GLASS model only takes 28% time needed for a SubGNN on average.
no code implementations • 22 May 2021 • Zhenyu Zhang, Yuanyuan Dong, Keping Long, Xiyuan Wang, Xiaoming Dai
Decentralized baseband processing (DBP) architecture, which partitions the base station antennas into multiple antenna clusters, has been recently proposed to alleviate the excessively high interconnect bandwidth, chip input/output data rates, and detection complexity for massive multi-user multiple-input multiple-output (MU-MIMO) systems.