no code implementations • 1 Mar 2024 • Jiaqi Han, Jiacheng Cen, Liming Wu, Zongzhao Li, Xiangzhe Kong, Rui Jiao, Ziyang Yu, Tingyang Xu, Fandi Wu, Zihe Wang, Hongteng Xu, Zhewei Wei, Yang Liu, Yu Rong, Wenbing Huang
Geometric graph is a special kind of graph with geometric features, which is vital to model many scientific problems.
1 code implementation • 6 Nov 2023 • Xuwei Xu, Sen Wang, Yudong Chen, Yanping Zheng, Zhewei Wei, Jiajun Liu
Vision Transformers (ViTs) have revolutionized the field of computer vision, yet their deployments on resource-constrained devices remain challenging due to high computational demands.
Ranked #185 on Image Classification on ImageNet
2 code implementations • 22 Aug 2023 • Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, ZhiYuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, Ji-Rong Wen
In this paper, we present a comprehensive survey of these studies, delivering a systematic review of the field of LLM-based autonomous agents from a holistic perspective.
2 code implementations • 31 May 2023 • Mingguo He, Zhewei Wei, Shikun Feng, Zhengjie Huang, Weibin Li, Yu Sun, dianhai yu
These spatial-based HGNNs neglect the utilization of spectral graph convolutions, which are the foundation of Graph Convolutional Networks (GCN) on homogeneous graphs.
Ranked #5 on Node Property Prediction on ogbn-mag
1 code implementation • 14 May 2023 • Yanping Zheng, Zhewei Wei, Jiajun Liu
The experimental results demonstrate that our algorithm achieves state-of-the-art performance in both kinds of dynamic graphs.
1 code implementation • 24 Mar 2023 • Qian Tao, Zhen Wang, Wenyuan Yu, Yaliang Li, Zhewei Wei
In recent years, a plethora of spectral graph neural networks (GNN) methods have utilized polynomial basis with learnable coefficients to achieve top-tier performances on many node-level tasks.
1 code implementation • 24 Feb 2023 • Yuhe Guo, Zhewei Wei
Second, we examine the supposedly unsolvable definition of optimal polynomial basis from Wang & Zhang (2022) and propose a simple model, OptBasisGNN, which computes the optimal basis for a given graph structure and graph signal.
1 code implementation • 23 Feb 2023 • Yang Zhang, Wenbing Huang, Zhewei Wei, Ye Yuan, Zhaohan Ding
Predicting the binding sites of the target proteins plays a fundamental role in drug discovery.
no code implementations • 14 Feb 2023 • Gengmo Zhou, Zhifeng Gao, Zhewei Wei, Hang Zheng, Guolin Ke
However, to our surprise, we design a simple and cheap algorithm (parameter-free) based on the traditional methods and find it is comparable to or even outperforms deep learning based MCG methods in the widely used GEOM-QM9 and GEOM-Drugs benchmarks.
1 code implementation • 29 Oct 2022 • Yuhe Guo, Zhewei Wei
Graph Convolutional Networks (GCNs), which use a message-passing paradigm with stacked convolution layers, are foundational methods for learning graph representations.
no code implementations • 18 Sep 2022 • Yang Zhang, Gengmo Zhou, Zhewei Wei, Hongteng Xu
The prediction of protein-ligand binding affinity is of great significance for discovering lead compounds in drug research.
1 code implementation • ChemRxiv 2022 • Gengmo Zhou, Zhifeng Gao, Qiankun Ding, Hang Zheng, Hongteng Xu, Zhewei Wei, Linfeng Zhang, Guolin Ke
Uni-Mol is composed of two models with the same SE(3)-equivariant transformer architecture: a molecular pretraining model trained by 209M molecular conformations; a pocket pretraining model trained by 3M candidate protein pocket data.
Ranked #1 on Molecular Property Prediction on MUV
no code implementations • 3 Jun 2022 • Yanping Zheng, Hanzhi Wang, Zhewei Wei, Jiajun Liu, Sibo Wang
With the development of numerous GNN variants, recent years have witnessed groundbreaking results in improving the scalability of GNNs to work on static graphs with millions of nodes.
1 code implementation • 27 May 2022 • Runlin Lei, Zhen Wang, Yaliang Li, Bolin Ding, Zhewei Wei
Despite their extraordinary predictive accuracy, existing approaches, such as GCN and GPRGNN, are not robust in the face of homophily changes on test graphs, rendering these models vulnerable to graph structural attacks and with limited capacity in generalizing to graphs of varied homophily levels.
1 code implementation • 23 Feb 2022 • Dazhao Du, Bing Su, Zhewei Wei
In this way, if a key segment has a high correlation score with the query segment, its successive segment contributes more to the prediction of the query segment.
1 code implementation • 6 Feb 2022 • Renzhi Wu, Bolin Ding, Xu Chu, Zhewei Wei, Xiening Dai, Tao Guan, Jingren Zhou
We derive conditions of the learning framework under which the learned model is workload agnostic, in the sense that the model/estimator can be trained with synthetically generated training data, and then deployed into any data warehouse simply as, e. g., user-defined functions (UDFs), to offer efficient (within microseconds on CPU) and accurate NDV estimations for unseen tables and workloads.
1 code implementation • 4 Feb 2022 • Mingguo He, Zhewei Wei, Ji-Rong Wen
GPR-GNN and BernNet demonstrate that the Monomial and Bernstein bases also outperform the Chebyshev basis in terms of learning the spectral graph convolutions.
1 code implementation • 31 Jan 2022 • Guanyu Cui, Zhewei Wei
As for spatial GNNs, models like Graph Isomorphism Networks (GIN) analyze their expressive power based on Graph Isomorphism Tests.
no code implementations • 29 Sep 2021 • Dazhao Du, Bing Su, Zhewei Wei
Long-term time series forecasting is widely used in real-world applications such as financial investment, electricity management and production planning.
no code implementations • 29 Sep 2021 • Weirui Kuang, Zhen Wang, Yaliang Li, Zhewei Wei, Bolin Ding
We get rid of these obstacles by exploiting the complementary natures of GNN and Transformer, and trade the fine-grained long-range information for the efficiency of Transformer.
1 code implementation • NeurIPS 2021 • Mingguo He, Zhewei Wei, Zengfeng Huang, Hongteng Xu
Many representative graph neural networks, e. g., GPR-GNN and ChebNet, approximate graph convolutions with graph spectral filters.
GPR Node Classification on Non-Homophilic (Heterophilic) Graphs
1 code implementation • 10 Mar 2021 • Yongyi Yang, Tang Liu, Yangkun Wang, Jinjing Zhou, Quan Gan, Zhewei Wei, Zheng Zhang, Zengfeng Huang, David Wipf
Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e. g., as can occur as a result of graph heterophily or adversarial attacks.
no code implementations • 9 Jan 2021 • Shuyuan Yan, Bolin Ding, Wei Guo, Jingren Zhou, Zhewei Wei, Xiaowei Jiang, Sheng Xu
Our scalable real-time forecasting system FlashP (Flash Prediction) is built based on this idea, with two major challenges to be resolved in this paper: first, we need to figure out how approximate aggregations affect the fitting of forecasting models, and forecasting results; and second, accordingly, what sampling algorithms we should use to obtain these approximate aggregations and how large the samples are.
1 code implementation • NeurIPS 2020 • Ming Chen, Zhewei Wei, Bolin Ding, Yaliang Li, Ye Yuan, Xiaoyong Du, Ji-Rong Wen
Most notably, GBP can deliver superior performance on a graph with over 60 million nodes and 1. 8 billion edges in less than half an hour on a single machine.
4 code implementations • ICML 2020 • Ming Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding, Yaliang Li
We propose the GCNII, an extension of the vanilla GCN model with two simple yet effective techniques: {\em Initial residual} and {\em Identity mapping}.
no code implementations • 16 May 2019 • Yuan Yin, Zhewei Wei
Based on the concept of transpose proximity, we design \strap, a factorization based graph embedding algorithm that achieves scalability and non-linearity simultaneously.