Search Results for author: Zhewei Wei

Found 26 papers, 18 papers with code

GTP-ViT: Efficient Vision Transformers via Graph-based Token Propagation

1 code implementation6 Nov 2023 Xuwei Xu, Sen Wang, Yudong Chen, Yanping Zheng, Zhewei Wei, Jiajun Liu

Vision Transformers (ViTs) have revolutionized the field of computer vision, yet their deployments on resource-constrained devices remain challenging due to high computational demands.

Efficient ViTs

A Survey on Large Language Model based Autonomous Agents

2 code implementations22 Aug 2023 Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, ZhiYuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, Ji-Rong Wen

In this paper, we present a comprehensive survey of these studies, delivering a systematic review of the field of LLM-based autonomous agents from a holistic perspective.

Language Modelling Large Language Model

Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials

2 code implementations31 May 2023 Mingguo He, Zhewei Wei, Shikun Feng, Zhengjie Huang, Weibin Li, Yu Sun, dianhai yu

These spatial-based HGNNs neglect the utilization of spectral graph convolutions, which are the foundation of Graph Convolutional Networks (GCN) on homogeneous graphs.

Graph Learning Node Classification +1

Decoupled Graph Neural Networks for Large Dynamic Graphs

1 code implementation14 May 2023 Yanping Zheng, Zhewei Wei, Jiajun Liu

The experimental results demonstrate that our algorithm achieves state-of-the-art performance in both kinds of dynamic graphs.

Recommendation Systems

LON-GNN: Spectral GNNs with Learnable Orthonormal Basis

1 code implementation24 Mar 2023 Qian Tao, Zhen Wang, Wenyuan Yu, Yaliang Li, Zhewei Wei

In recent years, a plethora of spectral graph neural networks (GNN) methods have utilized polynomial basis with learnable coefficients to achieve top-tier performances on many node-level tasks.

Graph Neural Networks with Learnable and Optimal Polynomial Bases

1 code implementation24 Feb 2023 Yuhe Guo, Zhewei Wei

Second, we examine the supposedly unsolvable definition of optimal polynomial basis from Wang & Zhang (2022) and propose a simple model, OptBasisGNN, which computes the optimal basis for a given graph structure and graph signal.

Node Classification on Non-Homophilic (Heterophilic) Graphs

Do Deep Learning Methods Really Perform Better in Molecular Conformation Generation?

no code implementations14 Feb 2023 Gengmo Zhou, Zhifeng Gao, Zhewei Wei, Hang Zheng, Guolin Ke

However, to our surprise, we design a simple and cheap algorithm (parameter-free) based on the traditional methods and find it is comparable to or even outperforms deep learning based MCG methods in the widely used GEOM-QM9 and GEOM-Drugs benchmarks.

Drug Discovery

Clenshaw Graph Neural Networks

1 code implementation29 Oct 2022 Yuhe Guo, Zhewei Wei

Graph Convolutional Networks (GCNs), which use a message-passing paradigm with stacked convolution layers, are foundational methods for learning graph representations.

Node Classification on Non-Homophilic (Heterophilic) Graphs

Predicting Protein-Ligand Binding Affinity via Joint Global-Local Interaction Modeling

no code implementations18 Sep 2022 Yang Zhang, Gengmo Zhou, Zhewei Wei, Hongteng Xu

The prediction of protein-ligand binding affinity is of great significance for discovering lead compounds in drug research.

Uni-Mol: A Universal 3D Molecular Representation Learning Framework

1 code implementation ChemRxiv 2022 Gengmo Zhou, Zhifeng Gao, Qiankun Ding, Hang Zheng, Hongteng Xu, Zhewei Wei, Linfeng Zhang, Guolin Ke

Uni-Mol is composed of two models with the same SE(3)-equivariant transformer architecture: a molecular pretraining model trained by 209M molecular conformations; a pocket pretraining model trained by 3M candidate protein pocket data.

3D Geometry Prediction molecular representation +3

Instant Graph Neural Networks for Dynamic Graphs

no code implementations3 Jun 2022 Yanping Zheng, Hanzhi Wang, Zhewei Wei, Jiajun Liu, Sibo Wang

With the development of numerous GNN variants, recent years have witnessed groundbreaking results in improving the scalability of GNNs to work on static graphs with millions of nodes.

EvenNet: Ignoring Odd-Hop Neighbors Improves Robustness of Graph Neural Networks

1 code implementation27 May 2022 Runlin Lei, Zhen Wang, Yaliang Li, Bolin Ding, Zhewei Wei

Despite their extraordinary predictive accuracy, existing approaches, such as GCN and GPRGNN, are not robust in the face of homophily changes on test graphs, rendering these models vulnerable to graph structural attacks and with limited capacity in generalizing to graphs of varied homophily levels.

Node Classification

Preformer: Predictive Transformer with Multi-Scale Segment-wise Correlations for Long-Term Time Series Forecasting

1 code implementation23 Feb 2022 Dazhao Du, Bing Su, Zhewei Wei

In this way, if a key segment has a high correlation score with the query segment, its successive segment contributes more to the prediction of the query segment.

Time Series Time Series Forecasting

Learning to be a Statistician: Learned Estimator for Number of Distinct Values

1 code implementation6 Feb 2022 Renzhi Wu, Bolin Ding, Xu Chu, Zhewei Wei, Xiening Dai, Tao Guan, Jingren Zhou

We derive conditions of the learning framework under which the learned model is workload agnostic, in the sense that the model/estimator can be trained with synthetically generated training data, and then deployed into any data warehouse simply as, e. g., user-defined functions (UDFs), to offer efficient (within microseconds on CPU) and accurate NDV estimations for unseen tables and workloads.

Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited

1 code implementation4 Feb 2022 Mingguo He, Zhewei Wei, Ji-Rong Wen

GPR-GNN and BernNet demonstrate that the Monomial and Bernstein bases also outperform the Chebyshev basis in terms of learning the spectral graph convolutions.

GPR Graph Learning +1

MGNN: Graph Neural Networks Inspired by Distance Geometry Problem

1 code implementation31 Jan 2022 Guanyu Cui, Zhewei Wei

As for spatial GNNs, models like Graph Isomorphism Networks (GIN) analyze their expressive power based on Graph Isomorphism Tests.

Combinatorial Optimization Metric Learning

SCformer: Segment Correlation Transformer for Long Sequence Time Series Forecasting

no code implementations29 Sep 2021 Dazhao Du, Bing Su, Zhewei Wei

Long-term time series forecasting is widely used in real-world applications such as financial investment, electricity management and production planning.

Management Time Series +1

Coarformer: Transformer for large graph via graph coarsening

no code implementations29 Sep 2021 Weirui Kuang, Zhen Wang, Yaliang Li, Zhewei Wei, Bolin Ding

We get rid of these obstacles by exploiting the complementary natures of GNN and Transformer, and trade the fine-grained long-range information for the efficiency of Transformer.

Graph Neural Networks Inspired by Classical Iterative Algorithms

1 code implementation10 Mar 2021 Yongyi Yang, Tang Liu, Yangkun Wang, Jinjing Zhou, Quan Gan, Zhewei Wei, Zheng Zhang, Zengfeng Huang, David Wipf

Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e. g., as can occur as a result of graph heterophily or adversarial attacks.

Node Classification

FlashP: An Analytical Pipeline for Real-time Forecasting of Time-Series Relational Data

no code implementations9 Jan 2021 Shuyuan Yan, Bolin Ding, Wei Guo, Jingren Zhou, Zhewei Wei, Xiaowei Jiang, Sheng Xu

Our scalable real-time forecasting system FlashP (Flash Prediction) is built based on this idea, with two major challenges to be resolved in this paper: first, we need to figure out how approximate aggregations affect the fitting of forecasting models, and forecasting results; and second, accordingly, what sampling algorithms we should use to obtain these approximate aggregations and how large the samples are.

Time Series Time Series Analysis

Scalable Graph Neural Networks via Bidirectional Propagation

1 code implementation NeurIPS 2020 Ming Chen, Zhewei Wei, Bolin Ding, Yaliang Li, Ye Yuan, Xiaoyong Du, Ji-Rong Wen

Most notably, GBP can deliver superior performance on a graph with over 60 million nodes and 1. 8 billion edges in less than half an hour on a single machine.

Graph Sampling

Simple and Deep Graph Convolutional Networks

4 code implementations ICML 2020 Ming Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding, Yaliang Li

We propose the GCNII, an extension of the vanilla GCN model with two simple yet effective techniques: {\em Initial residual} and {\em Identity mapping}.

Graph Classification Graph Regression +3

Scalable Graph Embeddings via Sparse Transpose Proximities

no code implementations16 May 2019 Yuan Yin, Zhewei Wei

Based on the concept of transpose proximity, we design \strap, a factorization based graph embedding algorithm that achieves scalability and non-linearity simultaneously.

Graph Embedding

Cannot find the paper you are looking for? You can Submit a new open access paper.