Search Results for author: Liheng Ma

Found 13 papers, 6 papers with code

Simplifying Graph Transformers

no code implementations17 Apr 2025 Liheng Ma, Soumyasundar Pal, Yingxue Zhang, Philip H. S. Torr, Mark Coates

Researchers have attempted to migrate Transformers to graph learning, but most advanced Graph Transformers are designed with major architectural differences, either integrating message-passing or incorporating sophisticated attention mechanisms.

Graph Learning

Sparse Decomposition of Graph Neural Networks

no code implementations25 Oct 2024 Yaochen Hu, Mai Zeng, Ge Zhang, Pavel Rumiantsev, Liheng Ma, Yingxue Zhang, Mark Coates

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes.

Graph Neural Network Graph Representation Learning +2

Enhancing Logical Reasoning in Large Language Models through Graph-based Synthetic Data

1 code implementation19 Sep 2024 Jiaming Zhou, Abbas Ghaddar, Ge Zhang, Liheng Ma, Yaochen Hu, Soumyasundar Pal, Mark Coates, Bin Wang, Yingxue Zhang, Jianye Hao

Despite recent advances in training and prompting strategies for Large Language Models (LLMs), these models continue to face challenges with complex logical reasoning tasks that involve long reasoning chains.

Logical Reasoning Spatial Reasoning

The Heterophilic Graph Learning Handbook: Benchmarks, Models, Theoretical Analysis, Applications and Challenges

no code implementations12 Jul 2024 Sitao Luan, Chenqing Hua, Qincheng Lu, Liheng Ma, Lirong Wu, Xinyu Wang, Minkai Xu, Xiao-Wen Chang, Doina Precup, Rex Ying, Stan Z. Li, Jian Tang, Guy Wolf, Stefanie Jegelka

In this survey, we provide a comprehensive review of the latest progress on heterophilic graph learning, including an extensive summary of benchmark datasets and evaluation of homophily metrics on synthetic graphs, meticulous classification of the most updated supervised and unsupervised learning methods, thorough digestion of the theoretical analysis on homophily/heterophily, and broad exploration of the heterophily-related applications.

Graph Learning Graph Representation Learning

CKGConv: General Graph Convolution with Continuous Kernels

1 code implementation21 Apr 2024 Liheng Ma, Soumyasundar Pal, Yitian Zhang, Jiaming Zhou, Yingxue Zhang, Mark Coates

In this work, we propose a novel and general graph convolution framework by parameterizing the kernels as continuous functions of pseudo-coordinates derived via graph positional encoding.

Graph Classification Graph Learning +2

Revealing Decurve Flows for Generalized Graph Propagation

no code implementations13 Feb 2024 Chen Lin, Liheng Ma, Yiyang Chen, Wanli Ouyang, Michael M. Bronstein, Philip H. S. Torr

\textbf{Secondly}, we propose the {\em Continuous Unified Ricci Curvature} (\textbf{CURC}), an extension of celebrated {\em Ollivier-Ricci Curvature} for directed and weighted graphs.

Graph Learning

Multi-resolution Time-Series Transformer for Long-term Forecasting

2 code implementations7 Nov 2023 Yitian Zhang, Liheng Ma, Soumyasundar Pal, Yingxue Zhang, Mark Coates

Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens.

Time Series Time Series Forecasting

Graph Inductive Biases in Transformers without Message Passing

2 code implementations27 May 2023 Liheng Ma, Chen Lin, Derek Lim, Adriana Romero-Soriano, Puneet K. Dokania, Mark Coates, Philip Torr, Ser-Nam Lim

Graph inductive biases are crucial for Graph Transformers, and previous works incorporate them using message-passing modules and/or positional encodings.

Graph Classification Graph Regression +2

RNN with Particle Flow for Probabilistic Spatio-temporal Forecasting

1 code implementation10 Jun 2021 Soumyasundar Pal, Liheng Ma, Yingxue Zhang, Mark Coates

Spatio-temporal forecasting has numerous applications in analyzing wireless, traffic, and financial networks.

Bayesian Inference Spatio-Temporal Forecasting +2

Graph Attention Networks with Positional Embeddings

no code implementations9 May 2021 Liheng Ma, Reihaneh Rabbany, Adriana Romero-Soriano

In this framework, the positional embeddings are learned by a model predictive of the graph context, plugged into an enhanced GAT architecture, which is able to leverage both the positional and content information of each node.

Graph Attention Node Classification +1

Knowledge-Enhanced Top-K Recommendation in Poincaré Ball

no code implementations13 Jan 2021 Chen Ma, Liheng Ma, Yingxue Zhang, Haolun Wu, Xue Liu, Mark Coates

To effectively make use of the knowledge graph, we propose a recommendation model in the hyperbolic space, which facilitates the learning of the hierarchical structure of knowledge graphs.

Knowledge Graphs Recommendation Systems

Probabilistic Metric Learning with Adaptive Margin for Top-K Recommendation

no code implementations13 Jan 2021 Chen Ma, Liheng Ma, Yingxue Zhang, Ruiming Tang, Xue Liu, Mark Coates

Personalized recommender systems are playing an increasingly important role as more content and services become available and users struggle to identify what might interest them.

Metric Learning Recommendation Systems

Memory Augmented Graph Neural Networks for Sequential Recommendation

1 code implementation26 Dec 2019 Chen Ma, Liheng Ma, Yingxue Zhang, Jianing Sun, Xue Liu, Mark Coates

In addition to the modeling of user interests, we employ a bilinear function to capture the co-occurrence patterns of related items.

Graph Neural Network Sequential Recommendation

Cannot find the paper you are looking for? You can Submit a new open access paper.