Search Results for author: Rex Ying

Found 51 papers, 31 papers with code

Inductive Representation Learning on Large Graphs

18 code implementations NeurIPS 2017 William L. Hamilton, Rex Ying, Jure Leskovec

Low-dimensional embeddings of nodes in large graphs have proved extremely useful in a variety of prediction tasks, from content recommendation to identifying protein functions.

Graph Classification Graph Regression +5

Representation Learning on Graphs: Methods and Applications

no code implementations17 Sep 2017 William L. Hamilton, Rex Ying, Jure Leskovec

Machine learning on graphs is an important and ubiquitous task with applications ranging from drug design to friendship recommendation in social networks.

BIG-bench Machine Learning Dimensionality Reduction +1

GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models

3 code implementations ICML 2018 Jiaxuan You, Rex Ying, Xiang Ren, William L. Hamilton, Jure Leskovec

Modeling and generating graphs is fundamental for studying networks in biology, engineering, and social sciences.

Graph Generation

Graph Convolutional Neural Networks for Web-Scale Recommender Systems

5 code implementations6 Jun 2018 Rex Ying, Ruining He, Kai-Feng Chen, Pong Eksombatchai, William L. Hamilton, Jure Leskovec

We develop a data-efficient Graph Convolutional Network (GCN) algorithm PinSage, which combines efficient random walks and graph convolutions to generate embeddings of nodes (i. e., items) that incorporate both graph structure as well as node feature information.

Recommendation Systems

Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generation

2 code implementations NeurIPS 2018 Jiaxuan You, Bowen Liu, Rex Ying, Vijay Pande, Jure Leskovec

Generating novel graph structures that optimize given objectives while obeying some given underlying rules is fundamental for chemistry, biology and social science research.

Graph Generation Molecular Graph Generation

Hierarchical Graph Representation Learning with Differentiable Pooling

14 code implementations NeurIPS 2018 Rex Ying, Jiaxuan You, Christopher Morris, Xiang Ren, William L. Hamilton, Jure Leskovec

Recently, graph neural networks (GNNs) have revolutionized the field of graph representation learning through effectively learned node embeddings, and achieved state-of-the-art results in tasks such as node classification and link prediction.

General Classification Graph Classification +3

GNNExplainer: Generating Explanations for Graph Neural Networks

10 code implementations NeurIPS 2019 Rex Ying, Dylan Bourgeois, Jiaxuan You, Marinka Zitnik, Jure Leskovec

We formulate GNNExplainer as an optimization task that maximizes the mutual information between a GNN's prediction and distribution of possible subgraph structures.

BIG-bench Machine Learning Explainable artificial intelligence +2

Redundancy-Free Computation Graphs for Graph Neural Networks

no code implementations9 Jun 2019 Zhihao Jia, Sina Lin, Rex Ying, Jiaxuan You, Jure Leskovec, Alex Aiken

Graph Neural Networks (GNNs) are based on repeated aggregations of information across nodes' neighbors in a graph.

Position-aware Graph Neural Networks

2 code implementations11 Jun 2019 Jiaxuan You, Rex Ying, Jure Leskovec

Learning node embeddings that capture a node's position within the broader graph structure is crucial for many prediction tasks on graphs.

Community Detection Link Prediction +1

Neural Execution of Graph Algorithms

no code implementations ICLR 2020 Petar Veličković, Rex Ying, Matilde Padovano, Raia Hadsell, Charles Blundell

Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs.

Improving Graph Attention Networks with Large Margin-based Constraints

no code implementations25 Oct 2019 Guangtao Wang, Rex Ying, Jing Huang, Jure Leskovec

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs.

Graph Attention Representation Learning

Hyperbolic Graph Convolutional Neural Networks

3 code implementations NeurIPS 2019 Ines Chami, Rex Ying, Christopher Ré, Jure Leskovec

Here we propose Hyperbolic Graph Convolutional Neural Network (HGCN), the first inductive hyperbolic GCN that leverages both the expressiveness of GCNs and hyperbolic geometry to learn inductive node representations for hierarchical and scale-free graphs.

 Ranked #1 on Link Prediction on PPI (Accuracy metric)

Link Prediction Node Classification

Learning to Simulate Complex Physics with Graph Networks

12 code implementations ICML 2020 Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, Peter W. Battaglia

Here we present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains, involving fluids, rigid solids, and deformable materials interacting with one another.

Multi-hop Attention Graph Neural Network

1 code implementation29 Sep 2020 Guangtao Wang, Rex Ying, Jing Huang, Jure Leskovec

Currently, at every layer, attention is computed between connected pairs of nodes and depends solely on the representation of the two nodes.

Graph Representation Learning Knowledge Graph Completion +1

Design Space for Graph Neural Networks

2 code implementations NeurIPS 2020 Jiaxuan You, Rex Ying, Jure Leskovec

However, current research focuses on proposing and evaluating specific architectural designs of GNNs, as opposed to studying the more general design space of GNNs that consists of a Cartesian product of different design dimensions, such as the number of layers or the type of the aggregation function.

Management

Identity-aware Graph Neural Networks

1 code implementation25 Jan 2021 Jiaxuan You, Jonathan Gomes-Selman, Rex Ying, Jure Leskovec

However, the expressive power of existing GNNs is upper-bounded by the 1-Weisfeiler-Lehman (1-WL) graph isomorphism test, which means GNNs that are not able to predict node clustering coefficients and shortest path distances, and cannot differentiate between different d-regular graphs.

Graph Classification Graph Property Prediction +3

Graph Ensemble Learning over Multiple Dependency Trees for Aspect-level Sentiment Classification

no code implementations NAACL 2021 Xiaochen Hou, Peng Qi, Guangtao Wang, Rex Ying, Jing Huang, Xiaodong He, BoWen Zhou

Recent work on aspect-level sentiment classification has demonstrated the efficacy of incorporating syntactic structures such as dependency trees with graph neural networks(GNN), but these approaches are usually vulnerable to parsing errors.

Ensemble Learning General Classification +2

Fea2Fea: Exploring Structural Feature Correlations via Graph Neural Networks

1 code implementation24 Jun 2021 Jiaqing Xie, Rex Ying

In this paper, we introuduce graph feature to feature (Fea2Fea) prediction pipelines in a low dimensional space to explore some preliminary results on structural feature correlation, which is based on graph neural network.

Feature Correlation Graph Classification +2

Local Augmentation for Graph Neural Networks

1 code implementation8 Sep 2021 Songtao Liu, Rex Ying, Hanze Dong, Lanqing Li, Tingyang Xu, Yu Rong, Peilin Zhao, Junzhou Huang, Dinghao Wu

To address this, we propose a simple and efficient data augmentation strategy, local augmentation, to learn the distribution of the node features of the neighbors conditioned on the central node's feature and enhance GNN's expressive power with generated features.

Open-Ended Question Answering

Neural Distance Embeddings for Biological Sequences

1 code implementation NeurIPS 2021 Gabriele Corso, Rex Ying, Michal Pándy, Petar Veličković, Jure Leskovec, Pietro Liò

The development of data-dependent heuristics and representations for biological sequences that reflect their evolutionary distance is critical for large-scale biological research.

Multiple Sequence Alignment

Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones

1 code implementation NeurIPS 2021 Yushi Bai, Rex Ying, Hongyu Ren, Jure Leskovec

Here we present ConE (Cone Embedding), a KG embedding model that is able to simultaneously model multiple hierarchical as well as non-hierarchical relations in a knowledge graph.

Ancestor-descendant prediction Knowledge Graph Completion +2

Bridging the Gap of AutoGraph between Academia and Industry: Analysing AutoGraph Challenge at KDD Cup 2020

1 code implementation6 Apr 2022 Zhen Xu, Lanning Wei, Huan Zhao, Rex Ying, Quanming Yao, Wei-Wei Tu, Isabelle Guyon

Researchers naturally adopt Automated Machine Learning on Graph Learning, aiming to reduce the human effort and achieve generally top-performing GNNs, but their methods focus more on the architecture search.

Graph Learning Neural Architecture Search +1

Learning Large-scale Subsurface Simulations with a Hybrid Graph Network Simulator

no code implementations15 Jun 2022 Tailin Wu, Qinchen Wang, Yinan Zhang, Rex Ying, Kaidi Cao, Rok Sosič, Ridwan Jalali, Hassan Hamam, Marko Maucec, Jure Leskovec

To model complex reservoir dynamics at both local and global scale, HGNS consists of a subsurface graph neural network (SGNN) to model the evolution of fluid flows, and a 3D-U-Net to model the evolution of pressure.

Decision Making

GraphFramEx: Towards Systematic Evaluation of Explainability Methods for Graph Neural Networks

1 code implementation20 Jun 2022 Kenza Amara, Rex Ying, Zitao Zhang, Zhihao Han, Yinan Shan, Ulrik Brandes, Sebastian Schemm, Ce Zhang

As GNN models are deployed to more mission-critical applications, we are in dire need for a common evaluation protocol of explainability methods of GNNs.

Node Classification

FusionRetro: Molecule Representation Fusion via In-Context Learning for Retrosynthetic Planning

1 code implementation30 Sep 2022 Songtao Liu, Zhengkai Tu, Minkai Xu, Zuobai Zhang, Lu Lin, Rex Ying, Jian Tang, Peilin Zhao, Dinghao Wu

Current strategies use a decoupled approach of single-step retrosynthesis models and search algorithms, taking only the product as the input to predict the reactants for each planning step and ignoring valuable context information along the synthetic route.

Drug Discovery In-Context Learning +3

Efficient Automatic Machine Learning via Design Graphs

1 code implementation21 Oct 2022 Shirley Wu, Jiaxuan You, Jure Leskovec, Rex Ying

FALCON features 1) a task-agnostic module, which performs message passing on the design graph via a Graph Neural Network (GNN), and 2) a task-specific module, which conducts label propagation of the known model performance information on the design graph.

AutoML Graph Classification +1

Diffuser: Efficient Transformers with Multi-hop Attention Diffusion for Long Sequences

1 code implementation21 Oct 2022 Aosong Feng, Irene Li, Yuang Jiang, Rex Ying

Efficient Transformers have been developed for long sequence modeling, due to their subquadratic memory and time complexity.

Language Modelling text-classification +1

Learning Graph Search Heuristics

no code implementations Learning on Graphs 2022 Michal Pándy, Weikang Qiu, Gabriele Corso, Petar Veličković, Rex Ying, Jure Leskovec, Pietro Liò

At training time, we aggregate datasets of search trajectories and ground-truth shortest path distances, which we use to train a specialized graph neural network-based heuristic function using backpropagation through steps of the pathfinding process.

Graph Representation Learning Imitation Learning

MUDiff: Unified Diffusion for Complete Molecule Generation

no code implementations28 Apr 2023 Chenqing Hua, Sitao Luan, Minkai Xu, Rex Ying, Jie Fu, Stefano Ermon, Doina Precup

Our model is a promising approach for designing stable and diverse molecules and can be applied to a wide range of tasks in molecular modeling.

Drug Discovery valid

HiPool: Modeling Long Documents Using Graph Neural Networks

1 code implementation5 May 2023 Irene Li, Aosong Feng, Dragomir Radev, Rex Ying

Encoding long sequences in Natural Language Processing (NLP) is a challenging problem.

Document Classification Sentence

Hyperbolic Representation Learning: Revisiting and Advancing

1 code implementation15 Jun 2023 Menglin Yang, Min Zhou, Rex Ying, Yankai Chen, Irwin King

To address this, we propose a simple yet effective method, hyperbolic informed embedding (HIE), by incorporating cost-free hierarchical information deduced from the hyperbolic distance of the node to origin (i. e., induced hyperbolic norm) to advance existing \hlms.

Representation Learning

DeSCo: Towards Generalizable and Scalable Deep Subgraph Counting

1 code implementation16 Aug 2023 Tianyu Fu, Chiyue Wei, Yu Wang, Rex Ying

We introduce DeSCo, a scalable neural deep subgraph counting pipeline, designed to accurately predict both the count and occurrence position of queries on target graphs post single training.

Graph Regression Position +1

GInX-Eval: Towards In-Distribution Evaluation of Graph Neural Network Explanations

no code implementations28 Sep 2023 Kenza Amara, Mennatallah El-Assady, Rex Ying

Diverse explainability methods of graph neural networks (GNN) have recently been developed to highlight the edges and nodes in the graph that contribute the most to the model predictions.

MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph Data

1 code implementation NeurIPS 2023 Tianyu Liu, Yuge Wang, Rex Ying, Hongyu Zhao

Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity.

Benchmarking Contrastive Learning +1

Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models

1 code implementation6 Oct 2023 Junchi Yu, Ran He, Rex Ying

These analogous problems are related to the input one, with reusable solutions and problem-solving strategies.

Prompt Engineering

BLIS-Net: Classifying and Analyzing Signals on Graphs

no code implementations26 Oct 2023 Charles Xu, Laney Goldman, Valentina Guo, Benjamin Hollander-Bodie, Maedee Trank-Greene, Ian Adelstein, Edward De Brouwer, Rex Ying, Smita Krishnaswamy, Michael Perlmutter

We make several crucial changes to the original geometric scattering architecture which we prove increase the ability of our network to capture information about the input signal and show that BLIS-Net achieves superior performance on both synthetic and real-world data sets based on traffic flow and fMRI data.

Graph Classification Node Classification

D4Explainer: In-Distribution GNN Explanations via Discrete Denoising Diffusion

1 code implementation30 Oct 2023 Jialin Chen, Shirley Wu, Abhijit Gupta, Rex Ying

The objective of GNN explainability is to discern the underlying graph structures that have the most significant impact on model predictions.

counterfactual Denoising +1

Dirichlet Energy Enhancement of Graph Neural Networks by Framelet Augmentation

no code implementations9 Nov 2023 Jialin Chen, Yuelin Wang, Cristian Bodnar, Rex Ying, Pietro Lio, Yu Guang Wang

However, recursively aggregating neighboring information with graph convolutions leads to indistinguishable node features in deep layers, which is known as the over-smoothing issue.

Node Classification

Learning High-Order Relationships of Brain Regions

no code implementations2 Dec 2023 Weikang Qiu, Huangrui Chu, Selena Wang, Haolan Zuo, Xiaoxiao Li, Yize Zhao, Rex Ying

In response to this gap, we propose a novel method named HYBRID which aims to extract MIMR high-order relationships from fMRI data.

Relational Deep Learning: Graph Representation Learning on Relational Databases

no code implementations7 Dec 2023 Matthias Fey, Weihua Hu, Kexin Huang, Jan Eric Lenssen, Rishabh Ranjan, Joshua Robinson, Rex Ying, Jiaxuan You, Jure Leskovec

The core idea is to view relational databases as a temporal, heterogeneous graph, with a node for each row in each table, and edges specified by primary-foreign key links.

Feature Engineering Graph Representation Learning

Representation Learning for Frequent Subgraph Mining

no code implementations22 Feb 2024 Rex Ying, Tianyu Fu, Andrew Wang, Jiaxuan You, Yu Wang, Jure Leskovec

SPMiner combines graph neural networks, order embedding space, and an efficient search strategy to identify network subgraph patterns that appear most frequently in the target graph.

Representation Learning Subgraph Counting

An Item is Worth a Prompt: Versatile Image Editing with Disentangled Control

1 code implementation7 Mar 2024 Aosong Feng, Weikang Qiu, Jinbin Bai, Kaicheng Zhou, Zhen Dong, Xiao Zhang, Rex Ying, Leandros Tassiulas

Building on the success of text-to-image diffusion models (DPMs), image editing is an important application to enable human interaction with AI-generated content.

Descriptive

Efficient High-Resolution Time Series Classification via Attention Kronecker Decomposition

no code implementations7 Mar 2024 Aosong Feng, Jialin Chen, Juan Garza, Brooklyn Berry, Francisco Salazar, Yifeng Gao, Rex Ying, Leandros Tassiulas

The high-resolution time series classification problem is essential due to the increasing availability of detailed temporal data in various domains.

Time Series Time Series Classification

From Similarity to Superiority: Channel Clustering for Time Series Forecasting

no code implementations31 Mar 2024 Jialin Chen, Jan Eric Lenssen, Aosong Feng, Weihua Hu, Matthias Fey, Leandros Tassiulas, Jure Leskovec, Rex Ying

Motivated by our observation of a correlation between the time series model's performance boost against channel mixing and the intrinsic similarity on a pair of channels, we developed a novel and adaptable Channel Clustering Module (CCM).

Clustering Time Series +1

Cannot find the paper you are looking for? You can Submit a new open access paper.