1 code implementation • 6 Mar 2023 • Haoteng Yin, Muhan Zhang, Jianguo Wang, Pan Li
In this work, we propose a novel framework SUREL+ that upgrades SUREL by using node sets instead of walks to represent subgraphs.
Ranked #1 on
Link Property Prediction
on ogbl-ppa
1 code implementation • 8 Jan 2023 • Haoyu Wang, Pan Li
With this observation, we propose a new objective of unsupervised learning for CO where the goal of learning is to search for good initialization for future problem instances rather than give direct solutions.
no code implementations • 23 Dec 2022 • Shuang Wu, Mingxuan Zhang, Yuantong Li, Carl Yang, Pan Li
On the other hand, due to the increasing demands for the protection of clients' data privacy, Federated Learning (FL) has been widely adopted: FL requires models to be trained in a multi-client system and restricts sharing of raw data among clients.
1 code implementation • 30 Oct 2022 • Siqi Miao, Yunan Luo, Mia Liu, Pan Li
LRI-induced models, once trained, can detect the points in the point cloud data that carry information indicative of the prediction label.
no code implementations • 27 Oct 2022 • Susheel Suresh, Danny Godbout, Arko Mukherjee, Mayank Shrivastava, Jennifer Neville, Pan Li
1. 7% gains compared to individual client specific self-supervised training and (2) we construct and introduce a new cross-silo dataset called Amazon Co-purchase Networks that have both the characteristics of the motivated problem setting.
1 code implementation • 17 Oct 2022 • Yuhong Li, Jiajie Li, Cong Han, Pan Li, JinJun Xiong, Deming Chen
(2) Efficient proxies are not extensible to multi-modality downstream tasks.
no code implementations • 17 Oct 2022 • Pan Li, Peizhuo Lv, Shenchen Zhu, Ruigang Liang, Kai Chen
Although traditional static DNNs are vulnerable to the membership inference attack (MIA) , which aims to infer whether a particular point was used to train the model, little is known about how such an attack performs on the dynamic NNs.
no code implementations • 7 Oct 2022 • Boyang Zhang, Suping Wu, Hu Cao, Kehua Ma, Pan Li, Lei Lin
Different from them, our STR aims to learn accurate and natural motion sequences in an unconstrained environment through temporal and spatial tendency and to fully excavate the spatio-temporal features of existing video data.
no code implementations • 8 Sep 2022 • Peizhuo Lv, Pan Li, Shenchen Zhu, Shengzhi Zhang, Kai Chen, Ruigang Liang, Chang Yue, Fan Xiang, Yuling Cai, Hualong Ma, Yingjun Zhang, Guozhu Meng
Recent years have witnessed significant success in Self-Supervised Learning (SSL), which facilitates various downstream tasks.
1 code implementation • 2 Sep 2022 • Yuhong Luo, Pan Li
Such a dictionary representation records a downsampled set of the neighboring nodes as keys, and allows fast construction of structural features for a joint neighborhood of multiple nodes.
1 code implementation • 22 Jul 2022 • Rongzhe Wei, Haoteng Yin, Junteng Jia, Austin R. Benson, Pan Li
Graph neural networks (GNNs) have shown superiority in many prediction tasks over graphs due to their impressive capability of capturing nonlinear relations in graph-structured data.
1 code implementation • 14 Jul 2022 • Peihao Wang, Shenghao Yang, Yunyu Liu, Zhangyang Wang, Pan Li
Hypergraph neural networks (HNNs) using neural networks to encode hypergraphs provide a promising way to model higher-order relations in data and further solve relevant prediction tasks built upon such higher-order relations.
1 code implementation • 13 Jul 2022 • Haoyu Wang, Nan Wu, Hang Yang, Cong Hao, Pan Li
Using machine learning to solve combinatorial optimization (CO) problems is challenging, especially when the data is unlabeled.
1 code implementation • 20 Jun 2022 • Yang Hu, Xiyuan Wang, Zhouchen Lin, Pan Li, Muhan Zhang
As pointed out by previous works, this two-step procedure results in low discriminating power, as 1-WL-GNNs by nature learn node-level representations instead of link-level.
no code implementations • 28 Mar 2022 • Pan Li, Yanwei Fu, Shaogang Gong
The MFL computes meta-knowledge on functional regularisation generalisable to different learning tasks by which functional training on limited labelled data promotes more discriminative functions to be learned.
1 code implementation • ICLR 2022 • Haorui Wang, Haoteng Yin, Muhan Zhang, Pan Li
Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of nodes such as link/motif prediction and so on.
3 code implementations • 28 Feb 2022 • Haoteng Yin, Muhan Zhang, Yanbang Wang, Jianguo Wang, Pan Li
Subgraph-based graph representation learning (SGRL) has been recently proposed to deal with some fundamental challenges encountered by canonical graph neural networks (GNNs), and has demonstrated advantages in many important data science applications such as link, relation and motif prediction.
Ranked #1 on
Link Property Prediction
on ogbl-citation2
1 code implementation • ICLR 2022 • Mingyue Tang, Carl Yang, Pan Li
Graph neural networks (GNNs) have drawn significant research attention recently, mostly under the setting of semi-supervised learning.
2 code implementations • 31 Jan 2022 • Siqi Miao, Miaoyuan Liu, Pan Li
However, those post-hoc methods often fail to provide stable interpretation and may extract features that are spuriously correlated with the task.
Ranked #9 on
Graph Property Prediction
on ogbg-molhiv
no code implementations • 18 Jan 2022 • Nan Wu, Hang Yang, Yuan Xie, Pan Li, Cong Hao
The contribution of this work is three-fold.
no code implementations • CVPR 2022 • Guanhong Tao, Guangyu Shen, Yingqi Liu, Shengwei An, QiuLing Xu, Shiqing Ma, Pan Li, Xiangyu Zhang
A popular trigger inversion method is by optimization.
no code implementations • CVPR 2022 • Pan Li, Shaogang Gong, Chengjie Wang, Yanwei Fu
The calibrated distance in this target-aware non-linear subspace is complementary to that in the pre-trained representation.
2 code implementations • NeurIPS 2021 • Muhan Zhang, Pan Li
The key is to make each node representation encode a subgraph around it more than a subtree.
Ranked #5 on
Graph Property Prediction
on ogbg-molpcba
no code implementations • 25 Oct 2021 • Allison McCarn Deiana, Nhan Tran, Joshua Agar, Michaela Blott, Giuseppe Di Guglielmo, Javier Duarte, Philip Harris, Scott Hauck, Mia Liu, Mark S. Neubauer, Jennifer Ngadiuba, Seda Ogrenci-Memik, Maurizio Pierini, Thea Aarrestad, Steffen Bahr, Jurgen Becker, Anne-Sophie Berthold, Richard J. Bonventre, Tomas E. Muller Bravo, Markus Diefenthaler, Zhen Dong, Nick Fritzsche, Amir Gholami, Ekaterina Govorkova, Kyle J Hazelwood, Christian Herwig, Babar Khan, Sehoon Kim, Thomas Klijnsma, Yaling Liu, Kin Ho Lo, Tri Nguyen, Gianantonio Pezzullo, Seyedramin Rasoulinezhad, Ryan A. Rivera, Kate Scholberg, Justin Selig, Sougata Sen, Dmitri Strukov, William Tang, Savannah Thais, Kai Lukas Unger, Ricardo Vilalta, Belinavon Krosigk, Thomas K. Warburton, Maria Acosta Flechas, Anthony Aportela, Thomas Calvet, Leonardo Cristella, Daniel Diaz, Caterina Doglioni, Maria Domenica Galati, Elham E Khoda, Farah Fahim, Davide Giri, Benjamin Hawks, Duc Hoang, Burt Holzman, Shih-Chieh Hsu, Sergo Jindariani, Iris Johnson, Raghav Kansal, Ryan Kastner, Erik Katsavounidis, Jeffrey Krupa, Pan Li, Sandeep Madireddy, Ethan Marx, Patrick McCormack, Andres Meza, Jovan Mitrevski, Mohammed Attia Mohammed, Farouk Mokhtar, Eric Moreno, Srishti Nagu, Rohin Narayan, Noah Palladino, Zhiqiang Que, Sang Eon Park, Subramanian Ramamoorthy, Dylan Rankin, Simon Rothman, ASHISH SHARMA, Sioni Summers, Pietro Vischia, Jean-Roch Vlimant, Olivia Weng
In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time experimental data processing loop to accelerate scientific discovery.
no code implementations • 29 Sep 2021 • Xueqi Ma, Pan Li, Qiong Cao, James Bailey, Yue Gao
In FAHGNN, we explore the influence of node features for the expressive power of GNNs and augment features by introducing common features and personal features to model information.
no code implementations • NeurIPS Workshop AI4Scien 2021 • Tianchun Li, Shikun Liu, Yongbin Feng, Nhan Tran, Miaoyuan Liu, Pan Li
The graph neural network is trained on charged particles with well-known labels, which can be obtained from simulation truth information or measurements from data, and inferred on neutral particles of which such labeling is missing.
no code implementations • 13 Sep 2021 • Nan Wu, Huake He, Yuan Xie, Pan Li, Cong Hao
Pioneering in this direction, we expect more GNN endeavors to revolutionize this high-demand Program-to-Circuit problem and to enrich the expressiveness of GNNs on programs.
no code implementations • Findings (EMNLP) 2021 • Xuanting Cai, Quanbin Ma, Pan Li, Jianyu Liu, Qi Zeng, Zhengkan Yang, Pushkar Tripathi
Understanding the semantic meaning of content on the web through the lens of entities and concepts has many practical advantages.
2 code implementations • NeurIPS 2021 • Yuhong Li, Cong Hao, Pan Li, JinJun Xiong, Deming Chen
Such a self-supervised regression task can effectively evaluate the intrinsic power of an architecture to capture and transform the input signal patterns, and allow more sufficient usage of training samples.
Ranked #1 on
Neural Architecture Search
on NAS-Bench-101
2 code implementations • 3 Jul 2021 • Hejie Cui, Zijie Lu, Pan Li, Carl Yang
Graph neural networks (GNNs) have been widely used in various graph-related problems such as node classification and graph classification, where superior performance is mainly established when natural node features are available.
1 code implementation • 11 Jun 2021 • Susheel Suresh, Vinith Budde, Jennifer Neville, Pan Li, Jianzhu Ma
We find that the prediction performance of a wide range of GNN models is highly correlated with the node level assortativity.
Graph Learning
Node Classification on Non-Homophilic (Heterophilic) Graphs
1 code implementation • NeurIPS 2021 • Susheel Suresh, Pan Li, Cong Hao, Jennifer Neville
Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data.
2 code implementations • 10 Jun 2021 • Yunyu Liu, Jianzhu Ma, Pan Li
HIT extracts the structural representation of a node triplet of interest on the temporal hypergraph and uses it to tell what type of, when, and why the interaction expansion could happen in this triplet.
no code implementations • 8 Jun 2021 • Changlin Wan, Muhan Zhang, Wei Hao, Sha Cao, Pan Li, Chi Zhang
SNALS captures the joint interactions of a hyperedge by its local environment, which is retrieved by collecting the spectrum information of their connections.
1 code implementation • 5 Jun 2021 • Pan Li, Maofei Que, Zhichao Jiang, Yao Hu, Alexander Tuzhilin
Classical recommender system methods typically face the filter bubble problem when users only receive recommendations of their familiar items, making them bored and dissatisfied.
1 code implementation • 5 Jun 2021 • Pan Li, Zhichao Jiang, Maofei Que, Yao Hu, Alexander Tuzhilin
While several cross domain sequential recommendation models have been proposed to leverage information from a source domain to improve CTR predictions in a target domain, they did not take into account bidirectional latent relations of user preferences across source-target domain pairs.
1 code implementation • 17 Apr 2021 • Pan Li, Alexander Tuzhilin
Furthermore, we combine the dual learning method with the metric learning approach, which allows us to significantly reduce the required common user overlap across the two domains and leads to even better cross-domain recommendation performance.
no code implementations • 25 Mar 2021 • Peizhuo Lv, Pan Li, Shengzhi Zhang, Kai Chen, Ruigang Liang, Yue Zhao, Yingjiu Li
Most existing solutions embed backdoors in DNN model training such that DNN ownership can be verified by triggering distinguishable model behaviors with a set of secret inputs.
no code implementations • 11 Mar 2021 • Tianxi Ji, Emre Yilmaz, Erman Ayday, Pan Li
Database fingerprinting have been widely adopted to prevent unauthorized sharing of data and identify the source of data leakages.
Cryptography and Security Databases
1 code implementation • NeurIPS 2021 • Kimon Fountoulakis, Pan Li, Shenghao Yang
Recently, hypergraphs have attracted a lot of attention due to their ability to capture complex relations among entities.
no code implementations • ICLR 2021 • Yanbang Wang, Yen-Yu Chang, Yunyu Liu, Jure Leskovec, Pan Li
Temporal networks serve as abstractions of many real-world dynamic systems.
no code implementations • 6 Jan 2021 • Ashwinkumar Badanidiyuru, Andrew Evdokimov, Vinodh Krishnan, Pan Li, Wynn Vonnegut, Jayden Wang
Predicting the expected value or number of post-click conversions (purchases or other events) is a key task in performance-based digital advertising.
no code implementations • ICCV 2021 • Pan Li, Da Li, Wei Li, Shaogang Gong, Yanwei Fu, Timothy M. Hospedales
The topical domain generalization (DG) problem asks trained models to perform well on an unseen target domain with different data statistics from the source training domains.
no code implementations • ICCV 2021 • Guile Wu, Shaogang Gong, Pan Li
With the reformulated baseline, we present two new approaches to CIL by learning class-independent knowledge and multi-perspective knowledge, respectively.
1 code implementation • 22 Nov 2020 • Haoteng Yin, Yanbang Wang, Pan Li
We want to explain how DE makes GNNs fit for node classification and link prediction.
1 code implementation • 9 Nov 2020 • Yen-Yu Chang, Pan Li, Rok Sosic, M. H. Afifi, Marco Schweighauser, Jure Leskovec
Edge streams are commonly used to capture interactions in dynamic networks, such as email, social, or computer networks.
2 code implementations • NeurIPS 2021 • Muhan Zhang, Pan Li, Yinglong Xia, Kai Wang, Long Jin
In this paper, we provide a theory of using graph neural networks (GNNs) for multi-node representation learning (where we are interested in learning a representation for a set of more than one node, such as link).
Ranked #1 on
Link Property Prediction
on ogbl-citation2
1 code implementation • NeurIPS 2020 • Tailin Wu, Hongyu Ren, Pan Li, Jure Leskovec
We design two sampling algorithms for structural regularization and instantiate the GIB principle with two new models: GIB-Cat and GIB-Bern, and demonstrate the benefits by evaluating the resilience to adversarial attacks.
no code implementations • 28 Sep 2020 • Muhan Zhang, Pan Li, Yinglong Xia, Kai Wang, Long Jin
Graph neural networks (GNNs) have achieved great success in recent years.
1 code implementation • 17 Sep 2020 • Siddharth Bhatia, Arjit Jain, Pan Li, Ritesh Kumar, Bryan Hooi
Given a stream of entries in a multi-aspect data setting i. e., entries having multiple dimensions, how can we detect anomalous activities in an unsupervised manner?
Ranked #1 on
Intrusion Detection
on CIC-DDoS
2 code implementations • NeurIPS 2020 • Pan Li, Yanbang Wang, Hongwei Wang, Jure Leskovec
DE captures the distance between the node set whose representation is to be learned and each node in the graph.
no code implementations • 27 Jul 2020 • Pan Li, Alexander Tuzhilin
Unexpected recommender system constitutes an important tool to tackle the problem of filter bubbles and user boredom, which aims at providing unexpected and satisfying recommendations to target users at the same time.
1 code implementation • ICLR 2021 • Eli Chien, Jianhao Peng, Pan Li, Olgica Milenkovic
We address these issues by introducing a new Generalized PageRank (GPR) GNN architecture that adaptively learns the GPR weights so as to jointly optimize node feature and topological information extraction, regardless of the extent to which the node labels are homophilic or heterophilic.
GPR
Node Classification on Non-Homophilic (Heterophilic) Graphs
+1
1 code implementation • NeurIPS 2019 • Carl Yang, Peiye Zhuang, Wenhan Shi, Alan Luu, Pan Li
Graph embedding has been intensively studied recently, due to the advance of various neural network models.
no code implementations • 20 Oct 2019 • Eli Chien, Pan Li, Olgica Milenkovic
We describe the first known mean-field study of landing probabilities for random walks on hypergraphs.
no code implementations • 11 Oct 2019 • Pan Li, Alexander Tuzhilin
Cross domain recommender systems have been increasingly valuable for helping consumers identify the most satisfying items from different categories.
no code implementations • IJCNLP 2019 • Pan Li, Alexander Tuzhilin
In this paper, we propose a novel model RevGAN that automatically generates controllable and personalized user reviews based on the arbitrarily given sentimental and stylistic information.
no code implementations • 29 Sep 2019 • Carl Yang, Yichen Feng, Pan Li, Yu Shi, Jiawei Han
In this work, we propose to study the utility of different meta-graphs, as well as how to simultaneously leverage multiple meta-graphs for HIN embedding in an unsupervised manner.
no code implementations • 15 Jul 2019 • Ruben Becker, Imane Hafnaoui, Michael E. Houle, Pan Li, Arthur Zimek
For each point, the recently-proposed Local Intrinsic Dimension (LID) model is used in identifying the axis directions along which features have the greatest local discriminability, or equivalently, the fewest number of components of LID that capture the local complexity of the data.
no code implementations • 26 Jun 2019 • Pan Li, Alexander Tuzhilin
Multi-criteria recommender systems have been increasingly valuable for helping consumers identify the most relevant items based on different dimensions of user experiences.
no code implementations • NeurIPS 2019 • Pan Li, Eli Chien, Olgica Milenkovic
Landing probabilities (LP) of random walks (RW) over graphs encode rich information regarding graph topology.
1 code implementation • 4 May 2019 • Pan Li, Alexander Tuzhilin
Providing unexpected recommendations is an important task for recommender systems.
no code implementations • 9 Mar 2019 • Pan Li, Baihong Jin, Ruoxuan Xiong, Dai Wang, Alberto Sangiovanni-Vincentelli, Baosen Zhang
We present a machine learning approach to the solution of chance constrained optimizations in the context of voltage regulation problems in power system operation.
no code implementations • 26 Feb 2019 • Pan Li, Niao He, Olgica Milenkovic
We introduce a new convex optimization problem, termed quadratic decomposable submodular function minimization (QDSFM), which allows to model a number of learning tasks on graphs and hypergraphs.
no code implementations • 25 Nov 2018 • I Chien, Huozhi Zhou, Pan Li
We propose a hypergraph-based active learning scheme which we term $HS^2$, $HS^2$ generalizes the previously reported algorithm $S^2$ originally proposed for graph-based active learning with pointwise queries [Dasarathy et al., COLT 2015].
no code implementations • 5 Nov 2018 • Pan Li, Gregory J. Puleo, Olgica Milenkovic
Our contributions are as follows: We first introduce several variants of motif correlation clustering and then show that these clustering problems are NP-hard.
no code implementations • 8 Oct 2018 • Chen Zhu, HengShu Zhu, Hui Xiong, Chao Ma, Fang Xie, Pengliang Ding, Pan Li
To this end, in this paper, we propose a novel end-to-end data-driven model based on Convolutional Neural Network (CNN), namely Person-Job Fit Neural Network (PJFNN), for matching a talent qualification to the requirements of a job.
1 code implementation • NeurIPS 2018 • Pan Li, Niao He, Olgica Milenkovic
The problem is closely related to decomposable submodular function minimization and arises in many learning on graphs and hypergraphs settings, such as graph-based semi-supervised learning and PageRank.
no code implementations • 11 Mar 2018 • Pan Li, Qiang Liu, Wentao Zhao, Dongxu Wang, Siqi Wang
In this paper, we adopt the Edge Pattern Detection (EPD) algorithm to design a novel poisoning method that attack against several machine learning algorithms used in IDSs.
1 code implementation • NeurIPS 2018 • Pan Li, Olgica Milenkovic
We introduce a new approach to decomposable submodular function minimization (DSFM) that exploits incidence relations.
1 code implementation • ICML 2018 • Pan Li, Olgica Milenkovic
We introduce submodular hypergraphs, a family of hypergraphs that have different submodular weights associated with different cuts of hyperedges.
1 code implementation • 2 Feb 2018 • Yize Chen, Pan Li, Baosen Zhang
We present a method to generate renewable scenarios using Bayesian probabilities by implementing the Bayesian generative adversarial network~(Bayesian GAN), which is a variant of generative adversarial networks based on two interconnected deep neural networks.
1 code implementation • NeurIPS 2017 • Pan Li, Olgica Milenkovic
Hypergraph partitioning is an important problem in machine learning, computer vision and network analytics.
no code implementations • 28 Apr 2017 • Pan Li, Baihong Jin, Dai Wang, Baosen Zhang
We also show that this optimization problem is convex for a wide variety of probabilistic distributions.
no code implementations • 28 Jan 2017 • Pan Li, Olgica Milenkovic
We introduce a new family of minmax rank aggregation problems under two distance measures, the Kendall {\tau} and the Spearman footrule.
no code implementations • 28 Jan 2017 • Pan Li, Arya Mazumdar, Olgica Milenkovic
We propose a novel rank aggregation method based on converting permutations into their corresponding Lehmer codes or other subdiagonal images.
no code implementations • 2 Oct 2016 • Pan Li, Baosen Zhang
The accurate estimation of impact of demand response signals to customers' consumption is central to any successful program.
no code implementations • 5 Nov 2015 • Pan Li, Baosen Zhang, Yang Weng, Ram Rajagopal
Accurate prediction of user consumption is a key part not only in understanding consumer flexibility and behavior patterns, but in the design of robust and efficient energy saving programs as well.