Search Results for author: Pan Li

Found 78 papers, 37 papers with code

SUREL+: Moving from Walks to Sets for Scalable Subgraph-based Graph Representation Learning

1 code implementation6 Mar 2023 Haoteng Yin, Muhan Zhang, Jianguo Wang, Pan Li

In this work, we propose a novel framework SUREL+ that upgrades SUREL by using node sets instead of walks to represent subgraphs.

Graph Representation Learning

Unsupervised Learning for Combinatorial Optimization Needs Meta-Learning

1 code implementation8 Jan 2023 Haoyu Wang, Pan Li

With this observation, we propose a new objective of unsupervised learning for CO where the goal of learning is to search for good initialization for future problem instances rather than give direct solutions.

Combinatorial Optimization Meta-Learning

Graph Federated Learning with Hidden Representation Sharing

no code implementations23 Dec 2022 Shuang Wu, Mingxuan Zhang, Yuantong Li, Carl Yang, Pan Li

On the other hand, due to the increasing demands for the protection of clients' data privacy, Federated Learning (FL) has been widely adopted: FL requires models to be trained in a multi-client system and restricts sharing of raw data among clients.

Federated Learning

Interpretable Geometric Deep Learning via Learnable Randomness Injection

1 code implementation30 Oct 2022 Siqi Miao, Yunan Luo, Mia Liu, Pan Li

LRI-induced models, once trained, can detect the points in the point cloud data that carry information indicative of the prediction label.

Federated Graph Representation Learning using Self-Supervision

no code implementations27 Oct 2022 Susheel Suresh, Danny Godbout, Arko Mukherjee, Mayank Shrivastava, Jennifer Neville, Pan Li

1. 7% gains compared to individual client specific self-supervised training and (2) we construct and introduce a new cross-silo dataset called Amazon Co-purchase Networks that have both the characteristics of the motivated problem setting.

Federated Learning Graph Representation Learning

Extensible Proxy for Efficient NAS

1 code implementation17 Oct 2022 Yuhong Li, Jiajie Li, Cong Han, Pan Li, JinJun Xiong, Deming Chen

(2) Efficient proxies are not extensible to multi-modality downstream tasks.

Neural Architecture Search

A Novel Membership Inference Attack against Dynamic Neural Networks by Utilizing Policy Networks Information

no code implementations17 Oct 2022 Pan Li, Peizhuo Lv, Shenchen Zhu, Ruigang Liang, Kai Chen

Although traditional static DNNs are vulnerable to the membership inference attack (MIA) , which aims to infer whether a particular point was used to train the model, little is known about how such an attack performs on the dynamic NNs.

Image Classification Inference Attack +1

Spatio-temporal Tendency Reasoning for Human Body Pose and Shape Estimation from Videos

no code implementations7 Oct 2022 Boyang Zhang, Suping Wu, Hu Cao, Kehua Ma, Pan Li, Lei Lin

Different from them, our STR aims to learn accurate and natural motion sequences in an unconstrained environment through temporal and spatial tendency and to fully excavate the spatio-temporal features of existing video data.

Temporal Sequences

Neighborhood-aware Scalable Temporal Network Representation Learning

1 code implementation2 Sep 2022 Yuhong Luo, Pan Li

Such a dictionary representation records a downsampled set of the neighboring nodes as keys, and allows fast construction of structural features for a joint neighborhood of multiple nodes.

Inductive Link Prediction Representation Learning

Understanding Non-linearity in Graph Neural Networks from the Bayesian-Inference Perspective

1 code implementation22 Jul 2022 Rongzhe Wei, Haoteng Yin, Junteng Jia, Austin R. Benson, Pan Li

Graph neural networks (GNNs) have shown superiority in many prediction tasks over graphs due to their impressive capability of capturing nonlinear relations in graph-structured data.

Bayesian Inference Node Classification

Equivariant Hypergraph Diffusion Neural Operators

1 code implementation14 Jul 2022 Peihao Wang, Shenghao Yang, Yunyu Liu, Zhangyang Wang, Pan Li

Hypergraph neural networks (HNNs) using neural networks to encode hypergraphs provide a promising way to model higher-order relations in data and further solve relevant prediction tasks built upon such higher-order relations.

Node Classification

Unsupervised Learning for Combinatorial Optimization with Principled Objective Relaxation

1 code implementation13 Jul 2022 Haoyu Wang, Nan Wu, Hang Yang, Cong Hao, Pan Li

Using machine learning to solve combinatorial optimization (CO) problems is challenging, especially when the data is unlabeled.

Combinatorial Optimization

Two-Dimensional Weisfeiler-Lehman Graph Neural Networks for Link Prediction

1 code implementation20 Jun 2022 Yang Hu, Xiyuan Wang, Zhouchen Lin, Pan Li, Muhan Zhang

As pointed out by previous works, this two-step procedure results in low discriminating power, as 1-WL-GNNs by nature learn node-level representations instead of link-level.

Link Prediction

A Framework of Meta Functional Learning for Regularising Knowledge Transfer

no code implementations28 Mar 2022 Pan Li, Yanwei Fu, Shaogang Gong

The MFL computes meta-knowledge on functional regularisation generalisable to different learning tasks by which functional training on limited labelled data promotes more discriminative functions to be learned.

cross-domain few-shot learning Transfer Learning

Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networks

1 code implementation ICLR 2022 Haorui Wang, Haoteng Yin, Muhan Zhang, Pan Li

Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of nodes such as link/motif prediction and so on.

Link Prediction

Algorithm and System Co-design for Efficient Subgraph-based Graph Representation Learning

3 code implementations28 Feb 2022 Haoteng Yin, Muhan Zhang, Yanbang Wang, Jianguo Wang, Pan Li

Subgraph-based graph representation learning (SGRL) has been recently proposed to deal with some fundamental challenges encountered by canonical graph neural networks (GNNs), and has demonstrated advantages in many important data science applications such as link, relation and motif prediction.

Graph Representation Learning

Graph Auto-Encoder Via Neighborhood Wasserstein Reconstruction

1 code implementation ICLR 2022 Mingyue Tang, Carl Yang, Pan Li

Graph neural networks (GNNs) have drawn significant research attention recently, mostly under the setting of semi-supervised learning.

Graph Mining Graph Reconstruction

Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanism

2 code implementations31 Jan 2022 Siqi Miao, Miaoyuan Liu, Pan Li

However, those post-hoc methods often fail to provide stable interpretation and may extract features that are spuriously correlated with the task.

Graph Learning

Applications and Techniques for Fast Machine Learning in Science

no code implementations25 Oct 2021 Allison McCarn Deiana, Nhan Tran, Joshua Agar, Michaela Blott, Giuseppe Di Guglielmo, Javier Duarte, Philip Harris, Scott Hauck, Mia Liu, Mark S. Neubauer, Jennifer Ngadiuba, Seda Ogrenci-Memik, Maurizio Pierini, Thea Aarrestad, Steffen Bahr, Jurgen Becker, Anne-Sophie Berthold, Richard J. Bonventre, Tomas E. Muller Bravo, Markus Diefenthaler, Zhen Dong, Nick Fritzsche, Amir Gholami, Ekaterina Govorkova, Kyle J Hazelwood, Christian Herwig, Babar Khan, Sehoon Kim, Thomas Klijnsma, Yaling Liu, Kin Ho Lo, Tri Nguyen, Gianantonio Pezzullo, Seyedramin Rasoulinezhad, Ryan A. Rivera, Kate Scholberg, Justin Selig, Sougata Sen, Dmitri Strukov, William Tang, Savannah Thais, Kai Lukas Unger, Ricardo Vilalta, Belinavon Krosigk, Thomas K. Warburton, Maria Acosta Flechas, Anthony Aportela, Thomas Calvet, Leonardo Cristella, Daniel Diaz, Caterina Doglioni, Maria Domenica Galati, Elham E Khoda, Farah Fahim, Davide Giri, Benjamin Hawks, Duc Hoang, Burt Holzman, Shih-Chieh Hsu, Sergo Jindariani, Iris Johnson, Raghav Kansal, Ryan Kastner, Erik Katsavounidis, Jeffrey Krupa, Pan Li, Sandeep Madireddy, Ethan Marx, Patrick McCormack, Andres Meza, Jovan Mitrevski, Mohammed Attia Mohammed, Farouk Mokhtar, Eric Moreno, Srishti Nagu, Rohin Narayan, Noah Palladino, Zhiqiang Que, Sang Eon Park, Subramanian Ramamoorthy, Dylan Rankin, Simon Rothman, ASHISH SHARMA, Sioni Summers, Pietro Vischia, Jean-Roch Vlimant, Olivia Weng

In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time experimental data processing loop to accelerate scientific discovery.

BIG-bench Machine Learning

FEATURE-AUGMENTED HYPERGRAPH NEURAL NETWORKS

no code implementations29 Sep 2021 Xueqi Ma, Pan Li, Qiong Cao, James Bailey, Yue Gao

In FAHGNN, we explore the influence of node features for the expressive power of GNNs and augment features by introducing common features and personal features to model information.

Node Classification Representation Learning

Semi-supervised Graph Neural Network for Particle-level Noise Removal

no code implementations NeurIPS Workshop AI4Scien 2021 Tianchun Li, Shikun Liu, Yongbin Feng, Nhan Tran, Miaoyuan Liu, Pan Li

The graph neural network is trained on charged particles with well-known labels, which can be obtained from simulation truth information or measurements from data, and inferred on neutral particles of which such labeling is missing.

Program-to-Circuit: Exploiting GNNs for Program Representation and Circuit Translation

no code implementations13 Sep 2021 Nan Wu, Huake He, Yuan Xie, Pan Li, Cong Hao

Pioneering in this direction, we expect more GNN endeavors to revolutionize this high-demand Program-to-Circuit problem and to enrich the expressiveness of GNNs on programs.

Transfer Learning Translation

A Web Scale Entity Extraction System

no code implementations Findings (EMNLP) 2021 Xuanting Cai, Quanbin Ma, Pan Li, Jianyu Liu, Qi Zeng, Zhengkan Yang, Pushkar Tripathi

Understanding the semantic meaning of content on the web through the lens of entities and concepts has many practical advantages.

Generic Neural Architecture Search via Regression

2 code implementations NeurIPS 2021 Yuhong Li, Cong Hao, Pan Li, JinJun Xiong, Deming Chen

Such a self-supervised regression task can effectively evaluate the intrinsic power of an architecture to capture and transform the input signal patterns, and allow more sufficient usage of training samples.

Image Classification Neural Architecture Search +1

On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphs

2 code implementations3 Jul 2021 Hejie Cui, Zijie Lu, Pan Li, Carl Yang

Graph neural networks (GNNs) have been widely used in various graph-related problems such as node classification and graph classification, where superior performance is mainly established when natural node features are available.

Classification Graph Classification +1

Adversarial Graph Augmentation to Improve Graph Contrastive Learning

1 code implementation NeurIPS 2021 Susheel Suresh, Pan Li, Cong Hao, Jennifer Neville

Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data.

Contrastive Learning Self-Supervised Learning

Neural Predicting Higher-order Patterns in Temporal Networks

2 code implementations10 Jun 2021 Yunyu Liu, Jianzhu Ma, Pan Li

HIT extracts the structural representation of a node triplet of interest on the temporal hypergraph and uses it to tell what type of, when, and why the interaction expansion could happen in this triplet.

Principled Hyperedge Prediction with Structural Spectral Features and Neural Networks

no code implementations8 Jun 2021 Changlin Wan, Muhan Zhang, Wei Hao, Sha Cao, Pan Li, Chi Zhang

SNALS captures the joint interactions of a hyperedge by its local environment, which is retrieved by collecting the spectrum information of their connections.

Hyperedge Prediction

PURS: Personalized Unexpected Recommender System for Improving User Satisfaction

1 code implementation5 Jun 2021 Pan Li, Maofei Que, Zhichao Jiang, Yao Hu, Alexander Tuzhilin

Classical recommender system methods typically face the filter bubble problem when users only receive recommendations of their familiar items, making them bored and dissatisfied.

Recommendation Systems

Dual Attentive Sequential Learning for Cross-Domain Click-Through Rate Prediction

1 code implementation5 Jun 2021 Pan Li, Zhichao Jiang, Maofei Que, Yao Hu, Alexander Tuzhilin

While several cross domain sequential recommendation models have been proposed to leverage information from a source domain to improve CTR predictions in a target domain, they did not take into account bidirectional latent relations of user preferences across source-target domain pairs.

Click-Through Rate Prediction Sequential Recommendation

Dual Metric Learning for Effective and Efficient Cross-Domain Recommendations

1 code implementation17 Apr 2021 Pan Li, Alexander Tuzhilin

Furthermore, we combine the dual learning method with the metric learning approach, which allows us to significantly reduce the required common user overlap across the two domains and leads to even better cross-domain recommendation performance.

Metric Learning Recommendation Systems

HufuNet: Embedding the Left Piece as Watermark and Keeping the Right Piece for Ownership Verification in Deep Neural Networks

no code implementations25 Mar 2021 Peizhuo Lv, Pan Li, Shengzhi Zhang, Kai Chen, Ruigang Liang, Yue Zhao, Yingjiu Li

Most existing solutions embed backdoors in DNN model training such that DNN ownership can be verified by triggering distinguishable model behaviors with a set of secret inputs.

The Curse of Correlations for Robust Fingerprinting of Relational Databases

no code implementations11 Mar 2021 Tianxi Ji, Emre Yilmaz, Erman Ayday, Pan Li

Database fingerprinting have been widely adopted to prevent unauthorized sharing of data and identify the source of data leakages.

Cryptography and Security Databases

Local Hyper-Flow Diffusion

1 code implementation NeurIPS 2021 Kimon Fountoulakis, Pan Li, Shenghao Yang

Recently, hypergraphs have attracted a lot of attention due to their ability to capture complex relations among entities.

Community Detection Recommendation Systems

Handling many conversions per click in modeling delayed feedback

no code implementations6 Jan 2021 Ashwinkumar Badanidiyuru, Andrew Evdokimov, Vinodh Krishnan, Pan Li, Wynn Vonnegut, Jayden Wang

Predicting the expected value or number of post-click conversions (purchases or other events) is a key task in performance-based digital advertising.

A Simple Feature Augmentation for Domain Generalization

no code implementations ICCV 2021 Pan Li, Da Li, Wei Li, Shaogang Gong, Yanwei Fu, Timothy M. Hospedales

The topical domain generalization (DG) problem asks trained models to perform well on an unseen target domain with different data statistics from the source training domains.

Data Augmentation Domain Generalization

Striking a Balance Between Stability and Plasticity for Class-Incremental Learning

no code implementations ICCV 2021 Guile Wu, Shaogang Gong, Pan Li

With the reformulated baseline, we present two new approaches to CIL by learning class-independent knowledge and multi-perspective knowledge, respectively.

Class Incremental Learning Incremental Learning

F-FADE: Frequency Factorization for Anomaly Detection in Edge Streams

1 code implementation9 Nov 2020 Yen-Yu Chang, Pan Li, Rok Sosic, M. H. Afifi, Marco Schweighauser, Jure Leskovec

Edge streams are commonly used to capture interactions in dynamic networks, such as email, social, or computer networks.

Anomaly Detection Anomaly Detection in Edge Streams

Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learning

2 code implementations NeurIPS 2021 Muhan Zhang, Pan Li, Yinglong Xia, Kai Wang, Long Jin

In this paper, we provide a theory of using graph neural networks (GNNs) for multi-node representation learning (where we are interested in learning a representation for a set of more than one node, such as link).

General Classification Graph Classification +4

Graph Information Bottleneck

1 code implementation NeurIPS 2020 Tailin Wu, Hongyu Ren, Pan Li, Jure Leskovec

We design two sampling algorithms for structural regularization and instantiate the GIB principle with two new models: GIB-Cat and GIB-Bern, and demonstrate the benefits by evaluating the resilience to adversarial attacks.

Representation Learning

MSTREAM: Fast Anomaly Detection in Multi-Aspect Streams

1 code implementation17 Sep 2020 Siddharth Bhatia, Arjit Jain, Pan Li, Ritesh Kumar, Bryan Hooi

Given a stream of entries in a multi-aspect data setting i. e., entries having multiple dimensions, how can we detect anomalous activities in an unsupervised manner?

Group Anomaly Detection Intrusion Detection

Latent Unexpected Recommendations

no code implementations27 Jul 2020 Pan Li, Alexander Tuzhilin

Unexpected recommender system constitutes an important tool to tackle the problem of filter bubbles and user boredom, which aims at providing unexpected and satisfying recommendations to target users at the same time.

Recommendation Systems

Adaptive Universal Generalized PageRank Graph Neural Network

1 code implementation ICLR 2021 Eli Chien, Jianhao Peng, Pan Li, Olgica Milenkovic

We address these issues by introducing a new Generalized PageRank (GPR) GNN architecture that adaptively learns the GPR weights so as to jointly optimize node feature and topological information extraction, regardless of the extent to which the node labels are homophilic or heterophilic.

GPR Node Classification on Non-Homophilic (Heterophilic) Graphs +1

Landing Probabilities of Random Walks for Seed-Set Expansion in Hypergraphs

no code implementations20 Oct 2019 Eli Chien, Pan Li, Olgica Milenkovic

We describe the first known mean-field study of landing probabilities for random walks on hypergraphs.

DDTCDR: Deep Dual Transfer Cross Domain Recommendation

no code implementations11 Oct 2019 Pan Li, Alexander Tuzhilin

Cross domain recommender systems have been increasingly valuable for helping consumers identify the most satisfying items from different categories.

Recommendation Systems Transfer Learning

Towards Controllable and Personalized Review Generation

no code implementations IJCNLP 2019 Pan Li, Alexander Tuzhilin

In this paper, we propose a novel model RevGAN that automatically generates controllable and personalized user reviews based on the arbitrarily given sentimental and stylistic information.

Review Generation

Meta-Graph Based HIN Spectral Embedding: Methods, Analyses, and Insights

no code implementations29 Sep 2019 Carl Yang, Yichen Feng, Pan Li, Yu Shi, Jiawei Han

In this work, we propose to study the utility of different meta-graphs, as well as how to simultaneously leverage multiple meta-graphs for HIN embedding in an unsupervised manner.

Subspace Determination through Local Intrinsic Dimensional Decomposition: Theory and Experimentation

no code implementations15 Jul 2019 Ruben Becker, Imane Hafnaoui, Michael E. Houle, Pan Li, Arthur Zimek

For each point, the recently-proposed Local Intrinsic Dimension (LID) model is used in identifying the axis directions along which features have the greatest local discriminability, or equivalently, the fewest number of components of LID that capture the local complexity of the data.

Latent Multi-Criteria Ratings for Recommendations

no code implementations26 Jun 2019 Pan Li, Alexander Tuzhilin

Multi-criteria recommender systems have been increasingly valuable for helping consumers identify the most relevant items based on different dimensions of user experiences.

Recommendation Systems

Latent Unexpected and Useful Recommendation

1 code implementation4 May 2019 Pan Li, Alexander Tuzhilin

Providing unexpected recommendations is an important task for recommender systems.

Recommendation Systems

A tractable ellipsoidal approximation for voltage regulation problems

no code implementations9 Mar 2019 Pan Li, Baihong Jin, Ruoxuan Xiong, Dai Wang, Alberto Sangiovanni-Vincentelli, Baosen Zhang

We present a machine learning approach to the solution of chance constrained optimizations in the context of voltage regulation problems in power system operation.

BIG-bench Machine Learning

Quadratic Decomposable Submodular Function Minimization: Theory and Practice (Computation and Analysis of PageRank over Hypergraphs)

no code implementations26 Feb 2019 Pan Li, Niao He, Olgica Milenkovic

We introduce a new convex optimization problem, termed quadratic decomposable submodular function minimization (QDSFM), which allows to model a number of learning tasks on graphs and hypergraphs.

hypergraph partitioning

$HS^2$: Active Learning over Hypergraphs

no code implementations25 Nov 2018 I Chien, Huozhi Zhou, Pan Li

We propose a hypergraph-based active learning scheme which we term $HS^2$, $HS^2$ generalizes the previously reported algorithm $S^2$ originally proposed for graph-based active learning with pointwise queries [Dasarathy et al., COLT 2015].

Active Learning

Motif and Hypergraph Correlation Clustering

no code implementations5 Nov 2018 Pan Li, Gregory J. Puleo, Olgica Milenkovic

Our contributions are as follows: We first introduce several variants of motif correlation clustering and then show that these clustering problems are NP-hard.

Person-Job Fit: Adapting the Right Talent for the Right Job with Joint Representation Learning

no code implementations8 Oct 2018 Chen Zhu, HengShu Zhu, Hui Xiong, Chao Ma, Fang Xie, Pengliang Ding, Pan Li

To this end, in this paper, we propose a novel end-to-end data-driven model based on Convolutional Neural Network (CNN), namely Person-Job Fit Neural Network (PJFNN), for matching a talent qualification to the requirements of a job.

Data Visualization Representation Learning

Quadratic Decomposable Submodular Function Minimization

1 code implementation NeurIPS 2018 Pan Li, Niao He, Olgica Milenkovic

The problem is closely related to decomposable submodular function minimization and arises in many learning on graphs and hypergraphs settings, such as graph-based semi-supervised learning and PageRank.

BEBP: An Poisoning Method Against Machine Learning Based IDSs

no code implementations11 Mar 2018 Pan Li, Qiang Liu, Wentao Zhao, Dongxu Wang, Siqi Wang

In this paper, we adopt the Edge Pattern Detection (EPD) algorithm to design a novel poisoning method that attack against several machine learning algorithms used in IDSs.

BIG-bench Machine Learning Intrusion Detection

Revisiting Decomposable Submodular Function Minimization with Incidence Relations

1 code implementation NeurIPS 2018 Pan Li, Olgica Milenkovic

We introduce a new approach to decomposable submodular function minimization (DSFM) that exploits incidence relations.

Submodular Hypergraphs: p-Laplacians, Cheeger Inequalities and Spectral Clustering

1 code implementation ICML 2018 Pan Li, Olgica Milenkovic

We introduce submodular hypergraphs, a family of hypergraphs that have different submodular weights associated with different cuts of hyperedges.

Bayesian Renewables Scenario Generation via Deep Generative Networks

1 code implementation2 Feb 2018 Yize Chen, Pan Li, Baosen Zhang

We present a method to generate renewable scenarios using Bayesian probabilities by implementing the Bayesian generative adversarial network~(Bayesian GAN), which is a variant of generative adversarial networks based on two interconnected deep neural networks.

Inhomogeneous Hypergraph Clustering with Applications

1 code implementation NeurIPS 2017 Pan Li, Olgica Milenkovic

Hypergraph partitioning is an important problem in machine learning, computer vision and network analytics.

hypergraph partitioning

Distribution System Voltage Control under Uncertainties using Tractable Chance Constraints

no code implementations28 Apr 2017 Pan Li, Baihong Jin, Dai Wang, Baosen Zhang

We also show that this optimization problem is convex for a wide variety of probabilistic distributions.

Multiclass MinMax Rank Aggregation

no code implementations28 Jan 2017 Pan Li, Olgica Milenkovic

We introduce a new family of minmax rank aggregation problems under two distance measures, the Kendall {\tau} and the Spearman footrule.

Efficient Rank Aggregation via Lehmer Codes

no code implementations28 Jan 2017 Pan Li, Arya Mazumdar, Olgica Milenkovic

We propose a novel rank aggregation method based on converting permutations into their corresponding Lehmer codes or other subdiagonal images.

An Optimal Treatment Assignment Strategy to Evaluate Demand Response Effect

no code implementations2 Oct 2016 Pan Li, Baosen Zhang

The accurate estimation of impact of demand response signals to customers' consumption is central to any successful program.

Experimental Design

A Sparse Linear Model and Significance Test for Individual Consumption Prediction

no code implementations5 Nov 2015 Pan Li, Baosen Zhang, Yang Weng, Ram Rajagopal

Accurate prediction of user consumption is a key part not only in understanding consumer flexibility and behavior patterns, but in the design of robust and efficient energy saving programs as well.

Two-sample testing

Cannot find the paper you are looking for? You can Submit a new open access paper.