Search Results for author: Hengrui Zhang

Found 26 papers, 14 papers with code

Adaptive Catalyst Discovery Using Multicriteria Bayesian Optimization with Representation Learning

1 code implementation18 Apr 2024 Jie Chen, Pengfei Ou, Yuxin Chang, Hengrui Zhang, Xiao-Yan Li, Edward H. Sargent, Wei Chen

The results demonstrate that our approach achieves high prediction accuracy, facilitates interpretable feature extraction, and enables multicriteria design optimization, leading to significant reduction of computing power and time (10x reduction of required DFT calculations) in high-performance catalyst discovery.

Overcoming Pitfalls in Graph Contrastive Learning Evaluation: Toward Comprehensive Benchmarks

no code implementations24 Feb 2024 Qian Ma, Hongliang Chi, Hengrui Zhang, Kay Liu, Zhiwei Zhang, Lu Cheng, Suhang Wang, Philip S. Yu, Yao Ma

The rise of self-supervised learning, which operates without the need for labeled data, has garnered significant interest within the graph learning community.

Contrastive Learning Graph Learning +1

Cyclic Neural Network

no code implementations11 Jan 2024 Liangwei Yang, Hengrui Zhang, Zihe Song, Jiawei Zhang, Weizhi Zhang, Jing Ma, Philip S. Yu

This paper answers a fundamental question in artificial neural network (ANN) design: We do not need to build ANNs layer-by-layer sequentially to guarantee the Directed Acyclic Graph (DAG) property.

Data Augmentation for Supervised Graph Outlier Detection with Latent Diffusion Models

1 code implementation29 Dec 2023 Kay Liu, Hengrui Zhang, Ziqing Hu, Fangxin Wang, Philip S. Yu

One of the fundamental challenges confronting supervised graph outlier detection algorithms is the prevalent issue of class imbalance, where the scarcity of outlier instances compared to normal instances often results in suboptimal performance.

Data Augmentation Denoising +1

MolSets: Molecular Graph Deep Sets Learning for Mixture Property Modeling

1 code implementation27 Dec 2023 Hengrui Zhang, Jie Chen, James M. Rondinelli, Wei Chen

This complexity is particularly evident in molecular mixtures, a frequently explored space for materials such as battery electrolytes.

mixture property prediction molecular representation

A Hardware Evaluation Framework for Large Language Model Inference

no code implementations5 Dec 2023 Hengrui Zhang, August Ning, Rohan Prabhakar, David Wentzlaff

With the large hardware needed to simply run LLM inference, evaluating different hardware designs becomes a new bottleneck.

Language Modelling Large Language Model +1

DRL4Route: A Deep Reinforcement Learning Framework for Pick-up and Delivery Route Prediction

1 code implementation30 Jul 2023 Xiaowei Mao, Haomin Wen, Hengrui Zhang, Huaiyu Wan, Lixia Wu, Jianbin Zheng, Haoyuan Hu, Youfang Lin

Deep neural networks based on supervised learning have emerged as the dominant model for the task because of their powerful ability to capture workers' behavior patterns from massive historical data.

reinforcement-learning Reinforcement Learning (RL)

OrthoReg: Improving Graph-regularized MLPs via Orthogonality Regularization

no code implementations31 Jan 2023 Hengrui Zhang, Shen Wang, Vassilis N. Ioannidis, Soji Adeshina, Jiani Zhang, Xiao Qin, Christos Faloutsos, Da Zheng, George Karypis, Philip S. Yu

Graph Neural Networks (GNNs) are currently dominating in modeling graph-structure data, while their high reliance on graph structure for inference significantly impedes them from widespread applications.

Node Classification

Localized Contrastive Learning on Graphs

no code implementations8 Dec 2022 Hengrui Zhang, Qitian Wu, Yu Wang, Shaofeng Zhang, Junchi Yan, Philip S. Yu

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data.

Contrastive Learning Data Augmentation +1

ET-AL: Entropy-Targeted Active Learning for Bias Mitigation in Materials Data

1 code implementation15 Nov 2022 Hengrui Zhang, Wei Wayne Chen, James M. Rondinelli, Wei Chen

To mitigate the bias, we develop an entropy-targeted active learning (ET-AL) framework, which guides the acquisition of new data to improve the diversity of underrepresented crystal systems.

Active Learning Materials Screening

ContrastVAE: Contrastive Variational AutoEncoder for Sequential Recommendation

1 code implementation27 Aug 2022 Yu Wang, Hengrui Zhang, Zhiwei Liu, Liangwei Yang, Philip S. Yu

Then we propose Contrastive Variational AutoEncoder (ContrastVAE in short), a two-branched VAE model with contrastive regularization as an embodiment of ContrastELBO for sequential recommendation.

Contrastive Learning Sequential Recommendation

Uncertainty-Aware Mixed-Variable Machine Learning for Materials Design

no code implementations11 Jul 2022 Hengrui Zhang, Wei Wayne Chen, Akshay Iyer, Daniel W. Apley, Wei Chen

Data-driven design shows the promise of accelerating materials discovery but is challenging due to the prohibitive cost of searching the vast design space of chemistry, structure, and synthesis methods.

Bayesian Optimization BIG-bench Machine Learning +1

Handling Distribution Shifts on Graphs: An Invariance Perspective

2 code implementations ICLR 2022 Qitian Wu, Hengrui Zhang, Junchi Yan, David Wipf

There is increasing evidence suggesting neural networks' sensitivity to distribution shifts, so that research on out-of-distribution (OOD) generalization comes into the spotlight.

valid

Conservative Distributional Reinforcement Learning with Safety Constraints

no code implementations18 Jan 2022 Hengrui Zhang, Youfang Lin, Sheng Han, Shuo Wang, Kai Lv

Then, CDMPO uses a conservative value function loss to reduce the number of violations of constraints during the exploration process.

Distributional Reinforcement Learning reinforcement-learning +1

Understanding GNN Computational Graph: A Coordinated Computation, IO, and Memory Perspective

no code implementations18 Oct 2021 Hengrui Zhang, Zhongming Yu, Guohao Dai, Guyue Huang, Yufei Ding, Yuan Xie, Yu Wang

The same data are propagated through the graph structure to perform the same neural operation multiple times in GNNs, leading to redundant computation which accounts for 92. 4% of total operators.

ESCo: Towards Provably Effective and Scalable Contrastive Representation Learning

no code implementations29 Sep 2021 Hengrui Zhang, Qitian Wu, Shaofeng Zhang, Junchi Yan, David Wipf, Philip S. Yu

In this paper, we propose ESCo (Effective and Scalable Contrastive), a new contrastive framework which is essentially an instantiation of the Information Bottleneck principle under self-supervised learning settings.

Contrastive Learning Representation Learning +1

CogDL: A Comprehensive Library for Graph Deep Learning

1 code implementation1 Mar 2021 Yukuo Cen, Zhenyu Hou, Yan Wang, Qibin Chen, Yizhen Luo, Zhongming Yu, Hengrui Zhang, Xingcheng Yao, Aohan Zeng, Shiguang Guo, Yuxiao Dong, Yang Yang, Peng Zhang, Guohao Dai, Yu Wang, Chang Zhou, Hongxia Yang, Jie Tang

In CogDL, we propose a unified design for the training and evaluation of GNN models for various graph tasks, making it unique among existing graph learning libraries.

Graph Classification Graph Embedding +5

Inductive Collaborative Filtering via Relation Graph Learning

no code implementations1 Jan 2021 Qitian Wu, Hengrui Zhang, Xiaofeng Gao, Hongyuan Zha

In this paper, we propose an inductive collaborative filtering framework that learns a hidden relational graph among users from the rating matrix.

Collaborative Filtering Graph Learning +2

Towards Open-World Recommendation: An Inductive Model-based Collaborative Filtering Approach

1 code implementation9 Jul 2020 Qitian Wu, Hengrui Zhang, Xiaofeng Gao, Junchi Yan, Hongyuan Zha

The first model follows conventional matrix factorization which factorizes a group of key users' rating matrix to obtain meta latents.

Collaborative Filtering Matrix Completion +2

Cannot find the paper you are looking for? You can Submit a new open access paper.