Learning Specialized Activation Functions for Physics-informed Neural Networks

1 code implementation • 8 Aug 2023 • Honghui Wang, Lu Lu, Shiji Song, Gao Huang

To avoid the inefficient manual selection and to alleviate the optimization difficulty of PINNs, we introduce adaptive activation functions to search for the optimal function when solving different problems.

Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework

1 code implementation • CVPR 2022 • Chenxin Tao, Honghui Wang, Xizhou Zhu, Jiahua Dong, Shiji Song, Gao Huang, Jifeng Dai

These methods appear to be quite different in the designed loss functions from various motivations.

Contrastive Learning Self-Supervised Learning

Dynamic Neural Networks: A Survey

no code implementations • 9 Feb 2021 • Yizeng Han, Gao Huang, Shiji Song, Le Yang, Honghui Wang, Yulin Wang

Dynamic neural network is an emerging research topic in deep learning.

Computational Efficiency Decision Making