1 code implementation • 15 Jan 2024 • Xiuyuan Hu, Guoqing Liu, Yang Zhao, Hao Zhang
AI for drug discovery has been a research hotspot in recent years, and SMILES-based language models has been increasingly applied in drug molecular design.
1 code implementation • NeurIPS 2023 • Xiuyuan Hu, Guoqing Liu, Yang Zhao, Hao Zhang
A central challenge in this field is to generate molecules with specific properties while also producing a wide range of diverse candidates.
no code implementations • 18 Mar 2022 • Yang Zhao, Hao Zhang, Xiuyuan Hu
Optimizers in RST would perform a Bernoulli trial at each iteration to choose randomly from base algorithms (SGD) and sharpness-aware algorithms (SAM) with a probability arranged by a predefined scheduling function.
1 code implementation • 8 Feb 2022 • Yang Zhao, Hao Zhang, Xiuyuan Hu
In this paper, we propose an effective method to improve the model generalization by additionally penalizing the gradient norm of loss function during optimization.
no code implementations • 2 Nov 2020 • Yang Zhao, Hao Zhang, Xiuyuan Hu
Identifying the role of network units in deep neural networks (DNNs) is critical in many aspects including giving understandings on the mechanisms of DNNs and building basic connections between deep learning and neuroscience.