Integrating convolutional layers and biformer network with forward-forward and backpropagation training

Accurate molecular property prediction is crucial for drug discovery and computational chemistry, facilitating the identification of promising compounds and accelerating therapeutic development. Traditional machine learning falters with high-dimensional data and manual feature engineering, while existing deep learning approaches may not capture complex molecular structures, leaving a research gap. We introduce Deep-CBN, a novel framework designed to enhance molecular property prediction by capturing intricate molecular representations directly from raw data, thus improving accuracy and efficiency. Our methodology combines convolutional neural networks (CNNs) with a BiFormer attention mechanism, employing both the forward-forward algorithm and backpropagation. The model operates in three stages: (1) feature learning, extracting local features from SMILES strings using CNNs; (2) attention refinement, capturing global context with a BiFormer module enhanced by the forward-forward algorithm; and (3) prediction subnetwork tuning, fine-tuning via backpropagation. Evaluations on benchmark datasets—including Tox21, BBBP, SIDER, ClinTox, BACE, HIV, and MUV—show that Deep-CBN achieves near-perfect ROC-AUC scores, significantly outperforming state-of-the-art methods. These findings demonstrate its effectiveness in capturing complex molecular patterns, offering a robust tool to accelerate drug discovery processes.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Molecular Property Prediction BACE Deep-CBN ROC-AUC 83.6 # 7
Molecular Property Prediction BBBP Deep-CBN ROC-AUC 75.8 # 12
Molecular Property Prediction clintox Deep-CBN ROC-AUC 99.2 # 1
Molecular Property Prediction HIV Deep-CBN ROC-AUC 97.3 # 1
Molecular Property Prediction MUV Deep-CBN ROC-AUC 99.8 # 1
Molecular Property Prediction SIDER Deep-CBN ROC-AUC 78.2 # 2
Molecular Property Prediction Tox21 Deep-CBN ROC-AUC 92.4 # 1

Methods


No methods listed for this paper. Add relevant methods here