A Detailed Study of Interpretability of Deep Neural Network based Top Taggers

1 code implementation • 9 Oct 2022 • Ayush Khot, Mark S. Neubauer, Avik Roy

We additionally illustrate the activity of hidden layers as Neural Activation Pattern (NAP) diagrams and demonstrate how they can be used to understand how DNNs relay information across the layers and how this understanding can help to make such models significantly simpler by allowing effective model reoptimization and hyperparameter tuning.

Explainable Artificial Intelligence (XAI) Feature Importance