no code implementations • 10 Sep 2024 • Teresa Dorszewski, Lenka Tětková, Lorenz Linhardt, Lars Kai Hansen
Understanding how neural networks align with human cognitive processes is a crucial step toward developing more interpretable and reliable AI systems.
no code implementations • 10 Sep 2024 • Teresa Dorszewski, Albert Kjøller Jacobsen, Lenka Tětková, Lars Kai Hansen
Our findings reveal a block-like structure of high similarity, suggesting two main processing steps and significant redundancy of layers.
no code implementations • 16 Aug 2024 • Teresa Dorszewski, Lenka Tětková, Lars Kai Hansen
Recent work has shown that there is significant redundancy in the transformer models for NLP and massive layer pruning is feasible (Sajjad et al., 2023).