Revealing the Utilized Rank of Subspaces of Learning in Neural Networks

no code implementations • 5 Jul 2024 • Isha Garg, Christian Koguchi, Eshan Verma, Daniel Ulbricht

In our findings, we conclude that most models utilize a fraction of the available space.