Neural Networks as Paths through the Space of Representations

no code implementations • 22 Jun 2022 • Richard D. Lange, Devin Kwok, Jordan Matelsky, Xinyue Wang, David S. Rolnick, Konrad P. Kording

Deep neural networks implement a sequence of layer-by-layer operations that are each relatively easy to understand, but the resulting overall computation is generally difficult to understand.

Clustering units in neural networks: upstream vs downstream information

1 code implementation • 22 Mar 2022 • Richard D. Lange, David S. Rolnick, Konrad P. Kording

However, defining and quantifying modularity remains an open problem.

Clustering Disentanglement