no code implementations • 13 Jul 2023 • Mara Graziani, Laura O' Mahony, An-phi Nguyen, Henning Müller, Vincent Andrearczyk
By decomposing the latent space of a layer in singular vectors and refining them by unsupervised clustering, we uncover concept vectors aligned with directions of high variance that are relevant to the model prediction, and that point to semantically distinct concepts.