1 code implementation • 5 Dec 2023 • Max Klabunde, Mehdi Ben Amor, Michael Granitzer, Florian Lemmerich
Understanding the similarity of the numerous released large language models (LLMs) has many uses, e. g., simplifying model selection, detecting illegal model reuse, and advancing our understanding of what makes LLMs perform well.
1 code implementation • 10 May 2023 • Max Klabunde, Tobias Schumacher, Markus Strohmaier, Florian Lemmerich
Measuring similarity of neural networks to understand and improve their behavior has become an issue of great importance and research interest.
1 code implementation • 20 May 2022 • Max Klabunde, Florian Lemmerich
Instability of trained models, i. e., the dependence of individual node predictions on random factors, can affect reproducibility, reliability, and trust in machine learning systems.
2 code implementations • 20 May 2020 • Tobias Schumacher, Hinrikus Wolf, Martin Ritzert, Florian Lemmerich, Jan Bachmann, Florian Frantzen, Max Klabunde, Martin Grohe, Markus Strohmaier
We systematically evaluate the (in-)stability of state-of-the-art node embedding algorithms due to randomness, i. e., the random variation of their outcomes given identical algorithms and graphs.