Search Results for author: Konstantin Schürholt

Found 9 papers, 7 papers with code

Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models

no code implementations26 Apr 2023 Dominik Honegger, Konstantin Schürholt, Damian Borth

With this paper, we address that gap by applying two popular sparsification methods on populations of models (so called model zoos) to create sparsified versions of the original zoos.

Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights

1 code implementation29 Sep 2022 Konstantin Schürholt, Boris Knyazev, Xavier Giró-i-Nieto, Damian Borth

Learning representations of neural network weights given a model zoo is an emerging and challenging area with many potential applications from model inspection, to neural architecture search or knowledge distillation.

Knowledge Distillation Neural Architecture Search +1

Model Zoos: A Dataset of Diverse Populations of Neural Network Models

1 code implementation29 Sep 2022 Konstantin Schürholt, Diyar Taskiran, Boris Knyazev, Xavier Giró-i-Nieto, Damian Borth

With this work, we publish a novel dataset of model zoos containing systematically generated and diverse populations of NN models for further research.

Classification Friction

Hyper-Representations for Pre-Training and Transfer Learning

1 code implementation22 Jul 2022 Konstantin Schürholt, Boris Knyazev, Xavier Giró-i-Nieto, Damian Borth

Learning representations of neural network weights given a model zoo is an emerging and challenging area with many potential applications from model inspection, to neural architecture search or knowledge distillation.

Knowledge Distillation Neural Architecture Search +4

Toward Dynamic Stability Assessment of Power Grid Topologies using Graph Neural Networks

1 code implementation10 Jun 2022 Christian Nauck, Michael Lindner, Konstantin Schürholt, Frank Hellmann

As a testbed for GNN models, we generate new, large datasets of dynamic stability of synthetic power grids, and provide them as an open-source resource to the research community.

Transfer Learning

Predicting Basin Stability of Power Grids using Graph Neural Networks

1 code implementation18 Aug 2021 Christian Nauck, Michael Lindner, Konstantin Schürholt, Haoming Zhang, Paul Schultz, Jürgen Kurths, Ingrid Isenhardt, Frank Hellmann

We investigate the feasibility of applying graph neural networks (GNN) to predict dynamic stability of synchronisation in complex power grids using the single-node basin stability (SNBS) as a measure.

An Investigation of the Weight Space to Monitor the Training Progress of Neural Networks

no code implementations18 Jun 2020 Konstantin Schürholt, Damian Borth

We show that the model trajectories can be separated and the order of checkpoints on the trajectories recovered, which may serve as a first step towards DNN model versioning.

Cannot find the paper you are looking for? You can Submit a new open access paper.