Search Results for author: Christian Borgelt

Found 12 papers, 7 papers with code

ISAAC Newton: Input-based Approximate Curvature for Newton's Method

1 code implementation1 May 2023 Felix Petersen, Tobias Sutter, Christian Borgelt, Dongsung Huh, Hilde Kuehne, Yuekai Sun, Oliver Deussen

We present ISAAC (Input-baSed ApproximAte Curvature), a novel method that conditions the gradient using selected second-order information and has an asymptotically vanishing computational overhead, assuming a batch size smaller than the number of neurons.

Second-order methods

Deep Differentiable Logic Gate Networks

1 code implementation15 Oct 2022 Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen

Recently, research has increasingly focused on developing efficient neural network architectures.

Efficient Neural Network

Differentiable Top-k Classification Learning

1 code implementation15 Jun 2022 Felix Petersen, Hilde Kuehne, Christian Borgelt, Oliver Deussen

In this work, we relax this assumption and optimize the model for multiple k simultaneously instead of using a single k. Leveraging recent advances in differentiable sorting and ranking, we propose a differentiable top-k cross-entropy classification loss.

General Classification Image Classification

Monotonic Differentiable Sorting Networks

1 code implementation ICLR 2022 Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen

We introduce a family of sigmoid functions and prove that they produce differentiable sorting networks that are monotonic.

Learning with Algorithmic Supervision via Continuous Relaxations

1 code implementation NeurIPS 2021 Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen

The integration of algorithmic components into neural architectures has gained increased attention recently, as it allows training neural networks with new forms of supervision such as ordering constraints or silhouettes instead of using ground truth labels.

A Sampling-Free Approximation of Gaussian Variational Auto-Encoders

no code implementations29 Sep 2021 Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen

We propose a sampling-free approximate formulation of Gaussian variational auto-encoders.

Decoder

Propagating Distributions through Neural Networks

no code implementations29 Sep 2021 Felix Petersen, Christian Borgelt, Mikhail Yurochkin, Hilde Kuehne, Oliver Deussen

We propose a new approach to propagating probability distributions through neural networks.

regression

Differentiable Sorting Networks for Scalable Sorting and Ranking Supervision

1 code implementation9 May 2021 Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen

Sorting and ranking supervision is a method for training neural networks end-to-end based on ordering constraints.

$C^\infty$ Smooth Algorithmic Neural Networks for Solving Inverse Problems

no code implementations NeurIPS Workshop Deep_Invers 2019 Felix Petersen, Christian Borgelt, Oliver Deussen

Artificial neural networks revolutionized many areas of computer science in recent years since they provide solutions to a number of previously unsolved problems.

AlgoNet: $C^\infty$ Smooth Algorithmic Neural Networks

no code implementations16 May 2019 Felix Petersen, Christian Borgelt, Oliver Deussen

These networks integrate smooth versions of classic algorithms into the topology of neural networks.

Cannot find the paper you are looking for? You can Submit a new open access paper.