no code implementations • 13 Feb 2024 • Felix Petersen, Aashwin Mishra, Hilde Kuehne, Christian Borgelt, Oliver Deussen, Mikhail Yurochkin
We propose a new approach for propagating stable probability distributions through neural networks.
1 code implementation • 1 May 2023 • Felix Petersen, Tobias Sutter, Christian Borgelt, Dongsung Huh, Hilde Kuehne, Yuekai Sun, Oliver Deussen
We present ISAAC (Input-baSed ApproximAte Curvature), a novel method that conditions the gradient using selected second-order information and has an asymptotically vanishing computational overhead, assuming a batch size smaller than the number of neurons.
1 code implementation • 15 Oct 2022 • Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen
Recently, research has increasingly focused on developing efficient neural network architectures.
1 code implementation • 15 Jun 2022 • Felix Petersen, Hilde Kuehne, Christian Borgelt, Oliver Deussen
In this work, we relax this assumption and optimize the model for multiple k simultaneously instead of using a single k. Leveraging recent advances in differentiable sorting and ranking, we propose a differentiable top-k cross-entropy classification loss.
Ranked #58 on Image Classification on ImageNet
1 code implementation • CVPR 2022 • Felix Petersen, Bastian Goldluecke, Christian Borgelt, Oliver Deussen
In this work, we present and study a generalized family of differentiable renderers.
1 code implementation • ICLR 2022 • Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen
We introduce a family of sigmoid functions and prove that they produce differentiable sorting networks that are monotonic.
1 code implementation • NeurIPS 2021 • Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen
The integration of algorithmic components into neural architectures has gained increased attention recently, as it allows training neural networks with new forms of supervision such as ordering constraints or silhouettes instead of using ground truth labels.
no code implementations • 29 Sep 2021 • Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen
We propose a sampling-free approximate formulation of Gaussian variational auto-encoders.
no code implementations • 29 Sep 2021 • Felix Petersen, Christian Borgelt, Mikhail Yurochkin, Hilde Kuehne, Oliver Deussen
We propose a new approach to propagating probability distributions through neural networks.
1 code implementation • 9 May 2021 • Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen
Sorting and ranking supervision is a method for training neural networks end-to-end based on ordering constraints.
no code implementations • NeurIPS Workshop Deep_Invers 2019 • Felix Petersen, Christian Borgelt, Oliver Deussen
Artificial neural networks revolutionized many areas of computer science in recent years since they provide solutions to a number of previously unsolved problems.
no code implementations • 16 May 2019 • Felix Petersen, Christian Borgelt, Oliver Deussen
These networks integrate smooth versions of classic algorithms into the topology of neural networks.