Search Results for author: Adeel Pervez

Found 7 papers, 1 papers with code

Low Bias Low Variance Gradient Estimates for Hierarchical Boolean Stochastic Networks

no code implementations ICML 2020 Adeel Pervez, Taco Cohen, Efstratios Gavves

Stochastic neural networks with discrete random variables are an important class of models for their expressiveness and interpretability.

Mechanistic Neural Networks for Scientific Machine Learning

1 code implementation20 Feb 2024 Adeel Pervez, Francesco Locatello, Efstratios Gavves

This paper presents Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences.

Differentiable Mathematical Programming for Object-Centric Representation Learning

no code implementations5 Oct 2022 Adeel Pervez, Phillip Lippe, Efstratios Gavves

To solve the graph cuts our solution relies on an efficient, scalable, and differentiable quadratic programming approximation.

Object Object Discovery +1

Stability Regularization for Discrete Representation Learning

no code implementations ICLR 2022 Adeel Pervez, Efstratios Gavves

Stability regularization is method to make the output of continuous functions of Gaussian random variables close to discrete, that is binary or categorical, without the need for significant manual tuning.

Representation Learning

Variance Reduction in Hierarchical Variational Autoencoders

no code implementations1 Jan 2021 Adeel Pervez, Efstratios Gavves

Variational autoencoders with deep hierarchies of stochastic layers have been known to suffer from the problem of posterior collapse, where the top layers fall back to the prior and become independent of input.

Low Bias Gradient Estimates for Very Deep Boolean Stochastic Networks

no code implementations25 Sep 2019 Adeel Pervez, Taco Cohen, Efstratios Gavves

In this work we focus on stochastic networks with multiple layers of Boolean latent variables.

A Fourier View of REINFORCE

no code implementations12 Aug 2018 Adeel Pervez

We show a connection between the Fourier spectrum of Boolean functions and the REINFORCE gradient estimator for binary latent variable models.

Cannot find the paper you are looking for? You can Submit a new open access paper.