Search Results for author: Garrett Bingham

Found 8 papers, 3 papers with code

Optimizing Neural Networks through Activation Function Discovery and Automatic Weight Initialization

1 code implementation6 Apr 2023 Garrett Bingham

While present methods focus on hyperparameters and neural network topologies, other aspects of neural network design can be optimized as well.

AutoML

Efficient Activation Function Optimization through Surrogate Modeling

2 code implementations NeurIPS 2023 Garrett Bingham, Risto Miikkulainen

Second, a characterization of the benchmark space was developed, leading to a new surrogate-based method for optimization.

AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks

1 code implementation18 Sep 2021 Garrett Bingham, Risto Miikkulainen

By analytically tracking the mean and variance of signals as they propagate through the network, AutoInit appropriately scales the weights at each layer to avoid exploding or vanishing signals.

Meta-Learning Neural Architecture Search +1

Discovering Parametric Activation Functions

no code implementations5 Jun 2020 Garrett Bingham, Risto Miikkulainen

Recent studies have shown that the choice of activation function can significantly affect the performance of deep learning networks.

Image Classification

Evolutionary Optimization of Deep Learning Activation Functions

no code implementations17 Feb 2020 Garrett Bingham, William Macke, Risto Miikkulainen

The choice of activation function can have a large effect on the performance of a neural network.

Evolutionary Algorithms

Preliminary Studies on a Large Face Database

no code implementations15 Nov 2018 Benjamin Yip, Garrett Bingham, Katherine Kempfert, Jonathan Fabish, Troy Kling, Cuixian Chen, Yishi Wang

We perform preliminary studies on a large longitudinal face database MORPH-II, which is a benchmark dataset in the field of computer vision and pattern recognition.

Age Estimation General Classification +1

Random Subspace Two-dimensional LDA for Face Recognition

no code implementations2 Nov 2017 Garrett Bingham

In this paper, a novel technique named random subspace two-dimensional LDA (RS-2DLDA) is developed for face recognition.

Face Recognition MORPH +1

Cannot find the paper you are looking for? You can Submit a new open access paper.