Efficient hyperparameter optimization by way of PAC-Bayes bound minimization

1 code implementation • 14 Aug 2020 • John J. Cherian, Andrew G. Taube, Robert T. McGibbon, Panagiotis Angelikopoulos, Guy Blanc, Michael Snarski, Daniel D. Richman, John L. Klepeis, David E. Shaw

Identifying optimal values for a high-dimensional set of hyperparameters is a problem that has received growing attention given its importance to large-scale machine learning applications such as neural architecture search.

Hyperparameter Optimization Neural Architecture Search