# Penalty Method for Inversion-Free Deep Bilevel Optimization

8 Nov 2019Akshay MehraJihun Hamm

Bilevel optimization problems are at the center of several important machine learning problems such as hyperparameter tuning, data denoising, meta- and few-shot learning, data poisoning. Different from simultaneous or multi-objective optimization, bilevel optimization requires computing the inverse of the Hessian of the lower-level cost function to obtain the exact descent direction for the upper-level cost... (read more)

PDF Abstract