About

Bilevel Optimization is a branch of optimization, which contains a nested optimization problem within the constraints of the outer optimization problem. The outer optimization task is usually referred as the upper level task, and the nested inner optimization task is referred as the lower level task. The lower level problem appears as a constraint, such that only an optimal solution to the lower level optimization problem is a possible feasible candidate to the upper level optimization problem.

Source: Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization

Benchmarks

No evaluation results yet. Help compare methods by submit evaluation metrics.

Greatest papers with code

OptNet: Differentiable Optimization as a Layer in Neural Networks

ICML 2017 Kyubyong/sudoku

This paper presents OptNet, a network architecture that integrates optimization problems (here, specifically in the form of quadratic programs) as individual layers in larger end-to-end trainable deep networks.

BILEVEL OPTIMIZATION

Truncated Back-propagation for Bilevel Optimization

25 Oct 2018lucfra/FAR-HO

Bilevel optimization has been recently revisited for designing and analyzing algorithms in hyperparameter tuning and meta learning tasks.

BILEVEL OPTIMIZATION META-LEARNING

MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation

CVPR 2020 chaoyanghe/MiLeNAS

To remedy this, this paper proposes \mldas, a mixed-level reformulation for NAS that can be optimized efficiently and reliably.

BILEVEL OPTIMIZATION NEURAL ARCHITECTURE SEARCH

MetaPoison: Practical General-purpose Clean-label Data Poisoning

NeurIPS 2020 JonasGeiping/poisoning-gradient-matching

Existing attacks for data poisoning neural networks have relied on hand-crafted heuristics, because solving the poisoning problem directly via bilevel optimization is generally thought of as intractable for deep models.

AUTOML BILEVEL OPTIMIZATION DATA POISONING META-LEARNING

Implicit differentiation for fast hyperparameter selection in non-smooth convex learning

4 May 2021QB3/sparse-ho

Finding the optimal hyperparameters of a model can be cast as a bilevel optimization problem, typically solved using zero-order techniques.

BILEVEL OPTIMIZATION HYPERPARAMETER OPTIMIZATION

Adaptive Personalized Federated Learning

30 Mar 2020MLOPTPSU/FedTorch

Investigation of the degree of personalization in federated learning algorithms has shown that only maximizing the performance of the global model will confine the capacity of the local models to personalize.

BILEVEL OPTIMIZATION PERSONALIZED FEDERATED LEARNING