Search Results for author:
Found 15 papers, 6 papers with code
Analyzing the Impact of Undersampling on the Benchmarking and Configuration of Evolutionary Algorithms
Particularly, we show that the number of runs used in many benchmarking studies, e. g., the default value of 15 suggested by the COCO environment, can be insufficient to reliably rank algorithms on well-known numerical optimization benchmarks.
Per-run Algorithm Selection with Warm-starting using Trajectory-based Features
In contrast to other recent work on online per-run algorithm selection, we warm-start the second optimizer using information accumulated during the first optimization phase.
The Importance of Landscape Features for Performance Prediction of Modular CMA-ES Variants
In addition, we have shown that by using classifiers that take the features relevance on the model accuracy, we are able to predict the status of individual modules in the CMA-ES configurations.
Trajectory-based Algorithm Selection with Warm-starting
We study the quality and accuracy of performance regression and algorithm selection models in the scenario of predicting different algorithm performances after a fixed budget of function evaluations.
Chaining of Numerical Black-box Algorithms: Warm-Starting and Switching Points
Lastly, with a sensitivity analysis, we find the actual performance gain is hugely affected by the switching point, and in some cases, the switching point yielding the best actual performance differs from the one computed from the theoretical gain.
The importance of being constrained: dealing with infeasible solutions in Differential Evolution and beyond
Here, we demonstrate that, at least in algorithms based on Differential Evolution, this choice induces notably different behaviours - in terms of performance, disruptiveness and population diversity.
IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristics
IOHexperimenter can be used as a stand-alone tool or as part of a benchmarking pipeline that uses other components of IOHprofiler such as IOHanalyzer, the module for interactive performance analysis and visualization.
Is there Anisotropy in Structural Bias?
We find that anisotropy is very rare, and even in cases where it is present, there are clear tests for SB which do not rely on any assumptions of isotropy, so we can safely expand the suite of SB tests to encompass these kinds of deficiencies not found by the original tests.
OPTION: OPTImization Algorithm Benchmarking ONtology
Many platforms for benchmarking optimization algorithms offer users the possibility of sharing their experimental data with the purpose of promoting reproducible and reusable research.
Tuning as a Means of Assessing the Benefits of New Ideas in Interplay with Existing Algorithmic Modules
However, when introducing a new component into an existing algorithm, assessing its potential benefits is a challenging task.
Squirrel: A Switching Hyperparameter Optimizer
In this short note, we describe our submission to the NeurIPS 2020 BBO challenge.
IOHanalyzer: Detailed Performance Analyses for Iterative Optimization Heuristics
An R programming interface is provided for users preferring to have a finer control over the implemented functionalities.
Towards Dynamic Algorithm Selection for Numerical Black-Box Optimization: Investigating BBOB as a Use Case
One of the most challenging problems in evolutionary computation is to select from its family of diverse solvers one that performs well on a given problem.
Sequential vs. Integrated Algorithm Selection and Configuration: A Case Study for the Modular CMA-ES
In this work we compare sequential and integrated algorithm selection and configuration approaches for the case of selecting and tuning the best out of 4608 variants of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) tested on the Black Box Optimization Benchmark (BBOB) suite.
Online Selection of CMA-ES Variants
An analysis of module activation indicates which modules are most crucial for the different phases of optimizing each of the 24 benchmark problems.
