Search Results for author: Peter Korošec

Found 11 papers, 3 papers with code

DynamoRep: Trajectory-Based Population Dynamics for Classification of Black-box Optimization Problems

1 code implementation8 Jun 2023 Gjorgjina Cenikj, Gašper Petelin, Carola Doerr, Peter Korošec, Tome Eftimov

The application of machine learning (ML) models to the analysis of optimization algorithms requires the representation of optimization problems using numerical features.

Benchmarking Descriptive

Algorithm Instance Footprint: Separating Easily Solvable and Challenging Problem Instances

no code implementations1 Jun 2023 Ana Nikolikj, Sašo Džeroski, Mario Andrés Muñoz, Carola Doerr, Peter Korošec, Tome Eftimov

In black-box optimization, it is essential to understand why an algorithm instance works on a set of problem instances while failing on others and provide explanations of its behavior.

Assessing the Generalizability of a Performance Predictive Model

no code implementations31 May 2023 Ana Nikolikj, Gjorgjina Cenikj, Gordana Ispirova, Diederick Vermetten, Ryan Dieter Lang, Andries Petrus Engelbrecht, Carola Doerr, Peter Korošec, Tome Eftimov

A key component of automated algorithm selection and configuration, which in most cases are performed using supervised machine learning (ML) methods is a good-performing predictive model.

Sensitivity Analysis of RF+clust for Leave-one-problem-out Performance Prediction

no code implementations30 May 2023 Ana Nikolikj, Michal Pluháček, Carola Doerr, Peter Korošec, Tome Eftimov

That is, instead of considering cosine distance in the feature space, we consider a weighted distance measure, with weights depending on the relevance of the feature for the regression model.

regression

SELECTOR: Selecting a Representative Benchmark Suite for Reproducible Statistical Comparison

no code implementations25 Apr 2022 Gjorgjina Cenikj, Ryan Dieter Lang, Andries Petrus Engelbrecht, Carola Doerr, Peter Korošec, Tome Eftimov

Fair algorithm evaluation is conditioned on the existence of high-quality benchmark datasets that are non-redundant and are representative of typical optimization scenarios.

The Importance of Landscape Features for Performance Prediction of Modular CMA-ES Variants

1 code implementation15 Apr 2022 Ana Kostovska, Diederick Vermetten, Sašo Džeroski, Carola Doerr, Peter Korošec, Tome Eftimov

In addition, we have shown that by using classifiers that take the features relevance on the model accuracy, we are able to predict the status of individual modules in the CMA-ES configurations.

regression

Explainable Landscape Analysis in Automated Algorithm Performance Prediction

no code implementations22 Mar 2022 Risto Trajanov, Stefan Dimeski, Martin Popovski, Peter Korošec, Tome Eftimov

Predicting the performance of an optimization algorithm on a new problem instance is crucial in order to select the most appropriate algorithm for solving that problem instance.

Explainable Landscape-Aware Optimization Performance Prediction

1 code implementation22 Oct 2021 Risto Trajanov, Stefan Dimeski, Martin Popovski, Peter Korošec, Tome Eftimov

In this study, we are investigating explainable landscape-aware regression models where the contribution of each landscape feature to the prediction of the optimization algorithm performance is estimated on a global and local level.

Less is more: Selecting the right benchmarking set of data for time series classification

no code implementations29 Sep 2021 Tome Eftimov, Gašper Petelin, Gjorgjina Cenikj, Ana Kostovska, Gordana Ispirova, Peter Korošec, Jasmin Bogatinovski

By observing discrepancy between the empirical results of the bootstrap evaluation and recently adapted practices in TSC literature when introducing novel methods we warn on the potentially harmful effects of tuning the methods on certain parts of the landscape (unless this is an explicit and desired goal of the study).

Benchmarking Time Series +2

A Complementarity Analysis of the COCO Benchmark Problems and Artificially Generated Problems

no code implementations27 Apr 2021 Urban Škvorc, Tome Eftimov, Peter Korošec

When designing a benchmark problem set, it is important to create a set of benchmark problems that are a good generalization of the set of all possible problems.

Benchmarking

Personalizing Performance Regression Models to Black-Box Optimization Problems

no code implementations22 Apr 2021 Tome Eftimov, Anja Jankovic, Gorjan Popovski, Carola Doerr, Peter Korošec

Accurately predicting the performance of different optimization algorithms for previously unseen problem instances is crucial for high-performing algorithm selection and configuration techniques.

regression

Cannot find the paper you are looking for? You can Submit a new open access paper.