Search Results for author: Ana Kostovska

Found 13 papers, 1 papers with code

PS-AAS: Portfolio Selection for Automated Algorithm Selection in Black-Box Optimization

no code implementations14 Oct 2023 Ana Kostovska, Gjorgjina Cenikj, Diederick Vermetten, Anja Jankovic, Ana Nikolikj, Urban Skvorc, Peter Korosec, Carola Doerr, Tome Eftimov

Our proposed method creates algorithm behavior meta-representations, constructs a graph from a set of algorithms based on their meta-representation similarity, and applies a graph algorithm to select a final portfolio of diverse, representative, and non-redundant algorithms.

Comparing Algorithm Selection Approaches on Black-Box Optimization Problems

no code implementations30 Jun 2023 Ana Kostovska, Anja Jankovic, Diederick Vermetten, Sašo Džeroski, Tome Eftimov, Carola Doerr

Performance complementarity of solvers available to tackle black-box optimization problems gives rise to the important task of algorithm selection (AS).

FAIRification of MLC data

no code implementations23 Nov 2022 Ana Kostovska, Jasmin Bogatinovski, Andrej Treven, Sašo Džeroski, Dragi Kocev, Panče Panov

The multi-label classification (MLC) task has increasingly been receiving interest from the machine learning (ML) community, as evidenced by the growing number of papers and methods that appear in the literature.

Benchmarking Management +1

Explainable Model-specific Algorithm Selection for Multi-Label Classification

no code implementations21 Nov 2022 Ana Kostovska, Carola Doerr, Sašo Džeroski, Dragi Kocev, Panče Panov, Tome Eftimov

To address this algorithm selection problem, we investigate in this work the quality of an automated approach that uses characteristics of the datasets - so-called features - and a trained algorithm selector to choose which algorithm to apply for a given task.

Classification Multi-Label Classification

OPTION: OPTImization Algorithm Benchmarking ONtology

no code implementations21 Nov 2022 Ana Kostovska, Diederick Vermetten, Carola Doerr, Saso Džeroski, Panče Panov, Tome Eftimov

Many optimization algorithm benchmarking platforms allow users to share their experimental data to promote reproducible and reusable research.

Benchmarking Data Integration

Discover the Mysteries of the Maya: Selected Contributions from the Machine Learning Challenge & The Discovery Challenge Workshop at ECML PKDD 2021

no code implementations5 Aug 2022 Dragi Kocev, Nikola Simidjievski, Ana Kostovska, Ivica Dimitrovski, Žiga Kokalj

The volume contains selected contributions from the Machine Learning Challenge "Discover the Mysteries of the Maya", presented at the Discovery Challenge Track of The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD 2021).

BIG-bench Machine Learning Image Segmentation +1

Per-run Algorithm Selection with Warm-starting using Trajectory-based Features

no code implementations20 Apr 2022 Ana Kostovska, Anja Jankovic, Diederick Vermetten, Jacob de Nobel, Hao Wang, Tome Eftimov, Carola Doerr

In contrast to other recent work on online per-run algorithm selection, we warm-start the second optimizer using information accumulated during the first optimization phase.

Time Series Analysis

The Importance of Landscape Features for Performance Prediction of Modular CMA-ES Variants

1 code implementation15 Apr 2022 Ana Kostovska, Diederick Vermetten, Sašo Džeroski, Carola Doerr, Peter Korošec, Tome Eftimov

In addition, we have shown that by using classifiers that take the features relevance on the model accuracy, we are able to predict the status of individual modules in the CMA-ES configurations.

regression

Trajectory-based Algorithm Selection with Warm-starting

no code implementations13 Apr 2022 Anja Jankovic, Diederick Vermetten, Ana Kostovska, Jacob de Nobel, Tome Eftimov, Carola Doerr

We study the quality and accuracy of performance regression and algorithm selection models in the scenario of predicting different algorithm performances after a fixed budget of function evaluations.

regression

Less is more: Selecting the right benchmarking set of data for time series classification

no code implementations29 Sep 2021 Tome Eftimov, Gašper Petelin, Gjorgjina Cenikj, Ana Kostovska, Gordana Ispirova, Peter Korošec, Jasmin Bogatinovski

By observing discrepancy between the empirical results of the bootstrap evaluation and recently adapted practices in TSC literature when introducing novel methods we warn on the potentially harmful effects of tuning the methods on certain parts of the landscape (unless this is an explicit and desired goal of the study).

Benchmarking Time Series +2

OPTION: OPTImization Algorithm Benchmarking ONtology

no code implementations24 Apr 2021 Ana Kostovska, Diederick Vermetten, Carola Doerr, Sašo Džeroski, Panče Panov, Tome Eftimov

Many platforms for benchmarking optimization algorithms offer users the possibility of sharing their experimental data with the purpose of promoting reproducible and reusable research.

Benchmarking Data Integration

Cannot find the paper you are looking for? You can Submit a new open access paper.