no code implementations • NAACL (BioNLP) 2021 • Gjorgjina Cenikj, Tome Eftimov, Barbara Koroušić Seljak
The accelerating growth of big data in the biomedical domain, with an endless amount of electronic health records and more than 30 million citations and abstracts in PubMed, introduces the need for automatic structuring of textual biomedical data.
no code implementations • 15 Oct 2024 • Marko Djukanović, Jaume Reixach, Ana Nikolikj, Tome Eftimov, Aleksandar Kartelj, Christian Blum
Building on recent advancements in solving this problem through a general search framework, this paper introduces two novel heuristic approaches designed to enhance the search process by steering it towards promising regions in the search space.
1 code implementation • 18 Jul 2024 • Carolin Benjamins, Gjorgjina Cenikj, Ana Nikolikj, Aditya Mohan, Tome Eftimov, Marius Lindauer
Dynamic Algorithm Configuration (DAC) addresses the challenge of dynamically setting hyperparameters of an algorithm for a diverse set of instances rather than focusing solely on individual tasks.
no code implementations • 8 Jun 2024 • Gjorgjina Cenikj, Ana Nikolikj, Gašper Petelin, Niki van Stein, Carola Doerr, Tome Eftimov
The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem instances.
no code implementations • 20 May 2024 • Ana Nikolikj, Ana Kostovska, Gjorgjina Cenikj, Carola Doerr, Tome Eftimov
This study examines the generalization ability of algorithm performance prediction models across various benchmark suites.
no code implementations • 20 May 2024 • Ana Nikolikj, Ana Kostovska, Diederick Vermetten, Carola Doerr, Tome Eftimov
This study explores the influence of modules on the performance of modular optimization frameworks for continuous single-objective black-box optimization.
no code implementations • 29 Nov 2023 • Gjorgjina Cenikj, Gašper Petelin, Tome Eftimov
We propose a representation of optimization problem instances using a transformer-based neural network architecture trained for the task of problem classification of the 24 problem classes from the Black-box Optimization Benchmarking (BBOB) benchmark.
no code implementations • 14 Oct 2023 • Ana Kostovska, Gjorgjina Cenikj, Diederick Vermetten, Anja Jankovic, Ana Nikolikj, Urban Skvorc, Peter Korosec, Carola Doerr, Tome Eftimov
Our proposed method creates algorithm behavior meta-representations, constructs a graph from a set of algorithms based on their meta-representation similarity, and applies a graph algorithm to select a final portfolio of diverse, representative, and non-redundant algorithms.
no code implementations • 30 Jun 2023 • Ana Kostovska, Anja Jankovic, Diederick Vermetten, Sašo Džeroski, Tome Eftimov, Carola Doerr
Performance complementarity of solvers available to tackle black-box optimization problems gives rise to the important task of algorithm selection (AS).
1 code implementation • 8 Jun 2023 • Gjorgjina Cenikj, Gašper Petelin, Carola Doerr, Peter Korošec, Tome Eftimov
The application of machine learning (ML) models to the analysis of optimization algorithms requires the representation of optimization problems using numerical features.
no code implementations • 1 Jun 2023 • Ana Nikolikj, Sašo Džeroski, Mario Andrés Muñoz, Carola Doerr, Peter Korošec, Tome Eftimov
In black-box optimization, it is essential to understand why an algorithm instance works on a set of problem instances while failing on others and provide explanations of its behavior.
no code implementations • 31 May 2023 • Ana Nikolikj, Gjorgjina Cenikj, Gordana Ispirova, Diederick Vermetten, Ryan Dieter Lang, Andries Petrus Engelbrecht, Carola Doerr, Peter Korošec, Tome Eftimov
A key component of automated algorithm selection and configuration, which in most cases are performed using supervised machine learning (ML) methods is a good-performing predictive model.
no code implementations • 30 May 2023 • Ana Nikolikj, Michal Pluháček, Carola Doerr, Peter Korošec, Tome Eftimov
That is, instead of considering cosine distance in the feature space, we consider a weighted distance measure, with weights depending on the relevance of the feature for the regression model.
no code implementations • 2 Feb 2023 • Gordana Ispirova, Tome Eftimov, Barbara Koroušić Seljak
From the list of ingredients, domain-specific embeddings are created using the same embedding space for all recipes - one ingredient dataset is generated.
no code implementations • 24 Jan 2023 • Ana Kostovska, Diederick Vermetten, Sašo Džeroski, Panče Panov, Tome Eftimov, Carola Doerr
In this work, we evaluate a performance prediction model built on top of the extension of the recently proposed OPTION ontology.
no code implementations • 23 Jan 2023 • Ana Nikolikj, Carola Doerr, Tome Eftimov
Per-instance automated algorithm configuration and selection are gaining significant moments in evolutionary computation in recent years.
no code implementations • 21 Nov 2022 • Ana Kostovska, Carola Doerr, Sašo Džeroski, Dragi Kocev, Panče Panov, Tome Eftimov
To address this algorithm selection problem, we investigate in this work the quality of an automated approach that uses characteristics of the datasets - so-called features - and a trained algorithm selector to choose which algorithm to apply for a given task.
no code implementations • 21 Nov 2022 • Ana Kostovska, Diederick Vermetten, Carola Doerr, Saso Džeroski, Panče Panov, Tome Eftimov
Many optimization algorithm benchmarking platforms allow users to share their experimental data to promote reproducible and reusable research.
no code implementations • 9 Sep 2022 • Risto Trajanov, Ana Nikolikj, Gjorgjina Cenikj, Fabien Teytaud, Mathurin Videau, Olivier Teytaud, Tome Eftimov, Manuel López-Ibáñez, Carola Doerr
Algorithm selection wizards are effective and versatile tools that automatically select an optimization algorithm given high-level information about the problem and available computational resources, such as number and type of decision variables, maximal number of evaluations, possibility to parallelize evaluations, etc.
no code implementations • 25 Apr 2022 • Gjorgjina Cenikj, Ryan Dieter Lang, Andries Petrus Engelbrecht, Carola Doerr, Peter Korošec, Tome Eftimov
Fair algorithm evaluation is conditioned on the existence of high-quality benchmark datasets that are non-redundant and are representative of typical optimization scenarios.
no code implementations • 20 Apr 2022 • Ana Kostovska, Anja Jankovic, Diederick Vermetten, Jacob de Nobel, Hao Wang, Tome Eftimov, Carola Doerr
In contrast to other recent work on online per-run algorithm selection, we warm-start the second optimizer using information accumulated during the first optimization phase.
1 code implementation • 15 Apr 2022 • Ana Kostovska, Diederick Vermetten, Sašo Džeroski, Carola Doerr, Peter Korošec, Tome Eftimov
In addition, we have shown that by using classifiers that take the features relevance on the model accuracy, we are able to predict the status of individual modules in the CMA-ES configurations.
no code implementations • 13 Apr 2022 • Anja Jankovic, Diederick Vermetten, Ana Kostovska, Jacob de Nobel, Tome Eftimov, Carola Doerr
We study the quality and accuracy of performance regression and algorithm selection models in the scenario of predicting different algorithm performances after a fixed budget of function evaluations.
no code implementations • 22 Mar 2022 • Risto Trajanov, Stefan Dimeski, Martin Popovski, Peter Korošec, Tome Eftimov
Predicting the performance of an optimization algorithm on a new problem instance is crucial in order to select the most appropriate algorithm for solving that problem instance.
1 code implementation • 22 Oct 2021 • Risto Trajanov, Stefan Dimeski, Martin Popovski, Peter Korošec, Tome Eftimov
In this study, we are investigating explainable landscape-aware regression models where the contribution of each landscape feature to the prediction of the optimization algorithm performance is estimated on a global and local level.
1 code implementation • 5 Oct 2021 • Gjorgjina Cenikj, Barbara Koroušić Seljak, Tome Eftimov
In this paper, we present FoodChem, a new Relation Extraction (RE) model for identifying chemicals present in the composition of food entities, based on textual information provided in biomedical peer-reviewed scientific literature.
no code implementations • 29 Sep 2021 • Tome Eftimov, Gašper Petelin, Gjorgjina Cenikj, Ana Kostovska, Gordana Ispirova, Peter Korošec, Jasmin Bogatinovski
By observing discrepancy between the empirical results of the bootstrap evaluation and recently adapted practices in TSC literature when introducing novel methods we warn on the potentially harmful effects of tuning the methods on certain parts of the landscape (unless this is an explicit and desired goal of the study).
no code implementations • 27 Apr 2021 • Urban Škvorc, Tome Eftimov, Peter Korošec
When designing a benchmark problem set, it is important to create a set of benchmark problems that are a good generalization of the set of all possible problems.
no code implementations • 24 Apr 2021 • Ana Kostovska, Diederick Vermetten, Carola Doerr, Sašo Džeroski, Panče Panov, Tome Eftimov
Many platforms for benchmarking optimization algorithms offer users the possibility of sharing their experimental data with the purpose of promoting reproducible and reusable research.
no code implementations • 22 Apr 2021 • Tome Eftimov, Anja Jankovic, Gorjan Popovski, Carola Doerr, Peter Korošec
Accurately predicting the performance of different optimization algorithms for previously unseen problem instances is crucial for high-performing algorithm selection and configuration techniques.
no code implementations • 19 Apr 2021 • Anja Jankovic, Gorjan Popovski, Tome Eftimov, Carola Doerr
By comparing a total number of 30 different models, each coupled with 2 complementary regression strategies, we derive guidelines for the tuning of the regression models and provide general recommendations for a more systematic use of classical machine learning models in landscape-aware algorithm selection.
no code implementations • 10 Feb 2021 • Anja Jankovic, Tome Eftimov, Carola Doerr
The evaluation of these points is costly, and the benefit of an ELA-based algorithm selection over a default algorithm must therefore be significant in order to pay off.
1 code implementation • 1 Dec 2020 • Hao Wang, Carlos Igncio Hernández Castellanos, Tome Eftimov
Assessing the empirical performance of Multi-Objective Evolutionary Algorithms (MOEAs) is vital when we extensively test a set of MOEAs and aim to determine a proper ranking thereof.
no code implementations • 30 Sep 2020 • Tome Eftimov, Gorjan Popovski, Quentin Renau, Peter Korosec, Carola Doerr
Automated per-instance algorithm selection and configuration have shown promising performances for a number of classic optimization problems, including satisfiability, AI planning, and TSP.
no code implementations • 7 Jul 2020 • Thomas Bartz-Beielstein, Carola Doerr, Daan van den Berg, Jakob Bossek, Sowmya Chandrasekaran, Tome Eftimov, Andreas Fischbach, Pascal Kerschke, William La Cava, Manuel Lopez-Ibanez, Katherine M. Malan, Jason H. Moore, Boris Naujoks, Patryk Orzechowski, Vanessa Volz, Markus Wagner, Thomas Weise
This survey compiles ideas and recommendations from more than a dozen researchers with different backgrounds and from different institutes around the world.
1 code implementation • 19 Jul 2019 • Khushbu Agarwal, Tome Eftimov, Raghavendra Addanki, Sutanay Choudhury, Suzanne Tamang, Robert Rallo
Representation learning methods that transform encoded data (e. g., diagnosis and drug codes) into continuous vector spaces (i. e., vector embeddings) are critical for the application of deep learning in healthcare.
no code implementations • 27 May 2019 • Maulik R. Kamdar, Tymor Hamamsy, Shea Shelton, Ayin Vala, Tome Eftimov, James Zou, Suzanne Tamang
Statistical learning methods that use data from multiple clinical centers across the US to detect opioid over-prescribing trends and predict possible opioid misuse are required.