1 code implementation • 31 Aug 2023 • Jan Simson, Florian Pfisterer, Christoph Kern
For each of these universes, we compute metrics of fairness and performance.
no code implementations • 15 Mar 2023 • Hilde Weerts, Florian Pfisterer, Matthias Feurer, Katharina Eggensperger, Edward Bergman, Noor Awad, Joaquin Vanschoren, Mykola Pechenizkiy, Bernd Bischl, Frank Hutter
The field of automated machine learning (AutoML) introduces techniques that automate parts of the development of machine learning (ML) systems, accelerating the process and reducing barriers for novices.
1 code implementation • 8 Dec 2022 • Matthias Feurer, Katharina Eggensperger, Edward Bergman, Florian Pfisterer, Bernd Bischl, Frank Hutter
Modern machine learning models are often constructed taking into account multiple objectives, e. g., minimizing inference time while also maximizing accuracy.
1 code implementation • 30 Jul 2022 • Lennart Schneider, Florian Pfisterer, Paul Kent, Juergen Branke, Bernd Bischl, Janek Thomas
Although considerable progress has been made in the field of multi-objective NAS, we argue that there is some discrepancy between the actual optimization problem of practical interest and the optimization problem that multi-objective NAS tries to solve.
no code implementations • 1 Jul 2022 • Moritz Herrmann, Florian Pfisterer, Fabian Scheipl
Outlier or anomaly detection is an important task in data analysis.
no code implementations • 15 Jun 2022 • Florian Karl, Tobias Pielok, Julia Moosbauer, Florian Pfisterer, Stefan Coors, Martin Binder, Lennart Schneider, Janek Thomas, Jakob Richter, Michel Lang, Eduardo C. Garrido-Merchán, Juergen Branke, Bernd Bischl
Hyperparameter optimization constitutes a large part of typical modern machine learning workflows.
1 code implementation • 26 May 2022 • Raphael Sonabend, Florian Pfisterer, Alan Mishler, Moritz Schauer, Lukas Burk, Sumantrak Mukherjee, Sebastian Vollmer
In this paper we explore how to utilise existing survival metrics to measure bias with group fairness metrics.
1 code implementation • 28 Apr 2022 • Lennart Schneider, Florian Pfisterer, Janek Thomas, Bernd Bischl
The goal of Quality Diversity Optimization is to generate a collection of diverse yet high-performing solutions to a given problem at hand.
1 code implementation • 29 Nov 2021 • Julia Moosbauer, Martin Binder, Lennart Schneider, Florian Pfisterer, Marc Becker, Michel Lang, Lars Kotthoff, Bernd Bischl
Automated hyperparameter optimization (HPO) has gained great popularity and is an important ingredient of most automated machine learning frameworks.
1 code implementation • 8 Sep 2021 • Florian Pfisterer, Lennart Schneider, Julia Moosbauer, Martin Binder, Bernd Bischl
When developing and analyzing new hyperparameter optimization methods, it is vital to empirically evaluate and compare them on well-curated benchmark suites.
no code implementations • ICML Workshop AutoML 2021 • Lennart Schneider, Florian Pfisterer, Martin Binder, Bernd Bischl
Neural architecture search (NAS) promises to make deep learning accessible to non-experts by automating architecture engineering of deep neural networks.
1 code implementation • 10 Jun 2021 • Pieter Gijsbers, Florian Pfisterer, Jan N. van Rijn, Bernd Bischl, Joaquin Vanschoren
Hyperparameter optimization in machine learning (ML) deals with the problem of empirically learning an optimal algorithm configuration from data, usually formulated as a black-box optimization problem.
2 code implementations • 6 Apr 2021 • David Rügamer, Chris Kolb, Cornelius Fritz, Florian Pfisterer, Philipp Kopper, Bernd Bischl, Ruolin Shen, Christina Bukas, Lisa Barros de Andrade e Sousa, Dominik Thalmeier, Philipp Baumann, Lucas Kook, Nadja Klein, Christian L. Müller
In this paper we describe the implementation of semi-structured deep distributional regression, a flexible framework to learn conditional distributions based on the combination of additive regression models and deep networks.
2 code implementations • 1 Apr 2021 • Florian Pargent, Florian Pfisterer, Janek Thomas, Bernd Bischl
Since most machine learning (ML) algorithms are designed for numerical inputs, efficiently encoding categorical variables is a crucial aspect in data analysis.
no code implementations • 4 Nov 2020 • Ashrya Agrawal, Florian Pfisterer, Bernd Bischl, Francois Buet-Golfouse, Srijan Sood, Jiahao Chen, Sameena Shah, Sebastian Vollmer
We present an empirical study of debiasing methods for classifiers, showing that debiasers often fail in practice to generalize out-of-sample, and can in fact make fairness worse rather than better.
no code implementations • 14 Oct 2020 • David Rügamer, Florian Pfisterer, Bernd Bischl
We present neural mixture distributional regression (NMDR), a holistic framework to estimate complex finite mixtures of distributional regressions defined by flexible additive predictors.
1 code implementation • 18 Nov 2019 • Florian Pfisterer, Laura Beggel, Xudong Sun, Fabian Scheipl, Bernd Bischl
In order to assess the methods and implementations, we run a benchmark on a wide variety of representative (time series) data sets, with in-depth analysis of empirical results, and strive to provide a reference ranking for which method(s) to use for non-expert practitioners.
no code implementations • 6 Nov 2019 • Florian Pfisterer, Janek Thomas, Bernd Bischl
Building models from data is an integral part of the majority of data science workflows.
no code implementations • 28 Aug 2019 • Florian Pfisterer, Stefan Coors, Janek Thomas, Bernd Bischl
AutoML systems are currently rising in popularity, as they can build powerful models without human oversight.
1 code implementation • 24 Feb 2019 • Xudong Sun, Andrea Bommert, Florian Pfisterer, Jörg Rahnenführer, Michel Lang, Bernd Bischl
To carry out a clinical research under this scenario, an analyst could train a machine learning model only on local data site, but it is still possible to execute a statistical query at a certain cost in the form of sending a machine learning model to some of the remote data sites and get the performance measures as feedback, maybe due to prediction being usually much cheaper.
no code implementations • 23 Nov 2018 • Florian Pfisterer, Jan N. van Rijn, Philipp Probst, Andreas Müller, Bernd Bischl
The performance of modern machine learning methods highly depends on their hyperparameter configurations.
no code implementations • 18 Sep 2016 • Julia Schiffner, Bernd Bischl, Michel Lang, Jakob Richter, Zachary M. Jones, Philipp Probst, Florian Pfisterer, Mason Gallo, Dominik Kirchhoff, Tobias Kühn, Janek Thomas, Lars Kotthoff
This document provides and in-depth introduction to the mlr framework for machine learning experiments in R.