no code implementations • 5 Oct 2023 • Philipp Schaer, Johann Schaible, Leyla Jael Castro
Meta-evaluation studies of system performances in controlled offline evaluation campaigns, like TREC and CLEF, show a need for innovation in evaluating IR-systems.
no code implementations • 24 Oct 2022 • Timo Breuer, Narges Tavakolpoursaleh, Johann Schaible, Daniel Hienert, Philipp Schaer, Leyla Jael Castro
Involving users in early phases of software development has become a common strategy as it enables developers to consider user needs from the beginning.
1 code implementation • 10 Mar 2022 • Philipp Schaer, Timo Breuer, Leyla Jael Castro, Benjamin Wolff, Johann Schaible, Narges Tavakolpoursaleh
The evaluation of results and a meta-analysis of the different tasks and submission types complement this overview.