no code implementations • 21 Sep 2023 • Ngozi Ihemelandu, Michael D. Ekstrand
The strategy for selecting candidate sets -- the set of items that the recommendation system is expected to rank for each user -- is an important decision in carrying out an offline top-$N$ recommender system evaluation.
no code implementations • 3 May 2023 • Ngozi Ihemelandu, Michael D. Ekstrand
However, these studies are focused on TREC-style experiments, which typically have fewer than 100 topics.
no code implementations • 14 Sep 2021 • Ngozi Ihemelandu, Michael D. Ekstrand
In this paper, we argue that the use of statistical inference is a key component of the evaluation process that has not been given sufficient attention.