1 code implementation • 3 May 2024 • Olivier Jeunen, Jatin Mandav, Ivan Potapov, Nakul Agarwal, Sourabh Vaid, Wenzhe Shi, Aleksei Ustimenko
We frame this as a decision-making task, where the scalarisation weights are actions taken to maximise an overall North Star reward (e. g. long-term user retention or growth).
1 code implementation • 27 Jul 2023 • Olivier Jeunen, Ivan Potapov, Aleksei Ustimenko
Through a correlation analysis between off- and on-line experiments conducted on a large-scale recommendation platform, we show that our unbiased DCG estimates strongly correlate with online reward, even when some of the metric's inherent assumptions are violated.