no code implementations • 12 Sep 2023 • Michael D. Ekstrand, Ben Carterette, Fernando Diaz
Current practice for evaluating recommender systems typically focuses on point estimates of user-oriented effectiveness metrics or business metrics, sometimes combined with additional metrics for considerations such as diversity and novelty.
no code implementations • 18 Apr 2023 • Christine Bauer, Ben Carterette, Nicola Ferro, Norbert Fuhr
This report documents the program and the outcomes of Dagstuhl Seminar 23031 ``Frontiers of Information Access Experimentation for Research and Education'', which brought together 37 participants from 12 countries.
no code implementations • 25 Aug 2021 • Ben Carterette, Rosie Jones, Gareth F. Jones, Maria Eskevich, Sravana Reddy, Ann Clifton, Yongze Yu, Jussi Karlgren, Ian Soboroff
We describe a set of diverse podcast information needs and different approaches to assessing retrieved content for relevance.
no code implementations • 11 Aug 2021 • Ömer Kırnap, Fernando Diaz, Asia Biega, Michael Ekstrand, Ben Carterette, Emine Yilmaz
There is increasing attention to evaluating the fairness of search system ranking decisions.
no code implementations • 17 Jun 2021 • Rosie Jones, Hamed Zamani, Markus Schedl, Ching-Wei Chen, Sravana Reddy, Ann Clifton, Jussi Karlgren, Helia Hashemi, Aasish Pappu, Zahra Nazari, Longqi Yang, Oguz Semerci, Hugues Bouchard, Ben Carterette
Podcasts are spoken documents across a wide-range of genres and styles, with growing listenership across the world, and a rapidly lowering barrier to entry for both listeners and creators.
no code implementations • NeurIPS 2020 • Zhenwen Dai, Praveen Chandar, Ghazal Fazelnia, Ben Carterette, Mounia Lalmas-Roelleke
A challenge that machine learning practitioners in the industry face is the task of selecting the best model to deploy in production.
no code implementations • 29 Mar 2021 • Rosie Jones, Ben Carterette, Ann Clifton, Maria Eskevich, Gareth J. F. Jones, Jussi Karlgren, Aasish Pappu, Sravana Reddy, Yongze Yu
The Podcast Track is new at the Text Retrieval Conference (TREC) in 2020.
no code implementations • COLING 2020 • Ann Clifton, Sravana Reddy, Yongze Yu, Aasish Pappu, Rezvaneh Rezapour, Hamed Bonab, Maria Eskevich, Gareth Jones, Jussi Karlgren, Ben Carterette, Rosie Jones
Paired with the audio files, they are also a resource for speech processing and the study of paralinguistic, sociolinguistic, and acoustic aspects of the domain.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +3
no code implementations • 8 Sep 2020 • Greg Benton, Ghazal Fazelnia, Alice Wang, Ben Carterette
Podcast recommendation is a growing area of research that presents new challenges and opportunities.
no code implementations • 27 Jul 2020 • Zahra Nazari, Christophe Charbuillet, Johan Pages, Martin Laurent, Denis Charrier, Briana Vecchione, Ben Carterette
Recommender systems are increasingly used to predict and serve content that aligns with user taste, yet the task of matching new users with relevant content remains a challenge.
1 code implementation • 25 Jul 2020 • James McInerney, Brian Brost, Praveen Chandar, Rishabh Mehrotra, Ben Carterette
Users of music streaming, video streaming, news recommendation, and e-commerce services often engage with content in a sequential manner.
no code implementations • 27 Apr 2020 • Fernando Diaz, Bhaskar Mitra, Michael D. Ekstrand, Asia J. Biega, Ben Carterette
We introduce the concept of \emph{expected exposure} as the average attention ranked items receive from users over repeated samples of the same query.
no code implementations • 8 Apr 2020 • Ann Clifton, Aasish Pappu, Sravana Reddy, Yongze Yu, Jussi Karlgren, Ben Carterette, Rosie Jones
Podcasts are a relatively new form of audio media.
no code implementations • NeurIPS 2007 • Ben Carterette, Rosie Jones
We propose a model that leverages the millions of clicks received by web search engines, to predict document relevance.