Search Results for author: Ben Carterette

Found 15 papers, 1 papers with code

Distributionally-Informed Recommender System Evaluation

no code implementations12 Sep 2023 Michael D. Ekstrand, Ben Carterette, Fernando Diaz

Current practice for evaluating recommender systems typically focuses on point estimates of user-oriented effectiveness metrics or business metrics, sometimes combined with additional metrics for considerations such as diversity and novelty.

Recommendation Systems

Report from Dagstuhl Seminar 23031: Frontiers of Information Access Experimentation for Research and Education

no code implementations18 Apr 2023 Christine Bauer, Ben Carterette, Nicola Ferro, Norbert Fuhr

This report documents the program and the outcomes of Dagstuhl Seminar 23031 ``Frontiers of Information Access Experimentation for Research and Education'', which brought together 37 participants from 12 countries.

Information Retrieval Recommendation Systems +2

Podcast Metadata and Content: Episode Relevance andAttractiveness in Ad Hoc Search

no code implementations25 Aug 2021 Ben Carterette, Rosie Jones, Gareth F. Jones, Maria Eskevich, Sravana Reddy, Ann Clifton, Yongze Yu, Jussi Karlgren, Ian Soboroff

We describe a set of diverse podcast information needs and different approaches to assessing retrieved content for relevance.

Current Challenges and Future Directions in Podcast Information Access

no code implementations17 Jun 2021 Rosie Jones, Hamed Zamani, Markus Schedl, Ching-Wei Chen, Sravana Reddy, Ann Clifton, Jussi Karlgren, Helia Hashemi, Aasish Pappu, Zahra Nazari, Longqi Yang, Oguz Semerci, Hugues Bouchard, Ben Carterette

Podcasts are spoken documents across a wide-range of genres and styles, with growing listenership across the world, and a rapidly lowering barrier to entry for both listeners and creators.

Model Selection for Production System via Automated Online Experiments

no code implementations NeurIPS 2020 Zhenwen Dai, Praveen Chandar, Ghazal Fazelnia, Ben Carterette, Mounia Lalmas-Roelleke

A challenge that machine learning practitioners in the industry face is the task of selecting the best model to deploy in production.

Model Selection

Trajectory Based Podcast Recommendation

no code implementations8 Sep 2020 Greg Benton, Ghazal Fazelnia, Alice Wang, Ben Carterette

Podcast recommendation is a growing area of research that presents new challenges and opportunities.

Collaborative Filtering

Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste

no code implementations27 Jul 2020 Zahra Nazari, Christophe Charbuillet, Johan Pages, Martin Laurent, Denis Charrier, Briana Vecchione, Ben Carterette

Recommender systems are increasingly used to predict and serve content that aligns with user taste, yet the task of matching new users with relevant content remains a challenge.

Recommendation Systems

Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions

1 code implementation25 Jul 2020 James McInerney, Brian Brost, Praveen Chandar, Rishabh Mehrotra, Ben Carterette

Users of music streaming, video streaming, news recommendation, and e-commerce services often engage with content in a sequential manner.

counterfactual News Recommendation +2

Evaluating Stochastic Rankings with Expected Exposure

no code implementations27 Apr 2020 Fernando Diaz, Bhaskar Mitra, Michael D. Ekstrand, Asia J. Biega, Ben Carterette

We introduce the concept of \emph{expected exposure} as the average attention ranked items receive from users over repeated samples of the same query.

Information Retrieval Retrieval

Evaluating Search Engines by Modeling the Relationship Between Relevance and Clicks

no code implementations NeurIPS 2007 Ben Carterette, Rosie Jones

We propose a model that leverages the millions of clicks received by web search engines, to predict document relevance.

Cannot find the paper you are looking for? You can Submit a new open access paper.