Evaluating recommender systems: survey and framework

E Zangerle, C Bauer - ACM Computing Surveys, 2022 - dl.acm.org
The comprehensive evaluation of the performance of a recommender system is a complex
endeavor: many facets need to be considered in configuring an adequate and effective …

Elliot: A comprehensive and rigorous framework for reproducible recommender systems evaluation

VW Anelli, A Bellogín, A Ferrara, D Malitesta… - Proceedings of the 44th …, 2021 - dl.acm.org
Recommender Systems have shown to be an effective way to alleviate the over-choice
problem and provide accurate and tailored recommendations. However, the impressive …

Evaluating stochastic rankings with expected exposure

F Diaz, B Mitra, MD Ekstrand, AJ Biega… - Proceedings of the 29th …, 2020 - dl.acm.org
We introduce the concept of expected exposure as the average attention ranked items
receive from users over repeated samples of the same query. Furthermore, we advocate for …

Measuring fairness in ranked results: an analytical and empirical comparison

A Raj, MD Ekstrand - Proceedings of the 45th International ACM SIGIR …, 2022 - dl.acm.org
Information access systems, such as search and recommender systems, often use ranked
lists to present results believed to be relevant to the user's information need. Evaluating …

Exploring author gender in book rating and recommendation

MD Ekstrand, M Tian, MRI Kazi… - Proceedings of the 12th …, 2018 - dl.acm.org
Collaborative filtering algorithms find useful patterns in rating and consumption data and
exploit these patterns to guide users to good items. Many of the patterns in rating datasets …

Exploring the landscape of recommender systems evaluation: Practices and perspectives

C Bauer, E Zangerle, A Said - ACM Transactions on Recommender …, 2024 - dl.acm.org
Recommender systems research and practice are fast-developing topics with growing
adoption in a wide variety of information access scenarios. In this article, we present an …

Psychology-informed recommender systems

E Lex, D Kowald, P Seitlinger, TNT Tran… - … and trends® in …, 2021 - nowpublishers.com
Personalized recommender systems have become indispensable in today's online world.
Most of today's recommendation algorithms are data-driven and based on behavioral data …

Distributionally-informed recommender system evaluation

MD Ekstrand, B Carterette, F Diaz - ACM Transactions on …, 2024 - dl.acm.org
Current practice for evaluating recommender systems typically focuses on point estimates of
user-oriented effectiveness metrics or business metrics, sometimes combined with …

[HTML][HTML] The role of context fusion on accuracy, beyond-accuracy, and fairness of point-of-interest recommendation systems

HA Rahmani, Y Deldjoo, T Di Noia - Expert Systems with Applications, 2022 - Elsevier
Abstract Point-of-interest (POI) recommendation is an essential service to location-based
social networks (LBSNs), benefiting both users providing them the chance to explore new …

From clicks to carbon: The environmental toll of recommender systems

T Vente, L Wegmeth, A Said, J Beel - … of the 18th ACM Conference on …, 2024 - dl.acm.org
As global warming soars, the need to assess the environmental impact of research is
becoming increasingly urgent. Despite this, few recommender systems research papers …