[HTML][HTML] An in-depth investigation on the behavior of measures to quantify reproducibility

M Maistro, T Breuer, P Schaer, N Ferro - Information Processing & …, 2023 - Elsevier
Science is facing a so-called reproducibility crisis, where researchers struggle to repeat
experiments and to get the same or comparable results. This represents a fundamental …

Toward Evaluating the Reproducibility of Information Retrieval Systems with Simulated Users

T Breuer, M Maistro - Proceedings of the 2nd ACM Conference on …, 2024 - dl.acm.org
Reproducibility is a fundamental part of scientific progress. Compared to other scientific
fields, computational sciences are privileged as experimental setups can be preserved with …

[PDF][PDF] Reproducible Information Retrieval Research: From Principled System-Oriented Evaluations Towards User-Oriented Experimentation

T Breuer - 2023 - duepublico2.uni-due.de
The reproducibility of earlier findings is fundamental to the empirical sciences. Even though
this circumstance is widely acknowledged, several systematic large-scale reproducibility …

Explaining Predictions from Machine Learning Models: Algorithms, Users, and Pedagogy

A Lucic - arXiv preprint arXiv:2209.05084, 2022 - arxiv.org
Model explainability has become an important problem in machine learning (ML) due to the
increased effect that algorithmic predictions have on humans. Explanations can help users …