Unbiased Learning to Rank: On Recent Advances and Practical Applications

S Gupta, P Hager, J Huang, A Vardasbi… - Proceedings of the 17th …, 2024 - dl.acm.org
Since its inception, the field of unbiased learning to rank (ULTR) has remained very active
and has seen several impactful advancements in recent years. This tutorial provides both an …

Marginal-certainty-aware fair ranking algorithm

T Yang, Z Xu, Z Wang, A Tran, Q Ai - … on Web Search and Data Mining, 2023 - dl.acm.org
Ranking systems are ubiquitous in modern Internet services, including online marketplaces,
social media, and search engines. Traditionally, ranking systems only focus on how to get …

Pre-trained language model-based retrieval and ranking for web search

L Zou, W Lu, Y Liu, H Cai, X Chu, D Ma, D Shi… - ACM Transactions on …, 2022 - dl.acm.org
Pre-trained language representation models (PLMs) such as BERT and Enhanced
Representation through kNowledge IntEgration (ERNIE) have been integral to achieving …

Unbiased Learning-to-Rank Needs Unconfounded Propensity Estimation

D Luo, L Zou, Q Ai, Z Chen, C Li, D Yin… - Proceedings of the 47th …, 2024 - dl.acm.org
The logs of the use of a search engine provide sufficient data to train a better ranker.
However, it is well known that such implicit feedback reflects biases, and in particular a …

Approximated doubly robust search relevance estimation

L Zou, C Hao, H Cai, S Wang, S Cheng… - Proceedings of the 31st …, 2022 - dl.acm.org
Extracting query-document relevance from the sparse, biased clickthrough log is among the
most fundamental tasks in the web search system. Prior art mainly learns a relevance …

Unconfounded Propensity Estimation for Unbiased Ranking

D Luo, L Zou, Q Ai, Z Chen, C Li, D Yin… - arXiv preprint arXiv …, 2023 - arxiv.org
The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for
optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms …

[PDF][PDF] A Self-Distilled Learning to Rank Model for Ad-hoc Retrieval

S Keshvari, F Saeedi, H Sadoghi Yazdi… - ACM Transactions on …, 2024 - researchgate.net
Authors' addresses: Sanaz Keshvari, Ferdowsi University of Mashhad, Mashhad, Iran,;
Farzan Saeedi, Ferdowsi University of Mashhad, Mashhad, Iran,; Hadi Sadoghi Yazdi …

CIR at the NTCIR-17 ULTRE-2 Task

L Yu, K Bi, J Guo, X Cheng - arXiv preprint arXiv:2310.11852, 2023 - arxiv.org
The Chinese academy of sciences Information Retrieval team (CIR) has participated in the
NTCIR-17 ULTRE-2 task. This paper describes our approaches and reports our results on …

Investigating the Robustness of Counterfactual Learning to Rank Models: A Reproducibility Study

Z Niu, J Mao, Q Ai, JR Wen - arXiv preprint arXiv:2404.03707, 2024 - arxiv.org
Counterfactual learning to rank (CLTR) has attracted extensive attention in the IR community
for its ability to leverage massive logged user interaction data to train ranking models. While …

Baby Bear: Seeking a Just Right Rating Scale for Scalar Annotations

X Han, F Yu, J Sedoc, B Van Durme - arXiv preprint arXiv:2408.09765, 2024 - arxiv.org
Our goal is a mechanism for efficiently assigning scalar ratings to each of a large set of
elements. For example," what percent positive or negative is this product review?" When …