Online evaluation is one of the most common approaches to measure the effectiveness of an
information retrieval system. It involves fielding the information retrieval system to real users …

The dueling bandits problem is an online learning framework where learning happens “on-
thefly” through preference feedback, ie, from comparisons between a pair of actions. Unlike …

Getting a better understanding of user behavior is important for advancing information
retrieval systems. Existing work focuses on modeling and predicting single interaction …

Modern search engines aggregate results from different verticals: webpages, news, images,
video, shopping, knowledge cards, local maps, etc. Unlike" ten blue links", these search …

As in most information retrieval (IR) studies, evaluation plays an essential part in Web
search research. Both offline and online evaluation metrics are adopted in measuring the …

Search engines are widely used in our daily life. Batch evaluation of the performance of
search systems to their users has always been an essential issue in the field of information …

Ranking systems form the basis for online search engines and recommendation services.
They process large collections of items, for instance web pages or e-commerce products …

The CLEF NewsREEL challenge is a campaign-style evaluation lab allowing participants to
evaluate and optimize news recommender algorithms. The goal is to create an algorithm …

Recent discussions on alternative facts, fake news, and post truth politics have motivated
research on creating technologies that allow people not only to access information, but also …

In web search, information about times between user actions has been shown to be a good
indicator of users' satisfaction with the search results. Existing work uses the mean values of …