Measuring the utility of search engine result pages: an information foraging based measure
Web Search Engine Result Pages (SERPs) are complex responses to queries, containing
many heterogeneous result elements (web results, advertisements, and specialised" …
many heterogeneous result elements (web results, advertisements, and specialised" …
Taking search to task
The importance of tasks in information retrieval (IR) has been long argued for, addressed in
different ways, often ignored, and frequently revisited. For decades, scholars made a case …
different ways, often ignored, and frequently revisited. For decades, scholars made a case …
An axiomatic analysis of diversity evaluation metrics: Introducing the rank-biased utility metric
Many evaluation metrics have been defined to evaluate the effectiveness ad-hoc retrieval
and search result diversification systems. However, it is often unclear which evaluation …
and search result diversification systems. However, it is often unclear which evaluation …
Offline evaluation by maximum similarity to an ideal ranking
CLA Clarke, MD Smucker, A Vtyurina - Proceedings of the 29th ACM …, 2020 - dl.acm.org
NDCG and similar measures remain standard for the offline evaluation of search,
recommendation, question answering and similar systems. These measures require …
recommendation, question answering and similar systems. These measures require …
Evaluation in contextual information retrieval: Foundations and recent advances within the challenges of context dynamicity and data privacy
L Tamine, M Daoud - ACM Computing Surveys (CSUR), 2018 - dl.acm.org
Context such as the user's search history, demographics, devices, and surroundings, has
become prevalent in various domains of information seeking and retrieval such as mobile …
become prevalent in various domains of information seeking and retrieval such as mobile …
Investigating cognitive effects in session-level search user satisfaction
User satisfaction is an important variable in Web search evaluation studies and has received
more and more attention in recent years. Many studies regard user satisfaction as the …
more and more attention in recent years. Many studies regard user satisfaction as the …
[PDF][PDF] TREC 2016 Dynamic Domain Track Overview.
GH Yang, I Soboroff - TREC, 2016 - trec.nist.gov
Search tasks for professional searchers, such as law enforcement agencies, police officers,
and patent examiners, are often more complex than open domain Web search tasks. When …
and patent examiners, are often more complex than open domain Web search tasks. When …
Preference-based offline evaluation
A core step in production model research and development involves the offline evaluation of
a system before production deployment. Traditional offline evaluation of search …
a system before production deployment. Traditional offline evaluation of search …
Cascade or recency: Constructing better evaluation metrics for session search
Recently session search evaluation has been paid more attention as a realistic search
scenario usually involves multiple queries and interactions between users and systems …
scenario usually involves multiple queries and interactions between users and systems …
On the impact of domain expertise on query formulation, relevance assessment and retrieval performance in clinical settings
L Tamine, C Chouquet - Information Processing & Management, 2017 - Elsevier
The large volumes of medical information available on the web may provide answers for a
wide range of users attempting to solve health-related problems. While experts generally …
wide range of users attempting to solve health-related problems. While experts generally …