For a system-based information retrieval evaluation, test collection model still remains as a
costly task. Producing relevance judgments is an expensive, time consuming task which has …

With the progressive and availability of various search tools, interest in the evaluation of
information retrieval based on user perspective has grown tremendously among …

The possibility of using fewer topics in TREC, and in TREC-like initiatives, has been studied
recently, with encouraging results: even when decreasing consistently the number of topics …

Understanding and comparing the behavior of retrieval models is a fundamental challenge
that requires going beyond examining average effectiveness and per-query metrics …

We propose a mathematical framework for query selection as a mechanism for reducing the
cost of constructing information retrieval test collections. In particular, our mathematical …

While test collections provide the cornerstone for Cranfield-based evaluation of information
retrieval (IR) systems, it has become practically infeasible to rely on traditional pooling …

When evaluating IR run effectiveness using a test collection, a key question is: What search
topics should be used? We explore what happens to measurement accuracy when the …

Abstract Evaluation has always been the cornerstone of scientific development. Scientists
come up with hypotheses (models) to explain physical phenomena, and validate these …

Given limited time and space, IR studies often report few evaluation metrics which must be
carefully selected. To inform such selection, we first quantify correlation between 23 popular …

Surnames play a key role as person natural identifiers, essentially in present information
systems. This paper deals with the topic of optimizing a phonetic search algorithm as a string …