Test collection based evaluation of information retrieval systems

M Sanderson - Foundations and Trends® in Information …, 2010 - nowpublishers.com
Use of test collections and evaluation measures to assess the effectiveness of information
retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 …

TopX: efficient and versatile top-k query processing for semistructured data

M Theobald, H Bast, D Majumdar, R Schenkel… - The VLDB Journal, 2008 - Springer
Recent IR extensions to XML query languages such as Xpath 1.0 Full-Text or the NEXI
query language of the INEX benchmark series reflect the emerging interest in IR-style …

INEX 2007 evaluation measures

J Kamps, J Pehcevski, G Kazai, M Lalmas… - Focused Access to XML …, 2008 - Springer
This paper describes the official measures of retrieval effectiveness that are employed for
the Ad Hoc Track at INEX 2007. Whereas in earlier years all, but only, XML elements could …

Overview of INEX 2005

S Malik, G Kazai, M Lalmas, N Fuhr - … Workshop of the Initiative for the …, 2006 - Springer
Since 2002, INEX has been working towards the goal of establishing an infrastructure, in the
form of a large XML test collection and appropriate scoring methods, for the evaluation of …

Semantic search via XML fragments: a high-precision approach to IR

J Chu-Carroll, J Prager, K Czuba, D Ferrucci… - Proceedings of the 29th …, 2006 - dl.acm.org
In some IR applications, it is desirable to adopt a high precision search strategy to return a
small set of documents that are highly focused and relevant to the user's information need …

Using personalization to improve XML retrieval

LM de Campos, JM Fernández-Luna… - … on Knowledge and …, 2013 - ieeexplore.ieee.org
As the amount of information increases every day and the users normally formulate short
and ambiguous queries, personalized search techniques are becoming almost a must …

Evaluating XML retrieval effectiveness at INEX

M Lalmas, A Tombros - ACM SIGIR Forum, 2007 - dl.acm.org
The INitiative for the Evaluation of XML retrieval (INEX) was set up in 2002 to establish an
infrastructure and provide means, in the form of large test collections and appropriate …

Extended cumulated gain measures for the evaluation of content-oriented XML retrieval

G Kazai, M Lalmas - ACM Transactions on Information Systems (TOIS), 2006 - dl.acm.org
We propose and evaluate a family of measures, the eXtended Cumulated Gain (XCG)
measures, for the evaluation of content-oriented XML retrieval approaches. Our aim is to …

A classification of IR effectiveness metrics

G Demartini, S Mizzaro - European Conference on Information Retrieval, 2006 - Springer
Effectiveness is a primary concern in the information retrieval (IR) field. Various metrics for IR
effectiveness have been proposed in the past; we take into account all the 44 metrics we are …

Sound and complete relevance assessment for XML retrieval

B Piwowarski, A Trotman, M Lalmas - ACM Transactions on Information …, 2008 - dl.acm.org
In information retrieval research, comparing retrieval approaches requires test collections
consisting of documents, user requests and relevance assessments. Obtaining relevance …