Cross-language information retrieval (CLIR) is an active sub-domain of information retrieval
(IR). Like IR, CLIR is centered on the search for documents and for information contained …

This lecture is intended to serve as an introduction to Information Retrieval (IR) effectiveness
metrics and their usage in IR experiments using test collections. Evaluation metrics are …

This paper presents an overview of the ACLIA (Advanced Cross-Lingual Information Access)
task cluster. The task overview includes: a definition of and motivation for the evaluation; a …

This paper presents an overview of NTCIR-9 Cross-lingual Link Discovery (Crosslink) task.
The overview includes: the motivation of cross-lingual link discovery; the Crosslink task …

GeoTime for the NTCIR Workshop 9 is the second evaluation of Geographic and Temporal
Information Retrieval called “NTCIR GeoTime”. The focus of this task is on search with …

Over the past decades, Information Access (IA) tasks have evolved and diversified. For
example, in the mid-20th century, Information Retrieval (IR) was about set retrieval for …

NTCIR was the first large-scale IR evaluation conference series to construct test collections
with graded relevance assessments: the NTCIR-1 test collections from 1998 already …

This paper describes the methods we used for evaluating the runs submitted to the NTCIR-8
Community QA Pilot Task, and report on the official results. Moreover, we also describe a set …

In this paper, we report various strategies for query expansion (QE) in the NTCIR-8 IR4QA
subtask. We submit the results of twelve runs from the formal run, which include cross …

ABSTRACT We describe Javelin, a Cross-lingual Question Answering system which
participated in the NTCIR-8 ACLIA evaluation and which is designed to work on any type of …