Resources for Combining Teaching and Research in Information Retrieval Coursework
The first International Workshop on Open Web Search (WOWS) was held on Thursday,
March 28th, at ECIR 2024 in Glasgow, UK. The full-day workshop had two calls for …
March 28th, at ECIR 2024 in Glasgow, UK. The full-day workshop had two calls for …
Extended overview of the CLEF 2024 LongEval Lab on Longitudinal Evaluation of Model Performance
We describe the second edition of the LongEval CLEF 2024 shared task. This lab evaluates
the temporal persistence of Information Retrieval (IR) systems and Text Classifiers. Task 1 …
the temporal persistence of Information Retrieval (IR) systems and Text Classifiers. Task 1 …
Evaluation of temporal change in IR test collections
Information retrieval systems have been evaluated using the Cranfield paradigm for many
years. This paradigm allows a systematic, fair, and reproducible evaluation of different …
years. This paradigm allows a systematic, fair, and reproducible evaluation of different …
Replicability measures for longitudinal information retrieval evaluation
Abstract Information Retrieval (IR) systems are exposed to constant changes in most
components. Documents are created, updated, or deleted, the information needs are …
components. Documents are created, updated, or deleted, the information needs are …
What Happened in CLEF For Another While?
N Ferro - International Conference of the Cross-Language …, 2024 - Springer
Abstract 2024 marks the 25 th birthday for CLEF, an evaluation campaign activity which has
applied the Cranfield evaluation paradigm to the testing of multilingual and multimodal …
applied the Cranfield evaluation paradigm to the testing of multilingual and multimodal …
[PDF][PDF] Leveraging prior relevance signals in web search
This work reports our participation in the retrieval task of the second LongEval lab iteration at
CLEF 2024. As part of this year's contribution, we analyze to which extent prior relevance …
CLEF 2024. As part of this year's contribution, we analyze to which extent prior relevance …
A Systematic Analysis on the Temporal Generalization of Language Models in Social Media
A Ushio, J Camacho-Collados - arXiv preprint arXiv:2405.13017, 2024 - arxiv.org
In machine learning, temporal shifts occur when there are differences between training and
test splits in terms of time. For streaming data such as news or social media, models are …
test splits in terms of time. For streaming data such as news or social media, models are …
[PDF][PDF] Team openwebsearch at clef 2024: Longeval
We describe the OpenWebSearch group's participation in the CLEF 2024 LongEval IR track.
Our submitted runs explore how historical data from the past can be transferred into future …
Our submitted runs explore how historical data from the past can be transferred into future …
Report on the 14th Conference and Labs of the Evaluation Forum (CLEF 2023): Experimental IR Meets Multilinguality, Multimodality, and Interaction
This is a report on the fourteenth edition of the Conference and Labs of the Evaluation
Forum (CLEF 2023), held on September 18--21, 2023, in Thessaloniki, Greece. CLEF was a …
Forum (CLEF 2023), held on September 18--21, 2023, in Thessaloniki, Greece. CLEF was a …
Keeping in Time: Adding Temporal Context to Sentiment Analysis Models
D Ninalga - arXiv preprint arXiv:2309.13562, 2023 - arxiv.org
This paper presents a state-of-the-art solution to the LongEval CLEF 2023 Lab Task 2:
LongEval-Classification. The goal of this task is to improve and preserve the performance of …
LongEval-Classification. The goal of this task is to improve and preserve the performance of …