Overview of the CLEF 2024 LongEval lab on longitudinal evaluation of model performance

R Alkhalifa, H Borkakoty, R Deveaud… - … Conference of the Cross …, 2024 - Springer
We describe the second edition of the LongEval CLEF 2024 shared task. This lab evaluates
the temporal persistence of Information Retrieval (IR) systems and Text Classifiers. Task 1 …

Resources for Combining Teaching and Research in Information Retrieval Coursework

M Fröbe, H Scells, T Elstner, C Akiki… - Proceedings of the 47th …, 2024 - dl.acm.org
The first International Workshop on Open Web Search (WOWS) was held on Thursday,
March 28th, at ECIR 2024 in Glasgow, UK. The full-day workshop had two calls for …

LongEval-Retrieval: French-English Dynamic Test Collection for Continuous Web Search Evaluation

P Galuscáková, R Deveaud, G González Sáez… - Proceedings of the 46th …, 2023 - dl.acm.org
LongEval-Retrieval is a Web document retrieval benchmark that focuses on continuous
retrieval evaluation. This test collection is intended to be used to study the temporal …

Evaluation of temporal change in IR test collections

J Keller, T Breuer, P Schaer - Proceedings of the 2024 ACM SIGIR …, 2024 - dl.acm.org
Information retrieval systems have been evaluated using the Cranfield paradigm for many
years. This paradigm allows a systematic, fair, and reproducible evaluation of different …

Extended overview of the CLEF 2024 LongEval Lab on Longitudinal Evaluation of Model Performance

R Alkhalifa, H Borkakoty, R Deveaud, A El-Ebshihy… - 2024 - qmro.qmul.ac.uk
We describe the second edition of the LongEval CLEF 2024 shared task. This lab evaluates
the temporal persistence of Information Retrieval (IR) systems and Text Classifiers. Task 1 …

[PDF][PDF] Longeval-retrieval: French-english dynamic test collection for continuous web search evaluation

P Galuščáková, R Deveaud… - arXiv preprint arXiv …, 2023 - ufal.mff.cuni.cz
ABSTRACT LongEval-Retrieval is a Web document retrieval benchmark that focuses on
continuous retrieval evaluation. This test collection is intended to be used to study the …

Exploratory visualization tool for the continuous evaluation of information retrieval systems

G González-Sáez, P Galuscáková, R Deveaud… - Proceedings of the 46th …, 2023 - dl.acm.org
This paper introduces a novel visualization tool that facilitates the exploratory analysis of
continuous evaluation for information retrieval systems. We base our analysis on score …

Humkinar: Construction of a Large Scale Web Repository and Information System for Low Resource Urdu Language

MA Mehmood, B Tahir - IEEE Access, 2024 - ieeexplore.ieee.org
Online content availability, commercial viability, and technological advancements for English
and European languages direct mainstream search engines to prioritize the search results …

[PDF][PDF] Team openwebsearch at clef 2024: Longeval

D Alexander, M Frobe, GAW Hendriksen, F Schlatt… - 2024 - repository.ubn.ru.nl
We describe the OpenWebSearch group's participation in the CLEF 2024 LongEval IR track.
Our submitted runs explore how historical data from the past can be transferred into future …

Keeping in Time: Adding Temporal Context to Sentiment Analysis Models

D Ninalga - arXiv preprint arXiv:2309.13562, 2023 - arxiv.org
This paper presents a state-of-the-art solution to the LongEval CLEF 2023 Lab Task 2:
LongEval-Classification. The goal of this task is to improve and preserve the performance of …