Overview of the CLEF 2024 LongEval lab on longitudinal evaluation of model performance

R Alkhalifa, H Borkakoty, R Deveaud… - … Conference of the Cross …, 2024 - Springer
We describe the second edition of the LongEval CLEF 2024 shared task. This lab evaluates
the temporal persistence of Information Retrieval (IR) systems and Text Classifiers. Task 1 …

Cross-lingual Offensive Language Detection: A Systematic Review of Datasets, Transfer Approaches and Challenges

A Jiang, A Zubiaga - arXiv preprint arXiv:2401.09244, 2024 - arxiv.org
The growing prevalence and rapid evolution of offensive language in social media amplify
the complexities of detection, particularly highlighting the challenges in identifying such …

Synergizing machine learning & symbolic methods: A survey on hybrid approaches to natural language processing

R Panchendrarajan, A Zubiaga - Expert Systems with Applications, 2024 - Elsevier
The advancement of machine learning and symbolic approaches have underscored their
strengths and weaknesses in Natural Language Processing (NLP). While machine learning …

Examining temporal bias in abusive language detection

M Jin, Y Mu, D Maynard, K Bontcheva - arXiv preprint arXiv:2309.14146, 2023 - arxiv.org
The use of abusive language online has become an increasingly pervasive problem that
damages both individuals and society, with effects ranging from psychological harm right …

LongEval: Longitudinal Evaluation of Model Performance at CLEF 2024

R Alkhalifa, H Borkakoty, R Deveaud… - … on Information Retrieval, 2024 - Springer
This paper introduces the planned second LongEval Lab, part of the CLEF 2024 conference.
The aim of the lab's two tasks is to give researchers test data for addressing temporal …

Examining temporalities on stance detection towards covid-19 vaccination

Y Mu, M Jin, K Bontcheva, X Song - arXiv preprint arXiv:2304.04806, 2023 - arxiv.org
Previous studies have highlighted the importance of vaccination as an effective strategy to
control the transmission of the COVID-19 virus. It is crucial for policymakers to have a …

LongEval-Retrieval: French-English Dynamic Test Collection for Continuous Web Search Evaluation

P Galuscáková, R Deveaud, G González Sáez… - Proceedings of the 46th …, 2023 - dl.acm.org
LongEval-Retrieval is a Web document retrieval benchmark that focuses on continuous
retrieval evaluation. This test collection is intended to be used to study the temporal …

Rant or rave: variation over time in the language of online reviews

Y Ziser, B Webber, SB Cohen - Language Resources and Evaluation, 2023 - Springer
We examine how the language of online reviews has changed over the past 20 years. The
corpora we use for this analysis consist of online reviews, each of which is paired with a …

[PDF][PDF] Seupd@ clef: team dam on reranking using sentence embedders

A Basaglia, A Stocco, M Popović, N Ferro - Faggioli et al.[12], 2024 - ceur-ws.org
This report gives an overview of the system developed by Team DAM for Task 1 of the
LongEval Lab at CLEF 2024. The team members are students enrolled in the Computer …

The finer they get: Combining fine-tuned models for better semantic change detection

W Zhou, N Tahmasebi… - Proceedings of the 24th …, 2023 - aclanthology.org
In this work we investigate the hypothesis that enriching contextualized models using fine-
tuning tasks can improve theircapacity to detect lexical semantic change (LSC). We include …