CLEF 2025 JOKER lab: Humour in the machine.
In Advances in Information Retrieval: 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6–10, Proceedings, Lecture Notes in Computer Science, Cham, 2025. Springer. To appear.
Over the last three years, the JOKER Lab series at CLEF
has gathered an active community of researchers in natural language
processing and information retrieval to collaborate on non-literal use of
language in text. Such language can be a challenge for AI systems, but also
sometimes for humans, as it requires understanding implicit cultural
references and unorthodox interactions between form and meaning. In this
paper, we discuss the lessons learned from the previous iterations of the Lab
and describe how its upcoming edition will build upon those to address new
challenges. In 2025, JOKER will provide novel tasks and update some previous
ones with new data and new languages. This year we provide sandbox
environments for experimenting with humour-aware information retrieval
(Task 1), a previously featured task now enhanced with an all-new
Portuguese corpus; wordplay translation in text (Task 2), another
historical task for which we provide new corpora; onomastic wordplay
(Task 3), a new task focussed on humorous proper names in fiction; and
controlled creativity (Task 4), another novel task that aims at
identifying and avoiding hallucinations.
@inproceedings{ermakova2025clef,
author = {Liana Ermakova and Anne-Gwenn Bosser and Tristan
Miller and Ricardo Campos},
title = {{CLEF} 2025 {JOKER} Lab: Humour in the
Machine},
booktitle = {Advances
in Information Retrieval: 47th {European} {Conference} on {Information}
{Retrieval}, {ECIR} 2025, {Lucca}, {Italy}, {April} 6–10,
Proceedings},
series = {Lecture Notes in Computer Science},
year = {2025},
publisher = {Springer},
address = {Cham},
issn = {0302-9743},
note = {To appear},
}