Interested in joining our team? We are currently offering funded PhD positions for research topics in computational humour, historical born-digital corpora, and Indigenous language technology.
Overview of JOKER: Humour in the machine.
In Jorge Carrillo de Albornoz, Julio Gonzalo, Laura Plaza, Alba García Seco de Herrera, Josiane Mothe, Florina Piroi, Paolo Rosso, Damiano Spina, Guglielmo Faggioli, and Nicola Ferro, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction: 16th International Conference of the CLEF Association, CLEF 2025, Madrid, Spain, September 9–12, 2025, Proceedings, volume 16089 of Lecture Notes in Computer Science (ISSN 0302-9743), pages 315–337, Cham, 2025. Springer. ISBN 978-3-032-04353-5. DOI: 10.1007/978-3-032-04354-2_18.
Humour poses a unique challenge for artificial
intelligence, as it often relies on non-literal language, cultural
references, and linguistic creativity. The JOKER Lab, now in its fourth year,
aims to advance computational humour research through shared tasks on
curated, multilingual datasets, with applications in education,
computer-mediated communication and translation, and conversational AI. This
paper provides an overview of the JOKER Lab held at CLEF 2025, detailing
the setup and results of its three main tasks: (1) humour-aware
information retrieval, which involves searching a document collection for
humorous texts relevant to user queries in either English or Portuguese;
(2) pun translation, focussed on humour-preserving translation of
paronomastic jokes from English into French; and (3) onomastic wordplay
translation, a task addressing the translation of name-based wordplay from
English into French. The 2025 edition builds upon previous iterations by
expanding datasets and emphasising nuanced, manual evaluation methods. The
Task 1 results show a marked improvement this year, apparently due to
participants' judicious combination of retrieval and filtering techniques.
Tasks 2 and 3 remain challenging, not only in terms of system
performance but also in terms of defining meaningful and reliable evaluation
metrics.
@inproceedings{ermakova2025overview,
author = {Liana Ermakova and Ricardo Campos and Anne-Gwenn
Bosser and Tristan Miller},
editor = {Jorge Carrillo-de-Albornoz and Julio Gonzalo and
Laura Plaza and Alba García Seco de Herrera and Josiane Mothe and Florina
Piroi and Paolo Rosso and Damiano Spina and Guglielmo Faggioli and Nicola
Ferro},
title = {Overview of {JOKER}: Humour in the
Machine},
booktitle = {Experimental {IR} Meets Multilinguality,
Multimodality, and Interaction: 16th {International} {Conference} of the
{CLEF} {Association}, {CLEF}~2025, {Madrid}, {Spain}, {September}~9–12,
2025, Proceedings},
volume = {16089},
pages = {315--337},
series = {Lecture Notes in Computer Science},
year = {2025},
publisher = {Springer},
address = {Cham},
isbn = {978-3-032-04353-5},
issn = {0302-9743},
doi = {10.1007/978-3-032-04354-2_18},
}