Publications

CEUR Working Notes of All Labs and Participants at CLEF 2024

This volume contains the 339 working notes that were peer-reviewed and accepted for publication at CLEF 2024. Out of these, 37 are overviews of the labs and tasks, while 302 are the participants' working notes. 

• CLEF 2024 CEUR Working Notes

SimpleText Lab Overview Paper

• Overview of the CLEF 2024 SimpleText Track: Improving Access to Scientific Texts for Everyone. Liana Ermakova, Eric SanJuan, Stéphane Huet, Hosein Azarbonyad, Giorgio Maria Di Nunzio, Federica Vezzani, Jennifer D’Souza, and Jaap Kamps. In Experimental IR Meets Multilinguality, Multimodality, and Interaction: 15th International Conference of the CLEF Association, Grenoble, France. (Sep 2024). ACM proceedings, slides, website

SimpleText Task 4 "SOTA" Overview Paper

• Overview of the CLEF 2024 SimpleText Task 4: SOTA? Tracking the State-of-the-Art in Scholarly Publications. Jennifer D’Souza, Salomon Kabongo, Hamed Babaei Giglou, and Yue Zhang. In Working Notes of CLEF 2024 - Conference and Labs of the Evaluation Forum, CEUR Workshop Proceedings, pages 3163-3173, Grenoble, France. (Sep 2024). CEUR proceedings, slides, codalab, dataset

SimpleText Task 4 "SOTA" Participant Papers

• [Team AMATU] Are LLMs Any Good for Scientific Leaderboard Extraction? Moritz Staudinger, Alaa El-Ebshihy, Annisa Maulida Ningtyas, Florina Piroi, and Allan Hanbury. In Working Notes of CLEF 2024 - Conference and Labs of the Evaluation Forum, CEUR Workshop Proceedings, pages 3300-3316, Grenoble, France. (Sep 2024). CEUR proceedings, slides

• [Team L3S] Exploring the Latest LLMs for Leaderboard Extraction. Salomon Kabongo, Jennifer D’Souza, and Sören Auer. In Working Notes of CLEF 2024 - Conference and Labs of the Evaluation Forum, CEUR Workshop Proceedings, pages 3246-3260, Grenoble, France. (Sep 2024). CEUR proceedings, slides, dataset