Fallacy Detection in Italian Social Media Texts
Shared Task at EVALITA 2026
Recognizing fallacies in everyday argumentation plays a key role in developing individuals' critical thinking skills, ultimately contributing to mitigate faulty and harmful argumentation at its root.
FadeIT is the first shared task on fallacy detection for Italian in public discourse about migration, climate change, and public health over a 4-year time period. It is part of the EVALITA 2026 campaign, whose workshop will be held in Bari, Apulia (Italy) on February 26-27, 2026.
FadeIT is based on Faina (Ramponi et al., 2025), a dataset for fallacy detection in Italian social media posts that includes disaggregated span-level annotations with overlaps for 20 fallacy types. Participant teams can leverage disaggregated annotations or aggregate them to develop systems to detect fallacies in subtasks of increasing complexity: at the post level (coarse-grained fallacy detection) and/or at the span level (fine-grained fallacy detection). Systems will be evaluated against two equally valid gold standards to account for genuine disagreement, in line with work advocating the importance of valuing human label variation in subjective tasks (Plank, 2022).
Learn more on the task (w/ associated subtasks), the data (w/ examples), and how to participate!
September 22, 2025 β FadeIT has started! The data and the evaluation script are available to participants.
September 1, 2025 β the registration to the FadeIT shared task is open! π You can register here!
Septemper 22, 2025 β Data (train/dev) and evaluation scorer are provided to participants
November 27 - December 4, 2025 β Evaluation window: participants submit predictions on the test data
December 15, 2025 β Official results for submitted runs available to participants
January 9, 2026 β Submission deadline for system description papers by participants
February 7, 2026 β Notification of acceptance of system description papers to participants
February 16, 2026 β Camera-ready version of system description papers due
February 26-27, 2026 β EVALITA 2026 Workshop in Bari, Italy