CLEF2022 - CheckThat! Lab

This page has moved. Please visit our new website

Lab Registration 

CLOSED on April 22, 2022: To register in the CheckThat! lab, please visit: https://clef2022-labs-registration.dei.unipd.it/registrationForm.php

Leaderboards

Kindly check the following leaderboards: 

• Task 1: http://shorturl.at/nuCOS 

• Task 2: http://shorturl.at/dzX28

• Task 3: http://shorturl.at/knBCG

Submission sites 

To submit your results on the test data, kindly use the following leaderboard: 

• Task 1: https://codalab.lisn.upsaclay.fr/competitions/4230 

  • Please check submission guidelines

• Task 2: https://codalab.lisn.upsaclay.fr/competitions/4260

  • Please check submission guidelines

• Task 3: https://codalab.lisn.upsaclay.fr/competitions/4633

  • Please check submission guidelines

Instructions to prepare your paper

The title of paper should be in the following format:
<Team Name> at CheckThat! 2022: <Name of the title>

For example:
LamdaX at CheckThat! 2022: Ensemble Models for Checkworthy Tweet Identification

Cite: Please check the citation section to cite the shared task papers.

Templates: The working notes are prepared using the CEUR-WS templates (both Word and LaTex) available at: https://drive.google.com/drive/folders/1atq0bC9hSDMicqm79Jeu6TWOR-q_BCRQ?usp=sharing

More information: https://clef2022.clef-initiative.eu/index.php?page=Pages/instructions_for_authors.html

Paper submission: https://www.easychair.org/my/conference?conf=clef2022 

Tasks

Check the overview of the tasks here. Details of each task are given in the specific task pages.
Task 1: https://sites.google.com/view/clef2022-checkthat/tasks/task-1-identifying-relevant-claims-in-tweets 

Task 2: https://sites.google.com/view/clef2022-checkthat/tasks/task-2-detecting-previously-fact-checked-claims 

Task 3: https://sites.google.com/view/clef2022-checkthat/tasks/task-3-fake-news-detection 

Datasets

You can check out the main repo containing all the scripts and data, CheckThat! Lab-2022. Liks to the Individual task dataset pages can be found below:

Task 1: https://gitlab.com/checkthat_lab/clef2022-checkthat-lab/clef2022-checkthat-lab/-/tree/main/task1

Task 2: https://gitlab.com/checkthat_lab/clef2022-checkthat-lab/clef2022-checkthat-lab/-/tree/main/task2  

Task 3: https://zenodo.org/record/6508748

Discussion Group

Please join our discussion group clef-factcheck@googlegroups.com to receive announcements and participate in discussions.

Citation

You can find the overview papers on the CLEF2021-CheckThat! Lab as well as of the individual tasks below:

@InProceedings{CheckThat:ECIR2022,

author="Nakov, Preslav and Barr{\'o}n-Cede{\~{n}}o, Alberto and Da San Martino, Giovanni and Alam, Firoj and Stru{\ss}, Julia Maria and Mandl, Thomas and M{\'i}guez, Rub{\'e}n and Caselli, Tommaso and Kutlu, Mucahid and Zaghouani, Wajdi and Li, Chengkai and Shaar, Shaden and Shahi, Gautam Kishore and Mubarak, Hamdy and Nikolov, Alex and Babulkov, Nikolay and Kartal, Yavuz Selim and Beltr{\'a}n, Javier",

editor="Hagen, Matthias and Verberne, Suzan and Macdonald, Craig and Seifert, Christin and Balog, Krisztian and N{\o}rv{\aa}g, Kjetil and Setty, Vinay",

title="The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection",

booktitle="Advances in Information Retrieval",

year="2022",

publisher="Springer International Publishing",

address="Cham",

pages="416--428",

isbn="978-3-030-99739-7"

}

@InProceedings{clef-checkthat:2022:LNCS,

author = {Nakov, Preslav and Barr\'{o}n-Cede\~{n}o, Alberto and Da San Martino, Giovanni and Alam, Firoj and Stru\ss{}, Julia Maria and Mandl, Thomas and M\'{\i}guez, Rub\'{e}n and Caselli, Tommaso and Kutlu, Mucahid and Zaghouani, Wajdi and Li, Chengkai and Shaar, Shaden and Shahi, Gautam Kishore and Mubarak, Hamdy and Nikolov, Alex and Babulkov, Nikolay and Kartal, Yavuz Selim and Beltr\'{a}n, Javier and Wiegand, Michael and Siegel, Melanie and K{\"o}hler, Juliane},

title = "Overview of the {CLEF}-2022 {CheckThat}! Lab on Fighting the {COVID-19} Infodemic and Fake News Detection",

year = {2022},

booktitle = "Proceedings of the 13th International Conference of the CLEF Association: Information Access Evaluation meets Multilinguality, Multimodality, and Visualization",

series = {CLEF~'2022},

address = {Bologna, Italy},

}

@InProceedings{clef-checkthat:2022:task1,

author = {Nakov, Preslav and Barr\'{o}n-Cede\~{n}o, Alberto and Da San Martino, Giovanni and Alam, Firoj and M\'{\i}guez, Rub\'{e}n and Caselli, Tommaso and Kutlu, Mucahid and Zaghouani, Wajdi and Li, Chengkai and Shaar, Shaden and Mubarak, Hamdy and Nikolov, Alex and Kartal, Yavuz Selim and Beltr\'{a}n, Javier},

title = "Overview of the {CLEF}-2022 {CheckThat}! Lab Task 1 on Identifying Relevant Claims in Tweets",

year = {2022},

booktitle = "Working Notes of CLEF 2022---Conference and Labs of the Evaluation Forum",

series = {CLEF~'2022},

address = {Bologna, Italy},

}

@InProceedings{clef-checkthat:2022:task2,

author = {Nakov, Preslav and Da San Martino, Giovanni and Alam, Firoj and Shaar, Shaden and Mubarak, Hamdy and Babulkov, Nikolay},

title = "Overview of the {CLEF}-2022 {CheckThat}! Lab Task 2 on Detecting Previously Fact-Checked Claims",

year = {2022},

booktitle = "Working Notes of CLEF 2022---Conference and Labs of the Evaluation Forum",

series = {CLEF~'2022},

address = {Bologna, Italy},

}

@InProceedings{clef-checkthat:2022:task3,

author = {K{\"o}hler, Juliane and Shahi, Gautam Kishore and Stru{\ss}, Julia Maria and Wiegand, Michael and Siegel, Melanie and Mandl, Thomas and Sch{\"u}tz, Mina},

title = "Overview of the {CLEF}-2022 {CheckThat}! Lab Task 3 on Fake News Detection ",

year = {2022},

booktitle = "Working Notes of CLEF 2022---Conference and Labs of the Evaluation Forum",

series = {CLEF~'2022},

address = {Bologna, Italy},

}