CLEF2020 - CheckThat! Lab

Enabling Automatic Identification and Verification of Claims

in Social Media

Welcome to CheckThat! Lab at CLEF 2020, the 3rd version of the lab!

CheckThat! 2019

CheckThat! 2018

Proceedings

Working Notes of CLEF 2020 - Conference and Labs of the Evaluation Forum

Lab Program

This year, lab activities will run on Tuesday and Wednesday, 22 & 23 September. All times follow CEST timezone (GMT+2).

[22/9] CLEF Plenary Session

[22/9] Session 1: 11:00 - 12:35 (Chair: Giovanni Da San Martino)

[22/9] Session 2: 13:00 - 14:30 (Chair: Preslav Nakov)

[22/9] Session 3: 17:00 - 18:30 (Chair: Alberto Barrón-Cedeño)

[23/9] CLEF Plenary Session

Recent Updates

  • May 26, 2020: Test data for English Task 1, 2, 5 is released.

  • April 12, 2020: CLEF-2020 dates updated, and we have updated the competition dates as well (see below)

  • March 25, 2020: Unfortunately, we wont be able to release any dataset in Spanish

  • March 20, 2020: Training datasets for English Task 1, 2, 5 released.

  • Mar 10, 2020: Training dataset for Arabic Task 1 released.

  • January 26, 2020: Important dates set on home page.

  • January 26, 2020: Official tasks definition and input/output format released.

  • September 10, 2019: New edition is announced at CLEF 2019 conference!

  • August 12, 2019: Website is up!

Tasks

Check overview of the tasks here. Details on "Tasks" pages.

Lab Registration

To register in the CheckThat! lab, please visit: http://clef2020-labs-registration.dei.unipd.it/registrationForm.php

Important Dates

All times are Any where On Earth (AOE).

Arabic Tasks

      • March 10, 2020 : Training dataset for Arabic Task 1 released

      • April 26, 2020: Registration ends

      • May 1 May 27, 2020: Release of testing data and beginning of evaluation cycle for Arabic Task 1

      • May 4 May 30, 2020: Submission deadline and end of evaluation cycle for Arabic Task 1

      • May 5 May 31, 2020: Results posted for Arabic Task 1

      • May 6 June 1, 2020: Release of testing data and beginning of evaluation cycle for Arabic Task 3 and Task 4

      • May 10 June 5, 2020: Submission deadline and end of evaluation cycle for Arabic Task 3 and Task 4

      • May 11 June 6, 2020: Results posted for Arabic Task 3 and Task 4

English Tasks

      • April 26, 2020: Registration ends

      • May 1 May 25, 2020 : Beginning of the evaluation cycle and test set release for the English Task 1, Task 2, and Task 5

      • May 10 June 5, 2020: Submission deadline for test set results for English Task 1, Task 2, and Task 5

Paper Deadlines

      • May 24 July 17, 2020: Submission of Participant Papers [CEUR-WS]

      • June 14 August 14, 2020: Notification of Acceptance Participant Papers [CEUR-WS]

      • June 28 August 28, 2020: Camera Ready Copy of Participant Papers [CEUR-WS]

Discussion Group

Please join our discussion group clef-factcheck@googlegroups.com to receive announcements and participate in discussions.

Organizers

Previous Editions of CheckThat!