CLEF2019 - CheckThat! Lab

Automatic Identification and Verification of Claims

Welcome to CheckThat! Lab at CLEF 2019, the second version of the lab!

Lab Program

This year, lab papers will be presented over two sessions as shown below.

Day 1: Tuesday Sep 10

Day 2: Wednesday Sep 11

Recent Updates

  • Jun 14th, 2019: Working draft of the lab overview paper is shared here.
  • May 23rd, 2019: Scorer code for Task 2 released.
  • May 8th, 2019: Evaluation Cycle 2 of Task 2 sub-task D started.
  • Apr 30th, 2019: Testing data released to registered participants for Task 1 and Task 2 (sub-tasks A, B, and D).
  • Apr 29th, 2019: Training data for Task 2 sub-task C is released. Check the Datasets page.
  • Apr 23rd, 2019: Submission guidelines and format for Task 2 have been finalized. Check Task 2 page.
  • Mar 13th, 2019: Training data for Task 1 is released. Check the Datasets page.
  • Mar 10th, 2019: Some training data (CT19-T2-Train-v1.0) for Task 2 (sub-tasks: A, B, and D) is released. Check the Datasets page.
  • Jan 15th, 2019: Website is up!

Lab Registration

To register in the CheckThat! lab, please visit: http://clef2019-labs-registration.dei.unipd.it/

Important Dates

All times are Any where On Earth (AOE).

  • 27 Feb 2019: Training dataset and evaluation scripts released
  • 26 April 2019: Registration ends
  • 30 Apr 2019: Beginning of evaluation cycle for Task 1 and Task 2 subtasks A & B & D
  • 6 May 2019: End of evaluation cycle for Task 1 and Task 2 subtasks A & B & D
  • 8 May 2019: Beginning of evaluation cycle for Task 2 subtask C & D
  • 10 May 2019: End of evaluation cycle for Task 2 subtask C & D
  • 12 May 2019: Results posted for Task 1 and Task 2
  • 24 May 2019: Submission of Participant Papers [CEUR-WS]
  • 14 Jun 2019: Notification of Acceptance Participant Papers [CEUR-WS]
  • 28 Jun 2019: Camera Ready Copy of Participant Papers [CEUR-WS]

Discussion Group

Please join our discussion group clef-factcheck@googlegroups.com to receive announcements and participate in discussions.

Organizers