Task 1: Check-Worthiness

Task Definition

Given a political debate or a transcribed speech, segmented into sentences, with speakers annotated, identify which sentence should be prioritized for fact-checking. This is a ranking task and systems are required to produce a score per sentence, according to which the ranking will be performed. This task will be run in English.

Here is an example:

CLINTON: I think my husband did a pretty good job in the 1990s.

CLINTON: I think a lot about what worked and how we can make it work again...

TRUMP: Well, he approved NAFTA...

Whereas Hillary Clinton discusses the job carried out by Bill Clinton in the past, Donald Trump fires back with a claim that is worth checking: that Bill Clinton approved NAFTA. Whether he did or not is definitively worth checking!

Let us look at another example:

CLINTON: Take clean energy

CLINTON: Some country is going to be the clean-energy superpower of the 21st century.

CLINTON: Donald thinks that climate change is a hoax perpetrated by the Chinese.

CLINTON: I think it's real.

TRUMP: I did not.

Checking if Donald Trump's thoughts about climate change are as claimed is definitively worth checking as well!