Embedded Files
Our members, Fatima Haouari and Dr. Tamer Elsayed, are co-organizing Task 5 at CheckThat! 2021 lab. The task is defined as follows.
Task 5 - Authority Finding in Twitter: Given a tweet stating a rumor, a model has to retrieve a ranked list of authority Twitter accounts that can help verify the rumor; i.e. they may tweet evidence that supports or denies the rumor.
To register, please visit this link.
Dataset
Dataset
The task is offered in Arabic and the dataset can be found here.
Related Publications
Related Publications
Alberto Barrón-Cedeño, Firoj Alam, Tommaso Caselli, Giovanni Da San Martino, Tamer Elsayed, Andrea Galassi, Fatima Haouari, Federico Ruggeri, Julia Maria Struß, Rabindra Nath Nandi, Gullal S. Cheema, Dilshod Azizov, and Preslav Nakov. The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority of News Articles and Their Sources. ECIR 2023
Fatima Haouari and Tamer Elsayed: Detecting Stance of Authorities towards Rumors in Arabic Tweets: A Preliminary Study. ECIR 2023
Reading comprehension (RC) task, viewed as a type of question-answering (QA) tasks, is perceived as the ideal method to evaluate language understanding by computer systems. Given a passage of text, a machine reading comprehension system is required to answer a set of questions over the given passage. We propose a shared task of Arabic Reading Comprehension over the Holy Qur’an, aiming to trigger state-of-the-art question answering and reading comprehension research on a book that is sacredly held by more than 1.8 billion people across the world.
More details about the task can be found on this website.
Task Definition
Task Definition
Given a Qur'anic passage (that consists of consecutive verses in a specific surah in the Holy Qur'an) and a question (posed in Modern Standard Arabic (MSA)) over that passage, the system is required to extract an answer to the question, where an answer is a span of text extracted from the given passage. The span must be an exact sub-string of the passage. The question might be a factoid or non-factoid question.
Dataset
Dataset
Download the dataset from here.
Related Publication
Related Publication
Rana Malhas, Watheq Mansour, and Tamer Elsayed: Qur’an QA 2022: Overview of The First Shared Task on Question Answering over the Holy Qur’an. OSACT 2022.
Rana Malhas and Tamer Elsayed. Official Repository of Qur’an QA Shared Task. February 2022.
Rana Malhas and Tamer Elsayed. Arabic Machine Reading Comprehension on the Holy Qur’an using CL-AraBERT. Information Processing & Management, 59(6), p.103068, 2022.
Rana Malhas and Tamer Elsayed: AyaTEC: Building a Reusable Verse-Based Test Collection for Arabic Question Answering on the Holy Qur’an. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 19(6), pp.1-21, 2020.
Our members, Maram Hasanain, Fatima Haouari, Watheq Mansour, Zien Sheikh Ali, and Dr. Tamer Elsayed, co-organized two tasks at CheckThat! 2021 lab. The tasks are defined as follows.
Task 1 - Check-Worthiness Estimation : Given a claim, detect whether it is worth fact-checking.
Task 2 - Verified Claim Retrieval: Given a check-worthy claim, and a set of previously fact-checked claims, determine whether the claim has been previously fact-checked.
Datasets
Datasets
Related Publication
Related Publication
Shaden Shaar, Maram Hasanain, Bayan Hamdan, Zien Sheikh Ali, Fatima Haouari, Alex Nikolov, Mucahid Kutlu, Yavuz Selim Kartal, Firoj Alam, Giovanni Da San Martino, Alberto Barrón-Cedeño, Ruben Miguez, Javier Beltrán, Tamer Elsayed, Preslav Nakov: Overview of the CLEF-2021 CheckThat! Lab Task 1 on Check-Worthiness Estimation in Tweets and Political Debates. Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum
Shaden Shaar, Fatima Haouari, Watheq Mansour, Maram Hasanain, Nikolay Babulkov, Firoj Alam, Giovanni Da San Martino, Tamer Elsayed, Preslav Nakov: Overview of the CLEF-2021 CheckThat! Lab Task 2 on Detecting Previously Fact-Checked Claims in Tweets and Political Debates. Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum
Preslav Nakov, Giovanni Da San Martino, Tamer Elsayed, Alberto Barrón-Cedeño, Rubén Míguez, Shaden Shaar, Firoj Alam, Fatima Haouari, Maram Hasanain, Watheq Mansour, Bayan Hamdan, Zien Sheikh Ali, Nikolay Babulkov, Alex Nikolov, Gautam Kishore Shahi, Julia Maria Struß, Thomas Mandl, Mucahid Kutlu, and Yavuz Selim Kartal: Overview of the CLEF–2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News. CLEF 2021
Preslav Nakov, Giovanni Da San Martino, Tamer Elsayed, Alberto Barrón-Cedeño, Rubén Míguez, Shaden Shaar, Firoj Alam, Fatima Haouari, Maram Hasanain, Nikolay Babulkov, Alex Nikolov, Gautam Kishore Shahi, Julia Maria Struß, and Thomas Mandl: The CLEF-2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News. ECIR 2021
Our members, Maram Hasanain, Fatima Haouari, Reem Suwaileh, Zien Sheikh Ali, and Dr. Tamer Elsayed, were co-organizers in all tasks at CheckThat! 2020 lab. Task definitions can be found here.
Related Publication
Related Publication
Maram Hasanain, Fatima Haouari, Reem Suwaileh, Zien Sheikh Ali, Bayan Hamdan, Tamer Elsayed, Alberto Barrón-Cedeño, Giovanni Da San Martino, Preslav Nakov: Overview of CheckThat! 2020 Arabic: Automatic Identification and Verification of Claims in Social Media. Working Notes of CLEF 2020 - Conference and Labs of the Evaluation Forum
Shaden Shaar, Alex Nikolov, Nikolay Babulkov, Firoj Alam, Alberto Barrón-Cedeño, Tamer Elsayed, Maram Hasanain, Reem Suwaileh, Fatima Haouari, Giovanni Da San Martino, Preslav Nakov: Overview of CheckThat! 2020 English: Automatic Identification and Verification of Claims in Social Media. Working Notes of CLEF 2020 - Conference and Labs of the Evaluation Forum
Alberto Barrón-Cedeño, Tamer Elsayed, Preslav Nakov, Giovanni Da San Martino, Maram Hasanain, Reem Suwaileh, Fatima Haouari, Nikolay Babulkov, Bayan Hamdan, Alex Nikolov, Shaden Shaar, and Zien Sheikh Ali: Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media. CLEF 2020
Our members, Maram Hasanain, Reem Suwaileh, and Dr. Tamer Elsayed, co-organized Task 2 at CheckThat! 2019 lab.
Task Definition
Task Definition
Given a claim associated with a set of Web pages P (that constitute the results of Web search in response to using the claim as a search query), identify which of the Web pages (and passages of those Web pages) can be useful in assisting a human who is fact-checking the claim. Finally, judge the claim factuality according to the supporting information in the passages of the Web documents. This task will be run in Arabic.
More details about the task can be found here.
Related Publication
Related Publication
Maram Hasanain, Reem Suwaileh, Tamer Elsayed, Alberto Barrón-Cedeño, Preslav Nakov: Overview of the CLEF-2019 CheckThat! Lab: Automatic Identification and Verification of Claims. Task 2: Evidence and Factuality. Working Notes of CLEF 2019- Conference and Labs of the Evaluation Forum
Tamer Elsayed, Preslav Nakov, Alberto Barrón-Cedeño, Maram Hasanain, Reem Suwaileh, Giovanni Da San Martino, and Pepa Atanasova: Overview of the CLEF-2019 CheckThat! Lab: Automatic Identification and Verification of Claims. CLEF 2019
Our members, Reem Suwaileh and Dr. Tamer Elsayed, co-organized Tasks 1 and 2 at CheckThat! 2018 lab.
Task 1 Definition
Task 1 Definition
Given a transcription of a political debate/speech, predict which claims should be prioritized for fact-checking.
Task 2 Definition
Task 2 Definition
Given a check-worthy claim in the form of a (transcribed) sentence, determine whether the claim is likely to be true, half-true, or false.
Related Publication
Related Publication
Preslav Nakov, Alberto Barrón-Cedeño, Tamer Elsayed, Reem Suwaileh, Lluís Màrquez, Wajdi Zaghouani, Pepa Atanasova, Spas Kyuchukov, and Giovanni Da San Martino: Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. CLEF 2018
Pepa Atanasova, Lluis Marquez, Alberto Barron-Cedeno, Tamer Elsayed, Reem Suwaileh, Wajdi Zaghouani, Spas Kyuchukov, Giovanni Da San Martino, Preslav Nakov: Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthiness. Working Notes of CLEF 2018- Conference and Labs of the Evaluation Forum
Alberto Barron-Cedeno, Tamer Elsayed, Reem Suwaileh, Lluis Marquez, Pepa Atanasova, Wajdi Zaghouani, Spas Kyuchukov, Giovanni Da San Martino, Preslav Nakov: Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 2: Factuality .Working Notes of CLEF 2018- Conference and Labs of the Evaluation Forum
Google Sites
Report abuse