Task B: "Threatening Language Detection in Urdu Tweets"

EmoThreat: Emotions & Threat Detection in Urdu @FIRE 2022


Task Description

With the growth of spread and importance of social media platforms, the effect of their misuse became more and more impactful. In particular, numerous posts contain threatening language towards certain users and hence worsen users’ experience from communication via such platforms and potentially put platform users in danger. The Urdu language has more than 230 million speakers worldwide with vast representation on social networks and digital media.

We encourage participants to suggest methods that can automatically detect threats in Urdu language to avoid violence and outrageous consequences.

Task B focuses on detecting Threatening language using Twitter tweets in Urdu language. This is a binary classification task in which participating systems are required to classify tweets into two classes, namely: (i) Threatening, and (ii) Non-Threatening.

  1. Threatening - This Twitter post contains any threatening content.

  2. Non-Threatening - This Twitter post does not contain any threatening or profane content.

Once the tweet is classified as "Threatening", then further classify the treat into two classes: (i) Group, and (ii) Individual.

  1. Group - This Twitter post contains threatening content for group (s).

  2. Individual - This Twitter post contains threatening or profane content for an individual.


We followed Twitter's definition to describe Threatening posts toward an individual or groups to threaten with violent acts, to kill or inflict serious physical harm, to intimidate, and to use violent language


References

  1. Amjad, Maaz, Noman Ashraf, Alisa Zhila, Grigori Sidorov, Arkaitz Zubiaga, and Alexander Gelbukh. "Threatening language detection and target identification in Urdu tweets." IEEE Access 9 (2021): 128302-128313.

  2. Amjad, Maaz, et al. "Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021.”. CEUR Workshop Proceedings.(2021). CEUR Workshop Proceedings. 2021.

  3. Amjad, Maaz, et al. "UrduThreat@ FIRE2021: Shared Track on Abusive Threat Identification in Urdu." Forum for Information Retrieval Evaluation. 2021.


Related work

  1. Ashraf, Noman, et al. "YouTube based religious hate speech and extremism detection dataset with machine learning baselines." Journal of Intelligent & Fuzzy Systems Preprint: 1-9.

  2. Animesh Chaturvedi, Rajesh Sharma. minOffense: Inter-Agreement Hate Terms for Stable Rules, Concepts, Transitivities, and Lattices. Accepted at IEEE International Conference on Data Science and Advanced Analytics (DSAA), 2022