Task 2: Automatic Detection of Narratives from Diplomats of Major Powers

Set of narratives

Selection of narratives

Our selection of target narratives is based on a comprehensive analysis conducted by our team (Moral, 2023; Moral, 2023b; Moral & Marco, 2023) utilizing the DIPROMATS dataset and additional sources. The narratives are categorized based on the originating international actors. For each actor, we include 6 possible narratives. We aim to suggest overarching narratives that are broad enough to be generalizable in other contexts and are likely to incorporate a wide lexical variety of messages, thus reducing potential bias of the systems. The statements shown next are based on plausible outcomes suggested by each of the narratives. 

Narratives used in this challenge

The following are the 24 narratives (6 narratives per region), that systems must identify in the set of testing tweets. Each narrative has a title, a brief description and an example of tweet.


Chinese overarching narratives 


Russian overarching narratives 


European Union overarching narratives 


United States overarching narratives 


References:


Bennett, G.  (2019). “Propaganda and Disinformation: How an historical Perspective Aids Critical Response Development”. in Baines, P., O’Shaughnessy, N., Snow, N. (eds) The SAGE Handbook of Propaganda. SAGE. 244-260.  

Bjola, C. & Pamment, J. (2019) Countering online propaganda and extremism. The dark side of digital diplomacy. Routledge.  

Bjola, C. (2018). Digital diplomacy and impression management. Presentation, Canada House, London, as cited in Manor (2019) The Digitalization of Public Diplomacy. Palgrave McMillian.  

Colley, T. (2020). Strategic narratives and war propaganda. En P. Baines, N. O’Shaughnessy, & N. Snow (Eds.), The SAGE handbook of propaganda (pp. 491-508). SAGE.  

d’Hooghe, I. (2021). China’s Public Diplomacy Goes Political, The Hague Journal of Diplomacy, 16(2-3), 299-322. doi: https://doi.org/10.1163/1871191X-BJA10067 

Da San Martino, G. Nakov, M., Piskorski, J. Stefanovitch, N. (2022). “Detecting the genre, the framing, and the persuasion techniques in online news in a multi-lingual setup”. Task for the Semeval research workshop 2023. https://propaganda.math.unipd.it/semeval2023task3/  

Da San Martino, G. Yu, S., Barrón-Cedeño, A. Petrov, R and Nakov, P. (2019). Fine-Grained Analysis of Propaganda in News Article. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 5636–5646, Hong Kong, China. Association for Computational Linguistics.  

Davis, J. E. (s. f.). Davis, J., (Ed.). (2002). Narrative and social movements: The power of stories. In Stories of change: Narratives and social Movements (pp. 3–31). Albany: State University of New York Press.  

Hedling, E. (2020). Storytelling in EU public diplomacy: Reputation management and recognition of success. Place Branding and Public Diplomacy, 16(2), 143-152. https://doi.org/10.1057/s41254-019-00138-2  

Hobbs, R. and Mcgee, S. 2008. Teaching about propaganda: An examination of the historical roots of media literacy. Journal of Media Literacy Education, 6(62):56–67.  

Johnson-Cartee, K., Copeland, G. (2004). Strategic Political Communication: Rethinking Social Influence, Persuasion, and Propaganda. Rowman & Littlefield Publishers.   

Lefebvre, V.A., & Lefebvre, V.D. (1984). Reflexive Control: The Soviet Concept of Influencing an Adversary’s Decision-Making Process. Englewood: Science Applications  

Miles, C, (2019). “Rhetorical Methods and Metaphor in Viral Propaganda” in Baines, P., O’Shaughnessy, N., Snow, N. (eds) The SAGE Handbook of Propaganda. SAGE. 244-260 154-170.  

Miskimmon, A., O’Loughlin, B., & Roselle, L. (2013). Strategic narratives: Communication power and the new world order. Routledge, Taylor & Francis Group. 

Miskimmon, A., O’Loughlin, B., & Roselle, L. (Eds.). (2017). Forging the world: Strategic narratives and international relations. University of Michigan Press. 

Moral, P. (2023a). A tale of heroes and villains: Russia’s strategic narratives on Twitter during the COVID-19 pandemic. Journal of Information Technology & Politics, 1-20. https://doi.org/10.1080/19331681.2023.2182862 

Moral, P. (2023b). Restoring reputation through digital diplomacy: The European Union’s strategic narratives on Twitter during the COVID-19 pandemic. Communication & Society, 241-269. https://doi.org/10.15581/003.36.2.241-269 

Moral, P., & Marco, G. (2023). Assembling stories tweet by tweet: Strategic narratives from Chinese authorities on Twitter during the COVID-19 pandemic. Communication Research and Practice, 9(2), 159-183. https://doi.org/10.1080/22041451.2023.2188699 

Miskimmon, A., O’Loughlin, B., Roselle, L. (2013). Strategic Narratives. Communication Power and the New World Order. Routledge.    

Paul, C., Matthews, M. (2019). “Defending Against Russian Propaganda”, in Baines, P., O’Shaughnessy, N., Snow, N. (eds) The SAGE Handbook of Propaganda. SAGE. 286-302  

Riessman, C. K. (2008). Narrative methods for the human sciences. Sage Publications.  

Sparkes-Vian, C. (2019). Digital Propaganda: The Tyranny of Ignorance. Critical Sociology, 45(3), 393-409. https://doi.org/10.1177/0896920517754241 

Starr, P. (2020). The Flooded Zone: How We Became More Vulnerable to Disinformation in the Digital Era. In W. Bennett & S. Livingston (Eds.), The Disinformation Age (SSRC Anxieties of Democracy, pp. 67-92). Cambridge: Cambridge University Press. doi:10.1017/9781108914628.003 

  Van Vleet, J. (2011). Informal Logical Fallacies. A brief guide. University Press of America.  

Wanless, A., Berk, M. (2019). The Audience is the Amplifier: Participatory Propaganda. The SAGE Handbook of Propaganda. SAGE. 85-104 154-170.  

Weston, A. (2018). A Rulebook for Arguments (5th Edition). Hackett Publishing Company