The task aims at finding the best techniques to identify propagandistic tweets from governmental and diplomatic sources on a dataset of tweets in English, posted by authorities of China, Russia, United States and the European Union. It consists on determining whether a tweet has propaganda techniques or not.
Publication
Pablo Moral, Guillermo Marco, Julio Gonzalo, Jorge Carrillo-de-Albornoz, Iván Gonzalo-Verdugo (2023) Overview of DIPROMATS 2023: automatic detection and characterization of propaganda techniques in messages from diplomats and authorities of world powers. Procesamiento del Lenguaje Natural, Revista nº 71, septiembre de 2023, pp. 397-407.
Language
English
NLP topic
Abstract task
Dataset
Year
2023
Publication link
Ranking metric
ICM
Task results
| System | ICM Norm Sort ascending |
|---|---|
| Qwen2.5-7B | 0.8119 |
| Mistral-7B-v03 | 0.8085 |
| Roberta large | 0.7984 |
| Xlm roberta large | 0.7931 |
| Llama-3.1-8B | 0.7845 |
| Roberta base | 0.7799 |
| Ixa ehu ixambert base cased | 0.7796 |
| Xlm roberta base | 0.7791 |
| Bert base cased | 0.7763 |
| Bert base multilingual cased | 0.7709 |
