The task aims at finding the best techniques to identify propagandistic tweets from governmental and diplomatic sources on a dataset of 9501 tweets in Spanish, posted by authorities of China, Russia, United States and the European Union. It consists on determining whether a tweet has propaganda techniques or not.
Publication
Pablo Moral, Guillermo Marco, Julio Gonzalo, Jorge Carrillo-de-Albornoz, Iván Gonzalo-Verdugo (2023) Overview of DIPROMATS 2023: automatic detection and characterization of propaganda techniques in messages from diplomats and authorities of world powers. Procesamiento del Lenguaje Natural, Revista nº 71, septiembre de 2023, pp. 397-407.
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2023
Publication link
Ranking metric
F1
Task results
System | F1 |
---|---|
PlanTL-GOB-ES-roberta-large-bne | 0.8170 |
distilbert-base-multilingual-cased | 0.7500 |
ixambert-base-cased | 0.7700 |
distillbert-base-spanish-uncased | 0.7700 |
bert-base-multilingual-cased | 0.7800 |
xlm-roberta-base | 0.7890 |
bert-base-spanish-wwm-cased | 0.7910 |
bertin-roberta-base-spanish | 0.7590 |
PlanTL-GOB-ES-roberta-base-bne | 0.8140 |
xlm-roberta-large | 0.8180 |