The task aims at finding the best techniques to identify propagandistic tweets from governmental and diplomatic sources on a dataset of 9501 tweets in Spanish, posted by authorities of China, Russia, United States and the European Union. It consists on determining whether a tweet has propaganda techniques or not.
Publication
Pablo Moral, Guillermo Marco, Julio Gonzalo, Jorge Carrillo-de-Albornoz, Iván Gonzalo-Verdugo (2023) Overview of DIPROMATS 2023: automatic detection and characterization of propaganda techniques in messages from diplomats and authorities of world powers. Procesamiento del Lenguaje Natural, Revista nº 71, septiembre de 2023, pp. 397-407.
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2023
Publication link
Ranking metric
F1
Task results
System | ICM Norm Sort ascending |
---|---|
Qwen2.5-14B-Instruct | 0.8360 |
Qwen2.5-14B-Instruct_mix | 0.8360 |
Qwen2.5-7B | 0.8282 |
Llama_3.1-8B-Instruct 0 shot no BIO v3 | 0.8274 |
Llama_3.1-8B-Instruct 0 shot no BIO v4 | 0.8274 |
Llama_3.1-8B-Instruct 0 shot no BIO v2 | 0.8273 |
XLM-RoBERTa-large | 0.8224 |
XLM-RoBERTa-large-2 | 0.8224 |
XLM-RoBERTa-large-v3 | 0.8224 |
Hermes-3-Llama-3.1-8B_2 | 0.8211 |
Pagination
- Page 1
- Next page