Classification of stereotypes

The task consists in determining whether a sentence contains at least one stereotype or none and assigning those sentences previously marked as positive (with stereotypes) to at least one of the ten categories that present immigrants as: 1) ‘victims of xenophobia’, 2) ‘suffering victims’, 3) ‘economic resources’, 4) a problem of ‘migration control’, 5) people with ‘cultural and religious differences’, 6) people that take advantage of welfare ‘benefits’, 7) a problem for ‘public health’, 8) a threat to ‘security’, 9) ‘dehumanization’ and 10) ‘other’ types of stereotypes. 

It is a multi-label classification problem, since each instance may be assigned one or more categories.

Publication
Alejandro Ariza-Casabona, Wolfgang S. Schmeisser-Nieto, Montserrat Nofre, Mariona Taulé, Enrique Amigó, Berta Chulvi, Paolo Rosso (2022) Overview of DETESTS at IberLEF 2022: DETEction and classification of racial STereotypes in Spanish. Procesamiento del Lenguaje Natural, Revista nº 69, septiembre de 2022, pp. 217-228

Task results

System Hierarchical F ICM Sort ascending Propensity F
MALNIS 0.88 -0.24 0.87
UMUTeam 0.88 -0.33 0.87
Lak NLP 0.86 -0.42 0.85

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.