Detection of stereotypes

The tasks consists in determining whether a sentence contains at least one stereotype (positive example) or none negative example). Sentences are taken from comments posted in Spanish in response to different online news articles.  

A stereotype is defined as a set of beliefs about others who are perceived as belonging to a different social category.

Publication
Alejandro Ariza-Casabona, Wolfgang S. Schmeisser-Nieto, Montserrat Nofre, Mariona Taulé, Enrique Amigó, Berta Chulvi, Paolo Rosso (2022) Overview of DETESTS at IberLEF 2022: DETEction and classification of racial STereotypes in Spanish. Procesamiento del Lenguaje Natural, Revista nº 69, septiembre de 2022, pp. 217-228
Language
Spanish
NLP topic
Abstract task
Year
2022
Ranking metric
F1

Task results

System F1 Sort ascending
I2C III 1.0000
UMUTeam 0.7042
Lak NLP 0.6627
DaMinCi 0.6596
MALNIS 0.6382

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.