This is a multi-class classification tasks. The systems have to decide whether or not a given tweet contains sexist expressions or behaviours (i.e., it is sexist itself, describes a sexist situation or criticizes a sexist behaviour) and, if so, to categorize the message according to the type of sexism (according to the categorization proposed by experts and that takes into account the different facets of women that are undermined): (i) ideological and inequality, (ii) stereotyping and dominance, (iii) objectification, (iv) sexual violence, and (v) misogyny and non-sexual violence.
Task results
System | MacroF1 Sort ascending |
---|---|
Llama_3.1-8B-Instruct 0 shot no BIO v4 | 0.6203 |
Llama_3.1-8B-Instruct 0 shot no BIO v3 | 0.6203 |
Ministral-8B | 0.6177 |
Llama_3.1-8B-Instruct 0 shot no BIO v2 | 0.6075 |
Qwen2.5-14B-Instruct | 0.6065 |
Qwen2.5-14B-Instruct_mix | 0.6065 |
xlm_roberta_cpt_en_es v2 | 0.6004 |
xlm_roberta_cpt_en_es | 0.5981 |
RigoBERTa | 0.5957 |
Hermes-3-Llama-3.1-8B_mix_2 | 0.5907 |
Pagination
- Page 1
- Next page