Evaluates the degree to which two Spanish sentences are semantically equivalent to each other. Similarity scores range from 0 for no overlap in meaning to 5 for equivalence of meaning. Values in between reflect interpretable levels of partial overlap in meaning.
Publication
Daniel Cer, Mona Diab, Eneko Agirre, Iñigo Lopez-Gazpio, and Lucia Specia. 2017. SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation. In Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pages 1–14, Vancouver, Canada. Association for Computational Linguistics.
Language
Spanish
NLP topic
Abstract task
Year
2017
Publication link
Ranking metric
Pearson correlation
Task results
System | Pearson correlation |
---|---|
ixambert-base-cased | 0.8100 |
bertin-roberta-base-spanish | 0.6700 |
distilbert-base-multilingual-cased | 0.6900 |
bert-base-multilingual-cased | 0.7000 |
xlm-roberta-base | 0.7300 |
distillbert-base-spanish-uncased | 0.7400 |
PlanTL-GOB-ES-roberta-base-bne | 0.7500 |
PlanTL-GOB-ES-roberta-large-bne | 0.7600 |
bert-base-spanish-wwm-cased | 0.7900 |
xlm-roberta-large | 0.8000 |
Pagination
- Page 1
- Next page